00010000:00010000:0.0:1746147705.628796:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c42f000/0xe64d3fbf12a79eb8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf96ba expref: 11 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147705.628807:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c42f000/0xe64d3fbf12a79eb8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf96ba expref: 11 pid: 21480 timeout: 884 lvb_type: 1 00000100:00100000:0.0:1746147705.628814:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796230144:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147705.628840:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801317ad400/0xe64d3fbf12a79cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf959b expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.628847:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801317ad400/0xe64d3fbf12a79cb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf959b expref: 23 pid: 4592 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746147705.628854:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796230272:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147705.628870:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147705.636642:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.636681:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.639437:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.640052:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.640477:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796230016:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147705.640524:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796230144:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147705.640549:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c482300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796230400:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147705.641325:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15084 00000100:00100000:0.0:1746147705.641331:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967793370624:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:0.0:1746147705.641347:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4000/0xe64d3fbf12a7a311 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.641357:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffff400/0xe64d3fbf12a7a07f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf97f5 expref: 20 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.641363:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134e48600/0xe64d3fbf12a7a13c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9865 expref: 29 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147705.641370:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7a0a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf980a expref: 13 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147705.641375:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147705.641376:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147705.641378:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4000/0xe64d3fbf12a7a311 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.641390:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7a0a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf980a expref: 13 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147705.641397:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7a0a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf980a expref: 13 pid: 8470 timeout: 884 lvb_type: 1 00000100:00100000:0.0:1746147705.641404:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136404380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796231808:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147705.641424:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134e48600/0xe64d3fbf12a7a13c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9865 expref: 29 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147705.641432:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134e48600/0xe64d3fbf12a7a13c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9865 expref: 29 pid: 20619 timeout: 884 lvb_type: 1 00000100:00100000:0.0:1746147705.641443:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136404700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796231936:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147705.641461:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ffff400/0xe64d3fbf12a7a07f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf97f5 expref: 20 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.641468:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ffff400/0xe64d3fbf12a7a07f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf97f5 expref: 20 pid: 7050 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746147705.641475:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136404a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796232064:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147705.641484:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147705.642608:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.642620:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.642637:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.642649:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793371520 00000100:00100000:0.0:1746147705.642653:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793371520 00010000:00010000:0.0:1746147705.642668:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7a04e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf97e0 expref: 21 pid: 7050 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746147705.642680:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793371264 00000100:00100000:0.0:1746147705.642682:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793371264 00010000:00010000:0.0:1746147705.642688:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c42f000/0xe64d3fbf12a79eb8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf96ba expref: 14 pid: 21480 timeout: 884 lvb_type: 1 00000100:00100000:0.0:1746147705.642696:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793371648 00000100:00100000:0.0:1746147705.642698:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793371648 00010000:00010000:0.0:1746147705.642704:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801317ad400/0xe64d3fbf12a79cb2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf959b expref: 24 pid: 4592 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746147705.642717:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7610 00000100:00100000:0.0:1746147705.642721:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967793371520:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147705.642728:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147705.642743:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7a04e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf97e0 expref: 21 pid: 7050 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746147705.642750:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7a04e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf97e0 expref: 21 pid: 7050 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746147705.642764:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7a04e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf97e0 expref: 21 pid: 7050 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746147705.642775:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147705.642788:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1957:x1830967793371520:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 66us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147705.642793:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7610 00000100:00100000:0.0:1746147705.642802:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7612 00000100:00100000:0.0:1746147705.643768:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793371648:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147705.643777:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147705.643786:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801317ad400/0xe64d3fbf12a79cb2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf959b expref: 24 pid: 4592 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746147705.643794:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801317ad400/0xe64d3fbf12a79cb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf959b expref: 24 pid: 4592 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746147705.643808:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147705.643810:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147705.643812:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dae9200/0xe64d3fbf12a7a2f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.643818:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae9200/0xe64d3fbf12a7a2f5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.643829:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147705.643859:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793371648:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1051us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147705.643864:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7612 00000100:00100000:0.0:1746147705.644259:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793369984:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20469us (21648us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147705.644266:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6570 00002000:00100000:0.0:1746147705.644272:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3731455) req@ffff880094efb100 x1830967793369984/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:326/0 lens 504/440 e 0 to 0 dl 1746147716 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147705.644280:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efb100 with x1830967793369984 ext(2097152->3731455) 00010000:00010000:0.0:1746147705.644285:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c800/0xe64d3fbf12a7a27e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9937 expref: 25 pid: 20619 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746147705.644294:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c800/0xe64d3fbf12a7a27e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9937 expref: 25 pid: 20619 timeout: 884 lvb_type: 0 00002000:00010000:0.0:1746147705.644299:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094efb100 00000100:00100000:0.0:1746147705.652205:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.652224:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.652238:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793372288 00000100:00100000:0.0:1746147705.652240:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793372288 00002000:00100000:0.0:1746147705.652263:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2560000->3145727) req@ffff880136405180 x1830967793372288/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:326/0 lens 488/0 e 0 to 0 dl 1746147716 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147705.652270:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136405180 with x1830967793372288 ext(2560000->3145727) 00010000:00010000:0.0:1746147705.652275:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c800/0xe64d3fbf12a7a27e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9937 expref: 25 pid: 20619 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746147705.652284:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c800/0xe64d3fbf12a7a27e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9937 expref: 25 pid: 20619 timeout: 884 lvb_type: 0 00002000:00010000:0.0:1746147705.652290:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136405180 00000100:00100000:0.0:1746147705.652300:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1271 00000100:00100000:0.0:1746147705.652304:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967793372288:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147705.656495:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793373184 00000100:00100000:0.0:1746147705.656500:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793373184 00010000:00010000:0.0:1746147705.656514:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7343a00/0xe64d3fbf12a7a1f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf98e3 expref: 35 pid: 20619 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746147705.656527:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7623 00000100:00100000:0.0:1746147705.656532:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967793373056:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147705.656538:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147705.656612:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134e48600/0xe64d3fbf12a7a13c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9865 expref: 27 pid: 20619 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746147705.656624:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134e48600/0xe64d3fbf12a7a13c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9865 expref: 27 pid: 20619 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746147705.656637:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134e48600/0xe64d3fbf12a7a13c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9865 expref: 27 pid: 20619 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746147705.656649:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147705.656651:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147705.656655:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4000/0xe64d3fbf12a7a311 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.656662:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4000/0xe64d3fbf12a7a311 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.656679:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147705.656696:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967793373056:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 164us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147705.656703:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7623 00000100:00100000:0.0:1746147705.656714:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7627 00000100:00100000:0.0:1746147705.656719:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967793373440:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147705.656727:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147705.656735:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd3cc00/0xe64d3fbf12a7a2a8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9945 expref: 11 pid: 7050 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746147705.656743:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd3cc00/0xe64d3fbf12a7a2a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9945 expref: 11 pid: 7050 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746147705.656754:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147705.656767:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967793373440:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 48us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147705.656771:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7627 00010000:00010000:0.0:1746147705.656789:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4000/0xe64d3fbf12a7a311 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.656797:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4000/0xe64d3fbf12a7a311 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.656812:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4000/0xe64d3fbf12a7a311 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.656818:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4000/0xe64d3fbf12a7a311 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.656824:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4000/0xe64d3fbf12a7a311 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.656829:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d4000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147705.656833:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4000/0xe64d3fbf12a7a311 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.656840:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4000/0xe64d3fbf12a7a311 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.656851:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4000/0xe64d3fbf12a7a311 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.656856:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4000/0xe64d3fbf12a7a311 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147705.656921:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967793370624:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 15589us (20285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147705.656928:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15084 00000100:00100000:0.0:1746147705.663150:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.679569:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793374080 00000100:00100000:0.0:1746147705.679578:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793374080 00010000:00010000:0.0:1746147705.679608:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c800/0xe64d3fbf12a7a27e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9937 expref: 26 pid: 20619 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746147705.679862:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7629 00000100:00100000:0.0:1746147705.679870:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967793374080:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147705.679994:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147705.680017:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c800/0xe64d3fbf12a7a27e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9937 expref: 26 pid: 20619 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746147705.680029:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c800/0xe64d3fbf12a7a27e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9937 expref: 26 pid: 20619 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746147705.680050:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c800/0xe64d3fbf12a7a27e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9937 expref: 26 pid: 20619 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746147705.680210:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147705.680212:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147705.680217:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800945c9a00/0xe64d3fbf12a7a30a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.680226:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800945c9a00/0xe64d3fbf12a7a30a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.680286:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147705.680432:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967793374080:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 563us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147705.680439:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7629 00000100:00100000:0.0:1746147705.682412:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.683124:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.683153:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.687942:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012efa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796232576:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147705.687955:0:17544:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.10@tcp) returned -22 from blocking AST (req@ffff88012efa9f80 x1830967796232704) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0357e00/0xe64d3fbf12a7a2d2 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9961 expref: 13 pid: 14546 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746147705.687968:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0357e00/0xe64d3fbf12a7a2d2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9961 expref: 13 pid: 14546 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746147705.688275:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012efa9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796232704:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147705.688294:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147705.688299:0:17544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7a334 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.688307:0:17544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7a334 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.688313:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7a334 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147705.688336:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793374848 00000100:00100000:0.0:1746147705.688341:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793374848 00010000:00010000:0.0:1746147705.688365:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299600/0xe64d3fbf12a7a2e7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf996f expref: 13 pid: 14546 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746147705.688703:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7630 00000100:00100000:0.0:1746147705.688711:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+13:31510:x1830967793374848:12345-192.168.202.10@tcp:103:lfs.0 00010000:00010000:0.0:1746147705.688764:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147705.688769:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299600/0xe64d3fbf12a7a2e7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf996f expref: 13 pid: 14546 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746147705.688778:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299600/0xe64d3fbf12a7a2e7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf996f expref: 13 pid: 14546 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746147705.688793:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299600/0xe64d3fbf12a7a2e7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf996f expref: 13 pid: 14546 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746147705.688815:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147705.688818:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7a334 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.688824:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7a334 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.688834:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7a334 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.689872:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7a334 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.689879:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7a334 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147705.689919:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147705.690813:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2127a00/0xe64d3fbf12a7a32d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9984 expref: 340 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.690827:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7a334 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9984 expref: 339 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.690834:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147705.690836:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147705.690838:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2127e00, rc 0) 00000100:00100000:0.0:1746147705.690862:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:31515:x1830967793374464:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 7497us (7739us total) trans 8589945632 rc 0/0 00000100:00100000:0.0:1746147705.690868:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11705 00000100:00100000:0.0:1746147705.707698:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.712833:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.712859:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793375872 00000100:00100000:0.0:1746147705.712865:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793375872 00000100:00100000:0.0:1746147705.712923:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11707 00000100:00100000:0.0:1746147705.712930:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+35:31517:x1830967793375872:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147705.712950:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147705.712966:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4a00/0xe64d3fbf12a7a342 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf998b expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.713053:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4200/0xe64d3fbf12a7a349 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.713063:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4200/0xe64d3fbf12a7a349 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.713072:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4200/0xe64d3fbf12a7a349 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.713081:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7a350 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.713087:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7a350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.713091:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7a350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.713184:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5600/0xe64d3fbf12a7a357 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.713193:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5600/0xe64d3fbf12a7a357 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.713198:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5600/0xe64d3fbf12a7a357 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147705.713205:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147705.714495:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4200/0xe64d3fbf12a7a349 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.714507:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4200/0xe64d3fbf12a7a349 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.714512:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4200/0xe64d3fbf12a7a349 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.714518:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d4200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147705.714521:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4200/0xe64d3fbf12a7a349 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.714527:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4200/0xe64d3fbf12a7a349 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.714536:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147705.714538:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147705.714541:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4200/0xe64d3fbf12a7a349 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.714545:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4200/0xe64d3fbf12a7a349 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.714571:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7a350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.714576:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7a350 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.714580:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7a350 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.714584:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d4400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147705.714586:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7a350 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.714593:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7a350 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.714599:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009129c000) 00010000:00010000:0.0:1746147705.714601:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147705.714603:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7a350 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.714606:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7a350 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147705.714644:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4a00/0xe64d3fbf12a7a342 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf998b expref: 38 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.714654:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5600/0xe64d3fbf12a7a357 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf998b expref: 37 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.714659:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147705.714661:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147705.714663:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d5600, rc 0) 00000100:00100000:0.0:1746147705.714721:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+37:31517:x1830967793375872:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1790us (1892us total) trans 8589945635 rc 0/0 00000100:00100000:0.0:1746147705.714727:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11707 00000100:00100000:0.0:1746147705.714783:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.714879:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.714914:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793376256 00000100:00100000:0.0:1746147705.714917:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793376256 00000100:00100000:0.0:1746147705.714940:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15089 00000100:00100000:0.0:1746147705.714944:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967793376256:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147705.714952:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147705.714962:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ebc200/0xe64d3fbf12a7a36c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf99a0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147705.714975:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x68141979, atime: 0x68141979, ctime: 0x68141979, blocks: 0x821 00010000:00010000:0.0:1746147705.714984:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147705.714985:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147705.714989:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ebc200/0xe64d3fbf12a7a36c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99a0 expref: 27 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147705.714997:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ebc200/0xe64d3fbf12a7a36c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99a0 expref: 27 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147705.715003:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ebc200, rc 0) 00000100:00100000:0.0:1746147705.715017:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967793376256:12345-192.168.202.10@tcp:101:cat.0 Request processed in 73us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147705.715021:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15089 00000100:00100000:0.0:1746147705.715046:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.715056:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793376128 00000100:00100000:0.0:1746147705.715058:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793376128 00000100:00100000:0.0:1746147705.715069:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15090 00000100:00100000:0.0:1746147705.715075:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967793376128:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147705.715080:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147705.715087:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc8b400/0xe64d3fbf12a7a373 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9999 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147705.716680:0:20619:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x68141979, atime: 0x68141979, ctime: 0x68141979, blocks: 0x81f 00010000:00010000:0.0:1746147705.717877:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147705.717880:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147705.717907:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc8b400/0xe64d3fbf12a7a373 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9999 expref: 28 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147705.717922:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc8b400/0xe64d3fbf12a7a373 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9999 expref: 28 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147705.717930:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc8b400, rc 0) 00000100:00100000:0.0:1746147705.717960:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1958:x1830967793376128:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2885us (2912us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147705.717967:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15090 00000100:00100000:0.0:1746147705.718306:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793376384 00000100:00100000:0.0:1746147705.718311:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793376384 00000100:00100000:0.0:1746147705.721155:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.731609:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.744657:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.744702:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.744721:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793377152 00000100:00100000:0.0:1746147705.744728:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793377152 00000100:00100000:0.0:1746147705.744763:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11708 00000100:00100000:0.0:1746147705.744770:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+36:31521:x1830967793377152:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147705.744790:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147705.744805:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976800/0xe64d3fbf12a7a381 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf99b5 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.744925:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0977200/0xe64d3fbf12a7a388 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.744940:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0977200/0xe64d3fbf12a7a388 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.744948:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0977200/0xe64d3fbf12a7a388 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.744958:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976000/0xe64d3fbf12a7a38f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.744963:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976000/0xe64d3fbf12a7a38f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.744968:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976000/0xe64d3fbf12a7a38f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745058:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976200/0xe64d3fbf12a7a39d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745065:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976200/0xe64d3fbf12a7a39d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745070:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976200/0xe64d3fbf12a7a39d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:0.0:1746147705.745077:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147705.745149:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0977200/0xe64d3fbf12a7a388 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745154:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0977200/0xe64d3fbf12a7a388 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745158:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0977200/0xe64d3fbf12a7a388 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745163:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0977200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147705.745166:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0977200/0xe64d3fbf12a7a388 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745171:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0977200/0xe64d3fbf12a7a388 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745180:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147705.745182:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147705.745185:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0977200/0xe64d3fbf12a7a388 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745189:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0977200/0xe64d3fbf12a7a388 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745203:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976000/0xe64d3fbf12a7a38f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745207:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976000/0xe64d3fbf12a7a38f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745211:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976000/0xe64d3fbf12a7a38f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745215:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0976000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147705.745217:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976000/0xe64d3fbf12a7a38f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745221:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976000/0xe64d3fbf12a7a38f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745226:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801354cb200) 00010000:00010000:0.0:1746147705.745228:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147705.745230:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976000/0xe64d3fbf12a7a38f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745238:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976000/0xe64d3fbf12a7a38f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147705.745268:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976800/0xe64d3fbf12a7a381 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99b5 expref: 39 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.745278:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976200/0xe64d3fbf12a7a39d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99b5 expref: 38 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.745283:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147705.745285:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147705.745287:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0976200, rc 0) 00000100:00100000:0.0:1746147705.745312:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+38:31521:x1830967793377152:12345-192.168.202.10@tcp:101:cat.0 Request processed in 542us (609us total) trans 8589945636 rc 0/0 00000100:00100000:0.0:1746147705.745317:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11708 00000100:00100000:0.0:1746147705.748804:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.748846:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.749138:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 842 00000100:00100000:0.0:1746147705.749146:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136404700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+38:1959:x1830967793377408:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147705.749154:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147705.749167:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0976200/0xe64d3fbf12a7a39d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99b5 expref: 38 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.749178:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147705.749182:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147705.749199:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136404700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+37:1959:x1830967793377408:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 55us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147705.749208:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 842 00000100:00100000:0.0:1746147705.750147:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.750176:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.750204:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.750279:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.750594:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.751125:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.751171:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.752071:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793378304 00000100:00100000:0.0:1746147705.752075:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793378304 00000100:00100000:0.0:1746147705.752095:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15098 00000100:00100000:0.0:1746147705.752100:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967793378304:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147705.752108:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147705.752117:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2127400/0xe64d3fbf12a7a3ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf99e6 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147705.752158:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796233216:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147705.752197:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147705.753040:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.764973:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.765461:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.779213:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.779704:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.844510:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.851381:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.851430:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.851482:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.851518:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793380992 00000100:00100000:0.0:1746147705.851520:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793380992 00002000:00100000:0.0:1746147705.851547:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009ce61c00 x1830967793380992/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:326/0 lens 488/0 e 0 to 0 dl 1746147716 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147705.851555:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61c00 with x1830967793380992 ext(2097152->3145727) 00002000:00010000:0.0:1746147705.851559:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce61c00 00000100:00100000:0.0:1746147705.852805:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793381120 00000100:00100000:0.0:1746147705.852809:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793381120 00002000:00100000:0.0:1746147705.852825:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009ce61f80 x1830967793381120/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:326/0 lens 504/0 e 0 to 0 dl 1746147716 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147705.852832:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61f80 with x1830967793381120 ext(3145728->4194303) 00002000:00010000:0.0:1746147705.852834:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce61f80 00000100:00100000:0.0:1746147705.862381:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967793381120:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9169us (10889us total) trans 0 rc 692224/692224 00000100:00100000:0.0:1746147705.862394:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6584 00002000:00100000:0.0:1746147705.862405:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009ce61f80 x1830967793381120/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:326/0 lens 504/440 e 0 to 0 dl 1746147716 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147705.862414:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61f80 with x1830967793381120 ext(3145728->4194303) 00002000:00010000:0.0:1746147705.862420:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce61f80 00000100:00100000:0.0:1746147705.868611:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.871800:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967793380736:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18706us (20422us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147705.871811:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6583 00002000:00100000:0.0:1746147705.871821:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009ce61880 x1830967793380736/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:326/0 lens 488/440 e 0 to 0 dl 1746147716 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147705.871835:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61880 with x1830967793380736 ext(3145728->4194303) 00002000:00010000:0.0:1746147705.871839:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce61880 00000100:00100000:0.0:1746147705.874457:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.874487:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.885744:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.885824:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.889141:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.890772:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.890924:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7635 00000100:00100000:0.0:1746147705.890932:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967793382400:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147705.890940:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147705.890952:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094b2c800/0xe64d3fbf12a7a3b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99d1 expref: 21 pid: 9615 timeout: 885 lvb_type: 1 00010000:00010000:0.0:1746147705.890961:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094b2c800/0xe64d3fbf12a7a3b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99d1 expref: 21 pid: 9615 timeout: 885 lvb_type: 1 00010000:00010000:0.0:1746147705.890973:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b2c800/0xe64d3fbf12a7a3b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99d1 expref: 21 pid: 9615 timeout: 885 lvb_type: 1 00010000:00010000:0.0:1746147705.890995:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147705.890997:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147705.891003:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a051aa00/0xe64d3fbf12a7a3f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9a02 expref: 26 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147705.891010:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a051aa00/0xe64d3fbf12a7a3f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9a02 expref: 26 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147705.893677:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.897099:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746147705.897115:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796234368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147705.897161:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746147705.897344:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147705.897588:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796234368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147705.905721:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.913102:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013640a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796234496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746147705.913596:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147705.913633:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1830967796234752:0@lo:400:kworker.0 00000100:00100000:0.0:1746147705.913656:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746147705.913675:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147705.913684:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796234752 00000100:00100000:0.0:1746147705.913686:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796234752 00000100:00100000:0.0:1746147705.913713:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1746147705.913717:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1830967796234752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147705.913745:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1830967796234752:12345-0@lo:400:kworker.0 Request processed in 28us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147705.913750:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1746147705.913764:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147705.913781:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1830967796234752:0@lo:400:kworker.0 00000100:00100000:0.0:1746147705.913804:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013640a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796234496:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1746147705.914074:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147705.914110:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.914137:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.937664:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.993522:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147705.997993:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.003617:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.028255:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.028293:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.028320:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.028357:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.028383:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793384576 00000100:00100000:0.0:1746147706.028389:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793384576 00002000:00100000:0.0:1746147706.031250:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a5e35500 x1830967793384576/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:327/0 lens 488/0 e 0 to 0 dl 1746147717 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147706.031259:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e35500 with x1830967793384576 ext(0->1048575) 00002000:00010000:0.0:1746147706.031264:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e35500 00000100:00100000:0.0:1746147706.031291:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6589 00000100:00100000:0.0:1746147706.031298:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967793384576:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147706.050935:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.050986:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.056518:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.061397:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.061430:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.061455:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.061678:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.061992:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.066806:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.066852:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.067536:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.067573:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.067604:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.067630:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15114 00000100:00100000:0.0:1746147706.067638:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967793387392:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147706.067651:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147706.067661:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7342600/0xe64d3fbf12a7a484 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9a5d expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147706.067696:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796236800:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147706.067750:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147706.068495:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:0.0:1746147706.069650:0:20619:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime: 1746147706 -> 1746147707 00002000:00010000:0.0:1746147706.069653:0:20619:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147706 -> 1746147707 00002000:00010000:0.0:1746147706.069655:0:20619:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime: 1746147705 -> 1746147707 00000100:00100000:0.0:1746147706.069668:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796236800:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147706.069690:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7342600/0xe64d3fbf12a7a484 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9a5d expref: 37 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147706.069699:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7342600/0xe64d3fbf12a7a484 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9a5d expref: 37 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147706.069712:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7342600, rc 0) 00000100:00100000:0.0:1746147706.069728:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967793387392:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2092us (2155us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147706.069734:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15114 00000100:00100000:0.0:1746147706.071146:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c483b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796236928:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147706.071163:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147706.071385:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967793387136:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3216us (3848us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147706.071395:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7639 00000100:00100000:0.0:1746147706.071749:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793387904 00000100:00100000:0.0:1746147706.071755:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793387904 00002000:00100000:0.0:1746147706.071791:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (786432->790527) req@ffff88012c483b80 x1830967793387904/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:327/0 lens 488/0 e 0 to 0 dl 1746147717 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147706.071800:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c483b80 with x1830967793387904 ext(786432->790527) 00010000:00010000:0.0:1746147706.071808:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a5d600/0xe64d3fbf12a7a476 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->1040383) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9a4f expref: 35 pid: 8469 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746147706.071821:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a5d600/0xe64d3fbf12a7a476 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->1040383) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9a4f expref: 35 pid: 8469 timeout: 885 lvb_type: 0 00002000:00010000:0.0:1746147706.071828:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c483b80 00000100:00100000:0.0:1746147706.072447:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1272 00000100:00100000:0.0:1746147706.072456:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967793387904:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147706.073186:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967793387904:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 730us (1659us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147706.073194:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1272 00002000:00100000:0.0:1746147706.073201:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (786432->790527) req@ffff88012c483b80 x1830967793387904/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:327/0 lens 488/4536 e 0 to 0 dl 1746147717 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147706.073210:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c483b80 with x1830967793387904 ext(786432->790527) 00010000:00010000:0.0:1746147706.073218:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a5d600/0xe64d3fbf12a7a476 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->1040383) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9a4f expref: 35 pid: 8469 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746147706.073230:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a5d600/0xe64d3fbf12a7a476 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 786432->1040383) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9a4f expref: 35 pid: 8469 timeout: 885 lvb_type: 0 00002000:00010000:0.0:1746147706.073237:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c483b80 00000100:00100000:0.0:1746147706.073806:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.077461:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.077502:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.088011:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.094037:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.101838:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.109528:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.110007:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15118 00000100:00100000:0.0:1746147706.110016:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:31530:x1830967793389568:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147706.110028:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147706.110043:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7a4a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9a79 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147706.110067:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b0ec00/0xe64d3fbf12a7a396 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3604479) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99ae expref: 19 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147706.110074:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147706.110076:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147706.110079:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7a4a0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9a79 expref: 28 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147706.110107:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b0ec00/0xe64d3fbf12a7a396 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3604479) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99ae expref: 19 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147706.110118:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b0ec00/0xe64d3fbf12a7a396 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3604479) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99ae expref: 19 pid: 20619 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746147706.110127:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796237568:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147706.110235:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147706.112439:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.116406:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.119525:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.124273:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.128746:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.131860:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.132828:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.132869:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.132935:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793390848 00000100:00100000:0.0:1746147706.132942:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793390848 00002000:00100000:0.0:1746147706.132974:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a0436680 x1830967793390848/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:327/0 lens 488/0 e 0 to 0 dl 1746147717 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147706.132982:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0436680 with x1830967793390848 ext(2097152->3145727) 00002000:00010000:0.0:1746147706.132986:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0436680 00000100:00100000:0.0:1746147706.133009:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793390976 00000100:00100000:0.0:1746147706.133012:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793390976 00002000:00100000:0.0:1746147706.133021:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009ce63480 x1830967793390976/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:327/0 lens 488/0 e 0 to 0 dl 1746147717 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147706.133028:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63480 with x1830967793390976 ext(3145728->4194303) 00002000:00010000:0.0:1746147706.133030:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce63480 00000100:00100000:0.0:1746147706.133041:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6596 00000100:00100000:0.0:1746147706.133048:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967793390848:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147706.154350:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.161129:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.165827:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.165867:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.165946:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.173724:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.186125:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.189162:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.205751:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.205805:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.224044:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793393792 00000100:00100000:0.0:1746147706.224052:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793393792 00002000:00100000:0.0:1746147706.224083:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88012efa8380 x1830967793393792/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:327/0 lens 488/0 e 0 to 0 dl 1746147717 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147706.224091:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012efa8380 with x1830967793393792 ext(3145728->4194303) 00002000:00010000:0.0:1746147706.224095:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012efa8380 00000100:00100000:0.0:1746147706.224110:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793393920 00000100:00100000:0.0:1746147706.224113:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793393920 00002000:00100000:0.0:1746147706.224124:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88012efa8e00 x1830967793393920/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:327/0 lens 488/0 e 0 to 0 dl 1746147717 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147706.224130:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012efa8e00 with x1830967793393920 ext(3145728->4194303) 00002000:00010000:0.0:1746147706.224133:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012efa8e00 00000100:00100000:0.0:1746147706.224144:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6603 00000100:00100000:0.0:1746147706.224149:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967793393792:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147706.225149:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6604 00000100:00100000:0.0:1746147706.225156:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967793393920:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147706.244127:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.244170:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793394304 00000100:00100000:0.0:1746147706.244175:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793394304 00010000:00010000:0.0:1746147706.244199:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7a4a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9a80 expref: 26 pid: 20619 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746147706.244221:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7646 00000100:00100000:0.0:1746147706.244227:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793394304:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147706.244237:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147706.244254:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7a4a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9a80 expref: 26 pid: 20619 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746147706.244262:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7a4a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9a80 expref: 26 pid: 20619 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746147706.244279:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7a4a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9a80 expref: 26 pid: 20619 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746147706.245339:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147706.245341:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147706.245348:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0299000/0xe64d3fbf12a7a4df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1363967) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ab8 expref: 32 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147706.245357:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0299000/0xe64d3fbf12a7a4df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1363967) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ab8 expref: 32 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147706.245383:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0299000/0xe64d3fbf12a7a4df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1363967) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ab8 expref: 32 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147706.245394:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e37b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796238720:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147706.248606:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.252578:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.261063:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.280166:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.291956:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.294732:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.318121:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.322214:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.322253:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.324154:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.326788:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.332114:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.336053:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.336100:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.366433:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.369218:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.377600:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.385836:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.478750:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.485805:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.493704:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.499239:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.506045:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.513650:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.513788:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.520557:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793400064 00000100:00100000:0.0:1746147706.520561:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793400064 00002000:00100000:0.0:1746147706.520579:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1867776->1871871) req@ffff88012efa9500 x1830967793400064/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:327/0 lens 488/0 e 0 to 0 dl 1746147717 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147706.520587:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012efa9500 with x1830967793400064 ext(1867776->1871871) 00002000:00010000:0.0:1746147706.520591:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012efa9500 00000100:00100000:0.0:1746147706.520996:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6614 00000100:00100000:0.0:1746147706.521003:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967793400064:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147706.521078:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967793400064:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 75us (575us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147706.521084:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6614 00002000:00100000:0.0:1746147706.521088:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1867776->1871871) req@ffff88012efa9500 x1830967793400064/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:327/0 lens 488/4536 e 0 to 0 dl 1746147717 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147706.521095:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012efa9500 with x1830967793400064 ext(1867776->1871871) 00002000:00010000:0.0:1746147706.521098:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012efa9500 00000100:00100000:0.0:1746147706.522213:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.527674:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793400448 00000100:00100000:0.0:1746147706.527684:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793400448 00000100:00100000:0.0:1746147706.527740:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793400576 00000100:00100000:0.0:1746147706.527743:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793400576 00000100:00100000:0.0:1746147706.527761:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15136 00000100:00100000:0.0:1746147706.527769:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:31554:x1830967793400448:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147706.527789:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147706.527806:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a051ae00/0xe64d3fbf12a7a587 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9b0c expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147706.527837:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0356400/0xe64d3fbf12a7a37a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99a7 expref: 39 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147706.527846:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd17400/0xe64d3fbf12a7a3b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99d8 expref: 23 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147706.527853:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147706.527855:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147706.527858:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a051ae00/0xe64d3fbf12a7a587 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1171455] (req 1048576->1171455) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b0c expref: 39 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147706.527929:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd17400/0xe64d3fbf12a7a3b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99d8 expref: 23 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147706.527944:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd17400/0xe64d3fbf12a7a3b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99d8 expref: 23 pid: 4592 timeout: 885 lvb_type: 1 00000100:00100000:0.0:1746147706.527956:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a213ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796240512:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147706.528038:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0356400/0xe64d3fbf12a7a37a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99a7 expref: 39 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147706.528050:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0356400/0xe64d3fbf12a7a37a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf99a7 expref: 39 pid: 4592 timeout: 885 lvb_type: 1 00000100:00100000:0.0:1746147706.528058:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2139500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796240640:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147706.528078:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147706.528787:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.529771:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.533133:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.533183:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.534368:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.540655:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.542961:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.558121:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.561644:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.565985:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793402624 00000100:00100000:0.0:1746147706.565992:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793402624 00000100:00100000:0.0:1746147706.589463:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.591967:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.597593:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.603508:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793403264 00000100:00100000:0.0:1746147706.603516:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793403264 00002000:00100000:0.0:1746147706.603552:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009f7fad80 x1830967793403264/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:327/0 lens 488/0 e 0 to 0 dl 1746147717 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147706.603561:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7fad80 with x1830967793403264 ext(1048576->2097151) 00002000:00010000:0.0:1746147706.603566:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7fad80 00000100:00100000:0.0:1746147706.603595:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6619 00000100:00100000:0.0:1746147706.603602:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793403264:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147706.622877:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.633769:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.633815:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.634768:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.641676:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.644808:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.654681:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.683173:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.689614:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.689670:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.689695:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793404800 00000100:00100000:0.0:1746147706.689700:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793404800 00002000:00100000:0.0:1746147706.689730:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1064959) req@ffff8800a0594a80 x1830967793404800/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:327/0 lens 16872/0 e 0 to 0 dl 1746147717 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147706.689738:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0594a80 with x1830967793404800 ext(1048576->1064959) 00010000:00010000:0.0:1746147706.689744:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7a58e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b13 expref: 27 pid: 4592 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746147706.689755:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7a58e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b13 expref: 27 pid: 4592 timeout: 885 lvb_type: 0 00002000:00010000:0.0:1746147706.689761:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0594a80 00000100:00100000:0.0:1746147706.689775:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1284 00000100:00100000:0.0:1746147706.689780:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793404800:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147706.690241:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967793404800:12345-192.168.202.10@tcp:4:cat.0 Request processed in 460us (570us total) trans 21474841311 rc 0/0 00000100:00100000:0.0:1746147706.690247:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1284 00002000:00100000:0.0:1746147706.690253:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1064959) req@ffff8800a0594a80 x1830967793404800/t21474841311(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:327/0 lens 16872/448 e 0 to 0 dl 1746147717 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147706.690260:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0594a80 with x1830967793404800 ext(1048576->1064959) 00010000:00010000:0.0:1746147706.690264:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7a58e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b13 expref: 29 pid: 4592 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746147706.690271:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7a58e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b13 expref: 29 pid: 4592 timeout: 885 lvb_type: 0 00002000:00010000:0.0:1746147706.690276:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0594a80 00000100:00100000:0.0:1746147706.695059:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.695105:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.695570:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7658 00000100:00100000:0.0:1746147706.695577:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a047b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967793405184:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147706.695584:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147706.695595:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0298600/0xe64d3fbf12a7a4d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ab1 expref: 29 pid: 4592 timeout: 885 lvb_type: 1 00010000:00010000:0.0:1746147706.695602:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0298600/0xe64d3fbf12a7a4d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ab1 expref: 29 pid: 4592 timeout: 885 lvb_type: 1 00010000:00010000:0.0:1746147706.695612:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0298600/0xe64d3fbf12a7a4d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ab1 expref: 29 pid: 4592 timeout: 885 lvb_type: 1 00010000:00010000:0.0:1746147706.695626:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147706.695646:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a047b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793405184:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 71us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147706.695652:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7658 00000100:00100000:0.0:1746147706.695932:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.699197:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.699558:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793405952 00000100:00100000:0.0:1746147706.699562:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793405952 00002000:00100000:0.0:1746147706.699579:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009f7f8e00 x1830967793405952/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:327/0 lens 488/0 e 0 to 0 dl 1746147717 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147706.699587:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7f8e00 with x1830967793405952 ext(1048576->2097151) 00002000:00010000:0.0:1746147706.699590:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7f8e00 00000100:00100000:0.0:1746147706.700447:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6622 00000100:00100000:0.0:1746147706.700453:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1960:x1830967793405952:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147706.708228:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.710513:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.712657:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1960:x1830967793405952:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 12203us (13112us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147706.712664:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6622 00002000:00100000:0.0:1746147706.712670:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009f7f8e00 x1830967793405952/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:327/0 lens 488/440 e 0 to 0 dl 1746147717 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147706.712937:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7f8e00 with x1830967793405952 ext(1048576->2097151) 00002000:00010000:0.0:1746147706.712942:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f7f8e00 00000100:00100000:0.0:1746147706.713399:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f7fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796242944:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147706.713416:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147706.713435:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1959:x1830967793406464:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1600us (2923us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147706.713442:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7661 00000100:00100000:0.0:1746147706.715103:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.729306:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.729346:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.729374:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.729417:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.730235:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6628 00000100:00100000:0.0:1746147706.730241:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967793407104:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:0.0:1746147706.739409:0:7099:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147706.765331:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.788787:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.793694:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.850810:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.855041:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.856552:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.856591:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.856609:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.856620:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.856644:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.856682:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793408896 00000100:00100000:0.0:1746147706.856688:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793408896 00000100:00100000:0.0:1746147706.856735:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793409024 00000100:00100000:0.0:1746147706.856737:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793409024 00000100:00100000:0.0:1746147706.857018:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793409280 00000100:00100000:0.0:1746147706.857021:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793409280 00000100:00100000:0.0:1746147706.857038:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793409408 00000100:00100000:0.0:1746147706.857040:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793409408 00000100:00100000:0.0:1746147706.857060:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15148 00000100:00100000:0.0:1746147706.857067:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1957:x1830967793409024:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147706.857081:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147706.857095:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a051b400/0xe64d3fbf12a7a621 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9b6e expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147706.857112:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147706.857114:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147706.857120:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a051b400/0xe64d3fbf12a7a621 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b6e expref: 32 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147706.857132:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a051b400/0xe64d3fbf12a7a621 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b6e expref: 32 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147706.857143:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a051b400, rc 0) 00000100:00100000:0.0:1746147706.857753:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:1957:x1830967793409024:12345-192.168.202.10@tcp:101:cat.0 Request processed in 685us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147706.857764:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15148 00000100:00100000:0.0:1746147706.857782:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15151 00000100:00100000:0.0:1746147706.857788:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1957:x1830967793409408:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147706.857794:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147706.857800:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a051bc00/0xe64d3fbf12a7a636 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9b83 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147706.857828:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796243328:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147706.857876:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147706.861667:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.861754:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.870020:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.877514:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.877612:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.909297:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.911931:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.912016:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.922473:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.931521:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.945404:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.952843:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.965693:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.966604:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.968030:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.977459:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.985604:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.985640:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147706.985700:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.021730:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.023438:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.031449:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.031506:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.033381:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6639 00000100:00100000:0.0:1746147707.033389:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967793414656:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147707.049688:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793414784 00000100:00100000:0.0:1746147707.049694:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793414784 00000100:00100000:0.0:1746147707.049734:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793414912 00000100:00100000:0.0:1746147707.049736:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793414912 00000100:00100000:0.0:1746147707.049755:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15162 00000100:00100000:0.0:1746147707.049762:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1959:x1830967793414784:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147707.049773:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147707.049908:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7343c00/0xe64d3fbf12a7a68a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9bd0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147707.049933:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796245376:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147707.049958:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147707.050687:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.055359:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.055408:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.056303:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.056327:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.069378:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.091222:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.091260:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.092815:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.092847:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.092872:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793416320 00000100:00100000:0.0:1746147707.092876:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793416320 00000100:00100000:0.0:1746147707.092910:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793416832 00000100:00100000:0.0:1746147707.092913:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793416832 00002000:00100000:0.0:1746147707.092928:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8801349d9880 x1830967793416832/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:328/0 lens 488/0 e 0 to 0 dl 1746147718 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147707.092936:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349d9880 with x1830967793416832 ext(2097152->3145727) 00002000:00010000:0.0:1746147707.092939:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349d9880 00000100:00100000:0.0:1746147707.092950:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6643 00000100:00100000:0.0:1746147707.092956:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1959:x1830967793416576:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:0.0:1746147707.093997:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8801349d9180 x1830967793416320/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:328/0 lens 488/0 e 0 to 0 dl 1746147718 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147707.094005:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349d9180 with x1830967793416320 ext(2097152->3145727) 00002000:00010000:0.0:1746147707.094008:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349d9180 00000100:00100000:0.0:1746147707.094028:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6645 00000100:00100000:0.0:1746147707.094033:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1959:x1830967793416320:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147707.127166:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.131352:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.135701:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.135777:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.256803:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793418752 00000100:00100000:0.0:1746147707.256927:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793418752 00002000:00100000:0.0:1746147707.257131:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x457:0x0] (1679360->1798143) req@ffff88009f7fa300 x1830967793418752/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:328/0 lens 488/0 e 0 to 0 dl 1746147718 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147707.257139:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f7fa300 with x1830967793418752 ext(1679360->1798143) 00010000:00010000:0.0:1746147707.257146:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6471800/0xe64d3fbf12a7a652 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b9f expref: 42 pid: 20619 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746147707.257158:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6471800/0xe64d3fbf12a7a652 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b9f expref: 42 pid: 20619 timeout: 886 lvb_type: 0 00002000:00010000:0.0:1746147707.257164:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f7fa300 00000100:00100000:0.0:1746147707.257180:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1288 00000100:00100000:0.0:1746147707.257187:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967793418752:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147707.273116:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.279237:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.279529:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793419264 00000100:00100000:0.0:1746147707.279536:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793419264 00000100:00100000:0.0:1746147707.279571:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15169 00000100:00100000:0.0:1746147707.279578:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:31585:x1830967793419264:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147707.279593:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147707.279607:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7342a00/0xe64d3fbf12a7a6d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9c08 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.279630:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6471a00/0xe64d3fbf12a7a64b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b98 expref: 25 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.279639:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6470200/0xe64d3fbf12a7a667 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bb4 expref: 42 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.279650:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147707.279651:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147707.279654:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7342a00/0xe64d3fbf12a7a6d7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->2727935] (req 2097152->2727935) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c08 expref: 25 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.279677:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6470200/0xe64d3fbf12a7a667 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bb4 expref: 42 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.279687:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6470200/0xe64d3fbf12a7a667 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bb4 expref: 42 pid: 4591 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746147707.279697:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796246400:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147707.279754:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6471a00/0xe64d3fbf12a7a64b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b98 expref: 25 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.279761:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6471a00/0xe64d3fbf12a7a64b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b98 expref: 25 pid: 20619 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746147707.279768:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796246528:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147707.279780:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147707.282295:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796246400:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147707.282306:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796246528:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147707.282330:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7342a00/0xe64d3fbf12a7a6d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->2727935] (req 2097152->2727935) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c08 expref: 25 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.282343:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7342a00, rc 0) 00000100:00100000:0.0:1746147707.282380:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:31585:x1830967793419264:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2801us (3149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147707.282388:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15169 00000100:00100000:0.0:1746147707.284979:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.288856:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.288936:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793419520 00000100:00100000:0.0:1746147707.288943:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793419520 00010000:00010000:0.0:1746147707.288966:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6470200/0xe64d3fbf12a7a667 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bb4 expref: 43 pid: 4591 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746147707.288990:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7673 00000100:00100000:0.0:1746147707.288997:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1960:x1830967793419520:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147707.289006:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147707.289024:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6470200/0xe64d3fbf12a7a667 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bb4 expref: 43 pid: 4591 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746147707.289033:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6470200/0xe64d3fbf12a7a667 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bb4 expref: 43 pid: 4591 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746147707.289051:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6470200/0xe64d3fbf12a7a667 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bb4 expref: 43 pid: 4591 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746147707.289062:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147707.289064:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147707.289069:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7342a00/0xe64d3fbf12a7a6d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c08 expref: 23 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.289075:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7342a00/0xe64d3fbf12a7a6d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c08 expref: 23 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.289100:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7342a00/0xe64d3fbf12a7a6d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c08 expref: 23 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147707.289114:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796246656:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147707.289174:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147707.300256:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796246656:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147707.300273:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147707.300312:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967793419520:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 11311us (11458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147707.300322:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7673 00000100:00100000:0.0:1746147707.304814:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793419776 00000100:00100000:0.0:1746147707.304821:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793419776 00002000:00100000:0.0:1746147707.304855:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2723840->2727935) req@ffff88009ce63100 x1830967793419776/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:328/0 lens 488/0 e 0 to 0 dl 1746147718 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147707.304865:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63100 with x1830967793419776 ext(2723840->2727935) 00002000:00010000:0.0:1746147707.304869:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce63100 00000100:00100000:0.0:1746147707.304911:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6649 00000100:00100000:0.0:1746147707.304918:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967793419776:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147707.305655:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967793419776:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 736us (889us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147707.305662:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6649 00002000:00100000:0.0:1746147707.305668:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2723840->2727935) req@ffff88009ce63100 x1830967793419776/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:328/0 lens 488/4536 e 0 to 0 dl 1746147718 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147707.305674:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63100 with x1830967793419776 ext(2723840->2727935) 00002000:00010000:0.0:1746147707.305677:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce63100 00000100:00100000:0.0:1746147707.317855:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793420416 00000100:00100000:0.0:1746147707.317863:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793420416 00000100:00100000:0.0:1746147707.317920:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15170 00000100:00100000:0.0:1746147707.317927:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1959:x1830967793420416:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147707.317941:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147707.317954:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7342200/0xe64d3fbf12a7a701 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9c16 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147707.318048:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796246784:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147707.318123:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147707.318136:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793420544 00000100:00100000:0.0:1746147707.318139:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793420544 00000100:00100000:0.0:1746147707.318160:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 851 00000100:00100000:0.0:1746147707.318165:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013640bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+57:1957:x1830967793420544:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147707.318172:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147707.318190:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130129600/0xe64d3fbf12a7a6f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c0f expref: 57 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.318211:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147707.318214:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147707.318230:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013640bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+56:1957:x1830967793420544:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 65us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147707.318236:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 851 00002000:00010000:0.0:1746147707.321201:0:8469:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime: 1746147707 -> 1746147708 00002000:00010000:0.0:1746147707.321206:0:8469:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime: 1746147707 -> 1746147708 00002000:00010000:0.0:1746147707.321471:0:8469:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2079 -> 2081 00000100:00100000:0.0:1746147707.321482:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796246784:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147707.321535:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7342200/0xe64d3fbf12a7a701 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c16 expref: 8 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.321546:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7342200/0xe64d3fbf12a7a701 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c16 expref: 8 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.321555:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7342200, rc 0) 00000100:00100000:0.0:1746147707.321590:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1959:x1830967793420416:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3663us (4032us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147707.321598:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15170 00000100:00100000:0.0:1746147707.330909:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.331093:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793420672 00000100:00100000:0.0:1746147707.331101:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793420672 00000100:00100000:0.0:1746147707.331149:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15171 00000100:00100000:0.0:1746147707.331321:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:31590:x1830967793420672:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147707.331335:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147707.331349:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7342400/0xe64d3fbf12a7a708 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9c1d expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.331371:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b8b000/0xe64d3fbf12a7a69f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1998847) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bec expref: 15 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.331379:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147707.331380:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147707.331383:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7342400/0xe64d3fbf12a7a708 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c1d expref: 8 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.331732:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b8b000/0xe64d3fbf12a7a69f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1998847) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bec expref: 15 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.331745:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b8b000/0xe64d3fbf12a7a69f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1998847) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bec expref: 15 pid: 20619 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746147707.331759:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796246912:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147707.331904:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147707.335976:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796246912:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147707.336042:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7342400/0xe64d3fbf12a7a708 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c1d expref: 8 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.336058:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7342400, rc 0) 00000100:00100000:0.0:1746147707.336095:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:31590:x1830967793420672:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4778us (5217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147707.336103:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15171 00000100:00100000:0.0:1746147707.336285:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.336303:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793420800 00000100:00100000:0.0:1746147707.336309:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793420800 00002000:00100000:0.0:1746147707.336336:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (1585152->1998847) req@ffff8801349d9c00 x1830967793420800/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:328/0 lens 488/0 e 0 to 0 dl 1746147718 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147707.336344:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349d9c00 with x1830967793420800 ext(1585152->1998847) 00010000:00010000:0.0:1746147707.336350:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b8b000/0xe64d3fbf12a7a69f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1998847) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bec expref: 16 pid: 20619 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746147707.336367:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b8b000/0xe64d3fbf12a7a69f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1998847) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bec expref: 16 pid: 20619 timeout: 886 lvb_type: 0 00002000:00010000:0.0:1746147707.336373:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801349d9c00 00000100:00100000:0.0:1746147707.337117:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1289 00000100:00100000:0.0:1746147707.337124:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+16:1960:x1830967793420800:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147707.357280:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.357309:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793420928 00000100:00100000:0.0:1746147707.357316:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793420928 00010000:00010000:0.0:1746147707.357344:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b8b000/0xe64d3fbf12a7a69f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1998847) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bec expref: 18 pid: 20619 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746147707.357366:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7674 00000100:00100000:0.0:1746147707.357372:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a237bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1959:x1830967793420928:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147707.357383:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147707.357402:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b8b000/0xe64d3fbf12a7a69f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->1998847) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bec expref: 18 pid: 20619 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746147707.357412:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b8b000/0xe64d3fbf12a7a69f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->1998847) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bec expref: 18 pid: 20619 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746147707.357431:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b8b000/0xe64d3fbf12a7a69f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->1998847) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9bec expref: 18 pid: 20619 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746147707.357442:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147707.357444:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147707.357450:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7342400/0xe64d3fbf12a7a708 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c1d expref: 7 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.357458:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7342400/0xe64d3fbf12a7a708 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c1d expref: 7 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.357486:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7342400/0xe64d3fbf12a7a708 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c1d expref: 7 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147707.357495:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349dad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796247040:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147707.358161:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147707.366509:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.366646:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.407854:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.407932:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.407972:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.407998:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793422592 00000100:00100000:0.0:1746147707.408000:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793422592 00002000:00100000:0.0:1746147707.408013:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8801349dad80 x1830967793422592/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:328/0 lens 488/0 e 0 to 0 dl 1746147718 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147707.408021:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349dad80 with x1830967793422592 ext(1048576->2097151) 00002000:00010000:0.0:1746147707.408026:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349dad80 00000100:00100000:0.0:1746147707.408197:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6652 00000100:00100000:0.0:1746147707.408203:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1960:x1830967793422592:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147707.427558:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.435470:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.438049:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.446016:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.452387:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.452419:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.460677:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.471473:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.471517:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.474166:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.475697:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.476030:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.484493:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793424896 00000100:00100000:0.0:1746147707.484498:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793424896 00000100:00100000:0.0:1746147707.484539:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15179 00000100:00100000:0.0:1746147707.484546:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:31593:x1830967793424896:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147707.484556:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147707.484569:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7e00/0xe64d3fbf12a7a740 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9c55 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.484587:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147707.484593:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0299c00/0xe64d3fbf12a7a732 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c47 expref: 21 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.484598:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746147707.484601:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7e00/0xe64d3fbf12a7a740 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->2760703] (req 2097152->2760703) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c55 expref: 21 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.484629:0:20619:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0299c00/0xe64d3fbf12a7a732 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c47 expref: 21 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.484643:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7e00/0xe64d3fbf12a7a740 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->2760703] (req 2097152->2760703) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c55 expref: 21 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.484651:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03b7e00, rc 0) 00000100:00100000:0.0:1746147707.484693:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:31593:x1830967793424896:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 148us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147707.484698:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15179 00000100:00100000:0.0:1746147707.492316:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.497788:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.497837:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.522212:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.536840:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793426432 00000100:00100000:0.0:1746147707.536850:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793426432 00000100:00100000:0.0:1746147707.536993:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15181 00000100:00100000:0.0:1746147707.537002:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967793426432:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147707.537025:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147707.537043:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03b6400/0xe64d3fbf12a7a74e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9c63 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.537075:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03b6400/0xe64d3fbf12a7a74e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c63 expref: 22 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.537087:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03b6400/0xe64d3fbf12a7a74e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c63 expref: 22 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.537117:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03b6400, rc 0) 00000100:00100000:0.0:1746147707.537178:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967793426432:12345-192.168.202.10@tcp:101:cat.0 Request processed in 177us (445us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147707.537184:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15181 00000100:00100000:0.0:1746147707.544284:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.556570:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793427200 00000100:00100000:0.0:1746147707.556582:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793427200 00000100:00100000:0.0:1746147707.556641:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15182 00000100:00100000:0.0:1746147707.556650:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967793427200:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147707.556674:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147707.556692:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7a778 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9c71 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.556724:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7a778 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c71 expref: 22 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.556734:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7a778 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c71 expref: 22 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.556794:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03b7400, rc 0) 00000100:00100000:0.0:1746147707.557036:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967793427200:12345-192.168.202.10@tcp:101:cat.0 Request processed in 386us (1212us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147707.557042:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15182 00000100:00100000:0.0:1746147707.559308:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.567394:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793427456 00000100:00100000:0.0:1746147707.567405:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793427456 00000100:00100000:0.0:1746147707.567466:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15184 00000100:00100000:0.0:1746147707.567474:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:31599:x1830967793427456:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147707.567495:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147707.567513:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6a00/0xe64d3fbf12a7a786 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9c7f expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.567545:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ce2c000/0xe64d3fbf12a7a5bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b44 expref: 17 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.567553:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a051b400/0xe64d3fbf12a7a621 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b6e expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.567559:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147707.567561:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147707.567564:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6a00/0xe64d3fbf12a7a786 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1265664->1622015] (req 1265664->1622015) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c7f expref: 9 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.567596:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a051b400/0xe64d3fbf12a7a621 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b6e expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.567607:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a051b400/0xe64d3fbf12a7a621 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b6e expref: 9 pid: 20619 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746147707.567619:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012efa9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796248576:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147707.567711:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ce2c000/0xe64d3fbf12a7a5bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b44 expref: 17 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.567725:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ce2c000/0xe64d3fbf12a7a5bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9b44 expref: 17 pid: 4591 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746147707.567733:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012efa8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796248704:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147707.567753:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147707.576200:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012efa9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796248576:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147707.576212:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012efa8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796248704:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147707.576237:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6a00/0xe64d3fbf12a7a786 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1265664->1622015] (req 1265664->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c7f expref: 10 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.576253:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03b6a00, rc 0) 00000100:00100000:0.0:1746147707.576292:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:31599:x1830967793427456:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 8819us (9007us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147707.576300:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15184 00000100:00100000:0.0:1746147707.593062:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.593091:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.593132:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.593160:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793428608 00000100:00100000:0.0:1746147707.593165:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793428608 00000100:00100000:0.0:1746147707.594836:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136405880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796248960:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147707.594860:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7a7b7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c8d expref: 11 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.594871:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7a7b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9c8d expref: 11 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.595153:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d2600, rc 0) 00000100:00100000:0.0:1746147707.595515:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967793428608:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1837us (2118us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147707.595523:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15186 00000100:00100000:0.0:1746147707.617764:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.644305:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.646677:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.658173:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.669341:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.669388:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.691063:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.705809:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.724334:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.735767:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147707.741050:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147707.742205:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.742303:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.742353:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7684 00000100:00100000:0.0:1746147707.742363:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793432064:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147707.742375:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147707.742396:0:20557:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4139 00010000:00010000:0.0:1746147707.742402:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3d400/0xe64d3fbf12a7a659 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ba6 expref: 9 pid: 20619 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746147707.742414:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3d400/0xe64d3fbf12a7a659 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ba6 expref: 9 pid: 20619 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746147707.742547:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3d400/0xe64d3fbf12a7a659 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ba6 expref: 9 pid: 20619 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746147707.742567:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147707.742569:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147707.742576:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095444600/0xe64d3fbf12a7a7ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9cb0 expref: 8 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.742585:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095444600/0xe64d3fbf12a7a7ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9cb0 expref: 8 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.742616:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095444600/0xe64d3fbf12a7a7ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9cb0 expref: 8 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147707.742628:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796249856:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147707.742687:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147707.745004:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.748430:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.755440:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.755485:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.761288:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.764185:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.780203:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.785464:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.795961:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.799696:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.799716:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.799737:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793433856 00000100:00100000:0.0:1746147707.799743:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793433856 00000100:00100000:0.0:1746147707.799777:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793433984 00000100:00100000:0.0:1746147707.799779:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793433984 00000100:00100000:0.0:1746147707.799808:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15192 00000100:00100000:0.0:1746147707.799816:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967793433856:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147707.799834:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147707.799850:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915fc200/0xe64d3fbf12a7a804 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9cc5 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.799873:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147707.799910:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147707.799918:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800915fc200/0xe64d3fbf12a7a804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9cc5 expref: 24 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.799932:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915fc200/0xe64d3fbf12a7a804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9cc5 expref: 24 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.799943:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915fc200, rc 0) 00000100:00100000:0.0:1746147707.799979:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967793433856:12345-192.168.202.10@tcp:101:cat.0 Request processed in 164us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147707.799985:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15192 00000100:00100000:0.0:1746147707.799999:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15193 00000100:00100000:0.0:1746147707.800004:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967793433984:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147707.800009:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147707.800015:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915fda00/0xe64d3fbf12a7a80b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9ccc expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147707.800056:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796250624:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147707.800108:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147707.800133:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.800149:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793434112 00000100:00100000:0.0:1746147707.800151:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793434112 00000100:00100000:0.0:1746147707.800169:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15194 00000100:00100000:0.0:1746147707.800173:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1958:x1830967793434112:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147707.800180:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147707.800191:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bff2a00/0xe64d3fbf12a7a812 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9cd3 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147707.800214:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091119880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796250752:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147707.800233:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64aec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147707.800284:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:0.0:1746147707.803152:0:8469:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime: 1746147707 -> 1746147708 00002000:00010000:0.0:1746147707.803156:0:8469:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime: 1746147707 -> 1746147708 00000100:00100000:0.0:1746147707.803169:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091119880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796250752:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147707.803188:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bff2a00/0xe64d3fbf12a7a812 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9cd3 expref: 18 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.803198:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bff2a00/0xe64d3fbf12a7a812 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9cd3 expref: 18 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147707.804243:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bff2a00, rc 0) 00000100:00100000:0.0:1746147707.804285:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1958:x1830967793434112:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4108us (4149us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147707.804292:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15194 00000100:00100000:0.0:1746147707.809278:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.812333:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.823342:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.823401:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.832934:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793435648 00000100:00100000:0.0:1746147707.832944:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793435648 00000100:00100000:0.0:1746147707.833013:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11721 00000100:00100000:0.0:1746147707.833022:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+63:31619:x1830967793435648:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147707.833047:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147707.833066:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e200/0xe64d3fbf12a7a819 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9cda expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.833174:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7a820 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.833187:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7a820 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.833198:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7a820 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.833210:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e600/0xe64d3fbf12a7a827 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.833216:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e600/0xe64d3fbf12a7a827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.833222:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e600/0xe64d3fbf12a7a827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.833786:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f600/0xe64d3fbf12a7a82e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.833796:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f600/0xe64d3fbf12a7a82e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.833802:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f600/0xe64d3fbf12a7a82e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:0.0:1746147707.833812:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147707.833936:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7a820 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.833944:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7a820 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.833949:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7a820 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.833955:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134b2f800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147707.833958:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7a820 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.833964:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7a820 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.833975:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147707.833978:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147707.833982:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7a820 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.833987:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7a820 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.835164:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e600/0xe64d3fbf12a7a827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.835174:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e600/0xe64d3fbf12a7a827 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.835178:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e600/0xe64d3fbf12a7a827 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.835182:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134b2e600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147707.835184:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e600/0xe64d3fbf12a7a827 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.835189:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e600/0xe64d3fbf12a7a827 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.837020:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcc4800) 00010000:00010000:0.0:1746147707.837023:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147707.837028:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e600/0xe64d3fbf12a7a827 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.837035:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e600/0xe64d3fbf12a7a827 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147707.837097:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e200/0xe64d3fbf12a7a819 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9cda expref: 66 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.837109:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f600/0xe64d3fbf12a7a82e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9cda expref: 65 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147707.837115:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147707.837118:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147707.837120:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2f600, rc 0) 00000100:00100000:0.0:1746147707.837169:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+65:31619:x1830967793435648:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4148us (4335us total) trans 8589945663 rc 0/0 00000100:00100000:0.0:1746147707.837176:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11721 00000100:00100000:0.0:1746147707.841100:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.841158:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.853390:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.853995:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.856349:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.856949:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.863516:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.865610:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.868906:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.870129:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.882553:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.889102:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.889148:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.892716:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.899430:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.908329:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.908347:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.908379:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.908393:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793438848 00000100:00100000:0.0:1746147707.908395:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793438848 00002000:00100000:0.0:1746147707.908410:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009d0dd500 x1830967793438848/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:328/0 lens 488/0 e 0 to 0 dl 1746147718 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147707.908417:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dd500 with x1830967793438848 ext(3145728->4194303) 00002000:00010000:0.0:1746147707.908420:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0dd500 00000100:00100000:0.0:1746147707.908436:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6678 00000100:00100000:0.0:1746147707.908441:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1959:x1830967793438720:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147707.917928:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.918357:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.918392:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.939711:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.956560:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.959060:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.980627:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.985617:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.991564:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147707.997103:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.000042:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796252288:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147708.000057:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147708.000082:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1958:x1830967793441536:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1727us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147708.000090:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7693 00000100:00100000:0.0:1746147708.004974:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.008713:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147708.008871:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147708.016980:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147708.017575:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147708.019777:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147708.019915:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147708.024997:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.029721:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793443072 00000100:00100000:0.0:1746147708.029728:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793443072 00000100:00100000:0.0:1746147708.029775:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793442944 00000100:00100000:0.0:1746147708.029778:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793442944 00000100:00100000:0.0:1746147708.029791:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793443200 00000100:00100000:0.0:1746147708.029793:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793443200 00000100:00100000:0.0:1746147708.029805:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15205 00000100:00100000:0.0:1746147708.029810:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793443072:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147708.029821:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147708.029841:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7a8c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9d3c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.029860:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.029862:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.029869:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7a8c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d3c expref: 8 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.029908:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7a8c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d3c expref: 8 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.029916:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55ffa00, rc 0) 00000100:00100000:0.0:1746147708.029951:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793443072:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 140us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147708.029958:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15205 00000100:00100000:0.0:1746147708.029973:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15208 00000100:00100000:0.0:1746147708.029977:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967793443328:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147708.029983:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147708.029989:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7a8d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9d4a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.030002:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.030003:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.030007:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7a8d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d4a expref: 7 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.030016:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7a8d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d4a expref: 7 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.030022:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55fe600, rc 0) 00000100:00100000:0.0:1746147708.030035:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793443328:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 58us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147708.030040:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15208 00000100:00100000:0.0:1746147708.036671:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.039589:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.045786:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.051617:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.051682:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.052652:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15213 00000100:00100000:0.0:1746147708.052660:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793444736:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147708.052677:0:8469:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a55fe400/0xe64d3fbf12a7a92a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.052688:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e60200/0xe64d3fbf12a7a851 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9cf6 expref: 11 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.052696:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3d800/0xe64d3fbf12a7a8cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d43 expref: 10 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.052703:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0029000/0xe64d3fbf12a7a874 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d19 expref: 18 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.052708:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.052710:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.052712:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55fe400/0xe64d3fbf12a7a92a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.052727:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0029000/0xe64d3fbf12a7a874 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d19 expref: 18 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.052735:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0029000/0xe64d3fbf12a7a874 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d19 expref: 18 pid: 4591 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746147708.052743:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0438380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796253568:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147708.052773:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3d800/0xe64d3fbf12a7a8cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d43 expref: 10 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.052781:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3d800/0xe64d3fbf12a7a8cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d43 expref: 10 pid: 7050 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746147708.052789:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a043b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796253952:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147708.052812:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e60200/0xe64d3fbf12a7a851 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9cf6 expref: 11 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.052823:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e60200/0xe64d3fbf12a7a851 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9cf6 expref: 11 pid: 8469 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746147708.052830:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a043b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796254208:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147708.052843:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64aec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147708.052864:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15216 00000100:00100000:0.0:1746147708.052869:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aabfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793445120:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147708.052910:0:4591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7a93f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.052920:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0028600/0xe64d3fbf12a7a89e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2101248->2260991) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d27 expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.052925:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147708.052927:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147708.052928:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7a93f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.052942:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0028600/0xe64d3fbf12a7a89e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2101248->2260991) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d27 expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.052948:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0028600/0xe64d3fbf12a7a89e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2101248->2260991) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d27 expref: 11 pid: 4591 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746147708.052955:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0439180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796254464:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147708.052970:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147708.057380:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0438380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796253568:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147708.058649:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.058680:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.058697:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.058723:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.059789:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.063308:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.064130:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.064146:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.064157:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.064186:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.064922:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.073391:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.079573:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.079656:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.079683:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.079714:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793447808 00000100:00100000:0.0:1746147708.079723:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793447808 00010000:00010000:0.0:1746147708.079767:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9c00/0xe64d3fbf12a79d76 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9635 expref: 67 pid: 17544 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746147708.079818:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793447680 00000100:00100000:0.0:1746147708.079822:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793447680 00010000:00010000:0.0:1746147708.079837:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0356a00/0xe64d3fbf12a79dae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9651 expref: 339 pid: 17544 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746147708.079860:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7712 00000100:00100000:0.0:1746147708.079869:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+67:1960:x1830967793447808:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147708.079932:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147708.079940:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9c00/0xe64d3fbf12a79d76 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9635 expref: 67 pid: 17544 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746147708.079951:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9c00/0xe64d3fbf12a79d76 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9635 expref: 67 pid: 17544 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746147708.081073:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9c00/0xe64d3fbf12a79d76 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9635 expref: 67 pid: 17544 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746147708.081102:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147708.081107:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a5da00/0xe64d3fbf12a7a946 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147708.081116:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147708.081154:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+66:1960:x1830967793447808:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1286us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147708.081168:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7712 00000100:00100000:0.0:1746147708.081311:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.081364:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147708.114469:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147708.114472:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147708.117787:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796256128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3080us (3802us total) trans 21474841325 rc 0/0 00000100:00100000:0.0:1746147708.117792:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15226 00000100:00100000:0.0:1746147708.122570:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.124787:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793448704 00000100:00100000:0.0:1746147708.124793:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793448704 00000100:00100000:0.0:1746147708.124955:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4813 00000100:00100000:0.0:1746147708.124961:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+7:31625:x1830967793448704:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:0.0:1746147708.125129:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+8:31625:x1830967793448704:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 167us (409us total) trans 8589945671 rc 0/0 00000100:00100000:0.0:1746147708.125134:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4813 00000100:00100000:0.0:1746147708.126520:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.153613:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.153702:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.159223:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.159990:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.160063:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.160075:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.160086:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.160120:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.160143:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793449728 00000100:00100000:0.0:1746147708.160146:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793449728 00000100:00100000:0.0:1746147708.160162:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793449856 00000100:00100000:0.0:1746147708.160163:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793449856 00000100:00100000:0.0:1746147708.160171:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793449984 00000100:00100000:0.0:1746147708.160173:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793449984 00000100:00100000:0.0:1746147708.160180:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793450112 00000100:00100000:0.0:1746147708.160182:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793450112 00000100:00100000:0.0:1746147708.160189:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793450240 00000100:00100000:0.0:1746147708.160191:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793450240 00000100:00100000:0.0:1746147708.160200:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15235 00000100:00100000:0.0:1746147708.160205:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967793449728:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147708.160212:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147708.160223:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55e9a00/0xe64d3fbf12a7a9a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9d90 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147708.160238:0:21480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x6814197c, atime: 0x6814197c, ctime: 0x6814197c, blocks: 0x821 00010000:00010000:0.0:1746147708.160245:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.160246:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.160250:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55e9a00/0xe64d3fbf12a7a9a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d90 expref: 14 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.160259:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55e9a00/0xe64d3fbf12a7a9a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d90 expref: 14 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.160266:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55e9a00, rc 0) 00000100:00100000:0.0:1746147708.160282:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967793449728:12345-192.168.202.10@tcp:101:cat.0 Request processed in 77us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147708.160287:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15235 00000100:00100000:0.0:1746147708.160297:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15236 00000100:00100000:0.0:1746147708.160301:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967793449856:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147708.160964:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147708.160974:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55e9c00/0xe64d3fbf12a7a9bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9d97 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147708.160986:0:21480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x6814197c, atime: 0x6814197c, ctime: 0x6814197c, blocks: 0x821 00010000:00010000:0.0:1746147708.160993:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.160995:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.161197:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55e9c00/0xe64d3fbf12a7a9bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d97 expref: 14 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.161213:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55e9c00/0xe64d3fbf12a7a9bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d97 expref: 14 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.161221:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55e9c00, rc 0) 00000100:00100000:0.0:1746147708.161255:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967793449856:12345-192.168.202.10@tcp:101:cat.0 Request processed in 952us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147708.161260:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15236 00000100:00100000:0.0:1746147708.179121:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793451520 00000100:00100000:0.0:1746147708.179129:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793451520 00000100:00100000:0.0:1746147708.179180:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11731 00000100:00100000:0.0:1746147708.179187:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:31631:x1830967793451520:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147708.179206:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147708.179209:0:14547:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147708.179228:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f89ca00/0xe64d3fbf12a7a98c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d82 expref: 324 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.179271:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147708.179275:0:14547:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147708.179285:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7a9c4 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9db3 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.180245:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7a9cb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147708.180257:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095150800/0xe64d3fbf12a7a94d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d74 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.180269:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0234e00/0xe64d3fbf12a7a969 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d7b expref: 7 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.180273:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7a9cb lrc: 5/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147708.180295:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0234e00/0xe64d3fbf12a7a969 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d7b expref: 7 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.180303:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0234e00/0xe64d3fbf12a7a969 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d7b expref: 7 pid: 14546 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746147708.180312:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a043b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796257664:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147708.180401:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095150800/0xe64d3fbf12a7a94d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d74 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.180408:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095150800/0xe64d3fbf12a7a94d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d74 expref: 8 pid: 17544 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746147708.180414:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0438380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796257792:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147708.180431:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147708.190470:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.190517:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.195223:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.203970:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.203993:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793452288 00000100:00100000:0.0:1746147708.203998:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793452288 00000100:00100000:0.0:1746147708.204022:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4815 00000100:00100000:0.0:1746147708.204027:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a043a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:31635:x1830967793452288:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:0.0:1746147708.204167:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a043a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:31635:x1830967793452288:12345-192.168.202.10@tcp:35:cat.0 Request processed in 139us (197us total) trans 8589945677 rc 0/0 00000100:00100000:0.0:1746147708.204172:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4815 00000100:00100000:0.0:1746147708.206819:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.212605:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.221718:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796259456 00000100:00100000:0.0:1746147708.221721:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796259456 00000100:00100000:0.0:1746147708.221736:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796259328 00000100:00100000:0.0:1746147708.221737:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796259328 00000100:00100000:0.0:1746147708.221746:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15249 00000100:00100000:0.0:1746147708.221751:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3302:x1830967796259456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147708.221992:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147708.221995:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147709 -> 1746147709 00002000:00010000:0.0:1746147708.221996:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147708 -> 1746147708 00002000:00010000:0.0:1746147708.221998:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147709 -> 1746147709 00002000:00010000:0.0:1746147708.222000:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746147708.222032:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3302:x1830967796259456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 280us (354us total) trans 21474841327 rc 0/0 00000100:00100000:0.0:1746147708.222037:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15249 00000100:00100000:0.0:1746147708.222085:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796259584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147708.222103:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147708.222114:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796260096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147708.222128:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147708.222142:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135849c00/2, rc 0, transno 21474841329 00000100:00100000:0.0:1746147708.222146:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796259200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147708.222151:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746147708.222155:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796259712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147708.222170:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147708.222183:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796260096 00000100:00100000:0.0:1746147708.222185:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796260096 00000100:00100000:0.0:1746147708.222194:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796259712 00000100:00100000:0.0:1746147708.222195:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796259712 00000100:00100000:0.0:1746147708.222202:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15253 00000100:00100000:0.0:1746147708.222205:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aabf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3303:x1830967796260096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147708.222284:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aabf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3303:x1830967796260096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (155us total) trans 21474841331 rc 0/0 00000100:00100000:0.0:1746147708.222289:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15253 00000004:00080000:0.0:1746147708.222309:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013584ad80/2, rc 0, transno 21474841330 00000100:00100000:0.0:1746147708.222312:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796259584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147708.222318:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136405880/2, rc 0, transno 21474841331 00000100:00100000:0.0:1746147708.222320:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796260096:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147708.222326:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136404a80/2, rc 0, transno 21474841332 00000100:00100000:0.0:1746147708.222329:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796259712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147708.226573:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.226673:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.226717:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.228821:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.230915:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.230951:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.230975:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.230988:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.231000:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.231012:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.231038:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.232852:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.233952:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.235772:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.239408:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.240985:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.250375:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.250431:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.265961:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793456000 00000100:00100000:0.0:1746147708.265973:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793456000 00000100:00100000:0.0:1746147708.266022:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15265 00000100:00100000:0.0:1746147708.266030:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:31637:x1830967793456000:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147708.266048:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147708.266067:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095235c00/0xe64d3fbf12a7aa6c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9e15 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.266097:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7a9b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9dac expref: 17 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.267095:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943c8400/0xe64d3fbf12a7aa5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e07 expref: 19 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.267109:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.267111:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.267117:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095235c00/0xe64d3fbf12a7aa6c lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e15 expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147708.267971:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793456128 00000100:00100000:0.0:1746147708.267978:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793456128 00010000:00010000:0.0:1746147708.268008:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095639600/0xe64d3fbf12a7aa34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->606207) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ddd expref: 27 pid: 10613 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746147708.268035:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7720 00000100:00100000:0.0:1746147708.268042:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967793456128:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147708.268053:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147708.268070:0:7312:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147707 -> 1746147709 00002000:00010000:0.0:1746147708.268072:0:7312:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147707 -> 1746147709 00010000:00010000:0.0:1746147708.268077:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095639600/0xe64d3fbf12a7aa34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 315392->606207) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ddd expref: 27 pid: 10613 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746147708.268088:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095639600/0xe64d3fbf12a7aa34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 315392->606207) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ddd expref: 27 pid: 10613 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746147708.268114:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095639600/0xe64d3fbf12a7aa34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 315392->606207) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ddd expref: 27 pid: 10613 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746147708.268133:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.268134:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.268140:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7aa65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e0e expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.268148:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7aa65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e0e expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.268184:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7aa65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e0e expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147708.268194:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce62300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796260864:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147708.268252:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2085000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147708.272528:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.272566:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.276311:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.276355:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.279454:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.284248:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.284330:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.287576:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.287609:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.287640:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.287671:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.287914:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6699 00000100:00100000:0.0:1746147708.288024:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967793458304:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147708.292089:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.298783:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.298817:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.299400:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.299425:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.312601:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.332351:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.333981:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.335569:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.335631:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.348274:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.356763:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.356813:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.363879:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.369996:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.371749:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.376356:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.383690:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.392497:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.392533:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.392575:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.419328:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.470194:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.507780:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.536024:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.544172:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.548992:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.556555:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.556601:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.571325:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.571366:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.571393:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.571432:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.571467:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793465600 00000100:00100000:0.0:1746147708.571471:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793465600 00002000:00100000:0.0:1746147708.571492:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a0595880 x1830967793465600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:329/0 lens 488/0 e 0 to 0 dl 1746147719 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147708.571500:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0595880 with x1830967793465600 ext(2097152->3145727) 00002000:00010000:0.0:1746147708.571506:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0595880 00000100:00100000:0.0:1746147708.571544:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6713 00000100:00100000:0.0:1746147708.571550:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967793465600:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147708.591115:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967793465856:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19550us (19669us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147708.591127:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6714 00002000:00100000:0.0:1746147708.591139:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a2139c00 x1830967793465856/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:329/0 lens 488/440 e 0 to 0 dl 1746147719 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147708.591148:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2139c00 with x1830967793465856 ext(3145728->4194303) 00002000:00010000:0.0:1746147708.591154:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2139c00 00000100:00100000:0.0:1746147708.603424:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.647174:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.653703:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.661753:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.661809:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.663403:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.663948:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.663980:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.664004:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.664029:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793467008 00000100:00100000:0.0:1746147708.664033:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793467008 00000100:00100000:0.0:1746147708.664062:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793467136 00000100:00100000:0.0:1746147708.664064:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793467136 00000100:00100000:0.0:1746147708.664078:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 325 00000100:00100000:0.0:1746147708.664083:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967793467008:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1746147708.664121:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967793467008:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 36us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147708.664127:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 325 00000100:00100000:0.0:1746147708.664148:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 326 00000100:00100000:0.0:1746147708.664153:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+5:1958:x1830967793467136:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1746147708.664172:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+5:1958:x1830967793467136:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 19us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147708.665820:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 326 00000100:00100000:0.0:1746147708.666261:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.667848:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.667879:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.668836:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.670067:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793467904 00000100:00100000:0.0:1746147708.670070:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793467904 00010000:00010000:0.0:1746147708.670089:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd84400/0xe64d3fbf12a7aae3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e62 expref: 17 pid: 22183 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746147708.670108:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7732 00000100:00100000:0.0:1746147708.670112:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967793467904:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147708.670121:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147708.670138:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd84400/0xe64d3fbf12a7aae3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e62 expref: 17 pid: 22183 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746147708.670151:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd84400/0xe64d3fbf12a7aae3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e62 expref: 17 pid: 22183 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746147708.670167:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd84400/0xe64d3fbf12a7aae3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e62 expref: 17 pid: 22183 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746147708.670184:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147708.670200:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967793467904:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 88us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147708.670207:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7732 00000100:00100000:0.0:1746147708.670715:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.670749:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.670764:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793468288 00000100:00100000:0.0:1746147708.670767:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793468288 00000100:00100000:0.0:1746147708.671748:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4820 00000100:00100000:0.0:1746147708.671756:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:31653:x1830967793468288:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:0.0:1746147708.673142:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:31653:x1830967793468288:12345-192.168.202.10@tcp:35:cat.0 Request processed in 1385us (2389us total) trans 8589945686 rc 0/0 00000100:00100000:0.0:1746147708.673151:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4820 00000100:00100000:0.0:1746147708.677402:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.678448:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.678488:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.680550:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793469568 00000100:00100000:0.0:1746147708.680554:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793469568 00000100:00100000:0.0:1746147708.680573:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793469696 00000100:00100000:0.0:1746147708.680575:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793469696 00000100:00100000:0.0:1746147708.680585:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15283 00000100:00100000:0.0:1746147708.680590:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967793469568:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147708.680599:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147708.680610:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915e4400/0xe64d3fbf12a7ab76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9eb6 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147708.680658:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796263936:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147708.680707:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2085780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147708.680722:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15284 00000100:00100000:0.0:1746147708.680726:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967793469696:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147708.680736:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147708.680742:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7ab7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9ebd expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147708.680760:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796264064:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147708.680775:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eca300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147708.681969:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796264064:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147708.681987:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7ab7d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ebd expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.681996:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7ab7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ebd expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.682003:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915e5c00, rc 0) 00000100:00100000:0.0:1746147708.682953:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967793469696:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 2220us (2511us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147708.682962:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15284 00000100:00100000:0.0:1746147708.686094:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.686562:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.688974:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.689003:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.693777:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.693810:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793471104 00000100:00100000:0.0:1746147708.693819:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793471104 00000100:00100000:0.0:1746147708.693879:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4821 00000100:00100000:0.0:1746147708.693913:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:31648:x1830967793471104:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:0.0:1746147708.696220:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:31648:x1830967793471104:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 2300us (2445us total) trans 8589945688 rc 0/0 00000100:00100000:0.0:1746147708.696230:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4821 00000100:00100000:0.0:1746147708.698316:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793471616 00000100:00100000:0.0:1746147708.698323:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793471616 00000100:00100000:0.0:1746147708.698362:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4822 00000100:00100000:0.0:1746147708.698368:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+7:31651:x1830967793471616:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:0.0:1746147708.698521:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+8:31651:x1830967793471616:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 152us (233us total) trans 8589945689 rc 0/0 00000100:00100000:0.0:1746147708.698526:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4822 00000100:00100000:0.0:1746147708.706249:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.709076:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.713397:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.717552:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.718187:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.718221:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.718260:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.731599:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967793472640:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11363us (13402us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147708.731610:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6722 00002000:00100000:0.0:1746147708.731620:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009505e300 x1830967793472640/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:329/0 lens 488/440 e 0 to 0 dl 1746147719 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147708.731628:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505e300 with x1830967793472640 ext(2097152->3145727) 00002000:00010000:0.0:1746147708.731633:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009505e300 00000100:00100000:0.0:1746147708.734729:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.741711:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147708.743018:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147708.752027:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.758330:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.761626:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.764562:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.769186:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.769237:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.778217:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.778274:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.784584:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.790623:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.819059:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.823518:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.826681:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.827707:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.846957:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.864118:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.864165:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.897069:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.906200:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.908517:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.909045:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.910135:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.912101:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.914910:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793477632 00000100:00100000:0.0:1746147708.914917:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793477632 00000100:00100000:0.0:1746147708.914943:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793477760 00000100:00100000:0.0:1746147708.914944:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793477760 00000100:00100000:0.0:1746147708.914957:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15297 00000100:00100000:0.0:1746147708.914962:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967793477632:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147708.914976:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147708.914990:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1000/0xe64d3fbf12a7ac56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9f3b expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147708.915036:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135a0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796265984:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147708.915110:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa5db840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147708.915129:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15298 00000100:00100000:0.0:1746147708.915134:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aabf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:31662:x1830967793477760:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147708.915141:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147708.915150:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a650ee00/0xe64d3fbf12a7ac5d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9f42 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.915168:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7aa65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e0e expref: 27 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.915176:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a66aa200/0xe64d3fbf12a7ab5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e9a expref: 6 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.915183:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd84a00/0xe64d3fbf12a7aa88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e31 expref: 17 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.915188:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.915190:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147708.915194:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a650ee00/0xe64d3fbf12a7ac5d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [860160->1048575] (req 860160->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f42 expref: 17 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.915212:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd84a00/0xe64d3fbf12a7aa88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e31 expref: 17 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.915223:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd84a00/0xe64d3fbf12a7aa88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e31 expref: 17 pid: 22183 timeout: 888 lvb_type: 1 00000100:00100000:0.0:1746147708.915231:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135a0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796266112:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147708.915259:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a66aa200/0xe64d3fbf12a7ab5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e9a expref: 6 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147708.915266:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a66aa200/0xe64d3fbf12a7ab5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e9a expref: 6 pid: 22183 timeout: 888 lvb_type: 1 00000100:00100000:0.0:1746147708.915273:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796266240:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147708.915308:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7aa65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e0e expref: 27 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147708.915315:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7aa65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9e0e expref: 27 pid: 10613 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746147708.915322:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c264000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796266368:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147708.915338:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa5db900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147708.924219:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.929740:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.933024:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.933059:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.942939:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.942978:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.943015:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.943042:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793478912 00000100:00100000:0.0:1746147708.943051:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793478912 00002000:00100000:0.0:1746147708.943098:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009c265180 x1830967793478912/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:329/0 lens 488/0 e 0 to 0 dl 1746147719 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147708.943109:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c265180 with x1830967793478912 ext(3145728->4194303) 00002000:00010000:0.0:1746147708.943115:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c265180 00000100:00100000:0.0:1746147708.943137:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793479296 00000100:00100000:0.0:1746147708.943140:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793479296 00002000:00100000:0.0:1746147708.943153:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (860160->1048575) req@ffff88009c265880 x1830967793479296/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:329/0 lens 488/0 e 0 to 0 dl 1746147719 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147708.943159:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c265880 with x1830967793479296 ext(860160->1048575) 00010000:00010000:0.0:1746147708.943166:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a650ee00/0xe64d3fbf12a7ac5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 860160->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f42 expref: 16 pid: 8470 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746147708.943180:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a650ee00/0xe64d3fbf12a7ac5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 860160->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f42 expref: 16 pid: 8470 timeout: 888 lvb_type: 0 00002000:00010000:0.0:1746147708.943185:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c265880 00000100:00100000:0.0:1746147708.943196:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1313 00000100:00100000:0.0:1746147708.943200:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967793479296:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:0.0:1746147708.948318:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.950796:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.952254:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.953482:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.954079:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.957603:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.958423:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.960459:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.960502:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.962417:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.963199:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.963212:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793481216 00000100:00100000:0.0:1746147708.963215:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793481216 00002000:00100000:0.0:1746147708.963233:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c267b80 x1830967793481216/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:329/0 lens 488/0 e 0 to 0 dl 1746147719 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147708.963240:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c267b80 with x1830967793481216 ext(0->1048575) 00010000:00010000:0.0:1746147708.963246:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b867c00/0xe64d3fbf12a7ac64 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f49 expref: 30 pid: 8470 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746147708.963265:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b867c00/0xe64d3fbf12a7ac64 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f49 expref: 30 pid: 8470 timeout: 888 lvb_type: 0 00002000:00010000:0.0:1746147708.963271:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c267b80 00000100:00100000:0.0:1746147708.963283:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1314 00000100:00100000:0.0:1746147708.963287:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967793481216:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147708.977134:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.979696:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.980080:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.981932:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.983844:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.984936:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.993284:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.995134:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147708.999789:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.008478:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147709.008686:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147709.013166:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.016091:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.018483:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147709.019533:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c8400/0xe64d3fbf12a7accd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019541:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c8400/0xe64d3fbf12a7accd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147709.019583:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:0.0:1746147709.019588:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147709.019601:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c8400/0xe64d3fbf12a7accd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019610:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c8400/0xe64d3fbf12a7accd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019618:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c9400/0xe64d3fbf12a7acbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019624:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c9400/0xe64d3fbf12a7acbf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019629:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c9400/0xe64d3fbf12a7acbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019634:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800943c9400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147709.019637:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c9400/0xe64d3fbf12a7acbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019643:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c9400/0xe64d3fbf12a7acbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019651:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147709.019653:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147709.019656:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c9400/0xe64d3fbf12a7acbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019659:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c9400/0xe64d3fbf12a7acbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019672:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c9a00/0xe64d3fbf12a7acc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019677:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c9a00/0xe64d3fbf12a7acc6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019681:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c9a00/0xe64d3fbf12a7acc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019684:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800943c9a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147709.019686:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c9a00/0xe64d3fbf12a7acc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019690:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c9a00/0xe64d3fbf12a7acc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019695:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fb79900) 00010000:00010000:0.0:1746147709.019697:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147709.019698:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c9a00/0xe64d3fbf12a7acc6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019702:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c9a00/0xe64d3fbf12a7acc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.019733:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c8000/0xe64d3fbf12a7acb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f81 expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.019743:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c8400/0xe64d3fbf12a7accd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f81 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.019748:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147709.019750:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147709.019752:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943c8400, rc 0) 00000100:00100000:0.0:1746147709.019776:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b6cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+9:31672:x1830967793483136:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 6249us (6619us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147709.019782:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11748 00000100:00100000:0.0:1746147709.022035:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.022065:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.022325:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.022744:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.027209:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.027255:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147709.027430:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147709.028012:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147709.032579:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7acf7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.032591:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7acf7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147709.032730:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147709.032858:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7acf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9fa4 expref: 11 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.032930:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7acf7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9fa4 expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.032937:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147709.032940:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147709.032943:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248800, rc 0) 00000100:00100000:0.0:1746147709.033509:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b6cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+10:31672:x1830967793484800:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 5374us (5495us total) trans 8589945699 rc 0/0 00000100:00100000:0.0:1746147709.033517:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11749 00000100:00100000:0.0:1746147709.038577:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793485056 00000100:00100000:0.0:1746147709.038586:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793485056 00000100:00100000:0.0:1746147709.038637:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11750 00000100:00100000:0.0:1746147709.038645:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+10:31672:x1830967793485056:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147709.038668:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147709.038687:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7ad05 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9fab expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.038761:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7ad0c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.038774:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7acf7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9fa4 expref: 11 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.038781:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7ad0c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.038810:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7acf7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9fa4 expref: 11 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.038822:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7acf7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9fa4 expref: 11 pid: 17544 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746147709.038833:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cbb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796268416:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147709.038935:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa5dbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147709.040459:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.044600:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.044953:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15310 00000100:00100000:0.0:1746147709.044963:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b6cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793485312:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147709.044982:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147709.044999:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfb4200/0xe64d3fbf12a7ad13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9fb2 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147709.045049:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796268544:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147709.045547:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa5db900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147709.049304:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.051449:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.054170:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793486464 00000100:00100000:0.0:1746147709.054176:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793486464 00000100:00100000:0.0:1746147709.054215:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15313 00000100:00100000:0.0:1746147709.054222:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793486464:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:0.0:1746147709.054311:0:8470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cfb5c00/0xe64d3fbf12a7ad3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.054327:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7a9a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d9e expref: 16 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147709.054335:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7ab6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9eaf expref: 7 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147709.054341:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fceb600/0xe64d3fbf12a7aa50 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9df9 expref: 27 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147709.054347:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147709.054349:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147709.054351:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfb5c00/0xe64d3fbf12a7ad3d lrc: 6/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.054383:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fceb600/0xe64d3fbf12a7aa50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9df9 expref: 27 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147709.054394:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fceb600/0xe64d3fbf12a7aa50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9df9 expref: 27 pid: 21480 timeout: 888 lvb_type: 1 00000100:00100000:0.0:1746147709.054406:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796268928:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147709.056198:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7ab6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9eaf expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147709.056208:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7ab6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9eaf expref: 9 pid: 10613 timeout: 888 lvb_type: 1 00000100:00100000:0.0:1746147709.056217:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796269952:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147709.056243:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7a9a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d9e expref: 16 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147709.056251:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7a9a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9d9e expref: 16 pid: 20619 timeout: 888 lvb_type: 1 00000100:00100000:0.0:1746147709.056259:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796270208:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147709.056273:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa5db900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147709.067497:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.067681:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.067695:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793486976 00000100:00100000:0.0:1746147709.067701:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793486976 00010000:00010000:0.0:1746147709.067733:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7342c00/0xe64d3fbf12a7ac1e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f1f expref: 20 pid: 9615 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746147709.068007:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7752 00000100:00100000:0.0:1746147709.068015:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1957:x1830967793486976:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147709.068029:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147709.068050:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7342c00/0xe64d3fbf12a7ac1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f1f expref: 20 pid: 9615 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746147709.068060:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7342c00/0xe64d3fbf12a7ac1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f1f expref: 20 pid: 9615 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746147709.068081:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7342c00/0xe64d3fbf12a7ac1e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f1f expref: 20 pid: 9615 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746147709.068110:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147709.068148:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1957:x1830967793486976:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 134us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147709.068155:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7752 00000100:00100000:0.0:1746147709.068172:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7753 00000100:00100000:0.0:1746147709.068177:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967793486848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147709.068183:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147709.068195:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095150400/0xe64d3fbf12a7acdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f8f expref: 12 pid: 8184 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.068203:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095150400/0xe64d3fbf12a7acdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f8f expref: 12 pid: 8184 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.068219:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095150400/0xe64d3fbf12a7acdb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f8f expref: 12 pid: 8184 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.068228:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147709.068242:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967793486848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 65us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147709.068247:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7753 00000100:00100000:0.0:1746147709.069425:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.069667:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.070652:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796268928:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147709.070674:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.070700:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.070708:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.070716:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.070739:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796269952:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147709.070751:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.070777:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796270208:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147709.070801:0:8470:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cfb5c00/0xe64d3fbf12a7ad3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147709.070841:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.070909:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796270720:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147709.070921:0:4592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012bfd3400/0xe64d3fbf12a7ad59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147709.070943:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.070955:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.070969:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.070979:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.071417:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793488384 00000100:00100000:0.0:1746147709.071420:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793488384 00002000:00100000:0.0:1746147709.071446:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x455:0x0] (278528->376831) req@ffff880094338000 x1830967793488384/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:330/0 lens 488/0 e 0 to 0 dl 1746147720 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147709.071454:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094338000 with x1830967793488384 ext(278528->376831) 00010000:00010000:0.0:1746147709.071459:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095150e00/0xe64d3fbf12a7ac95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->376831) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f5e expref: 28 pid: 22183 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746147709.071468:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095150e00/0xe64d3fbf12a7ac95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->376831) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9f5e expref: 28 pid: 22183 timeout: 888 lvb_type: 0 00002000:00010000:0.0:1746147709.071474:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094338000 00000100:00100000:0.0:1746147709.071486:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1316 00000100:00100000:0.0:1746147709.071490:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967793488384:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147709.071651:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147709.071698:0:8470:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cfb5c00/0xe64d3fbf12a7ad3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.071705:0:8470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfb5c00/0xe64d3fbf12a7ad3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.071728:0:8470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cfb5c00/0xe64d3fbf12a7ad3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.071736:0:8470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfb5c00/0xe64d3fbf12a7ad3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.071743:0:8470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cfb5c00/0xe64d3fbf12a7ad3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.071749:0:8470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfb5c00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147709.071753:0:8470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cfb5c00/0xe64d3fbf12a7ad3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.071760:0:8470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cfb5c00/0xe64d3fbf12a7ad3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.071768:0:8470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cfb5c00/0xe64d3fbf12a7ad3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.071773:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfb5c00/0xe64d3fbf12a7ad3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147709.071810:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793486464:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 17589us (17705us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147709.071816:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15313 00000100:00100000:0.0:1746147709.074637:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.079385:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.079424:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.079452:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.079467:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.079495:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.079508:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.079529:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793488896 00000100:00100000:0.0:1746147709.079537:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793488896 00000100:00100000:0.0:1746147709.079744:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15320 00000100:00100000:0.0:1746147709.079760:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967793489152:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147709.079776:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147709.079791:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfb4000/0xe64d3fbf12a7ad6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9fd5 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147709.079810:0:22183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x6814197c, atime: 0x6814197c, ctime: 0x6814197c, blocks: 0x821 00010000:00010000:0.0:1746147709.079825:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147709.079827:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147709.079832:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfb4000/0xe64d3fbf12a7ad6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9fd5 expref: 23 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147709.079843:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cfb4000/0xe64d3fbf12a7ad6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9fd5 expref: 24 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147709.079849:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfb4000, rc 0) 00000100:00100000:0.0:1746147709.079925:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967793489152:12345-192.168.202.10@tcp:101:cat.0 Request processed in 170us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147709.079931:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15320 00000100:00100000:0.0:1746147709.080053:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.082075:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.083402:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.086953:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.087397:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.087642:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.088748:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.105974:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793491200 00000100:00100000:0.0:1746147709.105982:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793491200 00000100:00100000:0.0:1746147709.106127:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11753 00000100:00100000:0.0:1746147709.106297:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:31665:x1830967793491200:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147709.106315:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147709.106460:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7ad91 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9ff1 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.106504:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfb5400/0xe64d3fbf12a7ad8a lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.106600:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7ad91 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ff1 expref: 334 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.106613:0:5744:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfb5400/0xe64d3fbf12a7ad8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.106623:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7ad91 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ff1 expref: 334 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.106633:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147709.106636:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147709.106639:0:5744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7ad91 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9ff1 expref: 334 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.106645:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095150e00, rc 0) 00000100:00100000:0.0:1746147709.106684:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:31665:x1830967793491200:12345-192.168.202.10@tcp:101:cat.0 Request processed in 389us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147709.106690:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11753 00000100:00100000:0.0:1746147709.124279:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793491456 00000100:00100000:0.0:1746147709.124287:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793491456 00000100:00100000:0.0:1746147709.124654:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11754 00000100:00100000:0.0:1746147709.124662:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:31674:x1830967793491456:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147709.124678:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147709.124694:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fceb600/0xe64d3fbf12a7ad98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaf9ff8 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.124783:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bfd3200/0xe64d3fbf12a7ad9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147709.124794:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bfd3200/0xe64d3fbf12a7ad9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147709.124803:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bfd3200/0xe64d3fbf12a7ad9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147709.124814:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bfd3400/0xe64d3fbf12a7ada6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147709.124819:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bfd3400/0xe64d3fbf12a7ada6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147709.124824:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bfd3400/0xe64d3fbf12a7ada6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147709.127606:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009433aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796273152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.127638:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147709.127653:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796273664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.127669:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147709.127681:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746147709.127685:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009433ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796273280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.127698:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147709.127712:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796273152 00000100:00100000:0.0:1746147709.127715:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796273152 00000100:00100000:0.0:1746147709.127728:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796273664 00000100:00100000:0.0:1746147709.127730:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796273664 00000100:00100000:0.0:1746147709.127737:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796273280 00000100:00100000:0.0:1746147709.127739:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796273280 00000100:00100000:0.0:1746147709.127744:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796271616 00000100:00100000:0.0:1746147709.127746:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796271616 00000100:00100000:0.0:1746147709.127753:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15325 00000100:00100000:0.0:1746147709.127758:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3304:x1830967796272256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147709.128728:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3304:x1830967796272256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 969us (1330us total) trans 21474841340 rc 0/0 00000100:00100000:0.0:1746147709.128735:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15325 00000100:00100000:0.0:1746147709.128745:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796272896 00000100:00100000:0.0:1746147709.128747:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796272896 00000100:00100000:0.0:1746147709.128756:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796273408 00000100:00100000:0.0:1746147709.128758:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796273408 00000100:00100000:0.0:1746147709.128766:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15327 00000100:00100000:0.0:1746147709.128771:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3304:x1830967796272128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147709.128860:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3304:x1830967796272128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (1413us total) trans 21474841342 rc 0/0 00000100:00100000:0.0:1746147709.128879:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15327 00000100:00100000:0.0:1746147709.128905:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15329 00000100:00100000:0.0:1746147709.128911:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3303:x1830967796273152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.129012:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3303:x1830967796273152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (1373us total) trans 17179874099 rc 0/0 00000100:00100000:0.0:1746147709.129017:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15329 00000100:00100000:0.0:1746147709.129027:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15332 00000100:00100000:0.0:1746147709.129032:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3301:x1830967796271616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147709.129059:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15334 00000100:00100000:0.0:1746147709.129064:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3302:x1830967796271744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.129149:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3302:x1830967796271744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (518us total) trans 17179874102 rc 0/0 00000100:00100000:0.0:1746147709.129154:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15334 00000100:00100000:0.0:1746147709.129164:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15337 00000100:00100000:0.0:1746147709.129167:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3302:x1830967796273536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.129242:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3302:x1830967796273536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (548us total) trans 17179874104 rc 0/0 00000100:00100000:0.0:1746147709.129247:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15337 00000100:00100000:0.0:1746147709.129255:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15339 00000100:00100000:0.0:1746147709.129259:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3301:x1830967796273408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.129329:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3301:x1830967796273408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (585us total) trans 17179874106 rc 0/0 00000100:00100000:0.0:1746147709.129334:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15339 00000004:00080000:0.0:1746147709.130404:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009433ad80/2, rc 0, transno 17179874101 00000100:00100000:0.0:1746147709.130409:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009433ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796273280:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147709.130416:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009433aa00/2, rc 0, transno 17179874099 00000100:00100000:0.0:1746147709.130419:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009433aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796273152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147709.130425:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094338a80/2, rc 0, transno 17179874100 00000100:00100000:0.0:1746147709.130428:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796273664:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147709.131007:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147709.131010:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147708 -> 1746147708 00002000:00010000:0.0:1746147709.131012:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147708 -> 1746147708 00002000:00010000:0.0:1746147709.131014:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147708 -> 1746147708 00002000:00010000:0.0:1746147709.131016:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147709.131222:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3301:x1830967796271616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2189us (3497us total) trans 21474841346 rc 0/0 00000100:00100000:0.0:1746147709.131229:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15332 00000100:00100000:0.0:1746147709.135092:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.135979:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.138202:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.141850:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.142250:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.145019:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.188758:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.200424:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.200452:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793493504 00000100:00100000:0.0:1746147709.200459:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793493504 00000100:00100000:0.0:1746147709.200493:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11757 00000100:00100000:0.0:1746147709.200500:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+6:31678:x1830967793493504:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147709.200520:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147709.200535:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7adde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa01b expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.200623:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ade5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200633:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ade5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200643:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ade5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200653:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7adec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200658:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7adec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200663:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7adec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200746:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7adf3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200752:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7adf3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200757:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7adf3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147709.200763:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147709.200876:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7adf3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200904:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7adf3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200909:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7adf3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200914:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090abb200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147709.200917:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7adf3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200922:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7adf3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200931:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147709.200933:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746147709.200936:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7adf3 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200940:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7adf3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200954:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ade5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200959:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ade5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200963:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ade5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200967:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931f9200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147709.200969:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ade5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200977:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ade5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200981:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147709.200983:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147709.200985:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ade5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200989:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ade5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200995:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7adec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.200999:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7adec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.201003:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7adec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.201007:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090abb400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147709.201008:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7adec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.201012:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7adec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.201016:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06eee00) 00010000:00010000:0.0:1746147709.201018:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147709.201020:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7adec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.201023:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7adec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147709.201053:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7adde lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa01b expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.201060:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7adde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa01b expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.201067:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095150e00, rc 0) 00000100:00100000:0.0:1746147709.201104:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:31678:x1830967793493504:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 604us (685us total) trans 8589945707 rc 301/301 00000100:00100000:0.0:1746147709.201110:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11757 00000100:00100000:0.0:1746147709.209032:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.209057:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793493760 00000100:00100000:0.0:1746147709.209064:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793493760 00000100:00100000:0.0:1746147709.209096:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11758 00000100:00100000:0.0:1746147709.209102:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:31681:x1830967793493760:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147709.209120:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147709.209134:0:15085:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7ae01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa022 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.209219:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ae08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209229:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ae08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209237:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ae08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209246:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7ae0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209252:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7ae0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209256:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7ae0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209332:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7ae16 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209339:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209345:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00000004:00200000:0.0:1746147709.209352:0:15085:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147709.209410:0:15085:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209415:0:15085:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7ae16 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209420:0:15085:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7ae16 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209425:0:15085:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090abb200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147709.209428:0:15085:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7ae16 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209432:0:15085:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7ae16 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209439:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147709.209442:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746147709.209445:0:15085:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7ae16 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209450:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7ae16 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209458:0:15085:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ae08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209463:0:15085:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ae08 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209467:0:15085:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ae08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209470:0:15085:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931f9200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147709.209472:0:15085:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ae08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209476:0:15085:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ae08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209482:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147709.209483:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147709.209485:0:15085:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ae08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209489:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7ae08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209494:0:15085:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7ae0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209498:0:15085:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7ae0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209503:0:15085:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7ae0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209506:0:15085:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090abb400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147709.209507:0:15085:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7ae0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209511:0:15085:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7ae0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209515:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06ee800) 00010000:00010000:0.0:1746147709.209517:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147709.209518:0:15085:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7ae0f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209522:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7ae0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147709.209553:0:15085:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7ae01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa022 expref: 9 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.209560:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7ae01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa022 expref: 9 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.209567:0:15085:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095150e00, rc 0) 00000100:00100000:0.0:1746147709.209602:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:31681:x1830967793493760:12345-192.168.202.10@tcp:101:cat.0 Request processed in 500us (575us total) trans 8589945708 rc 301/301 00000100:00100000:0.0:1746147709.209608:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11758 00000100:00100000:0.0:1746147709.212911:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.222573:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796274048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147709.222634:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147709.222679:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796274560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147709.222694:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147709.222705:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796275072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.222719:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147709.222729:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796275584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.222742:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147709.222754:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746147709.222759:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796274176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147709.222771:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147709.222781:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796274688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147709.222793:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147709.222804:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796275200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.222815:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147709.222824:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796275712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.222837:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147709.222872:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796274048 00000100:00100000:0.0:1746147709.222897:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796274048 00000100:00100000:0.0:1746147709.222918:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796274560 00000100:00100000:0.0:1746147709.222920:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796274560 00000100:00100000:0.0:1746147709.222926:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796275072 00000100:00100000:0.0:1746147709.222928:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796275072 00000100:00100000:0.0:1746147709.222934:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796275584 00000100:00100000:0.0:1746147709.222936:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796275584 00000100:00100000:0.0:1746147709.222942:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796274944 00000100:00100000:0.0:1746147709.222943:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796274944 00000100:00100000:0.0:1746147709.222950:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796275456 00000100:00100000:0.0:1746147709.222952:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796275456 00000100:00100000:0.0:1746147709.222958:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796275968 00000100:00100000:0.0:1746147709.222960:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796275968 00000100:00100000:0.0:1746147709.222966:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796274304 00000100:00100000:0.0:1746147709.222968:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796274304 00000100:00100000:0.0:1746147709.222974:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796274816 00000100:00100000:0.0:1746147709.222976:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796274816 00000100:00100000:0.0:1746147709.222982:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796275840 00000100:00100000:0.0:1746147709.222984:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796275840 00000100:00100000:0.0:1746147709.223119:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15344 00000100:00100000:0.0:1746147709.223125:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3301:x1830967796274560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147709.223239:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15345 00000100:00100000:0.0:1746147709.223245:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3301:x1830967796275072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147709.223375:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147709.223378:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147710 -> 1746147710 00002000:00010000:0.0:1746147709.223379:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147703 -> 1746147703 00002000:00010000:0.0:1746147709.223381:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147710 -> 1746147710 00002000:00010000:0.0:1746147709.223383:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:0.0:1746147709.223405:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3301:x1830967796275072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 160us (684us total) trans 17179874108 rc 0/0 00000100:00100000:0.0:1746147709.223410:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15345 00000100:00100000:0.0:1746147709.223426:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15346 00000100:00100000:0.0:1746147709.223430:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3301:x1830967796275584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.223506:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3301:x1830967796275584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (762us total) trans 17179874109 rc 0/0 00000100:00100000:0.0:1746147709.223511:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15346 00000100:00100000:0.0:1746147709.223521:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15351 00000100:00100000:0.0:1746147709.223524:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3301:x1830967796274688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147709.223536:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15352 00000100:00100000:0.0:1746147709.223540:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3304:x1830967796275968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.223955:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3304:x1830967796275968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 413us (1151us total) trans 17179874111 rc 0/0 00000100:00100000:0.0:1746147709.223961:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15352 00000100:00100000:0.0:1746147709.223972:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15356 00000100:00100000:0.0:1746147709.223976:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3304:x1830967796274816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147709.224055:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3304:x1830967796274816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (1203us total) trans 21474841349 rc 0/0 00000100:00100000:0.0:1746147709.224999:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15356 00000100:00100000:0.0:1746147709.225011:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15358 00000100:00100000:0.0:1746147709.225016:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3304:x1830967796275840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.225312:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3304:x1830967796275840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 296us (2397us total) trans 17179874114 rc 0/0 00000100:00100000:0.0:1746147709.225317:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15358 00000004:00080000:0.0:1746147709.225355:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135a0df80/2, rc 0, transno 17179874112 00000100:00100000:0.0:1746147709.226026:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796275200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147709.226054:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd18000/2, rc 0, transno 17179874113 00000100:00100000:0.0:1746147709.226057:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796275712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147709.226066:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135a0d500/2, rc 0, transno 17179874108 00000100:00100000:0.0:1746147709.226069:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796275072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147709.226076:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135a0f800/2, rc 0, transno 17179874109 00000100:00100000:0.0:1746147709.226079:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796275584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147709.226091:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b108380/2, rc 0, transno 21474841347 00000100:00100000:0.0:1746147709.226094:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796274048:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147709.226142:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:0.0:1746147709.226145:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147709.226147:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147709.226148:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147709.226150:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:0.0:1746147709.226171:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3301:x1830967796274560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3046us (3476us total) trans 21474841353 rc 0/0 00000100:00100000:0.0:1746147709.226176:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15344 00000004:00080000:0.0:1746147709.226196:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b109500/2, rc 0, transno 21474841352 00000100:00100000:0.0:1746147709.226199:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796274176:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147709.226206:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135a0ed80/2, rc 0, transno 21474841353 00000100:00100000:0.0:1746147709.226208:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796274560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147709.227225:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.231455:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.231535:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.231563:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.232058:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.237381:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.237414:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.237444:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.245175:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.253590:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.253623:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.253649:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.253735:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.261409:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.280943:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.283840:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.294528:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.298746:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.301283:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.301667:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.301690:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.301713:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.301920:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793498112 00000100:00100000:0.0:1746147709.301923:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793498112 00002000:00100000:0.0:1746147709.301950:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88012fda0380 x1830967793498112/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:330/0 lens 488/0 e 0 to 0 dl 1746147720 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147709.301957:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fda0380 with x1830967793498112 ext(1048576->2097151) 00002000:00010000:0.0:1746147709.301962:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fda0380 00000100:00100000:0.0:1746147709.301983:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793498496 00000100:00100000:0.0:1746147709.301986:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793498496 00002000:00100000:0.0:1746147709.301996:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88012fda0700 x1830967793498496/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:330/0 lens 488/0 e 0 to 0 dl 1746147720 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147709.302002:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fda0700 with x1830967793498496 ext(1048576->2097151) 00002000:00010000:0.0:1746147709.302005:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fda0700 00000100:00100000:0.0:1746147709.302015:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6744 00000100:00100000:0.0:1746147709.302021:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fda0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967793498112:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147709.319476:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.337580:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.343842:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793499264 00000100:00100000:0.0:1746147709.343850:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793499264 00002000:00100000:0.0:1746147709.343904:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009505ca80 x1830967793499264/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:330/0 lens 488/0 e 0 to 0 dl 1746147720 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147709.343912:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505ca80 with x1830967793499264 ext(3145728->4194303) 00002000:00010000:0.0:1746147709.343917:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009505ca80 00000100:00100000:0.0:1746147709.343942:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793499520 00000100:00100000:0.0:1746147709.343945:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793499520 00002000:00100000:0.0:1746147709.343957:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a0597b80 x1830967793499520/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:330/0 lens 488/0 e 0 to 0 dl 1746147720 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147709.343963:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0597b80 with x1830967793499520 ext(2097152->3145727) 00002000:00010000:0.0:1746147709.343966:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0597b80 00000100:00100000:0.0:1746147709.343974:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793499776 00000100:00100000:0.0:1746147709.343976:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793499776 00002000:00100000:0.0:1746147709.343984:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a0594000 x1830967793499776/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:330/0 lens 488/0 e 0 to 0 dl 1746147720 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147709.343990:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0594000 with x1830967793499776 ext(3145728->4194303) 00002000:00010000:0.0:1746147709.343993:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0594000 00000100:00100000:0.0:1746147709.344002:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6749 00000100:00100000:0.0:1746147709.344007:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793499264:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147709.354432:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.363113:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.368440:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.368478:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.368504:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.368524:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.368792:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6752 00000100:00100000:0.0:1746147709.368798:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fda2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967793500928:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147709.376140:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.376179:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.376206:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.376218:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.376229:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.377302:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.381252:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793502208 00000100:00100000:0.0:1746147709.381259:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793502208 00010000:00010000:0.0:1746147709.381285:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7ae8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa06f expref: 20 pid: 22183 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746147709.381320:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7777 00000100:00100000:0.0:1746147709.381326:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2378050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793502208:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147709.381336:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147709.381353:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7ae8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa06f expref: 20 pid: 22183 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746147709.381363:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7ae8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa06f expref: 20 pid: 22183 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746147709.381381:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7ae8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa06f expref: 20 pid: 22183 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746147709.381408:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147709.381440:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2378050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967793502208:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 114us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147709.381446:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7777 00000100:00100000:0.0:1746147709.391965:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.397349:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.397385:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.397470:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.401880:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.403548:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.404855:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793503488 00000100:00100000:0.0:1746147709.404859:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793503488 00000100:00100000:0.0:1746147709.404900:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11765 00000100:00100000:0.0:1746147709.404906:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+8:31686:x1830967793503488:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147709.404915:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147709.404922:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1200/0xe64d3fbf12a7af27 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa0d1 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.404960:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0c00/0xe64d3fbf12a7af2e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147709.404968:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090038000/0xe64d3fbf12a7aef6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa0bc expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.404974:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0c00/0xe64d3fbf12a7af2e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147709.405002:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090038000/0xe64d3fbf12a7aef6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa0bc expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.405010:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090038000/0xe64d3fbf12a7aef6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa0bc expref: 9 pid: 17544 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746147709.405019:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796277760:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147709.405062:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147709.405075:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793503360 00000100:00100000:0.0:1746147709.405078:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793503360 00000100:00100000:0.0:1746147709.405607:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15377 00000100:00100000:0.0:1746147709.405612:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:31684:x1830967793503360:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147709.405620:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147709.405628:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7af35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa0ca expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.405642:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147709.405645:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7af35 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa0ca expref: 33 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.405652:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7af35 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa0ca expref: 33 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.405659:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2b0a00, rc 0) 00000100:00100000:0.0:1746147709.405678:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:31684:x1830967793503360:12345-192.168.202.10@tcp:101:cat.0 Request processed in 66us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147709.405682:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15377 00000100:00100000:0.0:1746147709.407533:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.411218:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.414437:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.414468:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.425348:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.425370:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.428461:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.429223:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.430678:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.434058:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.434083:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.434159:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7786 00000100:00100000:0.0:1746147709.434166:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091631c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967793505792:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147709.434175:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147709.434192:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801348e5200/0xe64d3fbf12a7aec5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa092 expref: 7 pid: 22183 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.434201:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801348e5200/0xe64d3fbf12a7aec5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa092 expref: 7 pid: 22183 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.434309:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348e5200/0xe64d3fbf12a7aec5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa092 expref: 7 pid: 22183 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.434318:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147709.434392:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091631c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967793505792:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 226us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147709.434397:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7786 00000100:00100000:0.0:1746147709.437655:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.442485:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.444848:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.446733:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.457124:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793507840 00000100:00100000:0.0:1746147709.457131:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793507840 00002000:00100000:0.0:1746147709.457164:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3170304->4194303) req@ffff88009fd19500 x1830967793507840/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:330/0 lens 488/0 e 0 to 0 dl 1746147720 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147709.457172:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19500 with x1830967793507840 ext(3170304->4194303) 00002000:00010000:0.0:1746147709.457176:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd19500 00000100:00100000:0.0:1746147709.457209:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6758 00000100:00100000:0.0:1746147709.457212:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793507840:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147709.479961:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.481993:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.491680:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.496506:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.498511:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793508864 00000100:00100000:0.0:1746147709.498515:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793508864 00002000:00100000:0.0:1746147709.498533:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fd1a300 x1830967793508864/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:330/0 lens 488/0 e 0 to 0 dl 1746147720 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147709.498541:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1a300 with x1830967793508864 ext(3145728->4194303) 00002000:00010000:0.0:1746147709.498545:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1a300 00000100:00100000:0.0:1746147709.498567:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6760 00000100:00100000:0.0:1746147709.498572:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967793508864:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147709.513791:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.517314:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.522376:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.534224:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.541073:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.550128:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.576090:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.576146:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.580990:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.588555:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147709.588939:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7afba lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147709.588945:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7afba lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:0.0:1746147709.588964:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147709.589101:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7afb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa133 expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.589129:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7afba lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa133 expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.589135:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147709.589137:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147709.589140:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931ce600, rc 0) 00000100:00100000:0.0:1746147709.589163:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+11:31695:x1830967793510912:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 8005us (8178us total) trans 8589945718 rc 0/0 00000100:00100000:0.0:1746147709.589170:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11768 00000100:00100000:0.0:1746147709.591701:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.596810:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.601144:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793511552 00000100:00100000:0.0:1746147709.601151:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793511552 00000100:00100000:0.0:1746147709.601340:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793511808 00000100:00100000:0.0:1746147709.601343:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793511808 00000100:00100000:0.0:1746147709.601368:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15390 00000100:00100000:0.0:1746147709.601373:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793511552:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147709.601396:0:4591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093a5dc00/0xe64d3fbf12a7aff2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.601410:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe600/0xe64d3fbf12a7af58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->544767) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa0ed expref: 31 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.601416:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147709.601418:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147709.601420:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a5dc00/0xe64d3fbf12a7aff2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.601442:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe600/0xe64d3fbf12a7af58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->544767) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa0ed expref: 31 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.601462:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe600/0xe64d3fbf12a7af58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->544767) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa0ed expref: 31 pid: 21480 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746147709.601470:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fda3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796280320:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147709.601708:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147709.608016:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.608030:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793513216 00000100:00100000:0.0:1746147709.608032:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793513216 00010000:00010000:0.0:1746147709.608044:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7ad75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9fdc expref: 33 pid: 8470 timeout: 888 lvb_type: 1 00000100:00100000:0.0:1746147709.608066:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7794 00000100:00100000:0.0:1746147709.608072:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fda3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1957:x1830967793513216:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147709.608079:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147709.608088:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7ad75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9fdc expref: 33 pid: 8470 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.608100:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7ad75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9fdc expref: 33 pid: 8470 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.608113:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7ad75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9fdc expref: 33 pid: 8470 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.608736:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147709.608753:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fda3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1957:x1830967793513216:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 680us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147709.608758:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7794 00000100:00100000:0.0:1746147709.613208:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.613226:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.613240:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.613252:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.613263:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.614169:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.614188:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.614203:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.614212:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.614232:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.615289:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7804 00000100:00100000:0.0:1746147709.615297:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1957:x1830967793513472:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147709.615305:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147709.615317:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800915e7a00/0xe64d3fbf12a7ae4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa04c expref: 20 pid: 7050 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.615325:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800915e7a00/0xe64d3fbf12a7ae4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa04c expref: 20 pid: 7050 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.615336:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915e7a00/0xe64d3fbf12a7ae4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa04c expref: 20 pid: 7050 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.615344:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147709.615360:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1957:x1830967793513472:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 66us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147709.615366:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7804 00000100:00100000:0.0:1746147709.615378:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7805 00000100:00100000:0.0:1746147709.615382:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c265500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1959:x1830967793514112:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147709.615387:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147709.615395:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cfb4000/0xe64d3fbf12a7ad6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9fd5 expref: 20 pid: 22183 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.615402:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cfb4000/0xe64d3fbf12a7ad6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9fd5 expref: 20 pid: 22183 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.615412:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfb4000/0xe64d3fbf12a7ad6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf9fd5 expref: 20 pid: 22183 timeout: 888 lvb_type: 1 00010000:00010000:0.0:1746147709.615423:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147709.615424:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147709.615427:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8000/0xe64d3fbf12a7b000 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.615433:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8000/0xe64d3fbf12a7b000 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.615452:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147709.615467:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c265500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1959:x1830967793514112:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 84us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147709.615472:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7805 00000100:00100000:0.0:1746147709.615483:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7806 00000100:00100000:0.0:1746147709.615487:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c267480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967793514240:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147709.615492:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147709.615500:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7af35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa0ca expref: 34 pid: 4591 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746147709.615508:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7af35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa0ca expref: 34 pid: 4591 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746147709.615518:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7af35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa0ca expref: 34 pid: 4591 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746147709.615525:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147709.615537:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c267480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1957:x1830967793514240:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 50us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147709.615542:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7806 00000100:00100000:0.0:1746147709.618695:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.620282:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.623156:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.623184:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.623322:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.655002:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.655021:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793515136 00000100:00100000:0.0:1746147709.655025:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793515136 00000100:00100000:0.0:1746147709.655049:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11772 00000100:00100000:0.0:1746147709.655053:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41587371-240a-4781-aecb-638f17200fbd+7:31695:x1830967793515136:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147709.655065:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147709.655076:0:15085:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd63800/0xe64d3fbf12a7b015 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa148 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.655113:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd63800/0xe64d3fbf12a7b015 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa148 expref: 8 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.655124:0:15085:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd63800/0xe64d3fbf12a7b015 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa148 expref: 8 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147709.655138:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147709.655141:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147709.655143:0:15085:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd63800, rc 0) 00000100:00100000:0.0:1746147709.655844:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41587371-240a-4781-aecb-638f17200fbd+8:31695:x1830967793515136:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 789us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147709.655852:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11772 00000004:00080000:0.0:1746147709.658727:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c830700/2, rc 0, transno 17179874128 00000100:00100000:0.0:1746147709.658730:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796284800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147709.666182:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.666221:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.666252:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.666278:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.666294:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147709.666364:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.678568:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.678624:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147710.678977:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147710.678980:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147710.681163:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.681865:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793517056 00000100:00100000:0.0:1746147710.681870:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793517056 00000100:00100000:0.0:1746147710.681913:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6766 00000100:00100000:0.0:1746147710.681919:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793517056:12345-192.168.202.10@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147710.681950:0:31357:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009362aa00/0xe64d3fbf12a7b069 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147710.681958:0:31357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147710.681960:0:31357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147710.681963:0:31357:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009362aa00/0xe64d3fbf12a7b069 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147710.681971:0:31357:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009362aa00/0xe64d3fbf12a7b069 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147710.687154:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.688806:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.688843:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.688881:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.688926:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793517568 00000100:00100000:0.0:1746147710.688930:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793517568 00000100:00100000:0.0:1746147710.688952:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793517824 00000100:00100000:0.0:1746147710.688953:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793517824 00000100:00100000:0.0:1746147710.688964:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793518080 00000100:00100000:0.0:1746147710.688966:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793518080 00000100:00100000:0.0:1746147710.688977:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6768 00000100:00100000:0.0:1746147710.688982:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967793517568:12345-192.168.202.10@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147710.688999:0:8475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009362ac00/0xe64d3fbf12a7b077 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147710.689008:0:8475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147710.689009:0:8475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147710.689012:0:8475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009362ac00/0xe64d3fbf12a7b077 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147710.689021:0:8475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009362ac00/0xe64d3fbf12a7b077 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147710.690080:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6769 00000100:00100000:0.0:1746147710.690088:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967793517824:12345-192.168.202.10@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147710.690108:0:31360:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009362bc00/0xe64d3fbf12a7b07e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147710.690115:0:31360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147710.690117:0:31360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147710.690120:0:31360:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009362bc00/0xe64d3fbf12a7b07e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147710.690127:0:31360:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009362bc00/0xe64d3fbf12a7b07e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147710.742646:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147710.742801:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147710.746003:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147710.749456:0:7099:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147710.771049:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147710.771875:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147710.776845:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.776929:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147710.778008:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147710.778012:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147710.778765:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793519616 00000100:00100000:0.0:1746147710.778769:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793519616 00000100:00100000:0.0:1746147710.778800:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11775 00000100:00100000:0.0:1746147710.778805:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:31704:x1830967793519616:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147710.778817:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147710.778827:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248600/0xe64d3fbf12a7b0d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa19c expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147710.778945:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7b0e0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147710.778960:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528e00/0xe64d3fbf12a7b023 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa14f expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147710.778966:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095150400/0xe64d3fbf12a7b0a1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa180 expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147710.778971:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7b0e0 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147710.778994:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095150400/0xe64d3fbf12a7b0a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa180 expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147710.779003:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095150400/0xe64d3fbf12a7b0a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa180 expref: 9 pid: 5744 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746147710.779013:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796284928:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147710.779960:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528e00/0xe64d3fbf12a7b023 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa14f expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147710.779968:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528e00/0xe64d3fbf12a7b023 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa14f expref: 9 pid: 5744 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746147710.779976:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796285056:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147710.780431:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e2c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147710.784601:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.784634:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.784672:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.788938:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.799815:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6773 00000100:00100000:0.0:1746147710.799828:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967793522304:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147710.802769:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.870097:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.883586:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.883642:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.889319:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793524864 00000100:00100000:0.0:1746147710.889325:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793524864 00002000:00100000:0.0:1746147710.889357:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009111b800 x1830967793524864/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:331/0 lens 488/0 e 0 to 0 dl 1746147721 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147710.889365:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111b800 with x1830967793524864 ext(2097152->3145727) 00002000:00010000:0.0:1746147710.889369:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009111b800 00000100:00100000:0.0:1746147710.889386:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793525120 00000100:00100000:0.0:1746147710.889388:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793525120 00002000:00100000:0.0:1746147710.889396:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009111a300 x1830967793525120/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:331/0 lens 488/0 e 0 to 0 dl 1746147721 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147710.889401:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111a300 with x1830967793525120 ext(3145728->4194303) 00002000:00010000:0.0:1746147710.889404:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009111a300 00000100:00100000:0.0:1746147710.889415:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6781 00000100:00100000:0.0:1746147710.889421:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967793524864:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147710.921181:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1830967796285440:0@lo:400:kworker.0 00000100:00100000:0.0:1746147710.921336:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147710.921705:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1830967796285440:0@lo:400:kworker.0 00000100:00100000:0.0:1746147710.921718:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fda1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796285952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746147710.921738:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147710.921762:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796285696 00000100:00100000:0.0:1746147710.921764:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796285696 00000100:00100000:0.0:1746147710.921788:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1746147710.921793:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3303:x1830967796285696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147710.921834:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3303:x1830967796285696:12345-0@lo:400:kworker.0 Request processed in 41us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147710.921839:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1746147710.921868:0:10630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796285952 00000100:00100000:0.0:1746147710.921871:0:10630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796285952 00000100:00100000:0.0:1746147710.921917:0:10630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1746147710.921922:0:10630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3301:x1830967796285952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746147710.921945:0:10630:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 523829248 pending 22151168 free 3849322496 avail 3847225344 00000100:00100000:0.0:1746147710.921967:0:10630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3301:x1830967796285952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147710.921971:0:10630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1746147710.921991:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fda1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796285952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746147710.922011:0:14542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796285312 00000100:00100000:0.0:1746147710.922013:0:14542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796285312 00000100:00100000:0.0:1746147710.922027:0:14542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1746147710.922030:0:14542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a634195-95c6-4e3b-860d-2cf2df4961a5+18:3303:x1830967796285312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147710.922048:0:14542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a634195-95c6-4e3b-860d-2cf2df4961a5+18:3303:x1830967796285312:12345-0@lo:400:kworker.0 Request processed in 18us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147710.922058:0:14542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:0.0:1746147710.922081:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147710.922091:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091119c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a634195-95c6-4e3b-860d-2cf2df4961a5:3303:1830967796285312:0@lo:400:kworker.0 00000100:00100000:0.0:1746147710.922098:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796285696:0@lo:400:kworker.0 00000100:00100000:0.0:1746147710.929781:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.938655:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.938734:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.940951:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.964503:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796286976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147710.964528:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147710.964544:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796287488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147710.964559:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147710.964572:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147710.964576:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796286592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147710.964590:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147710.964602:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796287104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147710.964615:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147710.964639:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796287104 00000100:00100000:0.0:1746147710.964642:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796287104 00000100:00100000:0.0:1746147710.964657:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15435 00000100:00100000:0.0:1746147710.964661:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3301:x1830967796287488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147710.964754:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3301:x1830967796287488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (193us total) trans 17179874134 rc 0/0 00000100:00100000:0.0:1746147710.964759:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15435 00000100:00100000:0.0:1746147710.964770:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15437 00000100:00100000:0.0:1746147710.964774:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3301:x1830967796287104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147710.964863:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3301:x1830967796287104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (246us total) trans 17179874136 rc 0/0 00000100:00100000:0.0:1746147710.964868:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15437 00000004:00080000:0.0:1746147710.964912:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a08a9c00/2, rc 0, transno 17179874135 00000100:00100000:0.0:1746147710.964916:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796286592:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147710.964923:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a08aaa00/2, rc 0, transno 17179874136 00000100:00100000:0.0:1746147710.964925:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796287104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147710.964932:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a08aa680/2, rc 0, transno 17179874133 00000100:00100000:0.0:1746147710.964934:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796286976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147710.964940:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a08ab480/2, rc 0, transno 17179874134 00000100:00100000:0.0:1746147710.964943:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796287488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147710.964950:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147710.964954:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796287616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147710.964986:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147710.965001:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796287616 00000100:00100000:0.0:1746147710.965004:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796287616 00000100:00100000:0.0:1746147710.965024:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15438 00000100:00100000:0.0:1746147710.965029:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3301:x1830967796287616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147710.965114:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3301:x1830967796287616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (126us total) trans 17179874137 rc 0/0 00000100:00100000:0.0:1746147710.965119:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15438 00000100:00100000:0.0:1746147710.967019:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.967811:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.967975:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4842 00000100:00100000:0.0:1746147710.967982:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d5db450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:31707:x1830967793527168:12345-192.168.202.10@tcp:49:cat.0 00000100:00100000:0.0:1746147710.968024:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d5db450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:31707:x1830967793527168:12345-192.168.202.10@tcp:49:cat.0 Request processed in 43us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147710.968030:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4842 00000100:00100000:0.0:1746147710.968404:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.970347:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.989137:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.991029:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.991076:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147710.991289:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1324 00000100:00100000:0.0:1746147710.991298:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793527808:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147710.995789:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.000170:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.003223:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793527808:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 11926us (12193us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147711.003232:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1324 00002000:00100000:0.0:1746147711.003239:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009172f100 x1830967793527808/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:331/0 lens 488/440 e 0 to 0 dl 1746147721 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147711.003248:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172f100 with x1830967793527808 ext(3145728->4194303) 00010000:00010000:0.0:1746147711.003254:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800950ed200/0xe64d3fbf12a7b0cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa1aa expref: 20 pid: 8470 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746147711.003262:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800950ed200/0xe64d3fbf12a7b0cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa1aa expref: 20 pid: 8470 timeout: 890 lvb_type: 1 00002000:00010000:0.0:1746147711.003268:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009172f100 00000100:00100000:0.0:1746147711.012016:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.013445:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.023830:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.027225:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.027300:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.027345:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.031373:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.034710:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.035203:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.035215:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793530368 00000100:00100000:0.0:1746147711.035218:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793530368 00002000:00100000:0.0:1746147711.035233:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (3674112->3678207) req@ffff880136404700 x1830967793530368/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:332/0 lens 488/0 e 0 to 0 dl 1746147722 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147711.035239:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136404700 with x1830967793530368 ext(3674112->3678207) 00002000:00010000:0.0:1746147711.035241:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136404700 00000100:00100000:0.0:1746147711.035260:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6791 00000100:00100000:0.0:1746147711.035265:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967793530368:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147711.036129:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967793530368:12345-192.168.202.10@tcp:3:cat.0 Request processed in 862us (925us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147711.036135:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6791 00002000:00100000:0.0:1746147711.036140:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (3674112->3678207) req@ffff880136404700 x1830967793530368/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:332/0 lens 488/4536 e 0 to 0 dl 1746147722 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147711.036147:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136404700 with x1830967793530368 ext(3674112->3678207) 00002000:00010000:0.0:1746147711.036149:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136404700 00000100:00100000:0.0:1746147711.041319:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.048069:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.055073:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.055118:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.055170:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.055871:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793531392 00000100:00100000:0.0:1746147711.055875:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793531392 00000100:00100000:0.0:1746147711.056104:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15456 00000100:00100000:0.0:1746147711.056110:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967793531392:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147711.056117:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.056170:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd63000/0xe64d3fbf12a7b1c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa24b expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.056187:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd63000/0xe64d3fbf12a7b1c0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa24b expref: 36 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.056196:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd63000/0xe64d3fbf12a7b1c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa24b expref: 36 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.056206:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd63000, rc 0) 00000100:00100000:0.0:1746147711.056257:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967793531392:12345-192.168.202.10@tcp:101:cat.0 Request processed in 147us (400us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147711.056263:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15456 00000100:00100000:0.0:1746147711.059537:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.059575:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.061234:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.061277:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.061330:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.061452:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.061472:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793532288 00000100:00100000:0.0:1746147711.061479:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793532288 00000100:00100000:0.0:1746147711.061515:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4845 00000100:00100000:0.0:1746147711.061522:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:31707:x1830967793532288:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:0.0:1746147711.062543:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:31707:x1830967793532288:12345-192.168.202.10@tcp:35:cat.0 Request processed in 1021us (1090us total) trans 8589945729 rc 0/0 00000100:00100000:0.0:1746147711.062550:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4845 00000100:00100000:0.0:1746147711.072516:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.076746:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.188676:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.209019:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.225658:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793533696 00000100:00100000:0.0:1746147711.225669:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793533696 00002000:00100000:0.0:1746147711.225720:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fd1b480 x1830967793533696/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:332/0 lens 488/0 e 0 to 0 dl 1746147722 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147711.225731:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1b480 with x1830967793533696 ext(0->1048575) 00002000:00010000:0.0:1746147711.225737:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd1b480 00000100:00100000:0.0:1746147711.225979:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6795 00000100:00100000:0.0:1746147711.225990:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967793533696:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147711.236668:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.237939:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.238019:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.240230:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967793533696:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14240us (14662us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147711.240240:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6795 00002000:00100000:0.0:1746147711.240248:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fd1b480 x1830967793533696/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:332/0 lens 488/440 e 0 to 0 dl 1746147722 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147711.240263:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1b480 with x1830967793533696 ext(0->1048575) 00002000:00010000:0.0:1746147711.240269:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd1b480 00000100:00100000:0.0:1746147711.301424:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.303492:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.305637:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.316335:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.316364:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.322659:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793535872 00000100:00100000:0.0:1746147711.322666:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793535872 00000100:00100000:0.0:1746147711.322823:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 864 00000100:00100000:0.0:1746147711.322830:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:1960:x1830967793535872:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147711.323226:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147711.323239:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e94d600/0xe64d3fbf12a7b261 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa27c expref: 329 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.323257:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147711.323260:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147711.323297:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:1960:x1830967793535872:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 467us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.323303:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 864 00000100:00100000:0.0:1746147711.341529:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.341578:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.341607:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.342935:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.342971:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.342994:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6799 00000100:00100000:0.0:1746147711.343002:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967793536896:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147711.357658:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.357692:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.357825:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6803 00000100:00100000:0.0:1746147711.357833:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967793537792:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147711.401583:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.401691:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.406027:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.412366:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.413658:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.424939:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.425335:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.426654:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.430979:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.432072:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.432099:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793539328 00000100:00100000:0.0:1746147711.432105:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793539328 00010000:00010000:0.0:1746147711.432133:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800950ecc00/0xe64d3fbf12a7b0bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa195 expref: 24 pid: 8470 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746147711.432279:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7824 00000100:00100000:0.0:1746147711.432286:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793539328:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147711.432296:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147711.432315:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800950ecc00/0xe64d3fbf12a7b0bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa195 expref: 24 pid: 8470 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746147711.432330:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800950ecc00/0xe64d3fbf12a7b0bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa195 expref: 24 pid: 8470 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746147711.432358:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800950ecc00/0xe64d3fbf12a7b0bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa195 expref: 24 pid: 8470 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746147711.432377:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147711.432405:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967793539328:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 120us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.432410:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7824 00000100:00100000:0.0:1746147711.432698:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793539456 00000100:00100000:0.0:1746147711.432701:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793539456 00010000:00010000:0.0:1746147711.432712:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5528000/0xe64d3fbf12a7b031 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa164 expref: 8 pid: 8184 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746147711.432729:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7825 00000100:00100000:0.0:1746147711.432733:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793539456:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147711.432739:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147711.432745:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5528000/0xe64d3fbf12a7b031 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa164 expref: 8 pid: 8184 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746147711.432753:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5528000/0xe64d3fbf12a7b031 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa164 expref: 8 pid: 8184 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746147711.432776:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5528000/0xe64d3fbf12a7b031 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa164 expref: 8 pid: 8184 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746147711.432785:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.432786:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.432792:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7b292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1986559) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa2b4 expref: 21 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.432799:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7b292 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1986559) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa2b4 expref: 21 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.432826:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7b292 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1986559) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa2b4 expref: 21 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147711.432836:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009433b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796291200:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147711.432920:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a917780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147711.436441:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.436494:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.450169:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.464399:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.464454:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.465170:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.471819:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.480245:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793541248 00000100:00100000:0.0:1746147711.480256:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793541248 00002000:00100000:0.0:1746147711.480292:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88012ee58700 x1830967793541248/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:332/0 lens 488/0 e 0 to 0 dl 1746147722 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147711.480301:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58700 with x1830967793541248 ext(2097152->3145727) 00002000:00010000:0.0:1746147711.480307:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee58700 00000100:00100000:0.0:1746147711.480341:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6809 00000100:00100000:0.0:1746147711.480349:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967793541248:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147711.487554:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.496251:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.496275:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.498216:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.503744:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.503761:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.503777:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793542528 00000100:00100000:0.0:1746147711.503782:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793542528 00000100:00100000:0.0:1746147711.503811:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793542784 00000100:00100000:0.0:1746147711.503813:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793542784 00000100:00100000:0.0:1746147711.503822:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15472 00000100:00100000:0.0:1746147711.503827:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:31720:x1830967793542528:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147711.503855:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.503870:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcc6c00/0xe64d3fbf12a7b2d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa2de expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.503907:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092c24a00/0xe64d3fbf12a7b28b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3973120->4194303] (req 3973120->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa2a6 expref: 37 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.503914:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147711.503916:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147711.503923:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcc6c00/0xe64d3fbf12a7b2d8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa2de expref: 24 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.503956:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092c24a00/0xe64d3fbf12a7b28b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 9 type: EXT [3973120->4194303] (req 3973120->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa2a6 expref: 37 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.503966:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092c24a00/0xe64d3fbf12a7b28b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 8 type: EXT [3973120->4194303] (req 3973120->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa2a6 expref: 37 pid: 4592 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746147711.503977:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c266300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796292096:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147711.504030:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a917900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147711.504058:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.504112:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.504198:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.504243:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.507091:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.508559:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.508595:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.511758:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.515374:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.515465:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.516365:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.516453:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.516494:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.521914:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.523936:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.526624:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793545472 00000100:00100000:0.0:1746147711.526633:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793545472 00000100:00100000:0.0:1746147711.526675:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11789 00000100:00100000:0.0:1746147711.526683:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+9:31725:x1830967793545472:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147711.526706:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.526728:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6e00/0xe64d3fbf12a7b33a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa324 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.526798:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6e00/0xe64d3fbf12a7b33a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa324 expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.526813:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6e00/0xe64d3fbf12a7b33a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa324 expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.526830:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147711.526833:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147711.526836:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcc6e00, rc 0) 00000100:00100000:0.0:1746147711.526911:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+10:31725:x1830967793545472:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 229us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.526918:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11789 00000100:00100000:0.0:1746147711.533206:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.533358:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.533391:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.533653:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793545856 00000100:00100000:0.0:1746147711.533655:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793545856 00000100:00100000:0.0:1746147711.533672:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15481 00000100:00100000:0.0:1746147711.533677:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967793545728:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147711.533717:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fcc7600/0xe64d3fbf12a7b348 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.534468:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0029200/0xe64d3fbf12a7b03f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa15d expref: 8 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.534480:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7b111 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa1cd expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.534487:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095151a00/0xe64d3fbf12a7b0b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa18e expref: 20 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.534492:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.534494:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.534496:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcc7600/0xe64d3fbf12a7b348 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.534511:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095151a00/0xe64d3fbf12a7b0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa18e expref: 20 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.534518:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095151a00/0xe64d3fbf12a7b0b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa18e expref: 20 pid: 9615 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746147711.534526:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796293248:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147711.534553:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7b111 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa1cd expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.534561:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7b111 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa1cd expref: 22 pid: 7050 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746147711.534568:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796293504:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147711.534587:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0029200/0xe64d3fbf12a7b03f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa15d expref: 8 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.534594:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0029200/0xe64d3fbf12a7b03f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa15d expref: 8 pid: 22183 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746147711.534600:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796293760:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147711.534613:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a917900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147711.534634:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.535017:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.540324:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.540348:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.540369:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793546624 00000100:00100000:0.0:1746147711.540375:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793546624 00010000:00010000:0.0:1746147711.540467:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095150e00/0xe64d3fbf12a7b0c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa1a3 expref: 24 pid: 7050 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746147711.541294:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7833 00000100:00100000:0.0:1746147711.541304:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793546880:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147711.541317:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147711.541341:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090038600/0xe64d3fbf12a7b02a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa156 expref: 10 pid: 8468 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746147711.541352:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090038600/0xe64d3fbf12a7b02a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa156 expref: 10 pid: 8468 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746147711.541378:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090038600/0xe64d3fbf12a7b02a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa156 expref: 10 pid: 8468 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746147711.541399:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147711.541441:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793546880:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 140us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.541670:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7833 00000100:00100000:0.0:1746147711.541753:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.541801:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.542659:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.542677:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.542688:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.542710:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.542723:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.542736:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.543048:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.547872:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.547944:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.561030:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.561130:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.561174:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7847 00000100:00100000:0.0:1746147711.561242:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1957:x1830967793548544:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147711.561251:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147711.561264:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7b292 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa2b4 expref: 23 pid: 20619 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746147711.561278:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7b292 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->1986559) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa2b4 expref: 23 pid: 20619 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746147711.561290:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7b292 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->1986559) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa2b4 expref: 23 pid: 20619 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746147711.561304:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.561305:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.561308:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801354c8200/0xe64d3fbf12a7b34f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.561314:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801354c8200/0xe64d3fbf12a7b34f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.561364:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147711.561406:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967793548544:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 225us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.561413:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7847 00000100:00100000:0.0:1746147711.571038:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.586319:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793549952 00000100:00100000:0.0:1746147711.586330:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793549952 00000100:00100000:0.0:1746147711.586393:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11791 00000100:00100000:0.0:1746147711.586400:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:31720:x1830967793549952:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147711.586432:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.586453:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7b379 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa332 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.586518:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a086bc00/0xe64d3fbf12a7b372 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147711.586526:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7b379 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa332 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.586544:0:17544:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a086bc00/0xe64d3fbf12a7b372 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147711.586556:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7b379 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa332 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.586568:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147711.586571:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147711.586573:0:17544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7b379 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa332 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.586580:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5545c00, rc 0) 00000100:00100000:0.0:1746147711.586639:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:31720:x1830967793549952:12345-192.168.202.10@tcp:101:cat.0 Request processed in 239us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.586646:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11791 00000004:00010000:0.0:1746147711.612201:0:14545:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093cd7100 reply state ffff880135fafc00 transno 8589945741 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a086bc00/0xe64d3fbf12a7b372 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14545 initiator: MDT0 00000100:00100000:0.0:1746147711.612215:0:14545:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746147711.612326:0:14545:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746147711.612341:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+8:31725:x1830967793549184:12345-192.168.202.10@tcp:36:mirror_io.0 Request processed in 40994us (41308us total) trans 8589945741 rc 0/0 00000100:00100000:0.0:1746147711.612349:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11790 00000100:00100000:0.0:1746147711.612379:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009111a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796295808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147711.612641:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147711.612678:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009111aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796296320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147711.612692:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147711.612705:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796296832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147711.612717:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147711.612726:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796297344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147711.612735:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147711.612744:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147711.612748:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796296960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147711.612758:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147711.612765:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796297472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147711.612775:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147711.613800:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15490 00000100:00100000:0.0:1746147711.613808:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3303:x1830967796297344:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147711.613876:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009111aa00/2, rc 0, transno 17179874141 00000100:00100000:0.0:1746147711.613900:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009111aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796296320:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147711.613910:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009111a680/2, rc 0, transno 17179874142 00000100:00100000:0.0:1746147711.613914:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009111a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796295808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147711.613948:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796297984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147711.613968:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147711.615235:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093cd6680/2, rc 0, transno 17179874147 00000100:00100000:0.0:1746147711.615239:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796297984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147711.615293:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009505f800/2, rc 0, transno 21474841375 00000100:00100000:0.0:1746147711.615297:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796296832:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147711.615400:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:0.0:1746147711.615403:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147711.615405:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147711.615406:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147711.615408:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:0.0:1746147711.615434:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3303:x1830967796297344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1627us (2697us total) trans 21474841378 rc 0/0 00000100:00100000:0.0:1746147711.615439:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15490 00000004:00080000:0.0:1746147711.615463:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009111a300/2, rc 0, transno 17179874143 00000100:00100000:0.0:1746147711.615466:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009111a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796295936:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147711.615474:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091118a80/2, rc 0, transno 17179874144 00000100:00100000:0.0:1746147711.615477:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091118a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796296448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147711.615490:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009505f480/2, rc 0, transno 21474841378 00000100:00100000:0.0:1746147711.615493:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796297344:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147711.615900:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009505d180/2, rc 0, transno 21474841379 00000100:00100000:0.0:1746147711.615905:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796296960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147711.615912:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009505c000/2, rc 0, transno 21474841380 00000100:00100000:0.0:1746147711.615915:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796297472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147711.616403:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793550080 00000100:00100000:0.0:1746147711.616409:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793550080 00000100:00100000:0.0:1746147711.616436:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11792 00000100:00100000:0.0:1746147711.616441:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+8:31725:x1830967793550080:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147711.616458:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.616473:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ec200/0xe64d3fbf12a7b380 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa339 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.616823:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ec200/0xe64d3fbf12a7b380 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa339 expref: 9 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.616836:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ec200/0xe64d3fbf12a7b380 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa339 expref: 9 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.616866:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147711.616869:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147711.616872:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950ec200, rc 0) 00000100:00100000:0.0:1746147711.617278:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+8:31725:x1830967793550080:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 836us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.617283:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11792 00000100:00100000:0.0:1746147711.617542:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793550208 00000100:00100000:0.0:1746147711.617546:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793550208 00000100:00100000:0.0:1746147711.617770:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4851 00000100:00100000:0.0:1746147711.617775:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:31720:x1830967793550208:12345-192.168.202.10@tcp:49:cat.0 00000100:00100000:0.0:1746147711.617830:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:31720:x1830967793550208:12345-192.168.202.10@tcp:49:cat.0 Request processed in 56us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.617835:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4851 00000100:00100000:0.0:1746147711.620225:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.621764:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.626362:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793550592 00000100:00100000:0.0:1746147711.626372:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793550592 00000100:00100000:0.0:1746147711.626411:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793550848 00000100:00100000:0.0:1746147711.626414:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793550848 00000100:00100000:0.0:1746147711.626426:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793551104 00000100:00100000:0.0:1746147711.626427:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793551104 00000100:00100000:0.0:1746147711.626436:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793550720 00000100:00100000:0.0:1746147711.626438:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793550720 00000100:00100000:0.0:1746147711.626444:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793550976 00000100:00100000:0.0:1746147711.626446:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793550976 00000100:00100000:0.0:1746147711.626451:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793551232 00000100:00100000:0.0:1746147711.626453:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793551232 00000100:00100000:0.0:1746147711.626458:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793551360 00000100:00100000:0.0:1746147711.626460:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793551360 00000100:00100000:0.0:1746147711.626465:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793551488 00000100:00100000:0.0:1746147711.626466:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793551488 00000100:00100000:0.0:1746147711.626472:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793551616 00000100:00100000:0.0:1746147711.626473:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793551616 00000100:00100000:0.0:1746147711.626480:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793551744 00000100:00100000:0.0:1746147711.626481:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793551744 00000100:00100000:0.0:1746147711.626492:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15505 00000100:00100000:0.0:1746147711.626499:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793550592:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147711.626518:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.626539:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5544c00/0xe64d3fbf12a7b39c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa34e expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147711.626565:0:20619:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x6814197e, atime: 0x68141977, ctime: 0x6814197e, blocks: 0x79f 00010000:00010000:0.0:1746147711.626585:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.626587:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.626598:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5544c00/0xe64d3fbf12a7b39c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa34e expref: 8 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.626613:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5544c00/0xe64d3fbf12a7b39c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa34e expref: 8 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.626629:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5544c00, rc 0) 00000100:00100000:0.0:1746147711.626673:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793550592:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 174us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.626679:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15505 00000100:00100000:0.0:1746147711.626695:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15506 00000100:00100000:0.0:1746147711.626699:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967793550848:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147711.626705:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.626716:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800950ed000/0xe64d3fbf12a7b3a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa35c expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147711.626730:0:20619:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x6814197e, atime: 0x6814197c, ctime: 0x6814197e, blocks: 0x821 00010000:00010000:0.0:1746147711.626738:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.626739:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.626743:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800950ed000/0xe64d3fbf12a7b3a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa35c expref: 24 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.626752:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800950ed000/0xe64d3fbf12a7b3a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa35c expref: 24 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.626759:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950ed000, rc 0) 00000100:00100000:0.0:1746147711.626773:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793550848:12345-192.168.202.10@tcp:101:cat.0 Request processed in 73us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.626777:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15506 00000100:00100000:0.0:1746147711.626787:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15507 00000100:00100000:0.0:1746147711.626791:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967793551104:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147711.626798:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.626804:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800950ec800/0xe64d3fbf12a7b3aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa36a expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147711.626813:0:20619:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x6814197c, atime: 0x6814197c, ctime: 0x6814197c, blocks: 0x81f 00010000:00010000:0.0:1746147711.626819:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.626821:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.626824:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800950ec800/0xe64d3fbf12a7b3aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa36a expref: 22 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.626832:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800950ec800/0xe64d3fbf12a7b3aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa36a expref: 22 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.626837:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950ec800, rc 0) 00000100:00100000:0.0:1746147711.626863:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967793551104:12345-192.168.202.10@tcp:101:cat.0 Request processed in 71us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.626867:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15507 00000100:00100000:0.0:1746147711.626877:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15508 00000100:00100000:0.0:1746147711.626881:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967793550720:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147711.626903:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.626908:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800950edc00/0xe64d3fbf12a7b3b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa355 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.626915:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.626916:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.626920:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800950edc00/0xe64d3fbf12a7b3b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa355 expref: 22 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.626931:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800950edc00/0xe64d3fbf12a7b3b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa355 expref: 22 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.626937:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950edc00, rc 0) 00000100:00100000:0.0:1746147711.626949:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967793550720:12345-192.168.202.10@tcp:101:cat.0 Request processed in 68us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.626953:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15508 00000100:00100000:0.0:1746147711.626961:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15509 00000100:00100000:0.0:1746147711.626965:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967793550976:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147711.626970:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.626977:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800950ecc00/0xe64d3fbf12a7b3b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa363 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147711.626986:0:20619:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x68141980, atime: 0x6814197c, ctime: 0x68141980, blocks: 0x821 00010000:00010000:0.0:1746147711.626992:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.626993:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.626997:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800950ecc00/0xe64d3fbf12a7b3b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa363 expref: 24 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.627005:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800950ecc00/0xe64d3fbf12a7b3b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa363 expref: 24 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.627012:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950ecc00, rc 0) 00000100:00100000:0.0:1746147711.627024:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793550976:12345-192.168.202.10@tcp:101:cat.0 Request processed in 59us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.627032:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15509 00000100:00100000:0.0:1746147711.627040:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15510 00000100:00100000:0.0:1746147711.627043:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793551232:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147711.627048:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.627052:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800950ec600/0xe64d3fbf12a7b3bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa371 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.627061:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.627062:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.627065:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800950ec600/0xe64d3fbf12a7b3bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa371 expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.627072:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800950ec600/0xe64d3fbf12a7b3bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa371 expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.627077:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950ec600, rc 0) 00000100:00100000:0.0:1746147711.627087:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793551232:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 44us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.627091:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15510 00000100:00100000:0.0:1746147711.627097:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15511 00000100:00100000:0.0:1746147711.627101:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793551360:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147711.627105:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.627108:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800950ed400/0xe64d3fbf12a7b3c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa378 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.627114:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.627116:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.627119:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800950ed400/0xe64d3fbf12a7b3c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa378 expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.627125:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800950ed400/0xe64d3fbf12a7b3c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa378 expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.627130:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950ed400, rc 0) 00000100:00100000:0.0:1746147711.627139:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793551360:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 38us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.627142:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15511 00000100:00100000:0.0:1746147711.627147:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15512 00000100:00100000:0.0:1746147711.627150:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793551488:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147711.627154:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.627158:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800950ede00/0xe64d3fbf12a7b3cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa37f expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.627165:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.627166:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.627168:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800950ede00/0xe64d3fbf12a7b3cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa37f expref: 8 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.627175:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800950ede00/0xe64d3fbf12a7b3cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa37f expref: 8 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.627180:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950ede00, rc 0) 00000100:00100000:0.0:1746147711.627188:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793551488:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 37us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.627195:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15512 00000100:00100000:0.0:1746147711.627200:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15513 00000100:00100000:0.0:1746147711.627203:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793551616:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147711.627207:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.627211:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800950ed800/0xe64d3fbf12a7b3d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa386 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.627218:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.627219:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.627222:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800950ed800/0xe64d3fbf12a7b3d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa386 expref: 8 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.627229:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800950ed800/0xe64d3fbf12a7b3d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa386 expref: 8 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.627233:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950ed800, rc 0) 00000100:00100000:0.0:1746147711.627240:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793551616:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 36us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.627244:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15513 00000100:00100000:0.0:1746147711.627249:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15514 00000100:00100000:0.0:1746147711.627253:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793551744:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147711.627256:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147711.627260:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a086bc00/0xe64d3fbf12a7b3db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa38d expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147711.627267:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.627268:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147711.627271:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a086bc00/0xe64d3fbf12a7b3db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa38d expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.627278:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a086bc00/0xe64d3fbf12a7b3db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa38d expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147711.627283:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a086bc00, rc 0) 00000100:00100000:0.0:1746147711.627291:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793551744:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 38us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.627295:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15514 00000100:00100000:0.0:1746147711.632577:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.654642:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.682042:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.684382:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.737363:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.742708:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.747959:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.748038:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147711.751097:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147711.751757:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.751825:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.752499:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.752556:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.752856:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.753647:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.770195:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.770302:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.770384:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.770491:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.813601:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.822154:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.822192:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.822283:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.822329:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793555712 00000100:00100000:0.0:1746147711.822336:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793555712 00010000:00010000:0.0:1746147711.822374:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0029200/0xe64d3fbf12a7b436 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa3a2 expref: 326 pid: 14545 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746147711.824607:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7857 00000100:00100000:0.0:1746147711.824615:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:1957:x1830967793555712:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147711.824622:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147711.824627:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0029200/0xe64d3fbf12a7b436 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa3a2 expref: 326 pid: 14545 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746147711.824636:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0029200/0xe64d3fbf12a7b436 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa3a2 expref: 326 pid: 14545 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746147711.824647:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0029200/0xe64d3fbf12a7b436 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa3a2 expref: 326 pid: 14545 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746147711.824658:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147711.824661:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab4200/0xe64d3fbf12a7b48a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147711.824671:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab4200/0xe64d3fbf12a7b48a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147711.824682:0:7096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab4200/0xe64d3fbf12a7b48a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147711.824696:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147711.824714:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:1957:x1830967793555712:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 101us (2573us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147711.824719:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7857 00000100:00100000:0.0:1746147711.825343:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.826650:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.826700:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.826720:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6820 00000100:00100000:0.0:1746147711.826729:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1960:x1830967793556864:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147711.845000:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1960:x1830967793556864:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18263us (19647us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147711.845013:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6820 00002000:00100000:0.0:1746147711.845024:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a02aea00 x1830967793556864/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:332/0 lens 488/440 e 0 to 0 dl 1746147722 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147711.845033:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02aea00 with x1830967793556864 ext(3145728->4194303) 00002000:00010000:0.0:1746147711.845038:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02aea00 00000100:00100000:0.0:1746147711.854406:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000004:00080000:0.0:1746147711.862814:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009505ed80/2, rc 0, transno 21474841390 00000100:00100000:0.0:1746147711.862818:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796300416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147711.863154:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.871291:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.881278:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.885021:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.886482:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.893283:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.897258:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.897410:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.903300:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.903326:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.903343:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.903373:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.904441:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.904455:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.904488:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.904604:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6825 00000100:00100000:0.0:1746147711.904610:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967793559680:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147711.905990:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.929310:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.933359:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.943269:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.947742:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.955249:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.958698:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.960231:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.967227:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.967598:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.967918:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147711.992158:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.003882:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.007436:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.008987:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.015611:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.015658:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.025827:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147712.026671:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147712.031189:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.033737:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.041393:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.042475:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.047973:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.052153:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147712.052695:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147712.066477:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793566080 00000100:00100000:0.0:1746147712.066486:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793566080 00000100:00100000:0.0:1746147712.066539:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15548 00000100:00100000:0.0:1746147712.066547:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:31738:x1830967793566080:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147712.066563:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147712.066580:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcc6c00/0xe64d3fbf12a7b50f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa443 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.066607:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801362a1000/0xe64d3fbf12a7b4fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3694591) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa427 expref: 37 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.066614:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147712.066616:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147712.066619:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcc6c00/0xe64d3fbf12a7b50f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa443 expref: 24 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.066649:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801362a1000/0xe64d3fbf12a7b4fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3694591) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa427 expref: 37 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.066660:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801362a1000/0xe64d3fbf12a7b4fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3694591) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa427 expref: 37 pid: 9615 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746147712.066672:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e36a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796303232:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147712.066975:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.066997:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793565952 00000100:00100000:0.0:1746147712.067000:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793565952 00000100:00100000:0.0:1746147712.067034:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11802 00000100:00100000:0.0:1746147712.067040:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:31741:x1830967793565952:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147712.067053:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147712.067064:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7400/0xe64d3fbf12a7b516 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa43c expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.067298:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6400/0xe64d3fbf12a7b51d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067310:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6400/0xe64d3fbf12a7b51d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067321:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6400/0xe64d3fbf12a7b51d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067333:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7e00/0xe64d3fbf12a7b524 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067341:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7e00/0xe64d3fbf12a7b524 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067345:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7e00/0xe64d3fbf12a7b524 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067447:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6a00/0xe64d3fbf12a7b52b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067455:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6a00/0xe64d3fbf12a7b52b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067461:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6a00/0xe64d3fbf12a7b52b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147712.067470:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147712.067744:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6a00/0xe64d3fbf12a7b52b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067752:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6a00/0xe64d3fbf12a7b52b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067758:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6a00/0xe64d3fbf12a7b52b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067764:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcc6a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147712.067767:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6a00/0xe64d3fbf12a7b52b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067772:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6a00/0xe64d3fbf12a7b52b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067782:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147712.067786:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147712.067790:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6a00/0xe64d3fbf12a7b52b lrc: 2/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067795:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6a00/0xe64d3fbf12a7b52b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067820:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6400/0xe64d3fbf12a7b51d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067826:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6400/0xe64d3fbf12a7b51d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067830:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6400/0xe64d3fbf12a7b51d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067834:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcc6400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147712.067845:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6400/0xe64d3fbf12a7b51d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067850:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6400/0xe64d3fbf12a7b51d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067857:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147712.067860:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147712.067862:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6400/0xe64d3fbf12a7b51d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067866:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6400/0xe64d3fbf12a7b51d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067873:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7e00/0xe64d3fbf12a7b524 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067878:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7e00/0xe64d3fbf12a7b524 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067900:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7e00/0xe64d3fbf12a7b524 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067904:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcc7e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147712.067906:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7e00/0xe64d3fbf12a7b524 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067911:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7e00/0xe64d3fbf12a7b524 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.067917:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06ee200) 00010000:00010000:0.0:1746147712.067920:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147712.067921:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7e00/0xe64d3fbf12a7b524 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.068970:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7e00/0xe64d3fbf12a7b524 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.069018:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7400/0xe64d3fbf12a7b516 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa43c expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.069025:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7400/0xe64d3fbf12a7b516 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa43c expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.069033:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcc7400, rc 0) 00000100:00100000:0.0:1746147712.069095:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:31741:x1830967793565952:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2053us (2118us total) trans 8589945751 rc 301/301 00000100:00100000:0.0:1746147712.069104:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11802 00000100:00100000:0.0:1746147712.071531:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.071575:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.091091:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.096387:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.105115:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.105373:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6838 00000100:00100000:0.0:1746147712.105386:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793567232:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147712.120530:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793567232:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15133us (16659us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147712.120542:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6838 00002000:00100000:0.0:1746147712.120555:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a0437100 x1830967793567232/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:333/0 lens 488/440 e 0 to 0 dl 1746147723 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147712.120564:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0437100 with x1830967793567232 ext(3145728->4194303) 00002000:00010000:0.0:1746147712.120570:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0437100 00000100:00100000:0.0:1746147712.138715:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.154548:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.154662:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.157685:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.161455:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.161497:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793568256 00000100:00100000:0.0:1746147712.161505:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793568256 00010000:00010000:0.0:1746147712.161537:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801362a1e00/0xe64d3fbf12a7b4f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa420 expref: 27 pid: 8469 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746147712.161565:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7871 00000100:00100000:0.0:1746147712.161573:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967793568256:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147712.161586:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147712.161608:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801362a1e00/0xe64d3fbf12a7b4f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa420 expref: 27 pid: 8469 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746147712.161620:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801362a1e00/0xe64d3fbf12a7b4f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa420 expref: 27 pid: 8469 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746147712.161644:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801362a1e00/0xe64d3fbf12a7b4f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa420 expref: 27 pid: 8469 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746147712.161664:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147712.161666:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147712.161673:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009361cc00/0xe64d3fbf12a7b547 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2404352->3145727] (req 2404352->3051519) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa458 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.161681:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009361cc00/0xe64d3fbf12a7b547 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2404352->3145727] (req 2404352->3051519) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa458 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.161728:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009361cc00/0xe64d3fbf12a7b547 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2404352->3145727] (req 2404352->3051519) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa458 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147712.161741:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796303872:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147712.161810:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a917780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147712.168548:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796303872:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147712.168570:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147712.168614:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967793568256:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7041us (7167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147712.168623:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7871 00000100:00100000:0.0:1746147712.183265:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793569280 00000100:00100000:0.0:1746147712.183277:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793569280 00000100:00100000:0.0:1746147712.183333:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11803 00000100:00100000:0.0:1746147712.183341:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:31746:x1830967793569280:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147712.183366:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147712.183386:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6a00/0xe64d3fbf12a7b54e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa45f expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.183486:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7600/0xe64d3fbf12a7b555 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.183499:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7600/0xe64d3fbf12a7b555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.183509:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7600/0xe64d3fbf12a7b555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.183521:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7b55c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.183526:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7b55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.183531:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7b55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.183630:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38d000/0xe64d3fbf12a7b563 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.183636:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38d000/0xe64d3fbf12a7b563 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.183641:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38d000/0xe64d3fbf12a7b563 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147712.183649:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147712.183721:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38d000/0xe64d3fbf12a7b563 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.183727:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38d000/0xe64d3fbf12a7b563 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.183733:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38d000/0xe64d3fbf12a7b563 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.183739:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e38d000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147712.183742:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38d000/0xe64d3fbf12a7b563 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.183748:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38d000/0xe64d3fbf12a7b563 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.183758:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147712.183761:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147712.183765:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38d000/0xe64d3fbf12a7b563 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.183831:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38d000/0xe64d3fbf12a7b563 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.184349:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7600/0xe64d3fbf12a7b555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.184355:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7600/0xe64d3fbf12a7b555 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.184360:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7600/0xe64d3fbf12a7b555 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.184368:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcc7600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147712.184371:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7600/0xe64d3fbf12a7b555 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.184375:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7600/0xe64d3fbf12a7b555 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.184384:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147712.184386:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147712.184388:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7600/0xe64d3fbf12a7b555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.184392:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7600/0xe64d3fbf12a7b555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.184400:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7b55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.184405:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7b55c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.184408:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7b55c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.184412:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcc7a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147712.184414:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7b55c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.184419:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7b55c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.184424:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06ee500) 00010000:00010000:0.0:1746147712.184426:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147712.184428:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7b55c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.184432:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7b55c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.185571:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6a00/0xe64d3fbf12a7b54e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa45f expref: 326 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.185581:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc6a00/0xe64d3fbf12a7b54e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa45f expref: 326 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.185592:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcc6a00, rc 0) 00000100:00100000:0.0:1746147712.185652:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:31746:x1830967793569280:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2311us (2418us total) trans 8589945753 rc 301/301 00000100:00100000:0.0:1746147712.185661:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11803 00000100:00100000:0.0:1746147712.185795:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793569024 00000100:00100000:0.0:1746147712.185802:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793569024 00000100:00100000:0.0:1746147712.185831:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4858 00000100:00100000:0.0:1746147712.185849:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:31741:x1830967793569024:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:0.0:1746147712.186002:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:31741:x1830967793569024:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 165us (2829us total) trans 8589945754 rc 0/0 00000100:00100000:0.0:1746147712.186008:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4858 00000100:00100000:0.0:1746147712.300009:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.358382:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793570176 00000100:00100000:0.0:1746147712.358394:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793570176 00000100:00100000:0.0:1746147712.358443:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11805 00000100:00100000:0.0:1746147712.358452:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:31753:x1830967793570176:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147712.358484:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147712.358503:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7b59b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa474 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.358601:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7b5a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358614:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7b5a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358625:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7b5a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358636:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170c200/0xe64d3fbf12a7b5a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358641:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009170c200/0xe64d3fbf12a7b5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358646:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009170c200/0xe64d3fbf12a7b5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358732:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170da00/0xe64d3fbf12a7b5b0 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358739:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009170da00/0xe64d3fbf12a7b5b0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358743:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009170da00/0xe64d3fbf12a7b5b0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147712.358751:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147712.358813:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170da00/0xe64d3fbf12a7b5b0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358823:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009170da00/0xe64d3fbf12a7b5b0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358828:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009170da00/0xe64d3fbf12a7b5b0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358844:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009170da00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147712.358848:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009170da00/0xe64d3fbf12a7b5b0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358853:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009170da00/0xe64d3fbf12a7b5b0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358863:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147712.358865:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147712.358869:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009170da00/0xe64d3fbf12a7b5b0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358874:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009170da00/0xe64d3fbf12a7b5b0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358902:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7b5a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358906:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7b5a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358910:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7b5a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358914:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc2b600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147712.358916:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7b5a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358923:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7b5a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358928:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147712.358930:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147712.358931:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7b5a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358935:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7b5a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358940:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170c200/0xe64d3fbf12a7b5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358943:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009170c200/0xe64d3fbf12a7b5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358947:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009170c200/0xe64d3fbf12a7b5a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358950:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009170c200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147712.358951:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009170c200/0xe64d3fbf12a7b5a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358956:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009170c200/0xe64d3fbf12a7b5a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358960:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06ee300) 00010000:00010000:0.0:1746147712.358961:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147712.358963:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009170c200/0xe64d3fbf12a7b5a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.358966:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009170c200/0xe64d3fbf12a7b5a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.359000:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7b59b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa474 expref: 327 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.359007:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7b59b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa474 expref: 327 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.359016:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc2a200, rc 0) 00000100:00100000:0.0:1746147712.359067:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:31753:x1830967793570176:12345-192.168.202.10@tcp:101:cat.0 Request processed in 616us (1146us total) trans 8589945756 rc 301/301 00000100:00100000:0.0:1746147712.359073:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11805 00000100:00100000:0.0:1746147712.360955:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.361035:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793570432 00000100:00100000:0.0:1746147712.361042:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793570432 00000100:00100000:0.0:1746147712.361076:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4859 00000100:00100000:0.0:1746147712.361083:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c26f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:31753:x1830967793570432:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:0.0:1746147712.361246:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c26f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:31753:x1830967793570432:12345-192.168.202.10@tcp:35:cat.0 Request processed in 163us (293us total) trans 8589945757 rc 0/0 00000100:00100000:0.0:1746147712.361252:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4859 00000100:00100000:0.0:1746147712.363129:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793570560 00000100:00100000:0.0:1746147712.363138:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793570560 00000100:00100000:0.0:1746147712.363204:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11806 00000100:00100000:0.0:1746147712.363286:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:31753:x1830967793570560:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147712.363307:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147712.363326:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009170d400/0xe64d3fbf12a7b5be lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa47b expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.363410:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ce00/0xe64d3fbf12a7b5c5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.363440:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ce00/0xe64d3fbf12a7b5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.363450:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ce00/0xe64d3fbf12a7b5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147712.363547:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:0.0:1746147712.363552:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147712.363734:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ce00/0xe64d3fbf12a7b5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147712.363756:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009170d400/0xe64d3fbf12a7b5be lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa47b expref: 329 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.363770:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ce00/0xe64d3fbf12a7b5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa47b expref: 328 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.363968:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147712.363971:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147712.364234:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009170ce00, rc 0) 00000100:00100000:0.0:1746147712.364463:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:31753:x1830967793570560:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1250us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147712.364470:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11806 00000100:00100000:0.0:1746147712.385569:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793571712 00000100:00100000:0.0:1746147712.385574:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793571712 00002000:00100000:0.0:1746147712.385592:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009fc13800 x1830967793571712/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:333/0 lens 488/0 e 0 to 0 dl 1746147723 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147712.385605:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13800 with x1830967793571712 ext(1048576->2097151) 00002000:00010000:0.0:1746147712.385609:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc13800 00000100:00100000:0.0:1746147712.385625:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6845 00000100:00100000:0.0:1746147712.385631:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1958:x1830967793571456:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147712.405008:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793572224 00000100:00100000:0.0:1746147712.405014:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793572224 00010000:00010000:0.0:1746147712.405042:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801362a1200/0xe64d3fbf12a7b540 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa451 expref: 25 pid: 22183 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746147712.405072:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7872 00000100:00100000:0.0:1746147712.405078:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967793572224:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147712.405090:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147712.405108:0:20557:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5773 -> 5777 00010000:00010000:0.0:1746147712.405114:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801362a1200/0xe64d3fbf12a7b540 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa451 expref: 25 pid: 22183 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746147712.405125:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801362a1200/0xe64d3fbf12a7b540 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa451 expref: 25 pid: 22183 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746147712.405152:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801362a1200/0xe64d3fbf12a7b540 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa451 expref: 25 pid: 22183 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746147712.405203:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147712.405261:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967793572224:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 182us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147712.405270:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7872 00000100:00100000:0.0:1746147712.405571:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.405604:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.405844:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7874 00000100:00100000:0.0:1746147712.405850:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793572480:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147712.405858:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147712.405871:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009361cc00/0xe64d3fbf12a7b547 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2404352->3145727] (req 2404352->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa458 expref: 11 pid: 8469 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746147712.405880:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009361cc00/0xe64d3fbf12a7b547 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2404352->3145727] (req 2404352->3051519) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa458 expref: 11 pid: 8469 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746147712.405915:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009361cc00/0xe64d3fbf12a7b547 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2404352->3145727] (req 2404352->3051519) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa458 expref: 11 pid: 8469 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746147712.405924:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147712.405926:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147712.405933:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801362a0c00/0xe64d3fbf12a7b5cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa482 expref: 10 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.405941:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801362a0c00/0xe64d3fbf12a7b5cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa482 expref: 10 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.405970:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801362a0c00/0xe64d3fbf12a7b5cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa482 expref: 10 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147712.405987:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796304384:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147712.406292:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147712.417030:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.419922:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.423382:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.435242:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.437724:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.442199:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.443361:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.445857:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.446102:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.446618:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.446703:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.447173:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7878 00000100:00100000:0.0:1746147712.447181:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967793574144:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147712.447188:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147712.447198:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801362a0c00/0xe64d3fbf12a7b5cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa482 expref: 11 pid: 22183 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746147712.447206:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801362a0c00/0xe64d3fbf12a7b5cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa482 expref: 11 pid: 22183 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746147712.447222:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801362a0c00/0xe64d3fbf12a7b5cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa482 expref: 11 pid: 22183 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746147712.447242:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147712.447243:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147712.447247:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7b604 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa49e expref: 15 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.447253:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7b604 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa49e expref: 15 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.447271:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7b604 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa49e expref: 15 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147712.447278:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796305408:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147712.447915:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147712.448198:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.452506:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.457364:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.462316:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.462355:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.462380:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793575552 00000100:00100000:0.0:1746147712.462388:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793575552 00000100:00100000:0.0:1746147712.462444:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4861 00000100:00100000:0.0:1746147712.462450:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:31746:x1830967793575552:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:0.0:1746147712.462757:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:31746:x1830967793575552:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 307us (452us total) trans 8589945760 rc 0/0 00000100:00100000:0.0:1746147712.462763:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4861 00000100:00100000:0.0:1746147712.462801:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.465620:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.479241:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.484363:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.484578:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.503444:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.507818:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.508085:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.508950:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:0.0:1746147712.511036:0:22183:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime: 1746147710 -> 1746147713 00002000:00010000:0.0:1746147712.511043:0:22183:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime: 1746147708 -> 1746147713 00002000:00010000:0.0:1746147712.511045:0:22183:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime: 1746147710 -> 1746147713 00000100:00100000:0.0:1746147712.511066:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796305792:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147712.511098:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d87e00/0xe64d3fbf12a7b627 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa4c1 expref: 17 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147712.511111:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d87e00/0xe64d3fbf12a7b627 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa4c1 expref: 17 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147712.511655:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d87e00, rc 0) 00000100:00100000:0.0:1746147712.511736:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+16:1958:x1830967793577344:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3743us (3929us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147712.511744:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15561 00000100:00100000:0.0:1746147712.525566:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.526236:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967793577984:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8309us (9263us total) trans 0 rc 823296/823296 00000100:00100000:0.0:1746147712.526244:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6857 00002000:00100000:0.0:1746147712.526251:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88012ee59180 x1830967793577984/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:333/0 lens 488/440 e 0 to 0 dl 1746147723 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147712.526259:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee59180 with x1830967793577984 ext(4194304->5017599) 00002000:00010000:0.0:1746147712.526262:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee59180 00000100:00100000:0.0:1746147712.527817:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.537863:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.540621:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.540652:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.540685:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.548694:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.599808:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.607778:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.636525:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147712.636746:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147712.639144:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.649608:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.655547:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.674674:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796306304:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147712.674698:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147712.674719:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1959:x1830967793581312:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3580us (3749us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147712.674726:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7880 00000100:00100000:0.0:1746147712.675099:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793582208 00000100:00100000:0.0:1746147712.675102:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793582208 00000100:00100000:0.0:1746147712.675123:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 867 00000100:00100000:0.0:1746147712.675127:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+332:1958:x1830967793582208:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147712.675137:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147712.675153:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7e00/0xe64d3fbf12a7b6eb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa51c expref: 332 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.675167:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147712.675171:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147712.675185:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+331:1958:x1830967793582208:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 58us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147712.675189:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 867 00000100:00100000:0.0:1746147712.686072:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15573 00000100:00100000:0.0:1746147712.686080:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967793582976:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147712.686086:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147712.686093:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0476a00/0xe64d3fbf12a7b707 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa531 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.686112:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0476a00/0xe64d3fbf12a7b707 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa531 expref: 20 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147712.686121:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0476a00/0xe64d3fbf12a7b707 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa531 expref: 20 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147712.686131:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0476a00, rc 0) 00000100:00100000:0.0:1746147712.686148:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967793582976:12345-192.168.202.10@tcp:101:cat.0 Request processed in 70us (478us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147712.686152:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15573 00000100:00100000:0.0:1746147712.700435:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793583488 00000100:00100000:0.0:1746147712.700445:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793583488 00002000:00100000:0.0:1746147712.700499:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88012ee5a680 x1830967793583488/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:333/0 lens 488/0 e 0 to 0 dl 1746147723 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147712.700509:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee5a680 with x1830967793583488 ext(2097152->3145727) 00002000:00010000:0.0:1746147712.700515:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee5a680 00000100:00100000:0.0:1746147712.700549:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6862 00000100:00100000:0.0:1746147712.700557:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1957:x1830967793583488:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147712.706565:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796306560:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147712.706595:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6600/0xe64d3fbf12a7b70e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa538 expref: 18 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.706613:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00f6600, rc 0) 00000100:00100000:0.0:1746147712.706668:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:31770:x1830967793583616:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5336us (6230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147712.706677:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15574 00000100:00100000:0.0:1746147712.729724:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.729856:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.740378:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.740447:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.751032:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147712.753020:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147712.756377:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.756453:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.759793:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.759857:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.763129:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.763169:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.772052:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.776078:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.776174:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.791581:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793586176:12345-192.168.202.10@tcp:4:cat.0 Request processed in 15154us (15499us total) trans 17179874162 rc 0/0 00000100:00100000:0.0:1746147712.791594:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1349 00002000:00100000:0.0:1746147712.791605:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (2162688->3055615) req@ffff8800a213aa00 x1830967793586176/t17179874162(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:333/0 lens 488/448 e 0 to 0 dl 1746147723 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147712.791614:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a213aa00 with x1830967793586176 ext(2162688->3055615) 00010000:00010000:0.0:1746147712.791624:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bd10e00/0xe64d3fbf12a7b71c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2162688->3055615) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa546 expref: 25 pid: 22183 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746147712.791641:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bd10e00/0xe64d3fbf12a7b71c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2162688->3055615) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa546 expref: 25 pid: 22183 timeout: 891 lvb_type: 0 00002000:00010000:0.0:1746147712.791648:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a213aa00 00000100:00100000:0.0:1746147712.794293:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.801399:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.801439:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.822553:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.825107:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793587328 00000100:00100000:0.0:1746147712.825111:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793587328 00000100:00100000:0.0:1746147712.825142:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15580 00000100:00100000:0.0:1746147712.825149:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967793587328:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147712.825159:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147712.825171:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915e6a00/0xe64d3fbf12a7b738 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa562 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147712.825186:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147712.825188:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147712.825194:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915e6a00/0xe64d3fbf12a7b738 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa562 expref: 15 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147712.825204:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915e6a00/0xe64d3fbf12a7b738 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa562 expref: 15 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147712.825210:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915e6a00, rc 0) 00000100:00100000:0.0:1746147712.825241:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1958:x1830967793587328:12345-192.168.202.10@tcp:101:cat.0 Request processed in 93us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147712.825245:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15580 00000100:00100000:0.0:1746147712.828014:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.829967:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.854280:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.857476:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.905866:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.909520:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.911027:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.929290:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.933666:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.943434:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793589760 00000100:00100000:0.0:1746147712.943438:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793589760 00010000:00010000:0.0:1746147712.943461:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800950ede00/0xe64d3fbf12a7b3cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa37f expref: 7 pid: 20619 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746147712.943484:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793590016 00000100:00100000:0.0:1746147712.943486:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793590016 00010000:00010000:0.0:1746147712.943493:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800950ec800/0xe64d3fbf12a7b3aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa36a expref: 10 pid: 20619 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746147712.943502:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793589888 00000100:00100000:0.0:1746147712.943504:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793589888 00010000:00010000:0.0:1746147712.943511:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801354c8a00/0xe64d3fbf12a7b46e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa3c5 expref: 26 pid: 8468 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746147712.943525:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7888 00000100:00100000:0.0:1746147712.943530:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967793589760:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147712.943536:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147712.943552:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800950ede00/0xe64d3fbf12a7b3cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa37f expref: 7 pid: 20619 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746147712.943560:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800950ede00/0xe64d3fbf12a7b3cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa37f expref: 7 pid: 20619 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746147712.943575:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800950ede00/0xe64d3fbf12a7b3cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa37f expref: 7 pid: 20619 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746147712.943588:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147712.944341:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967793589760:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 809us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147712.944347:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7888 00000100:00080000:0.0:1746147712.944366:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147712.949741:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.949774:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.949799:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.952013:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.954184:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.958432:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.966423:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.969994:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793591680 00000100:00100000:0.0:1746147712.970002:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793591680 00010000:00010000:0.0:1746147712.970032:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd10c00/0xe64d3fbf12a7b723 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa54d expref: 24 pid: 22183 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746147712.970063:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7894 00000100:00100000:0.0:1746147712.970069:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967793591680:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147712.970080:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147712.970576:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd10c00/0xe64d3fbf12a7b723 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa54d expref: 24 pid: 22183 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746147712.970585:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd10c00/0xe64d3fbf12a7b723 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa54d expref: 24 pid: 22183 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746147712.970603:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd10c00/0xe64d3fbf12a7b723 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa54d expref: 24 pid: 22183 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746147712.970717:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147712.970823:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967793591680:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 753us (1870us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147712.970842:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7894 00000100:00100000:0.0:1746147712.971467:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.979250:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.985461:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.990780:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.990823:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.990872:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.990916:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793592576 00000100:00100000:0.0:1746147712.990923:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793592576 00000100:00100000:0.0:1746147712.990954:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793592704 00000100:00100000:0.0:1746147712.990956:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793592704 00000100:00100000:0.0:1746147712.990982:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15584 00000100:00100000:0.0:1746147712.990990:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1960:x1830967793592576:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147712.991004:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147712.991018:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a21df000/0xe64d3fbf12a7b7af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa593 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147712.991061:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b10a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796309504:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147712.991233:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93903c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147712.993251:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.995979:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.997764:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.998474:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147712.999183:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.007400:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147713.008214:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147713.015436:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967793593856:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15787us (16251us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147713.015444:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6876 00002000:00100000:0.0:1746147713.015452:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009b108a80 x1830967793593856/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:333/0 lens 488/440 e 0 to 0 dl 1746147723 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147713.015460:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b108a80 with x1830967793593856 ext(1048576->2097151) 00002000:00010000:0.0:1746147713.015465:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b108a80 00000100:00100000:0.0:1746147713.034048:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.037782:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.046446:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.046485:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.046800:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.076226:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.081211:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.085823:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.106498:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.107016:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.107056:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.114268:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.117430:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.127090:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1958:x1830967793596160:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19873us (20063us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147713.127101:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6880 00002000:00100000:0.0:1746147713.127110:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (2338816->3387391) req@ffff8800949d7800 x1830967793596160/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:334/0 lens 488/440 e 0 to 0 dl 1746147724 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147713.127119:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d7800 with x1830967793596160 ext(2338816->3387391) 00010000:00010000:0.0:1746147713.127127:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6581800/0xe64d3fbf12a7b785 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa585 expref: 28 pid: 9615 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746147713.127140:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6581800/0xe64d3fbf12a7b785 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa585 expref: 28 pid: 9615 timeout: 892 lvb_type: 0 00002000:00010000:0.0:1746147713.127147:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949d7800 00000100:00100000:0.0:1746147713.130063:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.130137:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.135377:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.142420:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.142455:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.142490:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.189362:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.189414:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.197725:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.216131:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.216176:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.224858:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793599488 00000100:00100000:0.0:1746147713.224866:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793599488 00000100:00100000:0.0:1746147713.224936:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 870 00000100:00100000:0.0:1746147713.224943:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967793599488:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147713.224955:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147713.224977:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801354c8e00/0xe64d3fbf12a7b849 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5e0 expref: 27 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.224998:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147713.225003:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147713.225039:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967793599488:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147713.225045:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 870 00000100:00100000:0.0:1746147713.242379:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147713.242996:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147713.251671:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.251704:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.251746:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.251776:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793600000 00000100:00100000:0.0:1746147713.251780:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793600000 00000100:00100000:0.0:1746147713.251801:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15594 00000100:00100000:0.0:1746147713.251807:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:31791:x1830967793600000:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147713.251820:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147713.251843:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a051b400/0xe64d3fbf12a7b85e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa5ee expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.251864:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800949c0600/0xe64d3fbf12a7b7fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5c4 expref: 11 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.251871:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800949c1a00/0xe64d3fbf12a7b826 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5d2 expref: 27 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.251876:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147713.251877:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147713.251881:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a051b400/0xe64d3fbf12a7b85e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2760704->3145727] (req 2760704->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5ee expref: 11 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.251926:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800949c1a00/0xe64d3fbf12a7b826 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5d2 expref: 27 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.251934:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800949c1a00/0xe64d3fbf12a7b826 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5d2 expref: 27 pid: 22183 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746147713.251944:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796311040:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147713.251994:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800949c0600/0xe64d3fbf12a7b7fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5c4 expref: 11 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.252001:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800949c0600/0xe64d3fbf12a7b7fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5c4 expref: 11 pid: 22183 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746147713.252009:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796311168:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147713.252024:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93903c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147713.253341:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796311040:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147713.254875:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796311168:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147713.254928:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a051b400/0xe64d3fbf12a7b85e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2760704->3145727] (req 2760704->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5ee expref: 11 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.254940:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a051b400, rc 0) 00000100:00100000:0.0:1746147713.254988:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:31791:x1830967793600000:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3180us (3240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147713.254994:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15594 00000100:00100000:0.0:1746147713.256415:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.260406:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.260454:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.265629:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.265667:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.265684:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793600896 00000100:00100000:0.0:1746147713.265687:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793600896 00000100:00100000:0.0:1746147713.265728:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15595 00000100:00100000:0.0:1746147713.265734:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:31789:x1830967793600896:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147713.265747:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147713.265762:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a051a200/0xe64d3fbf12a7b865 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa5f5 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.265784:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800950ecc00/0xe64d3fbf12a7b3b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa363 expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147713.265792:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136ab5e00/0xe64d3fbf12a7b460 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa3be expref: 20 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147713.265798:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800950ed400/0xe64d3fbf12a7b3c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa378 expref: 6 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147713.265803:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147713.265804:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147713.265808:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a051a200/0xe64d3fbf12a7b865 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1048576->1265663] (req 1048576->1265663) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5f5 expref: 20 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.265837:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800950ed400/0xe64d3fbf12a7b3c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa378 expref: 6 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147713.265852:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800950ed400/0xe64d3fbf12a7b3c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa378 expref: 6 pid: 20619 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746147713.265861:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796311552:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147713.265932:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136ab5e00/0xe64d3fbf12a7b460 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa3be expref: 20 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147713.265940:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136ab5e00/0xe64d3fbf12a7b460 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa3be expref: 20 pid: 10613 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746147713.265946:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796311680:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147713.265963:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800950ecc00/0xe64d3fbf12a7b3b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa363 expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147713.265969:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800950ecc00/0xe64d3fbf12a7b3b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa363 expref: 13 pid: 20619 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746147713.265975:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796311808:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147713.265986:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93903c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147713.272319:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.272362:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.275394:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.275442:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.276313:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793601664 00000100:00100000:0.0:1746147713.276317:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793601664 00010000:00010000:0.0:1746147713.276328:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4800/0xe64d3fbf12a7b715 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa53f expref: 15 pid: 22183 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746147713.276347:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7907 00000100:00100000:0.0:1746147713.276354:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6672c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967793601664:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147713.276360:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147713.276367:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4800/0xe64d3fbf12a7b715 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa53f expref: 15 pid: 22183 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746147713.276375:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4800/0xe64d3fbf12a7b715 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa53f expref: 15 pid: 22183 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746147713.276388:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d4800/0xe64d3fbf12a7b715 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa53f expref: 15 pid: 22183 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746147713.276405:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147713.276407:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147713.276411:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7b86c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2224127) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5fc expref: 14 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.276417:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7b86c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2224127) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5fc expref: 14 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147713.280258:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.280437:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6889 00000100:00100000:0.0:1746147713.280548:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1960:x1830967793601920:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147713.280712:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1960:x1830967793601920:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 270us (865us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147713.280718:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6889 00002000:00100000:0.0:1746147713.280723:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1261568->1265663) req@ffff880094338e00 x1830967793601920/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:334/0 lens 488/4536 e 0 to 0 dl 1746147724 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147713.280728:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094338e00 with x1830967793601920 ext(1261568->1265663) 00002000:00010000:0.0:1746147713.280731:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094338e00 00000100:00100000:0.0:1746147713.282836:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.372509:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.375987:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.379023:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147713.379992:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7b888 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.379998:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7b888 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746147713.380031:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:0.0:1746147713.380035:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147713.380048:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7b888 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380056:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7b888 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380063:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7b87a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380068:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7b87a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380076:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7b87a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380080:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a029a200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147713.380084:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7b87a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380090:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7b87a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380097:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147713.380099:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147713.380102:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7b87a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380106:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7b87a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380118:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b000/0xe64d3fbf12a7b881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380123:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b000/0xe64d3fbf12a7b881 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380128:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b000/0xe64d3fbf12a7b881 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380132:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a029b000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147713.380134:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b000/0xe64d3fbf12a7b881 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380139:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b000/0xe64d3fbf12a7b881 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380147:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091544d00) 00010000:00010000:0.0:1746147713.380149:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147713.380152:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b000/0xe64d3fbf12a7b881 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380156:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b000/0xe64d3fbf12a7b881 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.380186:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029bc00/0xe64d3fbf12a7b873 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa603 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.380197:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7b888 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa603 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.380202:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147713.380204:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147713.380206:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a029b600, rc 0) 00000100:00100000:0.0:1746147713.380245:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+9:31797:x1830967793602560:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 7566us (7743us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147713.380251:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11818 00000100:00100000:0.0:1746147713.383715:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.383741:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.383763:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.383775:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.383788:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.383809:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.383857:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793603200 00000100:00100000:0.0:1746147713.383864:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793603200 00000100:00100000:0.0:1746147713.383909:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793603712 00000100:00100000:0.0:1746147713.383911:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793603712 00000100:00100000:0.0:1746147713.383920:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793603072 00000100:00100000:0.0:1746147713.383921:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793603072 00000100:00100000:0.0:1746147713.383928:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793603328 00000100:00100000:0.0:1746147713.383930:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793603328 00000100:00100000:0.0:1746147713.383936:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793603584 00000100:00100000:0.0:1746147713.383937:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793603584 00000100:00100000:0.0:1746147713.383948:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15597 00000100:00100000:0.0:1746147713.383954:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793603200:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147713.383968:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147713.383982:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915fca00/0xe64d3fbf12a7b88f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa611 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147713.384022:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796312576:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147713.384080:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147713.384095:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15599 00000100:00100000:0.0:1746147713.384104:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793603712:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147713.384109:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147713.384115:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094b2f600/0xe64d3fbf12a7b89d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa62d expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.384129:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094b2f600/0xe64d3fbf12a7b89d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa62d expref: 10 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147713.384137:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b2f600/0xe64d3fbf12a7b89d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa62d expref: 10 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147713.384150:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b2f600, rc 0) 00000100:00100000:0.0:1746147713.384164:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793603712:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 64us (400us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147713.384169:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15599 00000100:00100000:0.0:1746147713.384181:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15601 00000100:00100000:0.0:1746147713.384185:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793603328:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147713.384189:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147713.384194:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094b2e200/0xe64d3fbf12a7b8ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa618 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147713.384210:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796312704:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147713.384224:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390780 going to sleep for 11 seconds 00002000:00010000:0.0:1746147713.387367:0:8468:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime: 1746147712 -> 1746147714 00002000:00010000:0.0:1746147713.387370:0:8468:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime: 1746147708 -> 1746147714 00002000:00010000:0.0:1746147713.387372:0:8468:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime: 1746147712 -> 1746147714 00000100:00100000:0.0:1746147713.387382:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796312704:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147713.387396:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094b2e200/0xe64d3fbf12a7b8ab lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa618 expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147713.387409:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b2e200/0xe64d3fbf12a7b8ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa618 expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147713.387416:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b2e200, rc 0) 00000100:00100000:0.0:1746147713.387449:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793603328:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 3262us (3659us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147713.387456:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15601 00000100:00100000:0.0:1746147713.390258:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793603968 00000100:00100000:0.0:1746147713.390264:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793603968 00000100:00100000:0.0:1746147713.390311:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11819 00000100:00100000:0.0:1746147713.390318:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+9:31797:x1830967793603968:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147713.390332:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147713.390349:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915fc200/0xe64d3fbf12a7b8b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa634 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.390433:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915fde00/0xe64d3fbf12a7b8c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.390446:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7b888 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa603 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.390453:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915fde00/0xe64d3fbf12a7b8c0 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.390478:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7b888 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa603 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.390487:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7b888 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa603 expref: 10 pid: 14547 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746147713.390497:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796312960:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147713.390628:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147713.393315:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.397332:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.400669:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.404556:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.404603:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.405502:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.405539:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.406540:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15608 00000100:00100000:0.0:1746147713.406546:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793605120:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147713.406562:0:4591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800915fce00/0xe64d3fbf12a7b90d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.406572:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a051b400/0xe64d3fbf12a7b85e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2760704->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5ee expref: 9 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.406576:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147713.406577:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147713.406579:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800915fce00/0xe64d3fbf12a7b90d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.406594:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a051b400/0xe64d3fbf12a7b85e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2760704->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5ee expref: 9 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.406600:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a051b400/0xe64d3fbf12a7b85e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2760704->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5ee expref: 9 pid: 8184 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746147713.406608:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796314496:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147713.406627:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147713.407220:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.407239:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793605376 00000100:00100000:0.0:1746147713.407242:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793605376 00010000:00010000:0.0:1746147713.407258:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7b82d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5d9 expref: 10 pid: 8184 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746147713.407283:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7910 00000100:00100000:0.0:1746147713.407287:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1958:x1830967793605376:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147713.407294:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147713.407310:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7b82d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5d9 expref: 10 pid: 8184 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746147713.407318:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7b82d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5d9 expref: 10 pid: 8184 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746147713.407333:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147713.407352:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1958:x1830967793605376:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 64us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147713.407356:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7910 00000100:00100000:0.0:1746147713.409068:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.409871:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.409908:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.409923:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793605760 00000100:00100000:0.0:1746147713.409927:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793605760 00002000:00100000:0.0:1746147713.409943:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->2224127) req@ffff8800941b3480 x1830967793605760/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:334/0 lens 488/0 e 0 to 0 dl 1746147724 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147713.409949:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b3480 with x1830967793605760 ext(2097152->2224127) 00010000:00010000:0.0:1746147713.409955:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7b86c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2224127) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5fc expref: 13 pid: 8184 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746147713.409965:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7b86c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2224127) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5fc expref: 13 pid: 8184 timeout: 892 lvb_type: 0 00002000:00010000:0.0:1746147713.409971:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800941b3480 00000100:00100000:0.0:1746147713.409982:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793605888 00000100:00100000:0.0:1746147713.409984:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793605888 00002000:00100000:0.0:1746147713.409993:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1265663) req@ffff88008fb74e00 x1830967793605888/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:334/0 lens 488/0 e 0 to 0 dl 1746147724 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147713.410000:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb74e00 with x1830967793605888 ext(1048576->1265663) 00010000:00010000:0.0:1746147713.410004:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a051a200/0xe64d3fbf12a7b865 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5f5 expref: 19 pid: 8184 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746147713.410011:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a051a200/0xe64d3fbf12a7b865 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5f5 expref: 19 pid: 8184 timeout: 892 lvb_type: 0 00002000:00010000:0.0:1746147713.410015:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fb74e00 00000100:00100000:0.0:1746147713.410025:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1355 00000100:00100000:0.0:1746147713.410030:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967793605760:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:0.0:1746147713.410189:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796314496:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147713.410205:0:4591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800915fce00/0xe64d3fbf12a7b90d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147713.410634:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796313344:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147713.410642:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796313856:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147713.410663:0:9615:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a051a000/0xe64d3fbf12a7b8ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147713.413524:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.414603:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793606016 00000100:00100000:0.0:1746147713.414610:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793606016 00010000:00010000:0.0:1746147713.414913:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801354c9e00/0xe64d3fbf12a7b7f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5bd expref: 28 pid: 8184 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746147713.414927:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7913 00000100:00100000:0.0:1746147713.415136:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6673450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793605632:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147713.415143:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147713.415194:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801354c9600/0xe64d3fbf12a7b896 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa61f expref: 9 pid: 21480 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746147713.415202:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801354c9600/0xe64d3fbf12a7b896 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa61f expref: 9 pid: 21480 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746147713.415213:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801354c9600/0xe64d3fbf12a7b896 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa61f expref: 9 pid: 21480 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746147713.415223:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147713.415225:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147713.415227:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6581800/0xe64d3fbf12a7b8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.415233:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6581800/0xe64d3fbf12a7b8f8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.415245:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147713.415260:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6673450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793605632:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 329us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147713.415266:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7913 00010000:00010000:0.0:1746147713.416219:0:8468:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a6581800/0xe64d3fbf12a7b8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.416227:0:8468:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6581800/0xe64d3fbf12a7b8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.416241:0:8468:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a6581800/0xe64d3fbf12a7b8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.416247:0:8468:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6581800/0xe64d3fbf12a7b8f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.416253:0:8468:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a6581800/0xe64d3fbf12a7b8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.416258:0:8468:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6581800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147713.416260:0:8468:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6581800/0xe64d3fbf12a7b8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.416266:0:8468:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6581800/0xe64d3fbf12a7b8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.416277:0:8468:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a6581800/0xe64d3fbf12a7b8f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.416283:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6581800/0xe64d3fbf12a7b8f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147713.416328:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967793604992:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 10779us (10825us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147713.416334:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15605 00000100:00100000:0.0:1746147713.419725:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147713.420776:0:8470:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a57bc800/0xe64d3fbf12a7b906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.420784:0:8470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57bc800/0xe64d3fbf12a7b906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.420803:0:8470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a57bc800/0xe64d3fbf12a7b906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.420809:0:8470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57bc800/0xe64d3fbf12a7b906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.420815:0:8470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a57bc800/0xe64d3fbf12a7b906 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.420822:0:8470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57bc800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147713.420833:0:8470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a57bc800/0xe64d3fbf12a7b906 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.420839:0:8470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a57bc800/0xe64d3fbf12a7b906 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.420848:0:8470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a57bc800/0xe64d3fbf12a7b906 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.420853:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57bc800/0xe64d3fbf12a7b906 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147713.421822:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793604864:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 15420us (15587us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147713.421839:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15607 00010000:00010000:0.0:1746147713.422199:0:8184:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7b8ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.422207:0:8184:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7b8ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.422220:0:8184:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7b8ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.422226:0:8184:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7b8ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.422231:0:8184:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7b8ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.422236:0:8184:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a029b200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147713.422238:0:8184:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7b8ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.422244:0:8184:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7b8ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.422251:0:8184:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7b8ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147713.422256:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7b8ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147713.422286:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793605248:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 16476us (16745us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147713.422291:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15606 00000100:00100000:0.0:1746147713.424311:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967793606272:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 9587us (9665us total) trans 17179874166 rc 0/0 00000100:00100000:0.0:1746147713.424320:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1357 00002000:00100000:0.0:1746147713.424329:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (2760704->3145727) req@ffff8800a5e35c00 x1830967793606272/t17179874166(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:334/0 lens 488/448 e 0 to 0 dl 1746147724 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147713.424336:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e35c00 with x1830967793606272 ext(2760704->3145727) 00010000:00010000:0.0:1746147713.424344:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a051b400/0xe64d3fbf12a7b85e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2760704->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5ee expref: 10 pid: 8184 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746147713.424359:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a051b400/0xe64d3fbf12a7b85e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2760704->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5ee expref: 10 pid: 8184 timeout: 892 lvb_type: 0 00002000:00010000:0.0:1746147713.424365:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5e35c00 00000100:00100000:0.0:1746147713.427389:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.427683:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.430004:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.433762:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.433792:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.433805:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.433852:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.433870:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793607680 00000100:00100000:0.0:1746147713.433876:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793607680 00010000:00010000:0.0:1746147713.433922:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2e00/0xe64d3fbf12a7b7d2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5a1 expref: 340 pid: 17544 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746147713.434448:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7923 00000100:00100000:0.0:1746147713.434454:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+340:1960:x1830967793607680:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147713.434461:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147713.434465:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2e00/0xe64d3fbf12a7b7d2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5a1 expref: 339 pid: 17544 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746147713.434475:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2e00/0xe64d3fbf12a7b7d2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5a1 expref: 339 pid: 17544 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746147713.434486:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2e00/0xe64d3fbf12a7b7d2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa5a1 expref: 339 pid: 17544 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746147713.434499:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147713.434503:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800949c1600/0xe64d3fbf12a7b914 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147713.434508:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147713.434521:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+337:1960:x1830967793607680:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 68us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147713.434526:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7923 00000100:00100000:0.0:1746147713.466749:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796315392 00000100:00100000:0.0:1746147713.466755:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796315392 00000100:00100000:0.0:1746147713.466774:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796315904 00000100:00100000:0.0:1746147713.466776:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796315904 00000100:00100000:0.0:1746147713.466788:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15613 00000100:00100000:0.0:1746147713.466793:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3303:x1830967796315392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147713.466921:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796315392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (187us total) trans 17179874170 rc 0/0 00000100:00100000:0.0:1746147713.466927:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15613 00000100:00100000:0.0:1746147713.466940:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15615 00000100:00100000:0.0:1746147713.466944:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3303:x1830967796315520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147713.467022:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796315520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (226us total) trans 17179874172 rc 0/0 00000100:00100000:0.0:1746147713.467027:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15615 00000100:00100000:0.0:1746147713.468482:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15618 00000100:00100000:0.0:1746147713.468489:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3302:x1830967796316800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147713.468606:0:7050:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:0.0:1746147713.468610:0:7050:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147713.468612:0:7050:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147713.468614:0:7050:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147713.468616:0:7050:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:0.0:1746147713.468637:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3302:x1830967796316800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 148us (454us total) trans 21474841401 rc 0/0 00000100:00100000:0.0:1746147713.468643:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15618 00000100:00100000:0.0:1746147713.468653:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15621 00000100:00100000:0.0:1746147713.468657:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3302:x1830967796317184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147713.468693:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15622 00000100:00100000:0.0:1746147713.468698:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3304:x1830967796316544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147713.468777:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3304:x1830967796316544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (505us total) trans 21474841403 rc 0/0 00000100:00100000:0.0:1746147713.468783:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15622 00000100:00100000:0.0:1746147713.468792:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15624 00000100:00100000:0.0:1746147713.469756:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3304:x1830967796316416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147713.469879:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3304:x1830967796316416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1081us (1575us total) trans 21474841406 rc 0/0 00000100:00100000:0.0:1746147713.469904:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15624 00000100:00100000:0.0:1746147713.471146:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.473519:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.480190:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793608448 00000100:00100000:0.0:1746147713.480199:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793608448 00000100:00100000:0.0:1746147713.480233:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793608576 00000100:00100000:0.0:1746147713.480235:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793608576 00000100:00100000:0.0:1746147713.480263:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15626 00000100:00100000:0.0:1746147713.480271:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+5:1960:x1830967793608448:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147713.480286:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147713.480303:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b847a00/0xe64d3fbf12a7b930 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa657 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147713.480324:0:7050:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x68141982, atime: 0x68141977, ctime: 0x68141982, blocks: 0x79f 00010000:00010000:0.0:1746147713.480340:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147713.480343:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147713.480350:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b847a00/0xe64d3fbf12a7b930 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa657 expref: 6 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147713.480362:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b847a00/0xe64d3fbf12a7b930 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa657 expref: 6 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147713.480373:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b847a00, rc 0) 00000100:00100000:0.0:1746147713.480413:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967793608448:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 142us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147713.480418:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15626 00000100:00100000:0.0:1746147713.481183:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.481208:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.481238:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147713.679115:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.495360:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.501997:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6892 00000100:00100000:0.0:1746147714.502006:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967793609984:12345-192.168.202.10@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147714.502033:0:31356:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b846200/0xe64d3fbf12a7b961 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.502044:0:31356:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.502046:0:31356:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.502050:0:31356:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b846200/0xe64d3fbf12a7b961 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.502060:0:31356:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b846200/0xe64d3fbf12a7b961 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746147714.503582:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147714.508116:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.508135:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.508166:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.508185:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793610752 00000100:00100000:0.0:1746147714.508191:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793610752 00000100:00100000:0.0:1746147714.508226:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793611008 00000100:00100000:0.0:1746147714.508228:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793611008 00000100:00100000:0.0:1746147714.508249:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793611264 00000100:00100000:0.0:1746147714.508251:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793611264 00000100:00100000:0.0:1746147714.508265:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6896 00000100:00100000:0.0:1746147714.508271:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967793610752:12345-192.168.202.10@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147714.508297:0:21459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7b97d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.508309:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.508311:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.508315:0:21459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7b97d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.508326:0:21459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7b97d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.521443:0:8474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b95a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.521460:0:8474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b95a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.521468:0:8474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b95a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.521474:0:8474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a2b1000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147714.521478:0:8474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b95a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.521484:0:8474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b95a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.521500:0:8474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b95a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.521505:0:8474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b95a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147714.525599:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967793609472:12345-192.168.202.10@tcp:3:mirror_io.0 Request processed in 27266us (30236us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147714.525610:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6891 00000100:00100000:0.0:1746147714.568629:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147714.571304:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147714.573041:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.578307:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.613730:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147714.614867:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147714.615799:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793612416 00000100:00100000:0.0:1746147714.615804:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793612416 00000100:00100000:0.0:1746147714.616260:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11826 00000100:00100000:0.0:1746147714.616385:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:31810:x1830967793612416:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147714.616398:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147714.616410:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7b9b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa688 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.616468:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0e00/0xe64d3fbf12a7b9bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616476:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0e00/0xe64d3fbf12a7b9bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616483:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0e00/0xe64d3fbf12a7b9bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616492:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b9c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616498:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616503:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616565:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7b9ca lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616576:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7b9ca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616581:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7b9ca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746147714.616588:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147714.616640:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0e00/0xe64d3fbf12a7b9bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616644:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0e00/0xe64d3fbf12a7b9bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616648:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0e00/0xe64d3fbf12a7b9bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616652:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a2b0e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147714.616654:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0e00/0xe64d3fbf12a7b9bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616659:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0e00/0xe64d3fbf12a7b9bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616665:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147714.616667:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147714.616669:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0e00/0xe64d3fbf12a7b9bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616674:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0e00/0xe64d3fbf12a7b9bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616689:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616697:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b9c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616702:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b9c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616706:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a2b1000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147714.616708:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b9c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616713:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b9c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616718:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a024b100) 00010000:00010000:0.0:1746147714.616719:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147714.616721:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b9c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616727:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1000/0xe64d3fbf12a7b9c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.616754:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7b9b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa688 expref: 325 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.616763:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7b9ca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa688 expref: 324 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.616769:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147714.616771:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147714.616773:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931f9200, rc 0) 00000100:00100000:0.0:1746147714.616802:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:31810:x1830967793612416:12345-192.168.202.10@tcp:101:cat.0 Request processed in 536us (1668us total) trans 8589945790 rc 0/0 00000100:00100000:0.0:1746147714.616807:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11826 00000100:00100000:0.0:1746147714.618482:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.620415:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.628025:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.630108:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.630147:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.630168:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.630222:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.630236:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.630249:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.630261:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.630272:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.630285:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.630308:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.630368:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793613696 00000100:00100000:0.0:1746147714.630372:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793613696 00000100:00100000:0.0:1746147714.630385:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793613824 00000100:00100000:0.0:1746147714.630387:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793613824 00000100:00100000:0.0:1746147714.630394:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793613952 00000100:00100000:0.0:1746147714.630395:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793613952 00000100:00100000:0.0:1746147714.630659:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793614592 00000100:00100000:0.0:1746147714.630662:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793614592 00000100:00100000:0.0:1746147714.630673:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15633 00000100:00100000:0.0:1746147714.630678:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967793613696:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147714.630685:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147714.630695:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd8000/0xe64d3fbf12a7ba09 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa6b2 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.630710:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.630712:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.630716:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd8000/0xe64d3fbf12a7ba09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6b2 expref: 23 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147714.630725:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd8000/0xe64d3fbf12a7ba09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6b2 expref: 23 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147714.630733:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd8000, rc 0) 00000100:00100000:0.0:1746147714.630748:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967793613696:12345-192.168.202.10@tcp:101:cat.0 Request processed in 70us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147714.630753:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15633 00000100:00100000:0.0:1746147714.630845:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15637 00000100:00100000:0.0:1746147714.630850:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967793613568:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147714.630857:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147714.630862:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd9400/0xe64d3fbf12a7ba1e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa6ab expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.630871:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.630873:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.630876:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd9400/0xe64d3fbf12a7ba1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6ab expref: 16 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147714.630903:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd9400/0xe64d3fbf12a7ba1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6ab expref: 16 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147714.630914:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd9400, rc 0) 00000100:00100000:0.0:1746147714.630929:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967793613568:12345-192.168.202.10@tcp:101:cat.0 Request processed in 79us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147714.630938:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15637 00000100:00100000:0.0:1746147714.630947:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15638 00000100:00100000:0.0:1746147714.630952:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967793614336:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147714.630957:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147714.630961:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd8600/0xe64d3fbf12a7ba25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa6d5 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.630970:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.630971:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.630974:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd8600/0xe64d3fbf12a7ba25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6d5 expref: 16 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147714.630982:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd8600/0xe64d3fbf12a7ba25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6d5 expref: 16 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147714.630988:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd8600, rc 0) 00000100:00100000:0.0:1746147714.630999:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967793614336:12345-192.168.202.10@tcp:101:cat.0 Request processed in 47us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147714.631003:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15638 00000100:00100000:0.0:1746147714.631011:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15639 00000100:00100000:0.0:1746147714.631015:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967793613952:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147714.631022:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147714.631028:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7ba2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa6c0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.631036:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.631037:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.631040:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7ba2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6c0 expref: 28 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147714.631048:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7ba2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6c0 expref: 28 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147714.631054:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd9600, rc 0) 00000100:00100000:0.0:1746147714.631066:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1958:x1830967793613952:12345-192.168.202.10@tcp:101:cat.0 Request processed in 50us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147714.631070:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15639 00000100:00100000:0.0:1746147714.631078:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15640 00000100:00100000:0.0:1746147714.631083:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967793614464:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147714.631087:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147714.631091:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd9c00/0xe64d3fbf12a7ba33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa6dc expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.631098:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.631100:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.631103:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd9c00/0xe64d3fbf12a7ba33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6dc expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147714.631110:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd9c00/0xe64d3fbf12a7ba33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6dc expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147714.631116:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd9c00, rc 0) 00000100:00100000:0.0:1746147714.631124:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967793614464:12345-192.168.202.10@tcp:101:cat.0 Request processed in 41us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147714.631318:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15640 00000100:00100000:0.0:1746147714.631329:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15641 00000100:00100000:0.0:1746147714.631334:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967793614592:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147714.631340:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147714.631345:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092c24a00/0xe64d3fbf12a7ba3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa6e3 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.631354:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.631355:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.631359:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092c24a00/0xe64d3fbf12a7ba3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6e3 expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147714.631367:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092c24a00/0xe64d3fbf12a7ba3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6e3 expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147714.631373:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092c24a00, rc 0) 00000100:00100000:0.0:1746147714.631383:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967793614592:12345-192.168.202.10@tcp:101:cat.0 Request processed in 49us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147714.631388:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15641 00000100:00100000:0.0:1746147714.631397:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15643 00000100:00100000:0.0:1746147714.631401:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967793614080:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147714.631408:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147714.631413:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a732c000/0xe64d3fbf12a7ba48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa6c7 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.631421:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.631423:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.631426:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a732c000/0xe64d3fbf12a7ba48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6c7 expref: 28 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147714.631434:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a732c000/0xe64d3fbf12a7ba48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6c7 expref: 28 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147714.631441:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a732c000, rc 0) 00000100:00100000:0.0:1746147714.631450:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967793614080:12345-192.168.202.10@tcp:101:cat.0 Request processed in 49us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147714.631460:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15643 00000100:00100000:0.0:1746147714.632808:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.632847:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.632919:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.632947:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793615104 00000100:00100000:0.0:1746147714.632950:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793615104 00010000:00010000:0.0:1746147714.632963:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9251400/0xe64d3fbf12a7b929 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa650 expref: 10 pid: 14547 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746147714.632978:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7927 00000100:00100000:0.0:1746147714.632984:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6672450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:1960:x1830967793614848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147714.632991:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147714.632996:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7b9ca lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa688 expref: 327 pid: 14547 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746147714.633005:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7b9ca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa688 expref: 327 pid: 14547 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746147714.633015:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931f9200/0xe64d3fbf12a7b9ca lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa688 expref: 327 pid: 14547 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746147714.633297:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147714.633301:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7b9f4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.633308:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7b9f4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147714.633313:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147714.633330:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6672450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:1960:x1830967793614848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 346us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147714.633336:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7927 00000100:00100000:0.0:1746147714.636710:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.651761:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.657535:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.660182:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.662197:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.671758:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.671916:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.671953:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793616512 00000100:00100000:0.0:1746147714.671961:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793616512 00002000:00100000:0.0:1746147714.672002:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fc12680 x1830967793616512/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:335/0 lens 488/0 e 0 to 0 dl 1746147725 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147714.672012:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc12680 with x1830967793616512 ext(0->1048575) 00002000:00010000:0.0:1746147714.672017:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc12680 00000100:00100000:0.0:1746147714.672045:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793616768 00000100:00100000:0.0:1746147714.672047:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793616768 00002000:00100000:0.0:1746147714.672060:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800941b2680 x1830967793616768/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:335/0 lens 488/0 e 0 to 0 dl 1746147725 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147714.672067:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b2680 with x1830967793616768 ext(1048576->2097151) 00002000:00010000:0.0:1746147714.672070:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b2680 00000100:00100000:0.0:1746147714.672082:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6903 00000100:00100000:0.0:1746147714.672088:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967793616512:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147714.676078:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.678011:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.708530:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.712421:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.722926:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.722961:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.724115:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6910 00000100:00100000:0.0:1746147714.724123:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967793618304:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147714.740235:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.742140:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.742931:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.742948:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.742971:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793619072 00000100:00100000:0.0:1746147714.742974:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793619072 00002000:00100000:0.0:1746147714.742989:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800941b1500 x1830967793619072/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:335/0 lens 488/0 e 0 to 0 dl 1746147725 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147714.742995:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b1500 with x1830967793619072 ext(2097152->3145727) 00002000:00010000:0.0:1746147714.742998:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b1500 00000100:00100000:0.0:1746147714.743006:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793619328 00000100:00100000:0.0:1746147714.743008:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793619328 00002000:00100000:0.0:1746147714.743014:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800941b0700 x1830967793619328/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:335/0 lens 488/0 e 0 to 0 dl 1746147725 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147714.743020:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b0700 with x1830967793619328 ext(3145728->4194303) 00002000:00010000:0.0:1746147714.743022:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b0700 00000100:00100000:0.0:1746147714.743034:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6913 00000100:00100000:0.0:1746147714.743038:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967793619072:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147714.743458:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6914 00000100:00100000:0.0:1746147714.743473:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967793619328:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:0.0:1746147714.760398:0:7099:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147714.762574:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.782953:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.803662:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.808332:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793620352 00000100:00100000:0.0:1746147714.808339:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793620352 00000100:00100000:0.0:1746147714.808387:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11830 00000100:00100000:0.0:1746147714.808394:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:31804:x1830967793620352:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147714.808412:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147714.808415:0:17544:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147714.808435:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defa00/0xe64d3fbf12a7b9df lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa68f expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.808449:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147714.808453:0:17544:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147714.808461:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00fe600/0xe64d3fbf12a7ba5d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa6f8 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.808500:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00fe400/0xe64d3fbf12a7ba64 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147714.808509:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9251c00/0xe64d3fbf12a7b91b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa649 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.808515:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013553dc00/0xe64d3fbf12a7ba56 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6f1 expref: 326 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.808520:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00fe400/0xe64d3fbf12a7ba64 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147714.808541:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013553dc00/0xe64d3fbf12a7ba56 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6f1 expref: 326 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.808549:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013553dc00/0xe64d3fbf12a7ba56 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6f1 expref: 326 pid: 14547 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746147714.808557:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796317696:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147714.808632:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9251c00/0xe64d3fbf12a7b91b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa649 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.808638:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9251c00/0xe64d3fbf12a7b91b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa649 expref: 8 pid: 14547 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746147714.808645:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796317824:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147714.808659:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a299900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147714.810537:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.810632:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.811291:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147714.811448:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00fe400/0xe64d3fbf12a7ba64 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147714.811454:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00fe400/0xe64d3fbf12a7ba64 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00000040:00080000:0.0:1746147714.812472:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3512, 88 off293408 00000004:00080000:0.0:1746147714.812479:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793986593913ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147714.812520:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3539, 88 off295440 00000004:00080000:0.0:1746147714.812525:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793986640075ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147714.812547:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3540, 88 off295528 00000004:00080000:0.0:1746147714.812551:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793986665835ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147714.812558:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3513, 88 off293496 00000004:00080000:0.0:1746147714.812560:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793986675648ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147714.812636:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3514, 88 off293584 00000004:00080000:0.0:1746147714.812639:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793986754443ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147714.812647:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3541, 88 off295616 00000004:00080000:0.0:1746147714.812649:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793986764990ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147714.812690:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3542, 88 off295704 00000004:00080000:0.0:1746147714.812693:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793986808280ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147714.812698:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3543, 88 off295792 00000004:00080000:0.0:1746147714.812701:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793986816380ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147714.812707:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3515, 88 off293672 00000004:00080000:0.0:1746147714.812709:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793986824364ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147714.812715:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3544, 88 off295880 00000004:00080000:0.0:1746147714.812718:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793986833372ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147714.812724:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3516, 88 off293760 00000004:00080000:0.0:1746147714.812726:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793986841747ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147714.812733:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3545, 88 off295968 00000004:00080000:0.0:1746147714.812735:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793986851030ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147714.812741:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3517, 88 off293848 00000004:00080000:0.0:1746147714.812744:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793986859173ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147714.812750:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3518, 88 off293936 00000004:00080000:0.0:1746147714.812753:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793986868108ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147714.812760:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3519, 88 off294024 00000004:00080000:0.0:1746147714.812763:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793986878643ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147714.812770:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3520, 88 off294112 00000004:00080000:0.0:1746147714.812773:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793986888085ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147714.812780:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3546, 88 off296056 00000004:00080000:0.0:1746147714.812782:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793986897665ns, next at 756024029964ns, rc = 0 00000100:00100000:0.0:1746147714.827826:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796318464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147714.827850:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147714.827868:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796318208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147714.827906:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796317952 00000100:00100000:0.0:1746147714.827912:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796317952 00000100:00100000:0.0:1746147714.827939:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796318464 00000100:00100000:0.0:1746147714.827941:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796318464 00000100:00100000:0.0:1746147714.827951:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796318848 00000100:00100000:0.0:1746147714.827953:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796318848 00000100:00100000:0.0:1746147714.827966:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15645 00000100:00100000:0.0:1746147714.827969:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3302:x1830967796318464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147714.828260:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:0.0:1746147714.828263:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147714.828265:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147714.828267:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147714.828269:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:0.0:1746147714.828296:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3302:x1830967796318464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 325us (445us total) trans 21474841408 rc 0/0 00000100:00100000:0.0:1746147714.828301:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15645 00000100:00100000:0.0:1746147714.828320:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147714.828330:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796318720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147714.828341:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147714.828350:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746147714.828353:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796318080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147714.828366:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147714.828373:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796318592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147714.828392:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147714.828406:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796318208 00000100:00100000:0.0:1746147714.828408:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796318208 00000100:00100000:0.0:1746147714.828419:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796318720 00000100:00100000:0.0:1746147714.828421:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796318720 00000100:00100000:0.0:1746147714.828428:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796318080 00000100:00100000:0.0:1746147714.828430:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796318080 00000100:00100000:0.0:1746147714.828437:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796318592 00000100:00100000:0.0:1746147714.828439:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796318592 00000100:00100000:0.0:1746147714.828447:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15648 00000100:00100000:0.0:1746147714.828451:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3304:x1830967796318208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147714.828518:0:7050:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147714.828521:0:7050:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147714 -> 1746147714 00002000:00010000:0.0:1746147714.828523:0:7050:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147712 -> 1746147712 00002000:00010000:0.0:1746147714.828525:0:7050:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147714 -> 1746147714 00002000:00010000:0.0:1746147714.828526:0:7050:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147714.828541:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3304:x1830967796318208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (219us total) trans 21474841409 rc 0/0 00000100:00100000:0.0:1746147714.828546:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15648 00000100:00100000:0.0:1746147714.828554:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796319232 00000100:00100000:0.0:1746147714.828557:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796319232 00000100:00100000:0.0:1746147714.828565:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796319744 00000100:00100000:0.0:1746147714.828566:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796319744 00000100:00100000:0.0:1746147714.828571:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796319360 00000100:00100000:0.0:1746147714.828573:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796319360 00000100:00100000:0.0:1746147714.828580:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15649 00000100:00100000:0.0:1746147714.828584:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3304:x1830967796318720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147714.828653:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3304:x1830967796318720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (310us total) trans 21474841410 rc 0/0 00000100:00100000:0.0:1746147714.828658:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15649 00000100:00100000:0.0:1746147714.828667:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15651 00000100:00100000:0.0:1746147714.828670:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3304:x1830967796318592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147714.828731:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3304:x1830967796318592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (338us total) trans 21474841412 rc 0/0 00000100:00100000:0.0:1746147714.828736:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15651 00000100:00100000:0.0:1746147714.828743:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15653 00000100:00100000:0.0:1746147714.828747:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3303:x1830967796319744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147714.828791:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15654 00000100:00100000:0.0:1746147714.828795:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3303:x1830967796319360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147714.828872:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:0.0:1746147714.828874:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147714 -> 1746147714 00002000:00010000:0.0:1746147714.828875:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147713 -> 1746147713 00002000:00010000:0.0:1746147714.828877:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147714 -> 1746147714 00002000:00010000:0.0:1746147714.828878:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:0.0:1746147714.828913:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3303:x1830967796319360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (344us total) trans 17179874178 rc 0/0 00000100:00100000:0.0:1746147714.828918:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15654 00000100:00100000:0.0:1746147714.828932:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796319104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147714.828947:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147714.828955:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796319616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147714.828966:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147714.828974:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796320128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147714.828984:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147714.828994:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b5f80/2, rc 0, transno 21474841408 00000100:00100000:0.0:1746147714.828997:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796318464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147714.829002:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746147714.829005:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796319488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147714.829016:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147714.829023:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796320000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147714.829033:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147714.829045:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15656 00000100:00100000:0.0:1746147714.829049:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3302:x1830967796319104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147714.829079:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15658 00000100:00100000:0.0:1746147714.829083:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3302:x1830967796320128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147714.829142:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3302:x1830967796320128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (157us total) trans 17179874180 rc 0/0 00000100:00100000:0.0:1746147714.829147:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15658 00000100:00100000:0.0:1746147714.829154:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15660 00000100:00100000:0.0:1746147714.829157:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3302:x1830967796320000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147714.829209:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3302:x1830967796320000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (174us total) trans 17179874182 rc 0/0 00000100:00100000:0.0:1746147714.829213:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15660 00002000:00010000:0.0:1746147714.829267:0:8469:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147714.829269:0:8469:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147714 -> 1746147714 00002000:00010000:0.0:1746147714.829271:0:8469:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147703 -> 1746147703 00002000:00010000:0.0:1746147714.829272:0:8469:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147714 -> 1746147714 00002000:00010000:0.0:1746147714.829274:0:8469:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:0.0:1746147714.829289:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3302:x1830967796319104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 240us (342us total) trans 17179874183 rc 0/0 00000100:00100000:0.0:1746147714.830470:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15656 00000100:00100000:0.0:1746147714.833164:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.833222:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.859381:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b10bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796320256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147714.859421:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147714.859447:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796320896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147714.859463:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147714.859477:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796321408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147714.859496:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147714.859509:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796321920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147714.860336:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15673 00000100:00100000:0.0:1746147714.860342:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aabd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3304:x1830967796321024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147714.860429:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aabd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3304:x1830967796321024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (360us total) trans 21474841421 rc 0/0 00000100:00100000:0.0:1746147714.860434:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15673 00000100:00100000:0.0:1746147714.860460:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147714.860480:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b10bb80/2, rc 0, transno 21474841418 00000100:00100000:0.0:1746147714.860484:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b10bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796320256:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147714.860494:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fb76d80/2, rc 0, transno 17179874185 00000100:00100000:0.0:1746147714.860501:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796321408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147714.860571:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796322432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147714.860589:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147714.860613:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093cd6680/2, rc 0, transno 17179874192 00000100:00100000:0.0:1746147714.860616:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796321920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147714.860723:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ef9500/2, rc 0, transno 17179874193 00000100:00100000:0.0:1746147714.860727:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796322432:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147714.861078:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b109500/2, rc 0, transno 21474841423 00000100:00100000:0.0:1746147714.861082:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796320896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147714.862694:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.875688:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.875767:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.878159:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.879095:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.879526:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.879945:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.879973:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.881323:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7936 00000100:00100000:0.0:1746147714.881330:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793622144:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147714.881337:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147714.881469:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b847a00/0xe64d3fbf12a7b930 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa657 expref: 8 pid: 7050 timeout: 894 lvb_type: 1 00010000:00010000:0.0:1746147714.881481:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b847a00/0xe64d3fbf12a7b930 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa657 expref: 8 pid: 7050 timeout: 894 lvb_type: 1 00010000:00010000:0.0:1746147714.882649:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147714.882669:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967793622144:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1339us (2694us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147714.882676:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7936 00000100:00100000:0.0:1746147714.883186:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.883199:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793622272 00000100:00100000:0.0:1746147714.883202:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793622272 00010000:00010000:0.0:1746147714.883216:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9251600/0xe64d3fbf12a7b94c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa67a expref: 9 pid: 8468 timeout: 894 lvb_type: 1 00000100:00100000:0.0:1746147714.883246:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7937 00000100:00100000:0.0:1746147714.883252:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793622272:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147714.883260:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147714.883273:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a9251600/0xe64d3fbf12a7b94c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa67a expref: 9 pid: 8468 timeout: 894 lvb_type: 1 00010000:00010000:0.0:1746147714.883283:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a9251600/0xe64d3fbf12a7b94c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa67a expref: 9 pid: 8468 timeout: 894 lvb_type: 1 00010000:00010000:0.0:1746147714.883297:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9251600/0xe64d3fbf12a7b94c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa67a expref: 9 pid: 8468 timeout: 894 lvb_type: 1 00010000:00010000:0.0:1746147714.883309:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.883311:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147714.883315:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7ba87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa70d expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.883322:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7ba87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa70d expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147714.883340:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7ba87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa70d expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147714.883350:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796323456:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147714.883404:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147714.888591:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796323456:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147714.888604:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147714.888719:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793622272:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5466us (5532us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147714.888727:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7937 00000100:00100000:0.0:1746147714.893428:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.899296:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.899380:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.899397:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.899424:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.899446:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793623296 00000100:00100000:0.0:1746147714.899452:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793623296 00010000:00010000:0.0:1746147714.899480:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a732c000/0xe64d3fbf12a7ba48 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6c7 expref: 29 pid: 20619 timeout: 894 lvb_type: 1 00000100:00100000:0.0:1746147714.899520:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793623168 00000100:00100000:0.0:1746147714.899522:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793623168 00010000:00010000:0.0:1746147714.899533:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092c24a00/0xe64d3fbf12a7ba3a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6e3 expref: 12 pid: 20619 timeout: 894 lvb_type: 1 00000100:00100000:0.0:1746147714.899545:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793623424 00000100:00100000:0.0:1746147714.899546:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793623424 00010000:00010000:0.0:1746147714.899554:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136575800/0xe64d3fbf12a7b953 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa673 expref: 7 pid: 8469 timeout: 894 lvb_type: 1 00000100:00100000:0.0:1746147714.899567:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7938 00000100:00100000:0.0:1746147714.899573:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967793623296:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147714.899583:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147714.899601:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a732c000/0xe64d3fbf12a7ba48 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6c7 expref: 29 pid: 20619 timeout: 894 lvb_type: 1 00010000:00010000:0.0:1746147714.899611:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a732c000/0xe64d3fbf12a7ba48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6c7 expref: 29 pid: 20619 timeout: 894 lvb_type: 1 00010000:00010000:0.0:1746147714.900906:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a732c000/0xe64d3fbf12a7ba48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6c7 expref: 28 pid: 20619 timeout: 894 lvb_type: 1 00010000:00010000:0.0:1746147714.900931:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147714.900949:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967793623296:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1376us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147714.900955:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7938 00000100:00100000:0.0:1746147714.905435:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.905460:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.905525:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.910484:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.915175:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.921146:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.921197:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.927953:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793625088 00000100:00100000:0.0:1746147714.927958:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793625088 00000100:00100000:0.0:1746147714.927977:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15683 00000100:00100000:0.0:1746147714.927981:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1957:x1830967793625088:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147714.927988:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147714.928001:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c466800/0xe64d3fbf12a7bac6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa737 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147714.928041:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796324608:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147714.928101:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147714.938298:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.938343:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.939959:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6923 00000100:00100000:0.0:1746147714.939966:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967793625856:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147714.959929:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1957:x1830967793625856:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19959us (20282us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147714.959937:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6923 00002000:00100000:0.0:1746147714.959945:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009505f100 x1830967793625856/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:335/0 lens 488/440 e 0 to 0 dl 1746147725 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147714.959950:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505f100 with x1830967793625856 ext(1048576->2097151) 00002000:00010000:0.0:1746147714.959954:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009505f100 00000100:00100000:0.0:1746147714.967208:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.967290:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.973593:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.977591:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.990957:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147714.994565:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.007436:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.011537:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147715.012446:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147715.020698:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.031196:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.031229:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.031259:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.034239:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.039102:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.039143:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.039168:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.039194:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147715.039317:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147715.039357:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15691 00000100:00100000:0.0:1746147715.039364:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967793629056:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147715.039371:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147715.039378:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7bb21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa76f expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147715.039389:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147715.039390:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147715.039397:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7bb21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa76f expref: 31 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147715.039410:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7bb21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa76f expref: 31 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147715.039419:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc1e600, rc 0) 00000100:00100000:0.0:1746147715.039445:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967793629056:12345-192.168.202.10@tcp:101:cat.0 Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147715.039450:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15691 00000100:00100000:0.0:1746147715.046243:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1957:x1830967793628032:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14685us (15048us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147715.046249:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6926 00002000:00100000:0.0:1746147715.046255:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009d0dca80 x1830967793628032/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:336/0 lens 488/440 e 0 to 0 dl 1746147726 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147715.046261:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dca80 with x1830967793628032 ext(2097152->3145727) 00002000:00010000:0.0:1746147715.046265:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0dca80 00000100:00100000:0.0:1746147715.051605:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.056338:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.059947:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.067610:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.080166:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.085036:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.094273:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.101636:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.109759:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.120079:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.120118:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.120163:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.139746:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967793631744:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19122us (19627us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147715.139752:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6932 00002000:00100000:0.0:1746147715.139758:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009ce61880 x1830967793631744/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:336/0 lens 488/440 e 0 to 0 dl 1746147726 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147715.139765:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61880 with x1830967793631744 ext(1048576->2097151) 00002000:00010000:0.0:1746147715.139768:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce61880 00000100:00100000:0.0:1746147715.144196:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.149291:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.150604:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.159043:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.163846:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.163921:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.203340:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.228786:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.243589:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.246022:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.246643:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.259227:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.259260:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.259320:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793634944 00000100:00100000:0.0:1746147715.259326:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793634944 00002000:00100000:0.0:1746147715.259360:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009ce61f80 x1830967793634944/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:336/0 lens 488/0 e 0 to 0 dl 1746147726 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147715.259369:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61f80 with x1830967793634944 ext(0->1048575) 00002000:00010000:0.0:1746147715.259373:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce61f80 00000100:00100000:0.0:1746147715.259385:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793635200 00000100:00100000:0.0:1746147715.259387:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793635200 00002000:00100000:0.0:1746147715.259397:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009ce60e00 x1830967793635200/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:336/0 lens 488/0 e 0 to 0 dl 1746147726 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147715.259403:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60e00 with x1830967793635200 ext(1048576->2097151) 00002000:00010000:0.0:1746147715.259406:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60e00 00000100:00100000:0.0:1746147715.259430:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6939 00000100:00100000:0.0:1746147715.259436:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967793634944:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147715.262844:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.265141:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.279878:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.290750:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.294479:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.296021:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.304064:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.304099:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.304131:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.313042:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0596d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796327552:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147715.313052:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147715.313070:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6673850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1958:x1830967793636608:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6845us (6921us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147715.313078:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7952 00000100:00100000:0.0:1746147715.318204:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.323694:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.323726:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.323758:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.346645:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.351187:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.357038:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.362983:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.367056:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.372392:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.376428:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.392362:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.397367:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.411723:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.423969:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.424012:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.449823:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.465349:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.473109:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.475621:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.475662:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.478407:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.478446:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.493865:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.522046:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.548074:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.554478:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793643008 00000100:00100000:0.0:1746147715.554486:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793643008 00000100:00100000:0.0:1746147715.554530:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 876 00000100:00100000:0.0:1746147715.554536:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967793643008:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147715.554548:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147715.554567:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0235200/0xe64d3fbf12a7bc2b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa7fb expref: 17 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147715.554752:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147715.554756:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147715.555250:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967793643008:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 712us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147715.555256:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 876 00000100:00100000:0.0:1746147715.558617:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.568287:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.568337:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.578441:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.584249:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.594655:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.649122:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.653949:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.653979:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.654021:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793645312 00000100:00100000:0.0:1746147715.654030:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793645312 00000100:00100000:0.0:1746147715.654667:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11841 00000100:00100000:0.0:1746147715.654675:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:31846:x1830967793645312:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147715.654704:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147715.654720:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7bc6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa817 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147715.654830:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7bc71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.654842:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7bc71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.654851:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7bc71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.654864:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7bc78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.654869:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7bc78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.654874:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7bc78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655016:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3400/0xe64d3fbf12a7bc7f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655025:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3400/0xe64d3fbf12a7bc7f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655041:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3400/0xe64d3fbf12a7bc7f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746147715.655050:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147715.655137:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7bc71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655144:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7bc71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655150:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7bc71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655155:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d2200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147715.655159:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7bc71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655164:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7bc71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655172:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147715.655175:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147715.655179:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7bc71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655183:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7bc71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655201:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7bc78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655206:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7bc78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655214:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7bc78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655218:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d2800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147715.655220:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7bc78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655224:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7bc78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655230:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009320b100) 00010000:00010000:0.0:1746147715.655232:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147715.655234:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7bc78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655238:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7bc78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147715.655273:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7bc6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa817 expref: 336 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147715.655284:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3400/0xe64d3fbf12a7bc7f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa817 expref: 335 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147715.655289:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147715.655291:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147715.655293:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d3400, rc 0) 00000100:00100000:0.0:1746147715.655348:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:31846:x1830967793645312:12345-192.168.202.10@tcp:101:cat.0 Request processed in 674us (1410us total) trans 8589945814 rc 0/0 00000100:00100000:0.0:1746147715.655355:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11841 00000100:00100000:0.0:1746147715.663756:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.679087:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.679123:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793646336 00000100:00100000:0.0:1746147715.679132:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793646336 00010000:00010000:0.0:1746147715.679168:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134b2f200/0xe64d3fbf12a7bc0f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa7f4 expref: 28 pid: 22183 timeout: 894 lvb_type: 1 00000100:00100000:0.0:1746147715.679194:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7959 00000100:00100000:0.0:1746147715.679201:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967793646336:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147715.679213:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147715.679237:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134b2f200/0xe64d3fbf12a7bc0f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa7f4 expref: 28 pid: 22183 timeout: 894 lvb_type: 1 00010000:00010000:0.0:1746147715.679248:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134b2f200/0xe64d3fbf12a7bc0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa7f4 expref: 28 pid: 22183 timeout: 894 lvb_type: 1 00010000:00010000:0.0:1746147715.679274:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147715.679311:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967793646336:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 110us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147715.679317:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7959 00000100:00100000:0.0:1746147715.684272:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.690115:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.697211:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.697260:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.699607:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793647232 00000100:00100000:0.0:1746147715.699614:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793647232 00000100:00100000:0.0:1746147715.699654:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11842 00000100:00100000:0.0:1746147715.699661:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:31849:x1830967793647232:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147715.699687:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147715.699701:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7bca9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa83a expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147715.699818:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7bcb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.699829:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7bcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.699839:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7bcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.699851:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3000/0xe64d3fbf12a7bcb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.699856:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3000/0xe64d3fbf12a7bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.699861:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3000/0xe64d3fbf12a7bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700023:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7bcbe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700031:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7bcbe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700038:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7bcbe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147715.700046:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147715.700129:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7bcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700138:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7bcb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700144:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7bcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700149:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d2600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147715.700153:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7bcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700159:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7bcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700169:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147715.700171:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147715.700177:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7bcb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700182:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7bcb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700207:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3000/0xe64d3fbf12a7bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700212:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3000/0xe64d3fbf12a7bcb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700216:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3000/0xe64d3fbf12a7bcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700220:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d3000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147715.700222:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3000/0xe64d3fbf12a7bcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700229:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3000/0xe64d3fbf12a7bcb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700235:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a0003d00) 00010000:00010000:0.0:1746147715.700236:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147715.700238:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3000/0xe64d3fbf12a7bcb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.700242:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3000/0xe64d3fbf12a7bcb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147715.705276:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.707257:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.707295:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.707347:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.713101:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967793647360:12345-192.168.202.10@tcp:4:cat.0 Request processed in 7370us (7827us total) trans 17179874198 rc 0/0 00000100:00100000:0.0:1746147715.713113:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1367 00002000:00100000:0.0:1746147715.713125:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3043328->3145727) req@ffff880135812a00 x1830967793647360/t17179874198(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:336/0 lens 488/448 e 0 to 0 dl 1746147726 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147715.713134:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812a00 with x1830967793647360 ext(3043328->3145727) 00010000:00010000:0.0:1746147715.713144:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0235600/0xe64d3fbf12a7bc63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3043328->3301375] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa810 expref: 35 pid: 4591 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746147715.713160:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0235600/0xe64d3fbf12a7bc63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3043328->3301375] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa810 expref: 35 pid: 4591 timeout: 894 lvb_type: 0 00002000:00010000:0.0:1746147715.713167:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135812a00 00000100:00100000:0.0:1746147715.719989:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.720826:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.725154:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793648256 00000100:00100000:0.0:1746147715.725163:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793648256 00002000:00100000:0.0:1746147715.725214:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880093cd4380 x1830967793648256/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:336/0 lens 488/0 e 0 to 0 dl 1746147726 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147715.725224:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4380 with x1830967793648256 ext(2097152->3145727) 00002000:00010000:0.0:1746147715.725230:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd4380 00000100:00100000:0.0:1746147715.725262:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6958 00000100:00100000:0.0:1746147715.725270:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967793648256:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147715.732164:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.733868:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.733922:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.734241:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6959 00000100:00100000:0.0:1746147715.734249:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b6cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967793649024:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147715.749152:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.749282:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.758703:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.759450:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.759479:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147715.761502:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147715.762378:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793649792 00000100:00100000:0.0:1746147715.762386:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793649792 00000100:00100000:0.0:1746147715.762539:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15717 00000100:00100000:0.0:1746147715.762548:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:31846:x1830967793649792:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147715.762566:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147715.762818:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bd10e00/0xe64d3fbf12a7bd12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa86b expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147715.762853:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0234a00/0xe64d3fbf12a7bc39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3301376->18446744073709551615] (req 3301376->3526655) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa802 expref: 16 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147715.762861:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147715.762863:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147715.762866:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd10e00/0xe64d3fbf12a7bd12 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa86b expref: 35 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147715.763025:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0234a00/0xe64d3fbf12a7bc39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3301376->18446744073709551615] (req 3301376->3526655) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa802 expref: 16 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147715.763038:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0234a00/0xe64d3fbf12a7bc39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3301376->18446744073709551615] (req 3301376->3526655) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa802 expref: 16 pid: 4591 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746147715.764180:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796330752:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147715.764862:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.765017:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796330496:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147715.765032:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147715.765065:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b6cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967793649664:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5429us (5585us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147715.765074:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7963 00000100:00100000:0.0:1746147715.769972:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.770162:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793650560 00000100:00100000:0.0:1746147715.770169:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793650560 00000100:00100000:0.0:1746147715.771625:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4890 00000100:00100000:0.0:1746147715.771630:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:31852:x1830967793650560:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:0.0:1746147715.771783:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:31852:x1830967793650560:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 152us (1647us total) trans 8589945818 rc 0/0 00000100:00100000:0.0:1746147715.771788:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4890 00000100:00100000:0.0:1746147715.778291:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.778441:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.782874:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.783189:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.801165:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.801212:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.809719:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6966 00000100:00100000:0.0:1746147715.809727:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793652352:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147715.825289:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.834488:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.854176:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.854225:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.872008:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.895557:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.903072:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.929083:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.930521:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147715.930536:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1830967796332160:0@lo:400:kworker.0 00000100:00100000:0.0:1746147715.930552:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147715.930575:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796331776 00000100:00100000:0.0:1746147715.930577:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796331776 00000100:00100000:0.0:1746147715.930596:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1746147715.930599:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1830967796331776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147715.930622:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1830967796331776:12345-0@lo:400:kworker.0 Request processed in 22us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147715.930627:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1746147715.930753:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11845 00000100:00100000:0.0:1746147715.930759:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:31859:x1830967793654400:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147715.930770:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147715.930784:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7bd5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa89c expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147715.930870:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050c00/0xe64d3fbf12a7bd66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.930880:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050c00/0xe64d3fbf12a7bd66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.930905:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050c00/0xe64d3fbf12a7bd66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.930914:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7bd6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.930919:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7bd6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.930924:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7bd6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931012:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7bd74 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931024:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7bd74 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931029:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7bd74 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147715.931037:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147715.931098:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050c00/0xe64d3fbf12a7bd66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931103:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050c00/0xe64d3fbf12a7bd66 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931109:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050c00/0xe64d3fbf12a7bd66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931114:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a1050c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147715.931117:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050c00/0xe64d3fbf12a7bd66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931122:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050c00/0xe64d3fbf12a7bd66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931131:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147715.931134:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147715.931137:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050c00/0xe64d3fbf12a7bd66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931142:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050c00/0xe64d3fbf12a7bd66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931165:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7bd6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931173:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7bd6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931178:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7bd6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931181:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a1051800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147715.931183:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7bd6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931187:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7bd6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931193:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ca65400) 00010000:00010000:0.0:1746147715.931195:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147715.931197:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7bd6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931201:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7bd6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147715.931228:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7bd5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa89c expref: 338 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147715.931237:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7bd74 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa89c expref: 337 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147715.931243:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147715.931244:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147715.931247:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1051c00, rc 0) 00000100:00100000:0.0:1746147715.931263:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+337:31859:x1830967793654400:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 505us (2186us total) trans 8589945821 rc 0/0 00000100:00100000:0.0:1746147715.931269:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11845 00000100:00100000:0.0:1746147715.931292:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1830967796332160:0@lo:400:kworker.0 00000100:00100000:0.0:1746147715.931300:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1830967796331648:0@lo:400:kworker.0 00000100:00080000:0.0:1746147715.931320:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147715.936113:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.936146:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.936180:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.939613:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.972461:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.974982:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.979935:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.984765:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.984857:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.989530:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.991446:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.994672:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.994764:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.996050:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147715.996079:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.000409:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.005720:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147716.009784:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147716.018502:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.022046:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.029434:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.035078:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.065576:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147716.066261:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147716.082044:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147716.083345:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147716.086101:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147716.086435:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147716.094504:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147716.095105:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147716.095500:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.096023:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.096036:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.096049:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793659392 00000100:00100000:0.0:1746147716.096051:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793659392 00000100:00080000:0.0:1746147716.096337:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147716.096723:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15732 00000100:00100000:0.0:1746147716.096728:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967793659392:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147716.096732:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147716.096737:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7be00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa8e2 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.096744:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.096745:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.096749:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7be00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa8e2 expref: 10 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147716.096757:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7be00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa8e2 expref: 10 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147716.096763:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2f800, rc 0) 00000100:00100000:0.0:1746147716.096777:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967793659392:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 49us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147716.096781:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15732 00000100:00100000:0.0:1746147716.103031:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.109371:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.114527:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.118740:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.123909:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.136068:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.138904:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.141262:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.148364:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796334336:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147716.148371:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796334464:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147716.148377:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796334592:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147716.148391:0:22183:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009527b800/0xe64d3fbf12a7be3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147716.150353:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147716.165916:0:22183:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009527b800/0xe64d3fbf12a7be3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.165925:0:22183:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009527b800/0xe64d3fbf12a7be3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.165945:0:22183:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009527b800/0xe64d3fbf12a7be3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.165956:0:22183:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009527b800/0xe64d3fbf12a7be3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.165963:0:22183:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009527b800/0xe64d3fbf12a7be3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.165968:0:22183:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009527b800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147716.165972:0:22183:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009527b800/0xe64d3fbf12a7be3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.165978:0:22183:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009527b800/0xe64d3fbf12a7be3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.165987:0:22183:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009527b800/0xe64d3fbf12a7be3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.165992:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009527b800/0xe64d3fbf12a7be3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147716.166034:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967793660672:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 27881us (29972us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147716.166041:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15733 00010000:00010000:0.0:1746147716.166117:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7bd20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa872 expref: 29 pid: 8184 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746147716.166126:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796336256:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147716.166136:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7bdf9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa8f0 expref: 9 pid: 4591 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746147716.166143:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796336384:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147716.166151:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1050800/0xe64d3fbf12a7bd0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa864 expref: 19 pid: 8184 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746147716.166159:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796336512:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147716.166176:0:21480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801354c8000/0xe64d3fbf12a7be62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166183:0:21480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801354c8000/0xe64d3fbf12a7be62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166188:0:21480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801354c8000/0xe64d3fbf12a7be62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166202:0:21480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801354c8000/0xe64d3fbf12a7be62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166208:0:21480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801354c8000/0xe64d3fbf12a7be62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166213:0:21480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801354c8000/0xe64d3fbf12a7be62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166222:0:21480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801354c8000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147716.166225:0:21480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801354c8000/0xe64d3fbf12a7be62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166230:0:21480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801354c8000/0xe64d3fbf12a7be62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166238:0:21480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801354c8000/0xe64d3fbf12a7be62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166244:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801354c8000/0xe64d3fbf12a7be62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147716.166282:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967793661312:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 18400us (18567us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147716.166287:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15738 00010000:00010000:0.0:1746147716.166307:0:4592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7be4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166313:0:4592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7be4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166325:0:4592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7be4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166330:0:4592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7be4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166336:0:4592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7be4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166341:0:4592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009528e800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147716.166343:0:4592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7be4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166349:0:4592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7be4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166357:0:4592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7be4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166362:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7be4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147716.166385:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+7:1958:x1830967793660928:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 19916us (25124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147716.166390:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15735 00010000:00010000:0.0:1746147716.166406:0:4591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012a2a0600/0xe64d3fbf12a7be46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166412:0:4591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a2a0600/0xe64d3fbf12a7be46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166422:0:4591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012a2a0600/0xe64d3fbf12a7be46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166429:0:4591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2a0600/0xe64d3fbf12a7be46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166434:0:4591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012a2a0600/0xe64d3fbf12a7be46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166439:0:4591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a2a0600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147716.166441:0:4591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012a2a0600/0xe64d3fbf12a7be46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166447:0:4591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012a2a0600/0xe64d3fbf12a7be46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166453:0:4591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012a2a0600/0xe64d3fbf12a7be46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.166459:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a2a0600/0xe64d3fbf12a7be46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147716.166482:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+6:1958:x1830967793660800:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 25804us (27579us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147716.166487:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15734 00000100:00100000:0.0:1746147716.169499:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.174386:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.174638:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.174739:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.175669:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.175683:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793664384 00000100:00100000:0.0:1746147716.175685:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793664384 00010000:00010000:0.0:1746147716.175697:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013553d200/0xe64d3fbf12a7ba72 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6ff expref: 336 pid: 14547 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746147716.175717:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7996 00000100:00100000:0.0:1746147716.175722:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+336:1959:x1830967793664384:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147716.175729:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147716.175732:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013553d200/0xe64d3fbf12a7ba72 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6ff expref: 336 pid: 14547 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746147716.175739:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013553d200/0xe64d3fbf12a7ba72 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6ff expref: 336 pid: 14547 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746147716.175749:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013553d200/0xe64d3fbf12a7ba72 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa6ff expref: 336 pid: 14547 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746147716.175756:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147716.175758:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7be69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.175764:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7be69 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.175770:0:7096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7be69 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.175785:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147716.175809:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:1959:x1830967793664384:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 77us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147716.175814:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7996 00000100:00100000:0.0:1746147716.222621:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.226558:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.226876:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.226924:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.227197:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.227260:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.227320:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.227339:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15756 00000100:00100000:0.0:1746147716.227345:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793664896:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147716.227358:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147716.227372:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7be8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa921 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147716.227392:0:10613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x68141985, atime: 0x68141984, ctime: 0x68141985, blocks: 0x821 00010000:00010000:0.0:1746147716.227405:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.227406:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.227413:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7be8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa921 expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147716.227425:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7be8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa921 expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147716.227434:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2f000, rc 0) 00000100:00100000:0.0:1746147716.227464:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793664896:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 119us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147716.227471:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15756 00000100:00100000:0.0:1746147716.227480:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15758 00000100:00100000:0.0:1746147716.227484:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793665408:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147716.227489:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147716.227495:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134b2f400/0xe64d3fbf12a7be93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa93d expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147716.227504:0:10613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x456:0x0] initial LVB size: 4194304, mtime: 0x68141984, atime: 0x68141984, ctime: 0x68141984, blocks: 0x1029 00010000:00010000:0.0:1746147716.227510:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.227512:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.227515:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134b2f400/0xe64d3fbf12a7be93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa93d expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147716.227523:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134b2f400/0xe64d3fbf12a7be93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa93d expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147716.227529:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2f400, rc 0) 00000100:00100000:0.0:1746147716.227542:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793665408:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 58us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147716.227547:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15758 00000100:00100000:0.0:1746147716.227555:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15760 00000100:00100000:0.0:1746147716.227559:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793665024:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147716.227563:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147716.227571:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7bea1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa928 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147716.227583:0:10613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x68141985, atime: 0x6814197c, ctime: 0x68141985, blocks: 0x821 00010000:00010000:0.0:1746147716.227587:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.227589:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.227591:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7bea1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa928 expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147716.227599:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7bea1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa928 expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147716.227605:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2fa00, rc 0) 00000100:00100000:0.0:1746147716.227615:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793665024:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 57us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147716.227620:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15760 00000100:00100000:0.0:1746147716.238388:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.238428:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.238462:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.238823:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.238837:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.238919:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.238937:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793666688 00000100:00100000:0.0:1746147716.238939:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793666688 00000100:00100000:0.0:1746147716.238957:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6974 00000100:00100000:0.0:1746147716.238968:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967793665664:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:0.0:1746147716.238996:0:31356:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880134b2ec00/0xe64d3fbf12a7beaf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.239011:0:31356:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.239013:0:31356:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.239017:0:31356:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134b2ec00/0xe64d3fbf12a7beaf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.239027:0:31356:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134b2ec00/0xe64d3fbf12a7beaf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147716.253662:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.253711:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.319579:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.324291:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.326852:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.329493:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.332775:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.335204:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.343701:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.348586:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.351963:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.355357:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.360282:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793668992 00000100:00100000:0.0:1746147716.360288:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793668992 00010000:00010000:0.0:1746147716.360312:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5528600/0xe64d3fbf12a7bea8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa936 expref: 9 pid: 8470 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746147716.360335:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8001 00000100:00100000:0.0:1746147716.360341:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793668992:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147716.360354:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147716.360373:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5528600/0xe64d3fbf12a7bea8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa936 expref: 9 pid: 8470 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746147716.360382:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5528600/0xe64d3fbf12a7bea8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa936 expref: 9 pid: 8470 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746147716.360400:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5528600/0xe64d3fbf12a7bea8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa936 expref: 9 pid: 8470 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746147716.360421:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.360423:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.360428:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7bf0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa960 expref: 8 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.360436:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7bf0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa960 expref: 8 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.360461:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7bf0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa960 expref: 8 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147716.360472:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cbbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796340480:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147716.360538:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147716.362452:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.366791:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.372377:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.372414:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.372444:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.372460:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.372493:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.372520:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.376012:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.378720:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000001:00080000:0.0:1746147716.412055:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945831 is committed 00000004:00080000:0.0:1746147716.412061:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2639 committed 00000004:00080000:0.0:1746147716.412067:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2617 committed 00000004:00080000:0.0:1746147716.412073:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2616 committed 00000004:00080000:0.0:1746147716.412074:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2615 committed 00000004:00080000:0.0:1746147716.412076:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2614 committed 00000004:00080000:0.0:1746147716.412077:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2638 committed 00000004:00080000:0.0:1746147716.412078:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2613 committed 00000004:00080000:0.0:1746147716.412080:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2637 committed 00000004:00080000:0.0:1746147716.412081:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2612 committed 00000004:00080000:0.0:1746147716.412082:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2636 committed 00000004:00080000:0.0:1746147716.412084:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2635 committed 00000004:00080000:0.0:1746147716.412085:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2634 committed 00000004:00080000:0.0:1746147716.412087:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2611 committed 00000004:00080000:0.0:1746147716.412088:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2610 committed 00000004:00080000:0.0:1746147716.412089:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2633 committed 00000004:00080000:0.0:1746147716.412091:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2632 committed 00000004:00080000:0.0:1746147716.412092:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2609 committed 00000100:00100000:0.0:1746147716.412279:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796341120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.412321:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412355:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796341632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.412369:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412379:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b10a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796342144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.412391:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412400:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796342656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.412411:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412424:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746147716.412429:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796340992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.412441:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412449:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796341504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.412460:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412470:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796342016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.412482:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412490:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796342528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.412500:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412512:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796341248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.412524:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412534:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796341760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.412547:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412556:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796342272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.412566:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412574:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796342784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.412586:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412596:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746147716.412600:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796341376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.412611:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412617:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796341888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.412626:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412631:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796342400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.412643:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412649:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796342912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.412661:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.412679:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796341120 00000100:00100000:0.0:1746147716.412684:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796341120 00000100:00100000:0.0:1746147716.412705:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796341632 00000100:00100000:0.0:1746147716.412706:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796341632 00000100:00100000:0.0:1746147716.412712:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796342144 00000100:00100000:0.0:1746147716.412714:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796342144 00000100:00100000:0.0:1746147716.412720:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796342656 00000100:00100000:0.0:1746147716.412721:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796342656 00000100:00100000:0.0:1746147716.412727:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796340992 00000100:00100000:0.0:1746147716.412729:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796340992 00000100:00100000:0.0:1746147716.412734:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796341504 00000100:00100000:0.0:1746147716.412735:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796341504 00000100:00100000:0.0:1746147716.412739:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796342016 00000100:00100000:0.0:1746147716.412741:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796342016 00000100:00100000:0.0:1746147716.412745:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796342528 00000100:00100000:0.0:1746147716.412746:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796342528 00000100:00100000:0.0:1746147716.412752:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796341248 00000100:00100000:0.0:1746147716.412753:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796341248 00000100:00100000:0.0:1746147716.412760:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796341760 00000100:00100000:0.0:1746147716.412762:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796341760 00000100:00100000:0.0:1746147716.412767:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796342272 00000100:00100000:0.0:1746147716.412768:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796342272 00000100:00100000:0.0:1746147716.412773:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796342784 00000100:00100000:0.0:1746147716.412774:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796342784 00000100:00100000:0.0:1746147716.412779:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796341376 00000100:00100000:0.0:1746147716.412780:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796341376 00000100:00100000:0.0:1746147716.412785:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796341888 00000100:00100000:0.0:1746147716.412786:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796341888 00000100:00100000:0.0:1746147716.412791:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796342400 00000100:00100000:0.0:1746147716.412792:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796342400 00000100:00100000:0.0:1746147716.412809:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796342912 00000100:00100000:0.0:1746147716.412811:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796342912 00000100:00100000:0.0:1746147716.412819:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15774 00000100:00100000:0.0:1746147716.412824:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3302:x1830967796341120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147716.412990:0:10613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147716.412993:0:10613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.412995:0:10613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:0.0:1746147716.412997:0:10613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.412998:0:10613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147716.413021:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3302:x1830967796341120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (700us total) trans 21474841443 rc 0/0 00000100:00100000:0.0:1746147716.413026:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15774 00000100:00100000:0.0:1746147716.413038:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15775 00000100:00100000:0.0:1746147716.413042:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3302:x1830967796341632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.413111:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3302:x1830967796341632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (741us total) trans 21474841444 rc 0/0 00000100:00100000:0.0:1746147716.413116:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15775 00000100:00100000:0.0:1746147716.413124:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15776 00000100:00100000:0.0:1746147716.413127:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3302:x1830967796342144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147716.413213:0:10613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147716.413216:0:10613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.413218:0:10613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:0.0:1746147716.413219:0:10613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.413222:0:10613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147716.413239:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3302:x1830967796342144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (846us total) trans 17179874212 rc 0/0 00000100:00100000:0.0:1746147716.413244:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15776 00000100:00100000:0.0:1746147716.413254:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15777 00000100:00100000:0.0:1746147716.413258:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3302:x1830967796342656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.413329:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3302:x1830967796342656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (917us total) trans 17179874213 rc 0/0 00000100:00100000:0.0:1746147716.413333:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15777 00000100:00100000:0.0:1746147716.413342:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15778 00000100:00100000:0.0:1746147716.413346:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3302:x1830967796340992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147716.413405:0:10613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147716.413407:0:10613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.413409:0:10613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:0.0:1746147716.413411:0:10613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.413412:0:10613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147716.413427:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3302:x1830967796340992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (984us total) trans 21474841445 rc 0/0 00000100:00100000:0.0:1746147716.413431:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15778 00000100:00100000:0.0:1746147716.413439:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15779 00000100:00100000:0.0:1746147716.413442:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3302:x1830967796341504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147716.413498:0:10613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:0.0:1746147716.413501:0:10613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147716.413503:0:10613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147716.413504:0:10613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147716.413507:0:10613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:0.0:1746147716.413524:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3302:x1830967796341504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (1062us total) trans 21474841446 rc 0/0 00000100:00100000:0.0:1746147716.413529:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15779 00000100:00100000:0.0:1746147716.413537:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15780 00000100:00100000:0.0:1746147716.413540:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3302:x1830967796342016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147716.413605:0:10613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147716.413607:0:10613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.413609:0:10613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:0.0:1746147716.413611:0:10613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.413612:0:10613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:0.0:1746147716.413629:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3302:x1830967796342016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (1145us total) trans 17179874214 rc 0/0 00000100:00100000:0.0:1746147716.413634:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15780 00000100:00100000:0.0:1746147716.413643:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15781 00000100:00100000:0.0:1746147716.413648:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3302:x1830967796342528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.413716:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3302:x1830967796342528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1215us total) trans 17179874215 rc 0/0 00000100:00100000:0.0:1746147716.413720:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15781 00000100:00100000:0.0:1746147716.413730:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15782 00000100:00100000:0.0:1746147716.413734:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3303:x1830967796341248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147716.413812:0:10613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147716.413814:0:10613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.413816:0:10613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:0.0:1746147716.413818:0:10613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.413820:0:10613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147716.413843:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3303:x1830967796341248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (1317us total) trans 21474841447 rc 0/0 00000100:00100000:0.0:1746147716.413849:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15782 00000100:00100000:0.0:1746147716.413858:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15783 00000100:00100000:0.0:1746147716.413862:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3303:x1830967796341760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.413957:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3303:x1830967796341760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (1408us total) trans 21474841448 rc 0/0 00000100:00100000:0.0:1746147716.413963:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15783 00000100:00100000:0.0:1746147716.413971:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15784 00000100:00100000:0.0:1746147716.413975:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3303:x1830967796342272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147716.414038:0:10613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:0.0:1746147716.414040:0:10613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.414041:0:10613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:0.0:1746147716.414043:0:10613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.414045:0:10613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:0.0:1746147716.414061:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3303:x1830967796342272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (1493us total) trans 17179874216 rc 0/0 00000100:00100000:0.0:1746147716.414065:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15784 00000100:00100000:0.0:1746147716.414073:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15785 00000100:00100000:0.0:1746147716.414076:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3303:x1830967796342784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.414146:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3303:x1830967796342784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (1558us total) trans 17179874217 rc 0/0 00000100:00100000:0.0:1746147716.414151:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15785 00000100:00100000:0.0:1746147716.414159:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15786 00000100:00100000:0.0:1746147716.414164:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3303:x1830967796341376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.414234:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3303:x1830967796341376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1621us total) trans 21474841449 rc 0/0 00000100:00100000:0.0:1746147716.414238:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15786 00000100:00100000:0.0:1746147716.414248:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15787 00000100:00100000:0.0:1746147716.414251:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3303:x1830967796341888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.414319:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3303:x1830967796341888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1690us total) trans 21474841450 rc 0/0 00000100:00100000:0.0:1746147716.414323:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15787 00000100:00100000:0.0:1746147716.414333:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15788 00000100:00100000:0.0:1746147716.414336:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aabc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3303:x1830967796342400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.414406:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aabc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3303:x1830967796342400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1761us total) trans 17179874218 rc 0/0 00000100:00100000:0.0:1746147716.414410:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15788 00000100:00100000:0.0:1746147716.414513:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15789 00000100:00100000:0.0:1746147716.414518:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3303:x1830967796342912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.414586:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3303:x1830967796342912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1923us total) trans 17179874219 rc 0/0 00000100:00100000:0.0:1746147716.414591:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15789 00000100:00100000:0.0:1746147716.420468:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000004:00080000:0.0:1746147716.420515:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b6680/2, rc 0, transno 21474841449 00000100:00100000:0.0:1746147716.420521:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796341376:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147716.420530:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b10b480/2, rc 0, transno 21474841450 00000100:00100000:0.0:1746147716.420533:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796341888:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147716.420545:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094690a80/2, rc 0, transno 17179874218 00000100:00100000:0.0:1746147716.420549:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796342400:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147716.420556:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094692a00/2, rc 0, transno 17179874219 00000100:00100000:0.0:1746147716.420558:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796342912:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147716.420566:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b6300/2, rc 0, transno 21474841447 00000100:00100000:0.0:1746147716.420568:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796341248:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147716.420575:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b7100/2, rc 0, transno 21474841448 00000100:00100000:0.0:1746147716.420577:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796341760:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147716.420584:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b108000/2, rc 0, transno 17179874216 00000100:00100000:0.0:1746147716.420586:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796342272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147716.420593:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094691880/2, rc 0, transno 17179874217 00000100:00100000:0.0:1746147716.420596:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796342784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.450726:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.468401:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.469246:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.471962:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.474264:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.479778:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.488237:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.490441:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.500774:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.510162:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.510194:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.510228:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.510273:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793672960 00000100:00100000:0.0:1746147716.510282:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793672960 00000100:00100000:0.0:1746147716.510326:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11860 00000100:00100000:0.0:1746147716.510334:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:31876:x1830967793672960:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147716.510360:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147716.510380:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093da9800/0xe64d3fbf12a7bf9d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa99f expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.510435:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.510449:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6d200/0xe64d3fbf12a7bf96 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147716.510460:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.510478:0:14546:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6d200/0xe64d3fbf12a7bf96 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147716.510489:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147716.510511:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793673216 00000100:00100000:0.0:1746147716.510514:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793673216 00010000:00010000:0.0:1746147716.510530:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd63000/0xe64d3fbf12a7bf1f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa96e expref: 8 pid: 14546 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746147716.510545:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793673088 00000100:00100000:0.0:1746147716.510547:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793673088 00010000:00010000:0.0:1746147716.510556:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092c24a00/0xe64d3fbf12a7bf73 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa97c expref: 326 pid: 14545 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746147716.510575:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8005 00000100:00100000:0.0:1746147716.510580:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793673216:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147716.510588:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147716.510592:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd63000/0xe64d3fbf12a7bf1f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa96e expref: 8 pid: 14546 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746147716.510602:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd63000/0xe64d3fbf12a7bf1f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa96e expref: 8 pid: 14546 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746147716.510621:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147716.510626:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6d200/0xe64d3fbf12a7bf96 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147716.510631:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6d200/0xe64d3fbf12a7bf96 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147716.510636:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147716.510676:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793673216:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 95us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147716.510682:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8005 00000100:00100000:0.0:1746147716.510698:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8006 00000100:00100000:0.0:1746147716.510702:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:1959:x1830967793673088:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147716.510707:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147716.510710:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092c24a00/0xe64d3fbf12a7bf73 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa97c expref: 326 pid: 14545 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746147716.510722:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092c24a00/0xe64d3fbf12a7bf73 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa97c expref: 326 pid: 14545 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746147716.510738:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147716.510740:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6d200/0xe64d3fbf12a7bf96 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147716.510747:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6d200/0xe64d3fbf12a7bf96 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147716.510753:0:7312:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6d200/0xe64d3fbf12a7bf96 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147716.510759:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.510763:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.510771:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147716.510785:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:1959:x1830967793673088:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 83us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147716.510790:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8006 00000100:00100000:0.0:1746147716.517951:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.523763:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.523826:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.523846:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793673600 00000100:00100000:0.0:1746147716.523853:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793673600 00000100:00100000:0.0:1746147716.523906:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15794 00000100:00100000:0.0:1746147716.523914:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b6cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:31879:x1830967793673600:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147716.523931:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147716.523947:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7bfb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa9ad expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.523970:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147716.523976:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7bfb2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9ad expref: 20 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.523987:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7bfb2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9ad expref: 20 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.523998:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a650e600, rc 0) 00000100:00100000:0.0:1746147716.524041:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b6cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:31879:x1830967793673600:12345-192.168.202.10@tcp:101:cat.0 Request processed in 128us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147716.524047:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15794 00000100:00100000:0.0:1746147716.524070:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8007 00000100:00100000:0.0:1746147716.524075:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967793673472:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147716.524084:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147716.524108:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5468800/0xe64d3fbf12a7bef5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa94b expref: 12 pid: 4591 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746147716.524118:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5468800/0xe64d3fbf12a7bef5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa94b expref: 12 pid: 4591 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746147716.524135:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.524137:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.524142:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd63000/0xe64d3fbf12a7bfab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9a6 expref: 30 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.524151:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd63000/0xe64d3fbf12a7bfab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9a6 expref: 30 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.524162:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.524163:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.524166:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7bfb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9ad expref: 19 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.524173:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7bfb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9ad expref: 19 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.524199:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7bfb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9ad expref: 19 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147716.524211:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cbad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796343936:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147716.524268:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd63000/0xe64d3fbf12a7bfab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9a6 expref: 30 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147716.524276:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cb8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796344064:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147716.524295:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147716.529522:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.529581:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.529619:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793673728 00000100:00100000:0.0:1746147716.529627:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793673728 00000100:00100000:0.0:1746147716.529677:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793673856 00000100:00100000:0.0:1746147716.529681:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793673856 00000100:00100000:0.0:1746147716.529705:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11861 00000100:00100000:0.0:1746147716.529715:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b6cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:31879:x1830967793673728:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147716.529739:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147716.529764:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ed800/0xe64d3fbf12a7bfb9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa9b4 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.529843:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.529853:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ed800/0xe64d3fbf12a7bfb9 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9b4 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.529873:0:17544:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.529913:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ed800/0xe64d3fbf12a7bfb9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9b4 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.529930:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147716.529933:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147716.529936:0:17544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.529942:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950ed800, rc 0) 00000100:00100000:0.0:1746147716.529972:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11862 00000100:00100000:0.0:1746147716.529980:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b6cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:31878:x1830967793673856:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147716.529989:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147716.530001:0:15085:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ed200/0xe64d3fbf12a7bfc0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa9bb expref: -99 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.530033:0:15085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ed200/0xe64d3fbf12a7bfc0 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9bb expref: 326 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.530043:0:15085:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ed200/0xe64d3fbf12a7bfc0 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9bb expref: 326 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.530050:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147716.530052:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147716.530054:0:15085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.530059:0:15085:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950ed200, rc 0) 00000100:00100000:0.0:1746147716.530105:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b6cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:31878:x1830967793673856:12345-192.168.202.10@tcp:101:cat.0 Request processed in 125us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147716.530113:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11862 00000100:00100000:0.0:1746147716.530260:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b6cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:31879:x1830967793673728:12345-192.168.202.10@tcp:101:cat.0 Request processed in 545us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147716.530266:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11861 00000001:00080000:0.0:1746147716.563734:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945834 is committed 00000001:00080000:0.0:1746147716.563748:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945836 is committed 00000004:00080000:0.0:1746147716.563753:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2647 committed 00000004:00080000:0.0:1746147716.563759:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2626 committed 00000004:00080000:0.0:1746147716.563764:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2625 committed 00000004:00080000:0.0:1746147716.563765:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2624 committed 00000004:00080000:0.0:1746147716.563766:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2623 committed 00000004:00080000:0.0:1746147716.563767:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2646 committed 00000004:00080000:0.0:1746147716.563769:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2622 committed 00000004:00080000:0.0:1746147716.563771:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2645 committed 00000004:00080000:0.0:1746147716.563772:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2621 committed 00000004:00080000:0.0:1746147716.563774:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2644 committed 00000004:00080000:0.0:1746147716.563775:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2643 committed 00000004:00080000:0.0:1746147716.563776:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2642 committed 00000004:00080000:0.0:1746147716.563778:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2620 committed 00000004:00080000:0.0:1746147716.563779:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2619 committed 00000004:00080000:0.0:1746147716.563782:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2641 committed 00000004:00080000:0.0:1746147716.563783:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2640 committed 00000004:00080000:0.0:1746147716.563785:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2618 committed 00000001:00080000:0.0:1746147716.563790:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945835 is committed 00000001:00080000:0.0:1746147716.563805:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945832 is committed 00000100:00100000:0.0:1746147716.564145:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796344448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.564782:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147716.565771:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0434a80/2, rc 0, transno 17179874221 00000100:00100000:1.0:1746147716.565777:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796345728:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147716.565781:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e35880/2, rc 0, transno 17179874222 00000100:00100000:1.0:1746147716.565784:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796346240:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.565823:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746147716.565828:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009433a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796346368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.565842:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.565855:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796346368 00000100:00100000:1.0:1746147716.565859:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796346368 00000100:00100000:1.0:1746147716.565870:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15800 00000100:00100000:1.0:1746147716.565873:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3301:x1830967796346368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.565967:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3301:x1830967796346368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (123us total) trans 17179874223 rc 0/0 00000100:00100000:1.0:1746147716.565971:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15800 00000100:00100000:0.0:1746147716.566419:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796344960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.566441:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.567930:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796345472:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147716.568096:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009433a680/2, rc 0, transno 17179874223 00000100:00100000:1.0:1746147716.568102:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009433a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796346368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.568130:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.568148:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796344832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147716.568171:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.568181:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796345344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.568194:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.568205:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796345856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.568222:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.568243:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796344320 00000100:00100000:1.0:1746147716.568247:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796344320 00000100:00100000:1.0:1746147716.568269:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796344832 00000100:00100000:1.0:1746147716.568272:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796344832 00000100:00100000:1.0:1746147716.568280:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796345344 00000100:00100000:1.0:1746147716.568282:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796345344 00000100:00100000:1.0:1746147716.568293:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796345856 00000100:00100000:1.0:1746147716.568294:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796345856 00000100:00100000:1.0:1746147716.568306:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15802 00000100:00100000:1.0:1746147716.568311:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3302:x1830967796344320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147716.568459:0:10613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147716.568462:0:10613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00002000:00010000:1.0:1746147716.568464:0:10613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:1.0:1746147716.568465:0:10613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:1.0:1746147716.568467:0:10613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147716.568496:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3302:x1830967796344320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (366us total) trans 21474841455 rc 0/0 00000100:00100000:1.0:1746147716.568502:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15802 00000100:00100000:1.0:1746147716.568516:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15805 00000100:00100000:1.0:1746147716.568520:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3302:x1830967796345856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.568622:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+55:3302:x1830967796345856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (398us total) trans 17179874225 rc 0/0 00000100:00100000:1.0:1746147716.568629:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15805 00000004:00080000:1.0:1746147716.568660:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c9a8000/2, rc 0, transno 21474841455 00000100:00100000:1.0:1746147716.568664:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796344320:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147716.568671:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d6680/2, rc 0, transno 21474841456 00000100:00100000:1.0:1746147716.568674:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796344832:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147716.568682:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d4000/2, rc 0, transno 17179874224 00000100:00100000:1.0:1746147716.568684:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796345344:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147716.568690:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0437800/2, rc 0, transno 17179874225 00000100:00100000:1.0:1746147716.568693:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796345856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.568814:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.568840:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796345984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.568857:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147716.568877:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c9a8700/2, rc 0, transno 21474841453 00000100:00100000:0.0:1746147716.568880:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796344448:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147716.568910:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d4a80/2, rc 0, transno 21474841454 00000100:00100000:0.0:1746147716.568914:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796344960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.568919:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746147716.568925:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796344576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.568941:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.568953:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796345088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.568965:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.568974:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796345600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.568987:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.568995:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796346112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.569007:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147716.569030:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796345472 00000100:00100000:0.0:1746147716.569033:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796345472 00000100:00100000:0.0:1746147716.569066:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796345984 00000100:00100000:0.0:1746147716.569068:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796345984 00000100:00100000:0.0:1746147716.569078:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796344576 00000100:00100000:0.0:1746147716.569080:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796344576 00000100:00100000:0.0:1746147716.569089:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796345088 00000100:00100000:0.0:1746147716.569090:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796345088 00000100:00100000:0.0:1746147716.569097:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796345600 00000100:00100000:0.0:1746147716.569099:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796345600 00000100:00100000:0.0:1746147716.569104:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796346112 00000100:00100000:0.0:1746147716.569105:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796346112 00000100:00100000:0.0:1746147716.569112:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15806 00000100:00100000:0.0:1746147716.569116:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b6cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3303:x1830967796345472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147716.569207:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147716.569210:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.569211:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:0.0:1746147716.569213:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.569215:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147716.569236:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b6cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3303:x1830967796345472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (422us total) trans 17179874226 rc 0/0 00000100:00100000:0.0:1746147716.569241:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15806 00000100:00100000:0.0:1746147716.569253:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15807 00000100:00100000:0.0:1746147716.569257:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b6cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3303:x1830967796345984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.569330:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b6cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3303:x1830967796345984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (471us total) trans 17179874227 rc 0/0 00000100:00100000:0.0:1746147716.569335:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15807 00000100:00100000:0.0:1746147716.569346:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15808 00000100:00100000:0.0:1746147716.569350:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b6cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3303:x1830967796344576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147716.569428:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147716.569430:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.569432:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:0.0:1746147716.569434:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.569435:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147716.569452:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b6cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3303:x1830967796344576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (511us total) trans 21474841457 rc 0/0 00000100:00100000:0.0:1746147716.569457:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15808 00000100:00100000:0.0:1746147716.569466:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15809 00000100:00100000:0.0:1746147716.569470:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b6cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3303:x1830967796345088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147716.569542:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b6cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3303:x1830967796345088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (575us total) trans 21474841458 rc 0/0 00000100:00100000:0.0:1746147716.569547:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15809 00000100:00100000:0.0:1746147716.569555:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15810 00000100:00100000:0.0:1746147716.569559:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b6cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3303:x1830967796345600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147716.569628:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:0.0:1746147716.569631:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.569632:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:0.0:1746147716.569635:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:0.0:1746147716.569636:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:0.0:1746147716.569653:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b6cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3303:x1830967796345600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (665us total) trans 17179874228 rc 0/0 00000100:00100000:0.0:1746147716.569657:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15810 00000100:00100000:0.0:1746147716.569665:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15811 00000100:00100000:0.0:1746147716.569669:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b6cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3303:x1830967796346112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.569743:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b6cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3303:x1830967796346112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (734us total) trans 17179874229 rc 0/0 00000100:00100000:0.0:1746147716.569747:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15811 00000004:00080000:0.0:1746147716.569965:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c9a8e00/2, rc 0, transno 21474841457 00000100:00100000:0.0:1746147716.569970:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796344576:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147716.569976:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d5c00/2, rc 0, transno 21474841458 00000100:00100000:0.0:1746147716.569978:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796345088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147716.569985:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0435f80/2, rc 0, transno 17179874228 00000100:00100000:0.0:1746147716.569987:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796345600:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147716.569992:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e36d80/2, rc 0, transno 17179874229 00000100:00100000:0.0:1746147716.569994:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796346112:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147716.570000:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d6a00/2, rc 0, transno 17179874226 00000100:00100000:0.0:1746147716.570002:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796345472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147716.570007:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0435880/2, rc 0, transno 17179874227 00000100:00100000:0.0:1746147716.570010:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796345984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.576937:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.577022:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793673984 00000100:00100000:1.0:1746147716.577032:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793673984 00010000:00010000:1.0:1746147716.577070:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6d200/0xe64d3fbf12a7bf96 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa998 expref: 8 pid: 14545 timeout: 895 lvb_type: 0 00000100:00100000:1.0:1746147716.577665:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8008 00000100:00100000:1.0:1746147716.577675:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1959:x1830967793673984:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147716.577691:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147716.577697:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6d200/0xe64d3fbf12a7bf96 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa998 expref: 8 pid: 14545 timeout: 895 lvb_type: 0 00010000:00010000:1.0:1746147716.577710:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6d200/0xe64d3fbf12a7bf96 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa998 expref: 8 pid: 14545 timeout: 895 lvb_type: 0 00010000:00010000:1.0:1746147716.577736:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6d200/0xe64d3fbf12a7bf96 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa998 expref: 8 pid: 14545 timeout: 895 lvb_type: 0 00010000:00010000:1.0:1746147716.577760:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147716.577765:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147716.577775:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147716.577781:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147716.577792:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ed800/0xe64d3fbf12a7bfb9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9b4 expref: 7 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147716.577828:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147716.577877:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1959:x1830967793673984:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 203us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147716.577911:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8008 00010000:00010000:0.0:1746147716.578245:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.578254:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00000040:00080000:0.0:1746147716.579080:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3558, 88 off297464 00000004:00080000:0.0:1746147716.579089:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795753203366ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147716.579135:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3579, 88 off298960 00000004:00080000:0.0:1746147716.579138:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795753253553ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147716.579148:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3580, 88 off299048 00000004:00080000:0.0:1746147716.579150:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795753265978ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147716.579157:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3559, 88 off297552 00000004:00080000:0.0:1746147716.579160:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795753275288ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147716.579165:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3560, 88 off297640 00000004:00080000:0.0:1746147716.579167:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795753282746ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147716.579173:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3581, 88 off299136 00000004:00080000:0.0:1746147716.579175:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795753290230ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147716.579181:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3582, 88 off299224 00000004:00080000:0.0:1746147716.579183:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795753299068ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147716.579189:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3583, 88 off299312 00000004:00080000:0.0:1746147716.579192:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795753307210ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147716.579197:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3561, 88 off297728 00000004:00080000:0.0:1746147716.579199:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795753314831ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147716.579205:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3584, 88 off299400 00000004:00080000:0.0:1746147716.579207:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795753323093ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147716.579213:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3562, 88 off297816 00000004:00080000:0.0:1746147716.579216:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795753331318ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147716.579221:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3585, 88 off299488 00000004:00080000:0.0:1746147716.579223:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795753339098ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147716.579231:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3563, 88 off297904 00000004:00080000:0.0:1746147716.579233:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795753348568ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147716.579239:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3564, 88 off297992 00000004:00080000:0.0:1746147716.579241:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795753356493ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147716.579247:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3565, 88 off298080 00000004:00080000:0.0:1746147716.579249:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795753364839ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147716.579255:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3566, 88 off298168 00000004:00080000:0.0:1746147716.579258:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795753373729ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147716.579264:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3586, 88 off299576 00000004:00080000:0.0:1746147716.579266:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795753381468ns, next at 756024029964ns, rc = 0 00000001:00080000:1.0:1746147716.610770:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945837 is committed 00000004:00080000:1.0:1746147716.610785:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2655 committed 00000004:00080000:1.0:1746147716.610792:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2635 committed 00000004:00080000:1.0:1746147716.610805:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2634 committed 00000004:00080000:1.0:1746147716.610807:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2633 committed 00000004:00080000:1.0:1746147716.610808:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2632 committed 00000004:00080000:1.0:1746147716.610810:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2654 committed 00000004:00080000:1.0:1746147716.610811:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2631 committed 00000004:00080000:1.0:1746147716.610813:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2653 committed 00000004:00080000:1.0:1746147716.610814:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2630 committed 00000004:00080000:1.0:1746147716.610816:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2652 committed 00000004:00080000:1.0:1746147716.610817:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2651 committed 00000004:00080000:1.0:1746147716.610822:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2650 committed 00000004:00080000:1.0:1746147716.610823:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2629 committed 00000004:00080000:1.0:1746147716.610825:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2628 committed 00000004:00080000:1.0:1746147716.610826:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2649 committed 00000004:00080000:1.0:1746147716.610827:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2648 committed 00000004:00080000:1.0:1746147716.610829:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2627 committed 00000100:00100000:1.0:1746147716.610987:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796346496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147716.611445:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611465:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796347008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147716.611480:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611491:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796347520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.611505:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611514:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796348032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.611525:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611537:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746147716.611541:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796346624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147716.611553:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611561:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796347136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147716.611573:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611581:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796347648:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.611592:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611599:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009111aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796348160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.611609:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611626:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796346752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147716.611640:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611646:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796347264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147716.611655:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611660:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796347776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.611669:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611675:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009111a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796348416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.611685:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611691:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746147716.611695:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796346880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147716.611708:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611713:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796347392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147716.611727:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611732:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796347904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.611743:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611750:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009111a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796348544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.611761:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147716.611777:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796346624 00000100:00100000:1.0:1746147716.611780:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796346624 00000100:00100000:1.0:1746147716.611792:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796347136 00000100:00100000:1.0:1746147716.611807:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796347136 00000100:00100000:1.0:1746147716.611815:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796348160 00000100:00100000:1.0:1746147716.611817:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796348160 00000100:00100000:1.0:1746147716.611822:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796347264 00000100:00100000:1.0:1746147716.611824:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796347264 00000100:00100000:1.0:1746147716.611829:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796348416 00000100:00100000:1.0:1746147716.611831:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796348416 00000100:00100000:1.0:1746147716.611835:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796347392 00000100:00100000:1.0:1746147716.611837:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796347392 00000100:00100000:1.0:1746147716.611842:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796347904 00000100:00100000:1.0:1746147716.611844:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796347904 00000100:00100000:1.0:1746147716.611851:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15813 00000100:00100000:1.0:1746147716.611855:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3303:x1830967796347008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147716.611954:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:1.0:1746147716.611956:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147716.611958:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147716.611960:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147716.611962:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:1.0:1746147716.611981:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3303:x1830967796347008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (499us total) trans 21474841460 rc 0/0 00000100:00100000:1.0:1746147716.611986:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15813 00000100:00100000:1.0:1746147716.611997:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15816 00000100:00100000:1.0:1746147716.612001:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3303:x1830967796346624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147716.612061:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147716.612063:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00002000:00010000:1.0:1746147716.612065:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:1.0:1746147716.612067:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:1.0:1746147716.612068:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147716.612081:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3303:x1830967796346624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (528us total) trans 21474841461 rc 0/0 00000100:00100000:1.0:1746147716.612087:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15816 00000100:00100000:1.0:1746147716.612094:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15818 00000100:00100000:1.0:1746147716.612098:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3303:x1830967796347648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147716.612156:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147716.612158:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00002000:00010000:1.0:1746147716.612160:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:1.0:1746147716.612162:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:1.0:1746147716.612163:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746147716.612176:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3303:x1830967796347648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (584us total) trans 17179874232 rc 0/0 00000100:00100000:1.0:1746147716.612180:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15818 00000100:00100000:1.0:1746147716.612188:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15820 00000100:00100000:1.0:1746147716.612191:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3301:x1830967796346752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147716.612250:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147716.612252:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00002000:00010000:1.0:1746147716.612254:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:1.0:1746147716.612256:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:1.0:1746147716.612258:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746147716.612276:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3301:x1830967796346752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (635us total) trans 21474841463 rc 0/0 00000100:00100000:1.0:1746147716.612280:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15820 00000100:00100000:1.0:1746147716.612289:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15822 00000100:00100000:1.0:1746147716.612293:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3301:x1830967796347776:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147716.613057:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172dc00/2, rc 0, transno 21474841465 00000100:00100000:0.0:1746147716.613065:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796346880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147716.613072:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172c700/2, rc 0, transno 21474841466 00000100:00100000:0.0:1746147716.613074:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796347392:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147716.613080:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172d500/2, rc 0, transno 21474841463 00000100:00100000:0.0:1746147716.613083:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796346752:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147716.613088:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172c380/2, rc 0, transno 21474841464 00000100:00100000:0.0:1746147716.613090:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796347264:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147716.613110:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172d880/2, rc 0, transno 21474841461 00002000:00010000:1.0:1746147716.613309:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:1.0:1746147716.613311:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00000100:00100000:0.0:1746147716.613311:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796346624:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147716.613313:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:1.0:1746147716.613315:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:1.0:1746147716.613316:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000004:00080000:0.0:1746147716.613322:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172ea00/2, rc 0, transno 21474841462 00000100:00100000:0.0:1746147716.613325:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796347136:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147716.613334:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172f480/2, rc 0, transno 17179874232 00000100:00100000:1.0:1746147716.613335:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3301:x1830967796347776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1042us (1664us total) trans 17179874234 rc 0/0 00000100:00100000:1.0:1746147716.613340:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15822 00000100:00100000:0.0:1746147716.613341:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796347648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147716.613348:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009111aa00/2, rc 0, transno 17179874233 00000100:00100000:0.0:1746147716.613351:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009111aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796348160:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147716.613358:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172ca80/2, rc 0, transno 21474841459 00000100:00100000:0.0:1746147716.613361:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796346496:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147716.613367:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172df80/2, rc 0, transno 21474841460 00000100:00100000:0.0:1746147716.613369:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796347008:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147716.613377:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172f100/2, rc 0, transno 17179874230 00000100:00100000:0.0:1746147716.613379:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796347520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147716.613385:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172f800/2, rc 0, transno 17179874231 00000100:00100000:0.0:1746147716.613387:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796348032:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147716.613400:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172e300/2, rc 0, transno 17179874235 00000100:00100000:0.0:1746147716.613402:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796347904:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147716.613408:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009111a300/2, rc 0, transno 17179874236 00000100:00100000:1.0:1746147716.613409:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746147716.613410:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009111a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796348544:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147716.613415:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172e680/2, rc 0, transno 17179874234 00000100:00100000:1.0:1746147716.613416:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796348800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.613417:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796347776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147716.613517:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147716.613766:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800943c6a00/2, rc 0, transno 17179874238 00000100:00100000:1.0:1746147716.613770:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796348800:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147716.613780:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009111a680/2, rc 0, transno 17179874237 00000100:00100000:1.0:1746147716.613782:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009111a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796348416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147716.616879:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.616965:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.617481:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4899 00000100:00100000:1.0:1746147716.617487:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:31878:x1830967793674368:12345-192.168.202.10@tcp:49:cat.0 00000100:00100000:1.0:1746147716.617549:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:31878:x1830967793674368:12345-192.168.202.10@tcp:49:cat.0 Request processed in 62us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147716.617555:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4899 00000100:00100000:0.0:1746147716.618387:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.620435:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.622931:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 884 00000100:00100000:1.0:1746147716.622941:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e386d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1957:x1830967793674624:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147716.622956:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147716.622982:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7bfc7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9c2 expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147716.622999:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147716.623003:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147716.623050:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e386d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1957:x1830967793674624:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 111us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147716.623057:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 884 00000100:00100000:0.0:1746147716.623184:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.623859:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.623964:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793674880 00000100:00100000:1.0:1746147716.623968:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793674880 00000100:00100000:1.0:1746147716.623998:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15830 00000100:00100000:1.0:1746147716.624003:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:31876:x1830967793674880:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147716.624010:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147716.624021:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc78e00/0xe64d3fbf12a7bfd5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa9d0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147716.624036:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5469e00/0xe64d3fbf12a7befc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa952 expref: 10 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147716.624043:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147716.624044:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147716.624047:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc78e00/0xe64d3fbf12a7bfd5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1441792->1966079] (req 1441792->1966079) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9d0 expref: 31 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147716.624062:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5469e00/0xe64d3fbf12a7befc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa952 expref: 10 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147716.624070:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5469e00/0xe64d3fbf12a7befc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa952 expref: 10 pid: 4591 timeout: 895 lvb_type: 0 00000100:00100000:1.0:1746147716.624078:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796349056:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147716.624124:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e2c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147716.626769:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.626991:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.627021:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.627229:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793675648 00000100:00100000:1.0:1746147716.627237:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793675648 00010000:00010000:1.0:1746147716.627268:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5469e00/0xe64d3fbf12a7befc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa952 expref: 11 pid: 4591 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746147716.627293:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.627340:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793675520 00000100:00100000:0.0:1746147716.627347:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793675520 00010000:00010000:0.0:1746147716.627374:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd62400/0xe64d3fbf12a7bf11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa967 expref: 12 pid: 4591 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746147716.627398:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8009 00000100:00100000:0.0:1746147716.627405:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967793675648:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147716.627418:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147716.627437:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5469e00/0xe64d3fbf12a7befc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa952 expref: 12 pid: 4591 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746147716.627447:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5469e00/0xe64d3fbf12a7befc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa952 expref: 12 pid: 4591 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746147716.627468:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.627470:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147716.627476:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc78e00/0xe64d3fbf12a7bfd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1441792->1966079) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9d0 expref: 32 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.627484:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc78e00/0xe64d3fbf12a7bfd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1441792->1966079) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9d0 expref: 32 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.627512:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc78e00/0xe64d3fbf12a7bfd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1441792->1966079) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9d0 expref: 32 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147716.627528:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce60700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796349184:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147716.627581:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03600 going to sleep for 11 seconds 00010000:00010000:1.0:1746147716.627765:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5469e00/0xe64d3fbf12a7befc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa952 expref: 11 pid: 4591 timeout: 895 lvb_type: 0 00000100:00100000:1.0:1746147716.627775:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796349056:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147716.627980:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc78e00/0xe64d3fbf12a7bfd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9d0 expref: 32 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147716.627996:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc78e00, rc 0) 00000100:00100000:1.0:1746147716.628104:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:31876:x1830967793674880:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4099us (4245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147716.628111:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15830 00000100:00100000:1.0:1746147716.635238:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce60700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796349184:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147716.635264:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147716.635334:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793675648:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7927us (8308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147716.635345:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8009 00000100:00100000:1.0:1746147716.641619:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793675392:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 14086us (14628us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147716.641626:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6985 00002000:00100000:1.0:1746147716.641631:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009fc37480 x1830967793675392/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:337/0 lens 488/440 e 0 to 0 dl 1746147727 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147716.641637:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc37480 with x1830967793675392 ext(1048576->2097151) 00002000:00010000:1.0:1746147716.641641:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc37480 00000100:00100000:0.0:1746147716.646090:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.651073:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.651135:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.655521:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.655580:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.656916:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793677312 00000100:00100000:1.0:1746147716.656924:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793677312 00000100:00100000:0.0:1746147716.657413:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.658115:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15831 00000100:00100000:1.0:1746147716.658125:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:31879:x1830967793677312:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147716.658139:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147716.658158:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc78400/0xe64d3fbf12a7bfdc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafa9d7 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147716.658844:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc78e00/0xe64d3fbf12a7bfd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9d0 expref: 32 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147716.658854:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147716.658855:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147716.658859:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc78400/0xe64d3fbf12a7bfdc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9d7 expref: 22 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147716.658911:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc78e00/0xe64d3fbf12a7bfd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1966079) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9d0 expref: 32 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147716.658923:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc78e00/0xe64d3fbf12a7bfd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1966079) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9d0 expref: 32 pid: 8469 timeout: 895 lvb_type: 0 00000100:00100000:1.0:1746147716.658934:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796349440:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147716.659003:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e2c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147716.661471:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.662303:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796349440:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147716.662327:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc78400/0xe64d3fbf12a7bfdc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9d7 expref: 22 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147716.662340:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc78400, rc 0) 00000100:00100000:1.0:1746147716.662358:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:31879:x1830967793677312:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4237us (6779us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147716.662365:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15831 00000100:00100000:0.0:1746147716.662725:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.666183:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.669844:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.674227:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.685007:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.691279:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.694128:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.697595:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.697637:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.706976:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.707069:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.707859:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15837 00000100:00100000:0.0:1746147716.707867:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b6cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:31878:x1830967793679488:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147716.708099:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147716.708108:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915e4400/0xe64d3fbf12a7c006 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaa01 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.708128:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7bf0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa960 expref: 8 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.708134:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147716.708135:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147716.708138:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800915e4400/0xe64d3fbf12a7c006 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa01 expref: 34 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.708161:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7bf0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa960 expref: 8 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.708170:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7bf0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa960 expref: 8 pid: 4591 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746147716.708180:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796350208:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147716.708246:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147716.717106:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.718383:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.730181:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.734183:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.744790:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.744841:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.744867:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.744916:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.745111:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6997 00000100:00100000:1.0:1746147716.745119:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b6cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967793680640:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147716.745977:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6999 00000100:00100000:0.0:1746147716.745985:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967793681152:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147716.760541:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b6cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793680640:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15414us (15691us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147716.760552:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6997 00002000:00100000:1.0:1746147716.760562:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800b6cbad80 x1830967793680640/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:337/0 lens 488/440 e 0 to 0 dl 1746147727 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147716.760570:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b6cbad80 with x1830967793680640 ext(2097152->3145727) 00002000:00010000:1.0:1746147716.760574:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b6cbad80 00000100:00100000:0.0:1746147716.762470:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147716.763279:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147716.768461:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793681152:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22475us (23543us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147716.768468:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6999 00002000:00100000:1.0:1746147716.768474:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880091118a80 x1830967793681152/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:337/0 lens 488/440 e 0 to 0 dl 1746147727 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147716.768480:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091118a80 with x1830967793681152 ext(3145728->4194303) 00002000:00010000:1.0:1746147716.768483:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091118a80 00000100:00100000:0.0:1746147716.771976:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.772182:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793681536 00000100:00100000:1.0:1746147716.772188:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793681536 00002000:00100000:1.0:1746147716.772221:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3469312->3948543) req@ffff88009111b800 x1830967793681536/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:337/0 lens 488/0 e 0 to 0 dl 1746147727 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147716.772228:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111b800 with x1830967793681536 ext(3469312->3948543) 00010000:00010000:1.0:1746147716.772234:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7bfce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9c9 expref: 22 pid: 8470 timeout: 895 lvb_type: 0 00010000:00010000:1.0:1746147716.772244:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7bfce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9c9 expref: 22 pid: 8470 timeout: 895 lvb_type: 0 00002000:00010000:1.0:1746147716.772250:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009111b800 00000100:00100000:1.0:1746147716.772664:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1374 00000100:00100000:1.0:1746147716.772671:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967793681536:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147716.782627:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967793681536:12345-192.168.202.10@tcp:4:cat.0 Request processed in 9948us (10643us total) trans 21474841468 rc 0/0 00000100:00100000:1.0:1746147716.782638:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1374 00002000:00100000:1.0:1746147716.782649:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3469312->3948543) req@ffff88009111b800 x1830967793681536/t21474841468(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:337/0 lens 488/448 e 0 to 0 dl 1746147727 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147716.782657:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111b800 with x1830967793681536 ext(3469312->3948543) 00010000:00010000:1.0:1746147716.782666:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7bfce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9c9 expref: 24 pid: 8470 timeout: 895 lvb_type: 0 00010000:00010000:1.0:1746147716.782680:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7bfce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9c9 expref: 24 pid: 8470 timeout: 895 lvb_type: 0 00002000:00010000:1.0:1746147716.782687:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009111b800 00000100:00100000:0.0:1746147716.783069:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.791328:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.803153:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.803192:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793682048 00000100:00100000:0.0:1746147716.803200:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793682048 00000100:00100000:0.0:1746147716.803238:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11864 00000100:00100000:0.0:1746147716.803246:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:31883:x1830967793682048:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147716.803266:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147716.803282:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093040600/0xe64d3fbf12a7c022 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaa1d expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.803379:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093041400/0xe64d3fbf12a7c029 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803390:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093041400/0xe64d3fbf12a7c029 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803399:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093041400/0xe64d3fbf12a7c029 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803409:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093041e00/0xe64d3fbf12a7c030 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803414:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093041e00/0xe64d3fbf12a7c030 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803419:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093041e00/0xe64d3fbf12a7c030 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803512:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093040c00/0xe64d3fbf12a7c037 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803519:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093040c00/0xe64d3fbf12a7c037 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803525:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093040c00/0xe64d3fbf12a7c037 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:0.0:1746147716.803533:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147716.803600:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093041400/0xe64d3fbf12a7c029 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803606:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093041400/0xe64d3fbf12a7c029 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803611:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093041400/0xe64d3fbf12a7c029 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803617:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093041400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147716.803619:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093041400/0xe64d3fbf12a7c029 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803625:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093041400/0xe64d3fbf12a7c029 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803634:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147716.803636:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147716.803639:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093041400/0xe64d3fbf12a7c029 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803644:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093041400/0xe64d3fbf12a7c029 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803662:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093041e00/0xe64d3fbf12a7c030 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803667:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093041e00/0xe64d3fbf12a7c030 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803671:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093041e00/0xe64d3fbf12a7c030 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803675:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093041e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147716.803677:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093041e00/0xe64d3fbf12a7c030 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803682:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093041e00/0xe64d3fbf12a7c030 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803687:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fb79200) 00010000:00010000:0.0:1746147716.803689:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147716.803691:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093041e00/0xe64d3fbf12a7c030 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803696:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093041e00/0xe64d3fbf12a7c030 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147716.803725:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093040600/0xe64d3fbf12a7c022 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa1d expref: 11 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.803734:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093040c00/0xe64d3fbf12a7c037 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa1d expref: 10 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147716.803740:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147716.803742:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147716.803744:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093040c00, rc 0) 00000100:00100000:0.0:1746147716.803781:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:31883:x1830967793682048:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 536us (637us total) trans 8589945840 rc 0/0 00000100:00100000:0.0:1746147716.803787:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11864 00010000:00010000:0.0:1746147716.803923:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7c01b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa16 expref: 24 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147716.803937:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796350592:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147716.805042:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7c014 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa0f expref: 33 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147716.805053:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0597b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796350720:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147716.805823:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147716.814427:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.814461:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.814492:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.814557:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793682304 00000100:00100000:1.0:1746147716.814565:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793682304 00002000:00100000:1.0:1746147716.814601:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a0597b80 x1830967793682304/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:337/0 lens 488/0 e 0 to 0 dl 1746147727 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147716.814610:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0597b80 with x1830967793682304 ext(2097152->3145727) 00002000:00010000:1.0:1746147716.814616:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0597b80 00000100:00100000:1.0:1746147716.814628:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793682688 00000100:00100000:1.0:1746147716.814630:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793682688 00002000:00100000:1.0:1746147716.814637:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880093cd5c00 x1830967793682688/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:337/0 lens 488/0 e 0 to 0 dl 1746147727 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147716.814643:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5c00 with x1830967793682688 ext(3145728->4194303) 00002000:00010000:1.0:1746147716.814645:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd5c00 00000100:00100000:1.0:1746147716.814651:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793682816 00000100:00100000:1.0:1746147716.814653:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793682816 00002000:00100000:1.0:1746147716.814661:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880093cd5180 x1830967793682816/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:337/0 lens 488/0 e 0 to 0 dl 1746147727 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147716.814667:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5180 with x1830967793682816 ext(3145728->4194303) 00002000:00010000:1.0:1746147716.814670:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd5180 00000100:00100000:1.0:1746147716.814679:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7000 00000100:00100000:1.0:1746147716.814685:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967793682304:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147716.822421:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.822454:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.822524:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793683072 00000100:00100000:1.0:1746147716.822531:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793683072 00002000:00100000:1.0:1746147716.822565:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880135848000 x1830967793683072/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:337/0 lens 488/0 e 0 to 0 dl 1746147727 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147716.822574:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848000 with x1830967793683072 ext(2097152->3145727) 00002000:00010000:1.0:1746147716.822579:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135848000 00000100:00100000:1.0:1746147716.822592:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793683200 00000100:00100000:1.0:1746147716.822593:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793683200 00002000:00100000:1.0:1746147716.822600:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880135849f80 x1830967793683200/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:337/0 lens 488/0 e 0 to 0 dl 1746147727 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147716.822607:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849f80 with x1830967793683200 ext(3145728->4194303) 00002000:00010000:1.0:1746147716.822609:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135849f80 00000100:00100000:1.0:1746147716.822618:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7003 00000100:00100000:1.0:1746147716.822624:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967793683072:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147716.827944:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967793682304:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13250us (13519us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147716.827956:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7000 00002000:00100000:1.0:1746147716.827966:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a0597b80 x1830967793682304/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:337/0 lens 488/440 e 0 to 0 dl 1746147727 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147716.827975:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0597b80 with x1830967793682304 ext(2097152->3145727) 00002000:00010000:1.0:1746147716.827979:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0597b80 00000100:00100000:1.0:1746147716.838399:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793683072:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15773us (15983us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147716.838407:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7003 00002000:00100000:1.0:1746147716.838418:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880135848000 x1830967793683072/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:337/0 lens 488/440 e 0 to 0 dl 1746147727 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147716.838426:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848000 with x1830967793683072 ext(2097152->3145727) 00002000:00010000:1.0:1746147716.838429:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135848000 00000100:00100000:0.0:1746147716.861292:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.861383:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793683584 00000100:00100000:1.0:1746147716.861392:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793683584 00002000:00100000:1.0:1746147716.861427:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880135848e00 x1830967793683584/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:337/0 lens 488/0 e 0 to 0 dl 1746147727 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147716.861436:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848e00 with x1830967793683584 ext(4194304->5017599) 00002000:00010000:1.0:1746147716.861441:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135848e00 00000100:00100000:1.0:1746147716.861468:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7005 00000100:00100000:1.0:1746147716.861474:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793683584:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147716.866235:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.874534:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793683584:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13050us (13240us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147716.874546:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7005 00002000:00100000:1.0:1746147716.874555:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880135848e00 x1830967793683584/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:337/0 lens 488/440 e 0 to 0 dl 1746147727 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147716.874565:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848e00 with x1830967793683584 ext(4194304->5017599) 00002000:00010000:1.0:1746147716.874570:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135848e00 00000100:00100000:0.0:1746147716.882038:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.901596:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.926666:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.932578:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.932621:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.932690:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793684608 00000100:00100000:1.0:1746147716.932697:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793684608 00010000:00010000:1.0:1746147716.932727:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7c01b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa16 expref: 24 pid: 8470 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746147716.932748:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793684736 00000100:00100000:1.0:1746147716.932750:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793684736 00010000:00010000:1.0:1746147716.932758:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7c014 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa0f expref: 36 pid: 8470 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746147716.932771:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8015 00000100:00100000:1.0:1746147716.932777:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793684608:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147716.932787:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147716.932817:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7c01b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa16 expref: 24 pid: 8470 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147716.932825:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7c01b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa16 expref: 24 pid: 8470 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147716.932847:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7c01b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa16 expref: 24 pid: 8470 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147716.932864:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147716.932900:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967793684608:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 105us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147716.933313:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8015 00000100:00100000:0.0:1746147716.937948:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.942264:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.949123:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.953144:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.953231:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793685376 00000100:00100000:1.0:1746147716.953408:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793685376 00010000:00010000:1.0:1746147716.953440:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800915e4400/0xe64d3fbf12a7c006 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa01 expref: 35 pid: 21480 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746147716.953549:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8018 00000100:00100000:1.0:1746147716.953557:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013582c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967793685376:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147716.953570:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147716.953828:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800915e4400/0xe64d3fbf12a7c006 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa01 expref: 35 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147716.953839:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800915e4400/0xe64d3fbf12a7c006 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa01 expref: 35 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147716.953858:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915e4400/0xe64d3fbf12a7c006 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa01 expref: 35 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147716.953905:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147716.953907:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147716.953913:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7c06f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa32 expref: 34 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147716.953920:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7c06f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa32 expref: 34 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147716.953950:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7c06f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa32 expref: 34 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147716.953960:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796351488:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147716.954037:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e2c240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147716.955724:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796351488:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147716.955740:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147716.955776:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013582c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793685376:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2220us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147716.955783:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8018 00000100:00100000:0.0:1746147716.956359:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.958703:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.966400:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.971209:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.971267:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147716.971423:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793686144 00000100:00100000:1.0:1746147716.971430:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793686144 00010000:00010000:1.0:1746147716.971453:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1050a00/0xe64d3fbf12a7bfea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9e5 expref: 34 pid: 8469 timeout: 896 lvb_type: 1 00000100:00100000:1.0:1746147716.971470:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793686272 00000100:00100000:1.0:1746147716.971472:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793686272 00010000:00010000:1.0:1746147716.971481:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc78400/0xe64d3fbf12a7bfdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9d7 expref: 24 pid: 8469 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746147716.971507:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8019 00000100:00100000:1.0:1746147716.971513:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967793686144:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147716.971523:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147716.971541:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a1050a00/0xe64d3fbf12a7bfea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9e5 expref: 34 pid: 8469 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746147716.971549:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a1050a00/0xe64d3fbf12a7bfea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9e5 expref: 34 pid: 8469 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746147716.971566:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1050a00/0xe64d3fbf12a7bfea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9e5 expref: 34 pid: 8469 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746147716.971582:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147716.971603:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1957:x1830967793686144:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 90us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147716.971609:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8019 00000100:00100000:1.0:1746147716.974343:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.974736:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793686528 00000100:00100000:0.0:1746147716.974742:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793686528 00002000:00100000:0.0:1746147716.974772:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1085440->1089535) req@ffff8800943c4000 x1830967793686528/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:337/0 lens 488/0 e 0 to 0 dl 1746147727 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147716.974781:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4000 with x1830967793686528 ext(1085440->1089535) 00002000:00010000:0.0:1746147716.974785:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c4000 00000100:00100000:0.0:1746147716.975279:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7009 00000100:00100000:0.0:1746147716.975286:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967793686528:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147716.975420:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967793686528:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 135us (1083us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147716.975426:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7009 00002000:00100000:0.0:1746147716.975431:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1085440->1089535) req@ffff8800943c4000 x1830967793686528/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:337/0 lens 488/4536 e 0 to 0 dl 1746147727 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147716.975437:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4000 with x1830967793686528 ext(1085440->1089535) 00002000:00010000:0.0:1746147716.975440:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c4000 00000100:00100000:0.0:1746147716.983920:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147716.987373:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.014408:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:1.0:1746147717.016692:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147717.018925:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.027366:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.027400:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.027440:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.027823:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15845 00000100:00080000:1.0:1746147717.027958:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147717.028166:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013582dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967793687552:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147717.028177:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.028191:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7c0a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaa4e expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147717.028289:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796352256:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147717.028334:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e2c6c0 going to sleep for 11 seconds 00002000:00010000:0.0:1746147717.031619:0:8470:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime: 1746147717 -> 1746147718 00002000:00010000:0.0:1746147717.031626:0:8470:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147716 -> 1746147718 00002000:00010000:0.0:1746147717.031627:0:8470:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime: 1746147717 -> 1746147718 00000100:00100000:0.0:1746147717.031651:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796352256:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147717.031687:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7c0a0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa4e expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.031703:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7c0a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa4e expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.031737:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e127e00, rc 0) 00000100:00100000:0.0:1746147717.031771:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013582dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967793687552:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3939us (4413us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147717.031779:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15845 00000100:00100000:0.0:1746147717.044992:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.045050:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.046091:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7013 00000100:00100000:1.0:1746147717.046097:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013582ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1957:x1830967793688448:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147717.047804:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.061967:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.068099:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.091124:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.091195:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793689216 00000100:00100000:0.0:1746147717.091205:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793689216 00000100:00100000:0.0:1746147717.091265:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11867 00000100:00100000:0.0:1746147717.091273:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:31898:x1830967793689216:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147717.091304:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.091502:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e4400/0xe64d3fbf12a7c0b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaa6a expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.091600:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e4c00/0xe64d3fbf12a7c0bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.091615:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093040c00/0xe64d3fbf12a7c037 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa1d expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.091621:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7c05a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa24 expref: 329 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.091627:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e4c00/0xe64d3fbf12a7c0bc lrc: 5/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.091658:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7c05a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa24 expref: 329 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.091668:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7c05a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa24 expref: 329 pid: 14545 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746147717.091684:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796352512:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147717.091967:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093040c00/0xe64d3fbf12a7c037 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa1d expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.091975:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093040c00/0xe64d3fbf12a7c037 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa1d expref: 13 pid: 14546 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746147717.091983:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796352640:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147717.092002:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147717.097840:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.097855:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013582fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796352512:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147717.097867:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013582c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796352640:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147717.097915:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e4c00/0xe64d3fbf12a7c0bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147717.097996:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796352768:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147717.099236:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.099272:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.099276:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793689344 00000100:00100000:1.0:1746147717.099280:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793689344 00010000:00010000:1.0:1746147717.099303:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7c05a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa24 expref: 330 pid: 14545 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746147717.099320:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8023 00000100:00100000:1.0:1746147717.099325:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:1959:x1830967793689344:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147717.099335:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147717.099339:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7c05a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa24 expref: 330 pid: 14545 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.099349:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7c05a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa24 expref: 330 pid: 14545 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.099363:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7c05a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa24 expref: 330 pid: 14545 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.099379:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147717.099383:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e4c00/0xe64d3fbf12a7c0bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147717.099390:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e4c00/0xe64d3fbf12a7c0bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147717.099398:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e4c00/0xe64d3fbf12a7c0bc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147717.099417:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147717.099434:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:1959:x1830967793689344:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 109us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147717.099440:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8023 00000100:00100000:0.0:1746147717.101537:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.127874:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.138200:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.139452:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.139514:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793690496 00000100:00100000:1.0:1746147717.139518:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793690496 00000100:00100000:1.0:1746147717.139551:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15850 00000100:00100000:1.0:1746147717.139556:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967793690496:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147717.139565:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147717.139578:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801354c8800/0xe64d3fbf12a7c0f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaa7f expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147717.139605:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796353152:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147717.139628:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e2c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147717.145821:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.145863:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.145918:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.145959:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.145982:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793691008 00000100:00100000:0.0:1746147717.145991:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793691008 00002000:00100000:0.0:1746147717.146036:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (3448832->4194303) req@ffff8800a5d7d880 x1830967793691008/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.146051:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7d880 with x1830967793691008 ext(3448832->4194303) 00002000:00010000:0.0:1746147717.146057:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7d880 00000100:00100000:0.0:1746147717.146074:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793690880 00000100:00100000:0.0:1746147717.146076:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793690880 00002000:00100000:0.0:1746147717.146086:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3448831) req@ffff8800a5d7dc00 x1830967793690880/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 504/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.146092:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7dc00 with x1830967793690880 ext(2097152->3448831) 00002000:00010000:0.0:1746147717.146094:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7dc00 00000100:00100000:0.0:1746147717.146102:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793691264 00000100:00100000:0.0:1746147717.146104:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793691264 00002000:00100000:0.0:1746147717.146166:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a5d7df80 x1830967793691264/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.146174:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7df80 with x1830967793691264 ext(2097152->3145727) 00002000:00010000:0.0:1746147717.146178:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7df80 00000100:00100000:0.0:1746147717.146188:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793691392 00000100:00100000:0.0:1746147717.146190:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793691392 00002000:00100000:0.0:1746147717.146203:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (3170304->4194303) req@ffff8800a5d7e300 x1830967793691392/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.146210:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7e300 with x1830967793691392 ext(3170304->4194303) 00002000:00010000:0.0:1746147717.146212:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7e300 00000100:00100000:0.0:1746147717.146224:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7016 00000100:00100000:0.0:1746147717.146231:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967793691008:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147717.147249:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7017 00000100:00100000:0.0:1746147717.147256:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967793690880:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147717.148857:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7018 00000100:00100000:1.0:1746147717.148867:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967793691264:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147717.150162:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796353152:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147717.150196:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801354c8800/0xe64d3fbf12a7c0f4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa7f expref: 26 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.150210:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801354c8800/0xe64d3fbf12a7c0f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa7f expref: 26 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.150233:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801354c8800, rc 0) 00000100:00100000:1.0:1746147717.150264:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967793690496:12345-192.168.202.10@tcp:101:cat.0 Request processed in 10707us (10812us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147717.150273:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15850 00000100:00100000:1.0:1746147717.150307:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7019 00000100:00100000:1.0:1746147717.150315:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967793691392:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147717.155284:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.173822:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967793691008:12345-192.168.202.10@tcp:3:cat.0 Request processed in 27580us (28002us total) trans 0 rc 745472/745472 00000100:00100000:0.0:1746147717.173835:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7016 00002000:00100000:0.0:1746147717.173849:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (3448832->4194303) req@ffff8800a5d7d880 x1830967793691008/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/440 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 745472/745472 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.173859:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7d880 with x1830967793691008 ext(3448832->4194303) 00002000:00010000:0.0:1746147717.173865:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7d880 00000100:00100000:1.0:1746147717.177426:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.178147:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793691776 00000100:00100000:0.0:1746147717.178155:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793691776 00002000:00100000:0.0:1746147717.178192:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3170303) req@ffff8800943c4a80 x1830967793691776/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.180524:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4a80 with x1830967793691776 ext(3145728->3170303) 00010000:00010000:0.0:1746147717.180542:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7c06f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa32 expref: 38 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746147717.180561:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7c06f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa32 expref: 38 pid: 21480 timeout: 896 lvb_type: 0 00002000:00010000:0.0:1746147717.180568:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800943c4a80 00000100:00100000:0.0:1746147717.198392:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967793690880:12345-192.168.202.10@tcp:3:cat.0 Request processed in 51134us (52525us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147717.198401:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7017 00002000:00100000:0.0:1746147717.198406:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3448831) req@ffff8800a5d7dc00 x1830967793690880/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 504/440 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.198420:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7dc00 with x1830967793690880 ext(2097152->3448831) 00002000:00010000:0.0:1746147717.198423:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7dc00 00000100:00100000:1.0:1746147717.201673:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1958:x1830967793691264:12345-192.168.202.10@tcp:3:cat.0 Request processed in 52800us (55746us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147717.201684:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7018 00002000:00100000:1.0:1746147717.201693:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a5d7df80 x1830967793691264/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/440 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.201702:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7df80 with x1830967793691264 ext(2097152->3145727) 00010000:00010000:1.0:1746147717.201711:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7c06f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa32 expref: 39 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.201726:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7c06f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa32 expref: 39 pid: 21480 timeout: 896 lvb_type: 0 00002000:00010000:1.0:1746147717.201733:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d7df80 00000100:00100000:1.0:1746147717.202050:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793691392:12345-192.168.202.10@tcp:3:cat.0 Request processed in 51736us (56089us total) trans 0 rc 1024000/1024000 00000100:00100000:1.0:1746147717.202055:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7019 00002000:00100000:1.0:1746147717.202060:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3170304->4194303) req@ffff8800a5d7e300 x1830967793691392/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/440 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 1024000/1024000 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.202068:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7e300 with x1830967793691392 ext(3170304->4194303) 00010000:00010000:1.0:1746147717.202072:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7c06f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa32 expref: 37 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.202081:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7c06f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa32 expref: 37 pid: 21480 timeout: 896 lvb_type: 0 00002000:00010000:1.0:1746147717.202087:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d7e300 00000100:00100000:1.0:1746147717.210108:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.210145:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.210172:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793692160 00000100:00100000:1.0:1746147717.210182:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793692160 00010000:00010000:1.0:1746147717.210219:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7c06f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa32 expref: 37 pid: 21480 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746147717.210249:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8024 00000100:00100000:1.0:1746147717.210256:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793692160:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147717.210270:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147717.210292:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7c06f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa32 expref: 37 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.210305:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7c06f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa32 expref: 37 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.210327:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7c06f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa32 expref: 37 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.210346:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147717.210349:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147717.210356:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1050000/0xe64d3fbf12a7c0fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa86 expref: 17 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.210364:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1050000/0xe64d3fbf12a7c0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa86 expref: 17 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.210371:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147717.210373:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147717.210376:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009456b400/0xe64d3fbf12a7c102 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4730879) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa8d expref: 36 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.210383:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009456b400/0xe64d3fbf12a7c102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4730879) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa8d expref: 36 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.210412:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009456b400/0xe64d3fbf12a7c102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4730879) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa8d expref: 36 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147717.210426:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796353408:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147717.210516:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1050000/0xe64d3fbf12a7c0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa86 expref: 17 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147717.210524:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796353536:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147717.210541:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e2c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147717.215419:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793692032 00000100:00100000:0.0:1746147717.215432:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793692032 00000100:00100000:0.0:1746147717.215549:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15853 00000100:00100000:0.0:1746147717.215557:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:31894:x1830967793692032:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147717.215576:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.215593:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091560400/0xe64d3fbf12a7c109 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaa94 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.215619:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147717.215620:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147717.215628:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091560400/0xe64d3fbf12a7c109 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa94 expref: 38 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.215642:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091560400/0xe64d3fbf12a7c109 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa94 expref: 38 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.215651:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091560400, rc 0) 00000100:00100000:0.0:1746147717.215705:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:31894:x1830967793692032:12345-192.168.202.10@tcp:101:cat.0 Request processed in 150us (5605us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147717.215711:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15853 00000100:00100000:1.0:1746147717.216014:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796353408:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147717.216024:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796353536:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147717.216044:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147717.216065:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793692160:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5809us (5919us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147717.216072:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8024 00000100:00100000:1.0:1746147717.216505:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793692416 00000100:00100000:1.0:1746147717.216510:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793692416 00002000:00100000:1.0:1746147717.216537:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880094efb100 x1830967793692416/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.216547:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efb100 with x1830967793692416 ext(2097152->3145727) 00002000:00010000:1.0:1746147717.216551:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efb100 00000100:00100000:1.0:1746147717.216563:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7020 00000100:00100000:1.0:1746147717.216569:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967793692416:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147717.220637:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.220684:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.220710:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793692800 00000100:00100000:0.0:1746147717.220718:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793692800 00002000:00100000:0.0:1746147717.220760:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a5d7ea00 x1830967793692800/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.220772:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ea00 with x1830967793692800 ext(3145728->4194303) 00002000:00010000:0.0:1746147717.220777:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7ea00 00000100:00100000:0.0:1746147717.220803:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793692672 00000100:00100000:0.0:1746147717.220805:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793692672 00002000:00100000:0.0:1746147717.220814:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (4726784->4730879) req@ffff8800a5d7ed80 x1830967793692672/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.220820:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ed80 with x1830967793692672 ext(4726784->4730879) 00002000:00010000:0.0:1746147717.220822:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7ed80 00000100:00100000:0.0:1746147717.220834:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7021 00000100:00100000:0.0:1746147717.220841:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1958:x1830967793692800:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147717.222198:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7022 00000100:00100000:0.0:1746147717.222207:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1958:x1830967793692672:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147717.222322:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1958:x1830967793692672:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 116us (1637us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147717.222328:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7022 00002000:00100000:0.0:1746147717.222334:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (4726784->4730879) req@ffff8800a5d7ed80 x1830967793692672/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/4536 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.222342:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ed80 with x1830967793692672 ext(4726784->4730879) 00002000:00010000:0.0:1746147717.222346:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7ed80 00000100:00100000:1.0:1746147717.236056:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967793692416:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19477us (19715us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147717.236069:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7020 00002000:00100000:1.0:1746147717.236082:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880094efb100 x1830967793692416/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/440 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.236092:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efb100 with x1830967793692416 ext(2097152->3145727) 00002000:00010000:1.0:1746147717.236098:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efb100 00000100:00100000:1.0:1746147717.244915:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793692800:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 24064us (24276us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147717.244928:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7021 00002000:00100000:1.0:1746147717.244941:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a5d7ea00 x1830967793692800/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/440 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.244952:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ea00 with x1830967793692800 ext(3145728->4194303) 00002000:00010000:1.0:1746147717.244958:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7ea00 00000100:00100000:1.0:1746147717.245105:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.245127:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793692928 00000100:00100000:1.0:1746147717.245134:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793692928 00000100:00100000:1.0:1746147717.245166:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15854 00000100:00100000:1.0:1746147717.245172:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:31895:x1830967793692928:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147717.245186:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147717.245204:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801354c9a00/0xe64d3fbf12a7c110 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaa9b expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.245231:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a1051600/0xe64d3fbf12a7c068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa2b expref: 33 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.245238:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147717.245240:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147717.245244:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801354c9a00/0xe64d3fbf12a7c110 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa9b expref: 26 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.245270:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a1051600/0xe64d3fbf12a7c068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa2b expref: 33 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.245281:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a1051600/0xe64d3fbf12a7c068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa2b expref: 33 pid: 21480 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746147717.245293:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796353664:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147717.245350:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e2c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147717.250760:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796353664:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147717.250808:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801354c9a00/0xe64d3fbf12a7c110 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa9b expref: 26 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.250827:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801354c9a00, rc 0) 00000100:00100000:1.0:1746147717.250874:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:31895:x1830967793692928:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5700us (5768us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147717.250902:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15854 00000100:00100000:0.0:1746147717.251124:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793693056 00000100:00100000:0.0:1746147717.251131:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793693056 00002000:00100000:0.0:1746147717.251169:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2842624->4194303) req@ffff880094ef8000 x1830967793693056/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 504/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.251180:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef8000 with x1830967793693056 ext(2842624->4194303) 00010000:00010000:0.0:1746147717.251186:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a1051600/0xe64d3fbf12a7c068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa2b expref: 34 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746147717.251198:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a1051600/0xe64d3fbf12a7c068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa2b expref: 34 pid: 21480 timeout: 896 lvb_type: 0 00002000:00010000:0.0:1746147717.251204:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094ef8000 00000100:00100000:0.0:1746147717.251220:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1377 00000100:00100000:0.0:1746147717.251226:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793693056:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:1.0:1746147717.254774:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793693184 00000100:00100000:1.0:1746147717.254785:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793693184 00000100:00100000:1.0:1746147717.254848:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793693312 00000100:00100000:1.0:1746147717.254850:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793693312 00000100:00100000:1.0:1746147717.254870:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15855 00000100:00100000:1.0:1746147717.254879:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793693184:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147717.254911:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147717.254931:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801354c9600/0xe64d3fbf12a7c117 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaaa2 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147717.254986:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796353792:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147717.255029:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15856 00000100:00100000:0.0:1746147717.255038:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967793693312:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147717.255047:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147717.255072:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c229c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147717.255134:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091561600/0xe64d3fbf12a7c11e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaaa9 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147717.255163:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796353920:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147717.255187:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147717.257336:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796353920:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147717.257365:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091561600/0xe64d3fbf12a7c11e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaa9 expref: 37 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.257378:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091561600/0xe64d3fbf12a7c11e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaa9 expref: 37 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.257394:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091561600, rc 0) 00000100:00100000:1.0:1746147717.257397:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796353792:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147717.257415:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801354c9600/0xe64d3fbf12a7c117 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaa2 expref: 38 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.257424:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801354c9600/0xe64d3fbf12a7c117 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaa2 expref: 38 pid: 8470 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147717.257432:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967793693312:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2394us (3184us total) trans 0 rc 301/301 00010000:00010000:1.0:1746147717.257436:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801354c9600, rc 0) 00000100:00100000:0.0:1746147717.257441:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15856 00000100:00100000:1.0:1746147717.257454:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793693184:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2577us (3616us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147717.257460:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15855 00000100:00100000:1.0:1746147717.262130:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967793693056:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 10894us (11297us total) trans 21474841470 rc 0/0 00000100:00100000:1.0:1746147717.262143:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1377 00002000:00100000:1.0:1746147717.262156:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2842624->4194303) req@ffff880094ef8000 x1830967793693056/t21474841470(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 504/448 e 0 to 0 dl 1746147728 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.262166:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef8000 with x1830967793693056 ext(2842624->4194303) 00010000:00010000:1.0:1746147717.262176:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a1051600/0xe64d3fbf12a7c068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa2b expref: 36 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.262192:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a1051600/0xe64d3fbf12a7c068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa2b expref: 36 pid: 21480 timeout: 896 lvb_type: 0 00002000:00010000:1.0:1746147717.262199:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094ef8000 00000100:00100000:1.0:1746147717.262985:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.270034:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.276770:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793693824 00000100:00100000:0.0:1746147717.276780:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793693824 00000100:00100000:0.0:1746147717.276966:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793693952 00000100:00100000:0.0:1746147717.276969:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793693952 00000100:00100000:0.0:1746147717.276993:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15857 00000100:00100000:1.0:1746147717.277000:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15858 00000100:00100000:0.0:1746147717.277002:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793693824:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147717.277010:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967793693952:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147717.277020:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.277020:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147717.277038:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dae9a00/0xe64d3fbf12a7c12c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaab7 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.277038:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095151800/0xe64d3fbf12a7c125 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaab0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.277061:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147717.277064:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147717.277072:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dae9a00/0xe64d3fbf12a7c12c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaab7 expref: 37 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.277086:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dae9a00/0xe64d3fbf12a7c12c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaab7 expref: 37 pid: 8470 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147717.277095:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796354176:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147717.277096:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dae9a00, rc 0) 00000100:00100000:1.0:1746147717.277248:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793693952:12345-192.168.202.10@tcp:101:cat.0 Request processed in 240us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147717.277255:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15858 00000100:00100000:0.0:1746147717.279618:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147717.285825:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796354176:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147717.285862:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095151800/0xe64d3fbf12a7c125 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaab0 expref: 38 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.285875:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095151800/0xe64d3fbf12a7c125 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaab0 expref: 38 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.285919:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095151800, rc 0) 00000100:00100000:0.0:1746147717.285973:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793693824:12345-192.168.202.10@tcp:101:cat.0 Request processed in 8973us (9760us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147717.285982:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15857 00000100:00100000:0.0:1746147717.290588:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.290616:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.290642:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.291295:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793694336 00000100:00100000:1.0:1746147717.291306:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793694336 00002000:00100000:1.0:1746147717.291354:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a5d7f100 x1830967793694336/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.291363:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f100 with x1830967793694336 ext(3145728->4194303) 00002000:00010000:1.0:1746147717.291370:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7f100 00000100:00100000:1.0:1746147717.291978:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793694464 00000100:00100000:1.0:1746147717.291982:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793694464 00002000:00100000:1.0:1746147717.292003:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a5d7f480 x1830967793694464/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.292011:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f480 with x1830967793694464 ext(2097152->3145727) 00002000:00010000:1.0:1746147717.292015:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7f480 00000100:00100000:1.0:1746147717.292033:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793694592 00000100:00100000:1.0:1746147717.292036:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793694592 00002000:00100000:1.0:1746147717.292048:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a5d7f800 x1830967793694592/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.293530:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f800 with x1830967793694592 ext(3145728->4194303) 00002000:00010000:1.0:1746147717.293535:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7f800 00000100:00100000:1.0:1746147717.293564:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7025 00000100:00100000:1.0:1746147717.293572:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1957:x1830967793694464:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147717.294749:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7026 00000100:00100000:1.0:1746147717.294760:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1957:x1830967793694592:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147717.298329:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.298669:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793694848 00000100:00100000:0.0:1746147717.298678:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793694848 00000100:00100000:0.0:1746147717.298728:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15859 00000100:00100000:0.0:1746147717.298735:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1957:x1830967793694848:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147717.298753:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.298771:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800950ede00/0xe64d3fbf12a7c133 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaabe expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147717.298845:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796354304:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147717.298929:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147717.314383:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967793694592:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19611us (23725us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147717.314397:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7026 00002000:00100000:1.0:1746147717.314412:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a5d7f800 x1830967793694592/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/440 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.314422:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f800 with x1830967793694592 ext(3145728->4194303) 00002000:00010000:1.0:1746147717.314429:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7f800 00000100:00100000:1.0:1746147717.315095:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796354304:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147717.315127:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800950ede00/0xe64d3fbf12a7c133 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaabe expref: 38 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.315142:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800950ede00/0xe64d3fbf12a7c133 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaabe expref: 38 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.315153:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950ede00, rc 0) 00000100:00100000:1.0:1746147717.315179:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1957:x1830967793694848:12345-192.168.202.10@tcp:101:cat.0 Request processed in 16445us (16863us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147717.315185:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15859 00000100:00100000:0.0:1746147717.318524:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.320143:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793694976 00000100:00100000:0.0:1746147717.320154:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793694976 00000100:00100000:0.0:1746147717.320198:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15860 00000100:00100000:0.0:1746147717.320206:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:31900:x1830967793694976:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147717.320226:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.320244:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800950ed400/0xe64d3fbf12a7c13a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaac5 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.320275:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1050000/0xe64d3fbf12a7c0fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa86 expref: 19 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.320288:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147717.320290:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147717.320293:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800950ed400/0xe64d3fbf12a7c13a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2244608->3145727] (req 2244608->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaac5 expref: 19 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.320325:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1050000/0xe64d3fbf12a7c0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa86 expref: 19 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.320337:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a1050000/0xe64d3fbf12a7c0fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa86 expref: 19 pid: 22183 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746147717.320350:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796354432:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147717.320424:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147717.320823:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967793694464:12345-192.168.202.10@tcp:3:cat.0 Request processed in 27250us (30203us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147717.320833:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7025 00002000:00100000:1.0:1746147717.320843:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a5d7f480 x1830967793694464/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/440 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.320852:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f480 with x1830967793694464 ext(2097152->3145727) 00002000:00010000:1.0:1746147717.320856:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7f480 00000100:00100000:0.0:1746147717.332288:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.332337:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796354432:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147717.332367:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800950ed400/0xe64d3fbf12a7c13a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2244608->3145727] (req 2244608->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaac5 expref: 19 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.332386:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950ed400, rc 0) 00000100:00100000:0.0:1746147717.332426:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:31900:x1830967793694976:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 12221us (13912us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147717.332435:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15860 00000100:00100000:1.0:1746147717.334481:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.334555:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793695232 00000100:00100000:0.0:1746147717.334564:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793695232 00000100:00100000:0.0:1746147717.335578:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15861 00000100:00100000:0.0:1746147717.335587:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1957:x1830967793695232:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147717.335606:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.335624:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800957b3800/0xe64d3fbf12a7c141 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaacc expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147717.335682:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796354560:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147717.335761:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147717.340377:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796354560:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147717.340416:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800957b3800/0xe64d3fbf12a7c141 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaacc expref: 20 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.340431:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800957b3800/0xe64d3fbf12a7c141 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaacc expref: 20 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.340449:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957b3800, rc 0) 00000100:00100000:0.0:1746147717.340491:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1957:x1830967793695232:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4904us (6018us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147717.340499:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15861 00000100:00100000:1.0:1746147717.346189:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.346263:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796354688:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147717.346283:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147717.346317:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967793695104:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 10172us (14040us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147717.346327:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8026 00000100:00100000:1.0:1746147717.355354:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.355383:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793695616 00000100:00100000:1.0:1746147717.355390:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793695616 00002000:00100000:1.0:1746147717.355427:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2244608->2248703) req@ffff8800943c5c00 x1830967793695616/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.355437:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5c00 with x1830967793695616 ext(2244608->2248703) 00002000:00010000:1.0:1746147717.355442:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c5c00 00000100:00100000:1.0:1746147717.355459:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7027 00000100:00100000:1.0:1746147717.355466:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793695616:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147717.357905:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793695616:12345-192.168.202.10@tcp:3:cat.0 Request processed in 2415us (2535us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147717.357916:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7027 00002000:00100000:1.0:1746147717.357924:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2244608->2248703) req@ffff8800943c5c00 x1830967793695616/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/4536 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.357932:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5c00 with x1830967793695616 ext(2244608->2248703) 00002000:00010000:1.0:1746147717.357937:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c5c00 00000100:00100000:1.0:1746147717.358874:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.359004:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793695744 00000100:00100000:1.0:1746147717.359009:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793695744 00002000:00100000:1.0:1746147717.359032:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4730879) req@ffff8800943c7480 x1830967793695744/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.359039:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c7480 with x1830967793695744 ext(4194304->4730879) 00010000:00010000:1.0:1746147717.359044:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009456b400/0xe64d3fbf12a7c102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4730879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa8d expref: 37 pid: 22183 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.359054:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009456b400/0xe64d3fbf12a7c102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4730879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa8d expref: 37 pid: 22183 timeout: 896 lvb_type: 0 00002000:00010000:1.0:1746147717.359060:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800943c7480 00000100:00100000:1.0:1746147717.359072:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1378 00000100:00100000:1.0:1746147717.359078:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793695744:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147717.368365:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.371066:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.371089:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793696128 00000100:00100000:0.0:1746147717.371093:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793696128 00000100:00100000:0.0:1746147717.371124:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15863 00000100:00100000:0.0:1746147717.371130:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:31900:x1830967793696128:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147717.371140:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.371152:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7c172 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaae1 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.371178:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801354c9a00/0xe64d3fbf12a7c110 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa9b expref: 9 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.371186:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dae9a00/0xe64d3fbf12a7c12c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaab7 expref: 17 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.371191:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147717.371193:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147717.371196:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7c172 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaae1 expref: 9 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.371222:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dae9a00/0xe64d3fbf12a7c12c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaab7 expref: 17 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.371247:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dae9a00/0xe64d3fbf12a7c12c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaab7 expref: 17 pid: 8470 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746147717.371257:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796354944:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147717.371333:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801354c9a00/0xe64d3fbf12a7c110 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa9b expref: 9 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.371342:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801354c9a00/0xe64d3fbf12a7c110 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa9b expref: 9 pid: 22183 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746147717.371353:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796355072:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147717.371370:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147717.372586:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1958:x1830967793695744:12345-192.168.202.10@tcp:4:cat.0 Request processed in 13506us (13710us total) trans 17179874240 rc 0/0 00000100:00100000:1.0:1746147717.372597:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1378 00002000:00100000:1.0:1746147717.372605:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4730879) req@ffff8800943c7480 x1830967793695744/t17179874240(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/448 e 0 to 0 dl 1746147728 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.372694:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c7480 with x1830967793695744 ext(4194304->4730879) 00010000:00010000:1.0:1746147717.372702:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009456b400/0xe64d3fbf12a7c102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4730879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa8d expref: 39 pid: 22183 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.372713:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009456b400/0xe64d3fbf12a7c102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4730879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa8d expref: 39 pid: 22183 timeout: 896 lvb_type: 0 00002000:00010000:1.0:1746147717.372719:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800943c7480 00000100:00100000:1.0:1746147717.373063:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796354944:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147717.373071:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796355072:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147717.373092:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7c172 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaae1 expref: 9 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.373102:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a221ec00, rc 0) 00000100:00100000:1.0:1746147717.373133:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:31900:x1830967793696128:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2003us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147717.373138:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15863 00000100:00100000:1.0:1746147717.374460:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.376196:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.376217:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.378129:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.378146:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793696768 00000100:00100000:0.0:1746147717.378175:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793696768 00010000:00010000:0.0:1746147717.378193:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009456b400/0xe64d3fbf12a7c102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4730879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa8d expref: 39 pid: 22183 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746147717.378212:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8029 00000100:00100000:0.0:1746147717.378217:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1957:x1830967793696768:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147717.378226:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147717.378245:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009456b400/0xe64d3fbf12a7c102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4730879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa8d expref: 39 pid: 22183 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746147717.378254:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009456b400/0xe64d3fbf12a7c102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4730879) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa8d expref: 39 pid: 22183 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746147717.378269:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009456b400/0xe64d3fbf12a7c102 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4730879) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa8d expref: 39 pid: 22183 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746147717.378279:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147717.378280:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147717.378285:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095234400/0xe64d3fbf12a7c148 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaad3 expref: 18 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.378292:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095234400/0xe64d3fbf12a7c148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaad3 expref: 18 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.378312:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095234400/0xe64d3fbf12a7c148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaad3 expref: 18 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147717.378320:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796355328:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147717.378354:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6176c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147717.380202:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796355328:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147717.380212:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147717.380229:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967793696768:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2012us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147717.380235:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8029 00000100:00100000:1.0:1746147717.382947:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793697024 00000100:00100000:1.0:1746147717.382953:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793697024 00002000:00100000:1.0:1746147717.382984:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2138112->2142207) req@ffff880094efbb80 x1830967793697024/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.382993:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efbb80 with x1830967793697024 ext(2138112->2142207) 00002000:00010000:1.0:1746147717.382998:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efbb80 00000100:00100000:1.0:1746147717.383014:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7028 00000100:00100000:1.0:1746147717.383021:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1960:x1830967793697024:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147717.383145:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1960:x1830967793697024:12345-192.168.202.10@tcp:3:cat.0 Request processed in 124us (397us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147717.383151:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7028 00002000:00100000:1.0:1746147717.383156:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2138112->2142207) req@ffff880094efbb80 x1830967793697024/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/4536 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.383163:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efbb80 with x1830967793697024 ext(2138112->2142207) 00002000:00010000:1.0:1746147717.383166:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efbb80 00000100:00100000:1.0:1746147717.384583:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.384784:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793697280 00000100:00100000:0.0:1746147717.384798:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793697280 00002000:00100000:0.0:1746147717.385058:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a5d7c380 x1830967793697280/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.385067:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c380 with x1830967793697280 ext(4194304->5017599) 00002000:00010000:0.0:1746147717.385071:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7c380 00000100:00100000:0.0:1746147717.385083:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7029 00000100:00100000:0.0:1746147717.385088:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967793697280:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147717.398832:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793697664 00000100:00100000:1.0:1746147717.398840:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793697664 00000100:00100000:1.0:1746147717.398908:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15864 00000100:00100000:1.0:1746147717.398915:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793697664:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147717.398929:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147717.398945:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095747c00/0xe64d3fbf12a7c179 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaae8 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.398970:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095747c00/0xe64d3fbf12a7c179 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaae8 expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.398979:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095747c00/0xe64d3fbf12a7c179 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaae8 expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.399002:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095747c00, rc 0) 00000100:00100000:1.0:1746147717.399050:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793697664:12345-192.168.202.10@tcp:101:cat.0 Request processed in 131us (1066us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147717.399056:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15864 00000100:00100000:0.0:1746147717.404224:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.404600:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793697792 00000100:00100000:1.0:1746147717.404608:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793697792 00000100:00100000:1.0:1746147717.404654:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15865 00000100:00100000:1.0:1746147717.404662:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793697792:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147717.404677:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147717.405575:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095747c00/0xe64d3fbf12a7c180 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaaef expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.405608:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095747c00/0xe64d3fbf12a7c180 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaef expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.405616:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095747c00/0xe64d3fbf12a7c180 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaef expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.405640:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095747c00, rc 0) 00000100:00100000:1.0:1746147717.405693:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793697792:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1033us (1477us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147717.405699:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15865 00000100:00100000:0.0:1746147717.435499:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.435590:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793697920 00000100:00100000:1.0:1746147717.435601:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793697920 00000100:00100000:1.0:1746147717.436539:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15866 00000100:00100000:1.0:1746147717.436549:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:31904:x1830967793697920:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147717.436563:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147717.436580:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095747c00/0xe64d3fbf12a7c187 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaaf6 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.436604:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd63000/0xe64d3fbf12a7bfab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9a6 expref: 18 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.436611:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7bfb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9ad expref: 7 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.436617:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147717.436619:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147717.436621:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095747c00/0xe64d3fbf12a7c187 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1175552->1818623] (req 1175552->1818623) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaf6 expref: 18 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.436645:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7bfb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9ad expref: 7 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.436660:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7bfb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9ad expref: 7 pid: 20619 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746147717.436671:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796355456:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147717.436782:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd63000/0xe64d3fbf12a7bfab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9a6 expref: 18 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.436800:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd63000/0xe64d3fbf12a7bfab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9a6 expref: 18 pid: 21480 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746147717.436809:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796355584:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147717.436827:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c22e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147717.441537:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.441585:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.441777:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013582c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796355456:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147717.441798:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013582d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796355584:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147717.441827:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095747c00/0xe64d3fbf12a7c187 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1175552->1818623] (req 1175552->1818623) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaf6 expref: 19 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.441843:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095747c00, rc 0) 00000100:00100000:1.0:1746147717.442501:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:31904:x1830967793697920:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5952us (7012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147717.442510:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15866 00000100:00100000:0.0:1746147717.445211:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.449006:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.451927:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.451979:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.457875:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.461704:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.461756:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.462206:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793699456 00000100:00100000:1.0:1746147717.462217:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793699456 00000100:00100000:1.0:1746147717.462271:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793699584 00000100:00100000:1.0:1746147717.462274:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793699584 00000100:00100000:1.0:1746147717.462302:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15867 00000100:00100000:1.0:1746147717.462309:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967793699456:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147717.462324:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147717.462340:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ee1000/0xe64d3fbf12a7c1b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafab04 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.462365:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ee1000/0xe64d3fbf12a7c1b1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab04 expref: 23 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.462379:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ee1000/0xe64d3fbf12a7c1b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab04 expref: 23 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.462390:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ee1000, rc 0) 00000100:00100000:1.0:1746147717.462431:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967793699456:12345-192.168.202.10@tcp:101:cat.0 Request processed in 124us (739us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147717.462436:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15867 00000100:00100000:0.0:1746147717.474362:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.493997:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.494042:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.497963:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094339500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796355968:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147717.498002:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095235000/0xe64d3fbf12a7c1c6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab19 expref: 18 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.498016:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095235000/0xe64d3fbf12a7c1c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab19 expref: 18 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.498030:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235000, rc 0) 00000100:00100000:0.0:1746147717.498082:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aabbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1960:x1830967793700096:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3631us (4038us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147717.498091:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15870 00000100:00100000:1.0:1746147717.501925:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.502201:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793700224 00000100:00100000:0.0:1746147717.502211:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793700224 00000100:00100000:0.0:1746147717.502267:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15871 00000100:00100000:0.0:1746147717.502275:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013582d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:31909:x1830967793700224:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147717.502297:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.502313:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cef5400/0xe64d3fbf12a7c1cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafab20 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.502350:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800950ed400/0xe64d3fbf12a7c13a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2244608->3145727] (req 2244608->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaac5 expref: 8 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.502357:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147717.502358:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147717.502362:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cef5400/0xe64d3fbf12a7c1cd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab20 expref: 23 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.502392:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800950ed400/0xe64d3fbf12a7c13a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2244608->3145727] (req 2244608->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaac5 expref: 8 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.502403:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800950ed400/0xe64d3fbf12a7c13a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2244608->3145727] (req 2244608->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaac5 expref: 8 pid: 21480 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746147717.502414:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796356096:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147717.502515:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6170c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147717.508533:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.537739:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.546581:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.565067:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.568514:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.575129:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.583178:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.583277:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.583656:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7035 00000100:00100000:0.0:1746147717.583664:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013582ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1959:x1830967793701632:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147717.597749:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013582ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1959:x1830967793701632:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14072us (14457us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147717.597763:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7035 00002000:00100000:1.0:1746147717.597776:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88013582ce00 x1830967793701632/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/440 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.597797:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013582ce00 with x1830967793701632 ext(3145728->4194303) 00002000:00010000:1.0:1746147717.597803:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013582ce00 00000100:00100000:0.0:1746147717.615266:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793702144 00000100:00100000:0.0:1746147717.615276:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793702144 00000100:00100000:0.0:1746147717.615327:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11871 00000100:00100000:0.0:1746147717.615378:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:31912:x1830967793702144:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147717.615405:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.615448:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b866c00/0xe64d3fbf12a7c1db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafab2e expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.615548:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b867e00/0xe64d3fbf12a7c1e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.615561:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b867e00/0xe64d3fbf12a7c1e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.615572:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b867e00/0xe64d3fbf12a7c1e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.615584:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7c1e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.615589:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7c1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.615594:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7c1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616384:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736ae00/0xe64d3fbf12a7c1f0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616397:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736ae00/0xe64d3fbf12a7c1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616405:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736ae00/0xe64d3fbf12a7c1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:0.0:1746147717.616418:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147717.616511:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b867e00/0xe64d3fbf12a7c1e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616518:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b867e00/0xe64d3fbf12a7c1e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616524:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b867e00/0xe64d3fbf12a7c1e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616529:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b867e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147717.616533:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b867e00/0xe64d3fbf12a7c1e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616539:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b867e00/0xe64d3fbf12a7c1e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616550:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147717.616558:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147717.616562:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b867e00/0xe64d3fbf12a7c1e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616567:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b867e00/0xe64d3fbf12a7c1e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616597:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7c1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616602:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7c1e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616606:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7c1e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616614:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a736bc00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147717.616616:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7c1e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616620:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7c1e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616626:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a024b300) 00010000:00010000:0.0:1746147717.616628:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147717.616630:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7c1e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616635:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7c1e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.616675:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b866c00/0xe64d3fbf12a7c1db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab2e expref: 19 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.616686:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736ae00/0xe64d3fbf12a7c1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab2e expref: 18 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.616692:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147717.616695:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147717.616697:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736ae00, rc 0) 00000100:00100000:0.0:1746147717.616732:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:31912:x1830967793702144:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1398us (1527us total) trans 8589945853 rc 0/0 00000100:00100000:0.0:1746147717.616739:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11871 00000100:00100000:0.0:1746147717.629640:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793702272 00000100:00100000:0.0:1746147717.629650:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793702272 00000100:00100000:0.0:1746147717.629713:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 886 00000100:00100000:0.0:1746147717.629721:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967793702272:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147717.629738:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147717.629764:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736ae00/0xe64d3fbf12a7c1f0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab2e expref: 18 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.629805:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147717.629810:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147717.630552:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967793702272:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 829us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147717.630560:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 886 00000100:00100000:1.0:1746147717.639746:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.640056:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793702528 00000100:00100000:0.0:1746147717.640066:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793702528 00000100:00100000:0.0:1746147717.640718:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11872 00000100:00100000:0.0:1746147717.640728:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013582f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:31916:x1830967793702528:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147717.640753:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.640772:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b800/0xe64d3fbf12a7c1fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafab35 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.640930:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a800/0xe64d3fbf12a7c205 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.640943:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a800/0xe64d3fbf12a7c205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.640954:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a800/0xe64d3fbf12a7c205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.640968:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7c20c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.640973:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7c20c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.640979:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7c20c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641444:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b400/0xe64d3fbf12a7c213 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641454:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b400/0xe64d3fbf12a7c213 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641460:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b400/0xe64d3fbf12a7c213 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:0.0:1746147717.641468:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147717.641550:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a800/0xe64d3fbf12a7c205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641556:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a800/0xe64d3fbf12a7c205 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641562:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a800/0xe64d3fbf12a7c205 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641567:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a736a800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147717.641570:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a800/0xe64d3fbf12a7c205 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641577:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a800/0xe64d3fbf12a7c205 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641587:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147717.641591:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147717.641595:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a800/0xe64d3fbf12a7c205 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641600:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a800/0xe64d3fbf12a7c205 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641618:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7c20c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641624:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7c20c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641628:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7c20c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641633:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a736a000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147717.641635:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7c20c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641640:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7c20c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641645:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a024b300) 00010000:00010000:0.0:1746147717.641647:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147717.641649:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7c20c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641653:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7c20c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.641690:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b800/0xe64d3fbf12a7c1fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab35 expref: 20 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.641705:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b400/0xe64d3fbf12a7c213 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab35 expref: 19 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.641711:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147717.641713:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147717.641715:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736b400, rc 0) 00000100:00100000:0.0:1746147717.643662:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013582f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:31916:x1830967793702528:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2929us (3920us total) trans 8589945854 rc 0/0 00000100:00100000:0.0:1746147717.643673:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11872 00000100:00100000:1.0:1746147717.647074:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.647109:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.647542:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fb74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796356608:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147717.647552:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796356736:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147717.647581:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7c221 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1265664->1646591] (req 1265664->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab3c expref: 9 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.647596:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bc600, rc 0) 00000100:00100000:0.0:1746147717.647634:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:31912:x1830967793702656:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3434us (3527us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147717.647641:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15873 00000100:00100000:0.0:1746147717.648402:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.648418:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793703168 00000100:00100000:0.0:1746147717.648421:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793703168 00010000:00010000:0.0:1746147717.648435:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093040400/0xe64d3fbf12a7c0a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa5c expref: 18 pid: 22183 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746147717.648453:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8034 00000100:00100000:0.0:1746147717.648459:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1960:x1830967793703168:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147717.648466:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147717.648485:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093040400/0xe64d3fbf12a7c0a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa5c expref: 18 pid: 22183 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746147717.648494:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093040400/0xe64d3fbf12a7c0a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa5c expref: 18 pid: 22183 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746147717.648509:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093040400/0xe64d3fbf12a7c0a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa5c expref: 18 pid: 22183 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746147717.648532:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147717.648546:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1960:x1830967793703168:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 87us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147717.648551:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8034 00000100:00100000:1.0:1746147717.650240:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.650593:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.651339:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793703424 00000100:00100000:0.0:1746147717.651343:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793703424 00000100:00100000:0.0:1746147717.651373:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15874 00000100:00100000:0.0:1746147717.651378:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013582d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793703424:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147717.651392:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.651402:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7c228 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafab43 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147717.651434:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796356992:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147717.651457:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6176c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147717.651524:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.651561:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.651574:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793703680 00000100:00100000:0.0:1746147717.651577:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793703680 00000100:00100000:0.0:1746147717.651592:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793703552 00000100:00100000:0.0:1746147717.651593:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793703552 00000100:00100000:0.0:1746147717.651604:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15875 00000100:00100000:0.0:1746147717.651608:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967793703680:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147717.651615:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.651625:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a736a200/0xe64d3fbf12a7c22f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafab51 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.651637:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147717.651638:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147717.651643:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a736a200/0xe64d3fbf12a7c22f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab51 expref: 11 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.651654:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a736a200/0xe64d3fbf12a7c22f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab51 expref: 11 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.651662:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736a200, rc 0) 00000100:00100000:0.0:1746147717.651680:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967793703680:12345-192.168.202.10@tcp:101:cat.0 Request processed in 71us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147717.651686:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15875 00000100:00100000:0.0:1746147717.651701:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15876 00000100:00100000:0.0:1746147717.651705:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967793703552:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147717.651710:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.651716:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a736b000/0xe64d3fbf12a7c236 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafab4a expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147717.651737:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ace680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796357120:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147717.651755:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147717.651809:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:0.0:1746147717.655629:0:22183:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime: 1746147717 -> 1746147718 00002000:00010000:0.0:1746147717.655635:0:22183:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime: 1746147716 -> 1746147718 00002000:00010000:0.0:1746147717.655636:0:22183:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime: 1746147717 -> 1746147718 00000100:00100000:0.0:1746147717.655655:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796356992:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147717.655661:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147717.655679:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7c228 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab43 expref: 12 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.655692:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7c228 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab43 expref: 12 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.655707:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736ac00, rc 0) 00000100:00100000:0.0:1746147717.655745:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013582d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793703424:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4366us (5151us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147717.655751:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15874 00000100:00100000:0.0:1746147717.661075:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.665210:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.665265:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793704576 00000100:00100000:1.0:1746147717.665269:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793704576 00002000:00100000:1.0:1746147717.665288:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (1175552->1818623) req@ffff8800a8acf100 x1830967793704576/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.665295:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf100 with x1830967793704576 ext(1175552->1818623) 00010000:00010000:1.0:1746147717.665303:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095747c00/0xe64d3fbf12a7c187 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1175552->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaf6 expref: 17 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.665322:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095747c00/0xe64d3fbf12a7c187 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1175552->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaf6 expref: 17 pid: 21480 timeout: 896 lvb_type: 0 00002000:00010000:1.0:1746147717.665328:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8acf100 00000100:00100000:1.0:1746147717.665350:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1381 00000100:00100000:1.0:1746147717.665357:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1959:x1830967793704576:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147717.665938:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7038 00000100:00100000:1.0:1746147717.665944:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793704448:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147717.666078:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793704448:12345-192.168.202.10@tcp:3:cat.0 Request processed in 133us (1540us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147717.666085:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7038 00002000:00100000:1.0:1746147717.666091:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1642496->1646591) req@ffff88012e385c00 x1830967793704448/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/4536 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.666099:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e385c00 with x1830967793704448 ext(1642496->1646591) 00002000:00010000:1.0:1746147717.666101:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e385c00 00000100:00100000:0.0:1746147717.670612:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793704832 00000100:00100000:0.0:1746147717.670621:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793704832 00000100:00100000:0.0:1746147717.670672:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4910 00000100:00100000:0.0:1746147717.670680:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:31912:x1830967793704832:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:0.0:1746147717.670957:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:31912:x1830967793704832:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 277us (421us total) trans 8589945856 rc 0/0 00000100:00100000:0.0:1746147717.670965:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4910 00000100:00100000:1.0:1746147717.679264:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1959:x1830967793704576:12345-192.168.202.10@tcp:4:cat.0 Request processed in 13895us (14042us total) trans 21474841472 rc 0/0 00000100:00100000:1.0:1746147717.679281:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1381 00002000:00100000:1.0:1746147717.679294:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (1175552->1818623) req@ffff8800a8acf100 x1830967793704576/t21474841472(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/448 e 0 to 0 dl 1746147728 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.679304:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf100 with x1830967793704576 ext(1175552->1818623) 00010000:00010000:1.0:1746147717.679314:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095747c00/0xe64d3fbf12a7c187 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1175552->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaf6 expref: 19 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.679332:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095747c00/0xe64d3fbf12a7c187 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1175552->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaf6 expref: 19 pid: 21480 timeout: 896 lvb_type: 0 00002000:00010000:1.0:1746147717.679340:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8acf100 00000100:00100000:0.0:1746147717.684279:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793705088 00000100:00100000:0.0:1746147717.684289:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793705088 00000100:00100000:0.0:1746147717.684357:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11873 00000100:00100000:0.0:1746147717.684366:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:31918:x1830967793705088:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147717.684393:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.684414:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736ae00/0xe64d3fbf12a7c24b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafab66 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.684524:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736be00/0xe64d3fbf12a7c252 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684537:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736be00/0xe64d3fbf12a7c252 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684547:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736be00/0xe64d3fbf12a7c252 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684560:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b600/0xe64d3fbf12a7c259 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684565:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b600/0xe64d3fbf12a7c259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684569:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b600/0xe64d3fbf12a7c259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684677:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a400/0xe64d3fbf12a7c260 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684686:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a400/0xe64d3fbf12a7c260 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684692:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a400/0xe64d3fbf12a7c260 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:0.0:1746147717.684701:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147717.684812:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736be00/0xe64d3fbf12a7c252 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684819:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736be00/0xe64d3fbf12a7c252 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684824:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736be00/0xe64d3fbf12a7c252 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684830:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a736be00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147717.684834:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736be00/0xe64d3fbf12a7c252 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684840:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736be00/0xe64d3fbf12a7c252 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684851:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147717.684854:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147717.684857:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736be00/0xe64d3fbf12a7c252 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684862:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736be00/0xe64d3fbf12a7c252 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684918:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b600/0xe64d3fbf12a7c259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684924:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b600/0xe64d3fbf12a7c259 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684932:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b600/0xe64d3fbf12a7c259 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684936:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a736b600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147717.684939:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b600/0xe64d3fbf12a7c259 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684943:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b600/0xe64d3fbf12a7c259 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684949:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06eeb00) 00010000:00010000:0.0:1746147717.684952:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147717.684954:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b600/0xe64d3fbf12a7c259 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684958:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736b600/0xe64d3fbf12a7c259 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147717.684992:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736ae00/0xe64d3fbf12a7c24b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab66 expref: 337 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.685012:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a400/0xe64d3fbf12a7c260 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab66 expref: 336 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.685019:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147717.685020:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147717.685023:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736a400, rc 0) 00000100:00100000:0.0:1746147717.685077:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+336:31918:x1830967793705088:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 711us (1856us total) trans 8589945857 rc 0/0 00000100:00100000:0.0:1746147717.685084:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11873 00000100:00100000:1.0:1746147717.690307:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793705216 00000100:00100000:1.0:1746147717.690312:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793705216 00010000:00010000:1.0:1746147717.690330:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095747c00/0xe64d3fbf12a7c187 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1175552->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaf6 expref: 19 pid: 21480 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746147717.690351:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8036 00000100:00100000:1.0:1746147717.690356:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1957:x1830967793705216:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147717.690364:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147717.690386:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095747c00/0xe64d3fbf12a7c187 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1175552->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaf6 expref: 19 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.690397:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095747c00/0xe64d3fbf12a7c187 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1175552->1818623) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaf6 expref: 19 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.690422:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095747c00/0xe64d3fbf12a7c187 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1175552->1818623) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaaf6 expref: 19 pid: 21480 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.690461:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147717.690463:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147717.690471:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21dea00/0xe64d3fbf12a7c244 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab5f expref: 9 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.690479:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21dea00/0xe64d3fbf12a7c244 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab5f expref: 9 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.690511:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a21dea00/0xe64d3fbf12a7c244 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab5f expref: 9 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147717.690523:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796357376:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147717.690575:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c220c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147717.692870:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013582e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796357376:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147717.693035:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147717.693082:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1957:x1830967793705216:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2724us (2839us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147717.693092:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8036 00000100:00100000:0.0:1746147717.695520:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.695575:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.695672:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793705856 00000100:00100000:1.0:1746147717.695680:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793705856 00002000:00100000:1.0:1746147717.695733:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a8acc380 x1830967793705856/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.695749:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acc380 with x1830967793705856 ext(1048576->2097151) 00002000:00010000:1.0:1746147717.695755:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acc380 00000100:00100000:1.0:1746147717.695795:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793705984 00000100:00100000:1.0:1746147717.695798:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793705984 00002000:00100000:1.0:1746147717.695808:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a8acce00 x1830967793705984/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 504/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.695815:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acce00 with x1830967793705984 ext(1048576->2097151) 00002000:00010000:1.0:1746147717.695818:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acce00 00000100:00100000:1.0:1746147717.695830:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7039 00000100:00100000:1.0:1746147717.695837:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967793705856:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147717.696190:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7040 00000100:00100000:0.0:1746147717.696198:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967793705984:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147717.712779:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967793705856:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16930us (17255us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147717.712803:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7039 00002000:00100000:1.0:1746147717.712811:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a8acc380 x1830967793705856/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/440 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.712820:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acc380 with x1830967793705856 ext(1048576->2097151) 00002000:00010000:1.0:1746147717.712827:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acc380 00000100:00100000:0.0:1746147717.721653:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.727082:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.727669:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793706368 00000100:00100000:1.0:1746147717.727676:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793706368 00010000:00010000:1.0:1746147717.727709:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801354c8400/0xe64d3fbf12a7bfff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9fa expref: 11 pid: 8470 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746147717.727743:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8037 00000100:00100000:1.0:1746147717.727750:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ace680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967793706368:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147717.727764:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147717.727795:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801354c8400/0xe64d3fbf12a7bfff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9fa expref: 11 pid: 8470 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.727805:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801354c8400/0xe64d3fbf12a7bfff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9fa expref: 11 pid: 8470 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.727829:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801354c8400/0xe64d3fbf12a7bfff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9fa expref: 11 pid: 8470 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.727846:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147717.728582:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ace680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967793706368:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 830us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147717.728590:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8037 00000100:00100000:1.0:1746147717.730999:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793707136 00000100:00100000:1.0:1746147717.731004:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793707136 00002000:00100000:1.0:1746147717.731202:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009c9a8a80 x1830967793707136/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.731214:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a8a80 with x1830967793707136 ext(3145728->4194303) 00002000:00010000:1.0:1746147717.731216:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9a8a80 00000100:00100000:1.0:1746147717.731510:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793707264 00000100:00100000:1.0:1746147717.731512:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793707264 00002000:00100000:1.0:1746147717.731523:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009505ce00 x1830967793707264/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.731529:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505ce00 with x1830967793707264 ext(2097152->3145727) 00002000:00010000:1.0:1746147717.731532:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009505ce00 00000100:00100000:1.0:1746147717.731544:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7041 00000100:00100000:1.0:1746147717.731549:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967793706752:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147717.732433:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7044 00000100:00100000:0.0:1746147717.732442:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967793707264:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147717.734291:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.735246:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793707776 00000100:00100000:1.0:1746147717.735254:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793707776 00002000:00100000:1.0:1746147717.735294:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x457:0x0] (1880064->1884159) req@ffff88013582fb80 x1830967793707776/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.735304:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013582fb80 with x1830967793707776 ext(1880064->1884159) 00002000:00010000:1.0:1746147717.735309:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013582fb80 00000100:00100000:1.0:1746147717.735334:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7045 00000100:00100000:1.0:1746147717.735341:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013582fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967793707776:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147717.735513:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013582fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967793707776:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 171us (1220us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147717.735520:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7045 00002000:00100000:1.0:1746147717.735525:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x457:0x0] (1880064->1884159) req@ffff88013582fb80 x1830967793707776/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/4536 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.735531:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013582fb80 with x1830967793707776 ext(1880064->1884159) 00002000:00010000:1.0:1746147717.735534:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013582fb80 00010000:00010000:1.0:1746147717.765019:0:20300:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147717.765721:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.767386:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.770160:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.773939:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.774264:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.774311:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.778357:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.778392:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.778413:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793709312 00000100:00100000:0.0:1746147717.778420:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793709312 00000100:00100000:0.0:1746147717.778463:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793709440 00000100:00100000:0.0:1746147717.778465:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793709440 00000100:00100000:0.0:1746147717.778479:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15882 00000100:00100000:0.0:1746147717.778487:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1959:x1830967793709312:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147717.778506:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.778524:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a736aa00/0xe64d3fbf12a7c2a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafab89 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.778547:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147717.778548:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147717.778558:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736aa00/0xe64d3fbf12a7c2a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab89 expref: 20 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.778575:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a736aa00/0xe64d3fbf12a7c2a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab89 expref: 20 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.778586:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736aa00, rc 0) 00000100:00100000:0.0:1746147717.778616:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1959:x1830967793709312:12345-192.168.202.10@tcp:101:cat.0 Request processed in 131us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147717.778622:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15882 00000100:00100000:0.0:1746147717.778637:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15883 00000100:00100000:0.0:1746147717.778641:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1959:x1830967793709440:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147717.778646:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.778651:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a736be00/0xe64d3fbf12a7c2ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafab90 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147717.778687:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796358272:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147717.778731:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6170c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147717.778767:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.778778:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793709568 00000100:00100000:0.0:1746147717.778781:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793709568 00000100:00100000:0.0:1746147717.778806:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15884 00000100:00100000:0.0:1746147717.778810:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967793709568:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147717.778817:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.778826:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a736b000/0xe64d3fbf12a7c2b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafab97 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.778847:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a736b000/0xe64d3fbf12a7c2b4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab97 expref: 24 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.778855:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a736b000/0xe64d3fbf12a7c2b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab97 expref: 24 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.781207:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736b000, rc 0) 00000100:00100000:0.0:1746147717.781279:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967793709568:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2461us (2504us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147717.781288:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15884 00000100:00100000:0.0:1746147717.781457:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.781487:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793709824 00000100:00100000:0.0:1746147717.781495:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793709824 00002000:00100000:0.0:1746147717.781537:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (2289664->2293759) req@ffff8800943c6d80 x1830967793709824/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.781546:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c6d80 with x1830967793709824 ext(2289664->2293759) 00002000:00010000:0.0:1746147717.781552:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c6d80 00000100:00100000:0.0:1746147717.781583:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7047 00000100:00100000:0.0:1746147717.781590:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967793709824:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147717.781731:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967793709824:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 142us (286us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147717.781736:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7047 00002000:00100000:0.0:1746147717.781741:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (2289664->2293759) req@ffff8800943c6d80 x1830967793709824/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/4536 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.781753:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c6d80 with x1830967793709824 ext(2289664->2293759) 00002000:00010000:0.0:1746147717.781755:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c6d80 00000100:00100000:1.0:1746147717.786203:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796358272:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147717.786239:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a736be00/0xe64d3fbf12a7c2ad lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab90 expref: 20 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.786258:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a736be00/0xe64d3fbf12a7c2ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab90 expref: 20 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.786273:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736be00, rc 0) 00000100:00100000:1.0:1746147717.786317:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1959:x1830967793709440:12345-192.168.202.10@tcp:101:cat.0 Request processed in 7674us (7924us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147717.786325:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15883 00000100:00100000:1.0:1746147717.787155:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1958:x1830967793709184:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12468us (12839us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147717.787164:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7046 00002000:00100000:1.0:1746147717.787173:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009172ce00 x1830967793709184/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/440 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.787182:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172ce00 with x1830967793709184 ext(3145728->4194303) 00002000:00010000:1.0:1746147717.787186:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172ce00 00000100:00100000:0.0:1746147717.793477:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.793535:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.794209:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793709952 00000100:00100000:1.0:1746147717.794219:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793709952 00000100:00100000:1.0:1746147717.794431:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793710080 00000100:00100000:1.0:1746147717.794434:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793710080 00000100:00100000:0.0:1746147717.794437:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.794453:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15885 00000100:00100000:1.0:1746147717.794460:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967793709952:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147717.794480:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147717.794498:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a932b000/0xe64d3fbf12a7c2bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafab9e expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147717.794556:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796358400:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147717.794631:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147717.794648:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793710336 00000100:00100000:1.0:1746147717.794874:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793710336 00002000:00100000:1.0:1746147717.794996:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800943c6300 x1830967793710336/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.795019:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c6300 with x1830967793710336 ext(1048576->2097151) 00002000:00010000:1.0:1746147717.795024:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c6300 00000100:00100000:1.0:1746147717.795114:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7048 00000100:00100000:1.0:1746147717.795120:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967793710336:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147717.814546:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793710720 00000100:00100000:0.0:1746147717.814558:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793710720 00000100:00100000:1.0:1746147717.815386:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793710848 00000100:00100000:1.0:1746147717.815391:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793710848 00000100:00100000:1.0:1746147717.815423:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15889 00000100:00100000:1.0:1746147717.815430:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967793710720:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147717.815451:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147717.815470:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e200/0xe64d3fbf12a7c2d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafabba expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147717.815526:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796358656:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147717.815595:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c22e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147717.816104:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793710976 00000100:00100000:0.0:1746147717.816108:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793710976 00000100:00100000:0.0:1746147717.816163:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15891 00000100:00100000:0.0:1746147717.816168:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:31923:x1830967793710976:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147717.816175:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.816185:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7c2e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafabc8 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.816201:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7c221 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab3c expref: 9 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.816208:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147717.816210:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147717.816213:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7c2e5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabc8 expref: 20 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.816236:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7c221 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1646591) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab3c expref: 9 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.816247:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7c221 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1646591) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab3c expref: 9 pid: 8469 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746147717.816258:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796358784:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147717.816301:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6170c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147717.817503:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013582ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796358656:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147717.817523:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e200/0xe64d3fbf12a7c2d7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabba expref: 11 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.817533:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e200/0xe64d3fbf12a7c2d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabba expref: 11 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.817549:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7e200, rc 0) 00000100:00100000:1.0:1746147717.817796:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1958:x1830967793710720:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2365us (4197us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147717.817803:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15889 00000100:00100000:0.0:1746147717.818768:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796358784:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147717.818796:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7c2e5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabc8 expref: 20 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.818808:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d2200, rc 0) 00000100:00100000:0.0:1746147717.818836:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:31923:x1830967793710976:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2668us (2769us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147717.818842:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15891 00000100:00100000:0.0:1746147717.819557:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793711104 00000100:00100000:0.0:1746147717.819562:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793711104 00002000:00100000:0.0:1746147717.819593:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1265664->1646591) req@ffff8800a8acf480 x1830967793711104/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.819602:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf480 with x1830967793711104 ext(1265664->1646591) 00010000:00010000:0.0:1746147717.819608:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7c221 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab3c expref: 10 pid: 8469 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746147717.819619:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7c221 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab3c expref: 10 pid: 8469 timeout: 896 lvb_type: 0 00002000:00010000:0.0:1746147717.819626:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8acf480 00000100:00100000:0.0:1746147717.819642:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1382 00000100:00100000:0.0:1746147717.819649:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967793711104:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147717.826457:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967793711104:12345-192.168.202.10@tcp:4:cat.0 Request processed in 6796us (7451us total) trans 21474841473 rc 0/0 00000100:00100000:1.0:1746147717.826471:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1382 00002000:00100000:1.0:1746147717.826483:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1265664->1646591) req@ffff8800a8acf480 x1830967793711104/t21474841473(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/448 e 0 to 0 dl 1746147728 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.826492:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf480 with x1830967793711104 ext(1265664->1646591) 00010000:00010000:1.0:1746147717.826503:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7c221 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab3c expref: 12 pid: 8469 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746147717.826518:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7c221 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab3c expref: 12 pid: 8469 timeout: 897 lvb_type: 0 00002000:00010000:1.0:1746147717.826525:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8acf480 00000100:00100000:0.0:1746147717.829681:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.837610:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.837980:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793711488 00000100:00100000:1.0:1746147717.837987:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793711488 00002000:00100000:1.0:1746147717.838023:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800943c5180 x1830967793711488/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.838032:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5180 with x1830967793711488 ext(1048576->2097151) 00002000:00010000:1.0:1746147717.838037:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c5180 00000100:00100000:1.0:1746147717.838062:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7049 00000100:00100000:1.0:1746147717.838070:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967793711488:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147717.839139:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.849210:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967793711488:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11134us (11601us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147717.849219:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7049 00002000:00100000:0.0:1746147717.849227:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800943c5180 x1830967793711488/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/440 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.849233:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5180 with x1830967793711488 ext(1048576->2097151) 00002000:00010000:0.0:1746147717.849237:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c5180 00000100:00100000:0.0:1746147717.861507:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.879017:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.881595:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.897200:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.901295:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.901371:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793712768 00000100:00100000:1.0:1746147717.901378:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793712768 00000100:00100000:1.0:1746147717.901418:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15895 00000100:00100000:1.0:1746147717.901423:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967793712768:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147717.901435:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147717.901448:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5528000/0xe64d3fbf12a7c301 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafabe4 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.901467:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5528000/0xe64d3fbf12a7c301 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabe4 expref: 25 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.901474:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5528000/0xe64d3fbf12a7c301 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabe4 expref: 25 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.901482:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5528000, rc 0) 00000100:00100000:1.0:1746147717.901509:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967793712768:12345-192.168.202.10@tcp:101:cat.0 Request processed in 87us (221us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147717.901512:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15895 00000100:00100000:0.0:1746147717.905392:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.905438:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.908348:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.908395:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.921882:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.928453:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.928522:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793714048 00000100:00100000:1.0:1746147717.928531:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793714048 00010000:00010000:1.0:1746147717.928562:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801308bd800/0xe64d3fbf12a7c1d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab27 expref: 21 pid: 8469 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746147717.928602:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8042 00000100:00100000:1.0:1746147717.928609:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967793714048:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147717.928623:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147717.928643:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801308bd800/0xe64d3fbf12a7c1d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab27 expref: 21 pid: 8469 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147717.928652:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801308bd800/0xe64d3fbf12a7c1d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab27 expref: 21 pid: 8469 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147717.928670:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801308bd800/0xe64d3fbf12a7c1d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab27 expref: 21 pid: 8469 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147717.928691:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147717.928725:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1959:x1830967793714048:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 116us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147717.928731:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8042 00000100:00100000:0.0:1746147717.929753:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.929944:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793714176 00000100:00100000:1.0:1746147717.929948:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793714176 00010000:00010000:1.0:1746147717.929965:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7c23d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab58 expref: 11 pid: 8470 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746147717.929994:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8043 00000100:00100000:1.0:1746147717.929999:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793714176:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147717.930007:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147717.930018:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7c23d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab58 expref: 11 pid: 8470 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746147717.930026:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7c23d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab58 expref: 11 pid: 8470 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746147717.930040:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7c23d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab58 expref: 11 pid: 8470 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746147717.930049:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147717.930050:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147717.930055:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffcc400/0xe64d3fbf12a7c34e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2371584->2703359) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabf9 expref: 19 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.930062:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffcc400/0xe64d3fbf12a7c34e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2371584->2703359) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabf9 expref: 19 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.930089:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffcc400/0xe64d3fbf12a7c34e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2371584->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabf9 expref: 19 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147717.930099:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796359296:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147717.930549:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c22e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147717.931452:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013582ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796359296:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147717.931466:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147717.931502:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967793714176:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1502us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147717.931509:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8043 00000100:00100000:0.0:1746147717.932863:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.937130:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.937385:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7054 00000100:00100000:0.0:1746147717.937393:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1958:x1830967793714688:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147717.937433:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.937648:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1958:x1830967793714688:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 255us (525us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147717.937654:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7054 00002000:00100000:0.0:1746147717.937660:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2699264->2703359) req@ffff88009fe41500 x1830967793714688/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:338/0 lens 488/4536 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147717.937666:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41500 with x1830967793714688 ext(2699264->2703359) 00002000:00010000:0.0:1746147717.937668:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe41500 00000100:00100000:0.0:1746147717.940751:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.940826:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793714944 00000100:00100000:1.0:1746147717.940832:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793714944 00010000:00010000:1.0:1746147717.940858:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7c2e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabc8 expref: 20 pid: 22183 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746147717.940988:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8044 00000100:00100000:1.0:1746147717.940995:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967793714944:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147717.941008:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147717.941029:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7c2e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabc8 expref: 20 pid: 22183 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147717.941040:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7c2e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabc8 expref: 20 pid: 22183 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147717.941061:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7c2e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabc8 expref: 20 pid: 22183 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147717.941081:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147717.941082:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147717.941088:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffcd400/0xe64d3fbf12a7c355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1695743) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac00 expref: 10 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.941095:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffcd400/0xe64d3fbf12a7c355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1695743) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac00 expref: 10 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.941127:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffcd400/0xe64d3fbf12a7c355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac00 expref: 10 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147717.941139:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796359552:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147717.941206:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c22e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147717.942667:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013582f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796359552:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147717.942682:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147717.942719:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967793714944:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1723us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147717.942726:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8044 00000100:00100000:0.0:1746147717.942941:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.943131:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793715200 00000100:00100000:1.0:1746147717.943136:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793715200 00002000:00100000:1.0:1746147717.943166:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1159168->1163263) req@ffff88009fe41c00 x1830967793715200/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.943174:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41c00 with x1830967793715200 ext(1159168->1163263) 00002000:00010000:1.0:1746147717.943178:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe41c00 00000100:00100000:1.0:1746147717.943206:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7055 00000100:00100000:1.0:1746147717.943212:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967793715200:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147717.943341:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967793715200:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 129us (401us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147717.943346:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7055 00002000:00100000:1.0:1746147717.943351:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1159168->1163263) req@ffff88009fe41c00 x1830967793715200/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/4536 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.943358:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41c00 with x1830967793715200 ext(1159168->1163263) 00002000:00010000:1.0:1746147717.943360:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe41c00 00000100:00100000:0.0:1746147717.947576:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.947636:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793715456 00000100:00100000:1.0:1746147717.947644:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793715456 00002000:00100000:1.0:1746147717.947679:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1691648->1695743) req@ffff88009fe41f80 x1830967793715456/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/0 e 0 to 0 dl 1746147728 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.947686:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41f80 with x1830967793715456 ext(1691648->1695743) 00002000:00010000:1.0:1746147717.947692:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe41f80 00000100:00100000:1.0:1746147717.947719:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7056 00000100:00100000:1.0:1746147717.947727:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967793715456:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147717.948122:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967793715456:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 395us (552us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147717.948127:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7056 00002000:00100000:1.0:1746147717.948132:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1691648->1695743) req@ffff88009fe41f80 x1830967793715456/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:338/0 lens 488/4536 e 0 to 0 dl 1746147728 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147717.948138:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41f80 with x1830967793715456 ext(1691648->1695743) 00002000:00010000:1.0:1746147717.948141:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe41f80 00000100:00100000:0.0:1746147717.950364:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.964248:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.969201:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.971944:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.972018:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793716224 00000100:00100000:1.0:1746147717.972023:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793716224 00010000:00010000:1.0:1746147717.972048:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e4c00/0xe64d3fbf12a7c0bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa6a expref: 341 pid: 14546 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746147717.972073:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8045 00000100:00100000:1.0:1746147717.972078:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+341:1959:x1830967793716224:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147717.972090:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147717.972094:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e4c00/0xe64d3fbf12a7c0bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa6a expref: 341 pid: 14546 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147717.972103:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e4c00/0xe64d3fbf12a7c0bc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa6a expref: 341 pid: 14546 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147717.972120:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e4c00/0xe64d3fbf12a7c0bc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa6a expref: 341 pid: 14546 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147717.972139:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147717.972143:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0505e00/0xe64d3fbf12a7c371 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147717.972151:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0505e00/0xe64d3fbf12a7c371 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147717.972156:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0505e00/0xe64d3fbf12a7c371 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147717.972184:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147717.972216:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+340:1959:x1830967793716224:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 136us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147717.972221:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8045 00000100:00100000:0.0:1746147717.977613:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.977647:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.977672:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.977698:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.977710:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.977744:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.977760:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793716480 00000100:00100000:0.0:1746147717.977763:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793716480 00000100:00100000:1.0:1746147717.977818:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793716608 00000100:00100000:1.0:1746147717.977822:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793716608 00000100:00100000:0.0:1746147717.977852:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793716736 00000100:00100000:0.0:1746147717.977854:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793716736 00000100:00100000:0.0:1746147717.977864:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793716864 00000100:00100000:0.0:1746147717.977866:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793716864 00000100:00100000:0.0:1746147717.977875:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793716992 00000100:00100000:0.0:1746147717.977877:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793716992 00000100:00100000:0.0:1746147717.977903:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15899 00000100:00100000:0.0:1746147717.977909:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793716480:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147717.977916:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.977926:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bc90600/0xe64d3fbf12a7c37f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafac15 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.977938:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147717.977940:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147717.977944:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc90600/0xe64d3fbf12a7c37f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac15 expref: 9 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.977953:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bc90600/0xe64d3fbf12a7c37f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac15 expref: 9 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.977961:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc90600, rc 0) 00000100:00100000:0.0:1746147717.977995:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793716480:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 87us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147717.978001:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15899 00000100:00100000:0.0:1746147717.978015:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15900 00000100:00100000:0.0:1746147717.978019:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793716736:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147717.978024:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.978030:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135500000/0xe64d3fbf12a7c386 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafac23 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147717.978061:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0224380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796359808:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147717.978109:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6170c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147717.978127:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15901 00000100:00100000:0.0:1746147717.978133:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793716864:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147717.978138:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.978144:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7c38d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafac2a expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147717.978160:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7c38d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac2a expref: 10 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.978168:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7c38d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac2a expref: 10 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147717.978182:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095093400, rc 0) 00000100:00100000:0.0:1746147717.978202:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793716864:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 70us (491us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147717.978208:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15901 00000100:00100000:0.0:1746147717.978218:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15902 00000100:00100000:0.0:1746147717.978223:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793716992:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147717.978228:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147717.978234:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7c394 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafac31 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147717.978254:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0224700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796359936:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147717.978273:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147717.978466:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15903 00000100:00100000:1.0:1746147717.978473:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793716608:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147717.978479:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147717.978486:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c39b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafac1c expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147717.978508:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796360064:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147717.978528:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c22300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147717.980920:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0224700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796359936:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147717.980934:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7c394 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac31 expref: 10 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.980948:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7c394 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac31 expref: 10 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147717.980961:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095092a00, rc 0) 00000100:00100000:1.0:1746147717.981259:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793716992:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 3035us (3513us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147717.981264:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15902 00000100:00100000:1.0:1746147717.983710:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.987832:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.991003:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.993356:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.995931:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.997158:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.997194:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.997226:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147717.997271:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147717.997610:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15908 00000100:00100000:1.0:1746147717.997616:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793718144:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147717.997628:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c3ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.997636:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffcd400/0xe64d3fbf12a7c355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac00 expref: 10 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.997641:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147717.997642:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147717.997644:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c3ef lrc: 4/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.997656:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffcd400/0xe64d3fbf12a7c355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1695743) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac00 expref: 10 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147717.997664:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ffcd400/0xe64d3fbf12a7c355 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1695743) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac00 expref: 10 pid: 22183 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746147717.997671:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796361088:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147717.997685:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c22b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147718.001655:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793718400 00000100:00100000:0.0:1746147718.001663:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793718400 00000100:00100000:0.0:1746147718.001720:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15909 00000100:00100000:0.0:1746147718.001728:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793718400:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147718.001760:0:4592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cc31000/0xe64d3fbf12a7c3f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.001774:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095093a00/0xe64d3fbf12a7c275 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab7b expref: 23 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.001795:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091560400/0xe64d3fbf12a7c109 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa94 expref: 23 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.001802:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc91000/0xe64d3fbf12a7c29f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab82 expref: 9 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.001808:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095234400/0xe64d3fbf12a7c148 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaad3 expref: 9 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.001814:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffcce00/0xe64d3fbf12a7c2f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabd6 expref: 23 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.001823:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 5 00010000:00010000:0.0:1746147718.001825:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 5 00010000:00010000:0.0:1746147718.001828:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc31000/0xe64d3fbf12a7c3f6 lrc: 8/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.001854:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ffcce00/0xe64d3fbf12a7c2f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabd6 expref: 23 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.001863:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ffcce00/0xe64d3fbf12a7c2f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabd6 expref: 23 pid: 22183 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746147718.001874:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0226680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796361472:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147718.001967:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095234400/0xe64d3fbf12a7c148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaad3 expref: 9 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.001975:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095234400/0xe64d3fbf12a7c148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaad3 expref: 9 pid: 21480 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746147718.001983:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0226a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796361600:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147718.002004:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc91000/0xe64d3fbf12a7c29f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab82 expref: 9 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.002011:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bc91000/0xe64d3fbf12a7c29f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab82 expref: 9 pid: 21480 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746147718.002023:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0226d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796361728:192.168.202.10@tcp:104: 00000100:00080000:1.0:1746147718.002026:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746147718.002043:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091560400/0xe64d3fbf12a7c109 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa94 expref: 23 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.002050:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091560400/0xe64d3fbf12a7c109 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa94 expref: 23 pid: 8470 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746147718.002057:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0227100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796361856:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147718.002077:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095093a00/0xe64d3fbf12a7c275 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab7b expref: 23 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.002084:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095093a00/0xe64d3fbf12a7c275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab7b expref: 23 pid: 21480 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746147718.002090:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0227480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796361984:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147718.002104:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147718.004051:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.004075:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147718.004143:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013582c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796361088:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147718.004153:0:20619:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c3ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147718.004197:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.004211:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.004945:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147718.005001:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793718912 00000100:00100000:1.0:1746147718.005004:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793718912 00000100:00100000:1.0:1746147718.005011:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793719296 00000100:00100000:1.0:1746147718.005013:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793719296 00010000:00010000:1.0:1746147718.005030:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a732c000/0xe64d3fbf12a7bf81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa98a expref: 10 pid: 21480 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746147718.005122:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0226680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796361472:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147718.005151:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0226a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796361600:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147718.005172:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0226d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796361728:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147718.005195:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0227100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796361856:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147718.005217:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0227480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796361984:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147718.005236:0:4592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cc31000/0xe64d3fbf12a7c3f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147718.005274:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147718.006606:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793719424 00000100:00100000:1.0:1746147718.006612:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793719424 00010000:00010000:1.0:1746147718.006630:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc90600/0xe64d3fbf12a7c37f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac15 expref: 10 pid: 8469 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746147718.006645:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8049 00000100:00100000:1.0:1746147718.006650:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1958:x1830967793719296:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147718.006658:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147718.006673:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a732c000/0xe64d3fbf12a7bf81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa98a expref: 10 pid: 21480 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.006685:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a732c000/0xe64d3fbf12a7bf81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa98a expref: 10 pid: 21480 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.006700:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a732c000/0xe64d3fbf12a7bf81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa98a expref: 10 pid: 21480 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.006716:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147718.006718:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147718.006721:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffcca00/0xe64d3fbf12a7c3d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.006727:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffcca00/0xe64d3fbf12a7c3d3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.006743:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147718.006765:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1958:x1830967793719296:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 114us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147718.006770:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8049 00000100:00100000:1.0:1746147718.006791:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8050 00000100:00100000:1.0:1746147718.006796:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967793719424:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147718.006802:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147718.006816:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bc90600/0xe64d3fbf12a7c37f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac15 expref: 10 pid: 8469 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746147718.006822:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bc90600/0xe64d3fbf12a7c37f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac15 expref: 10 pid: 8469 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746147718.006838:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bc90600/0xe64d3fbf12a7c37f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac15 expref: 10 pid: 8469 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746147718.006846:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147718.006861:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967793719424:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 65us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147718.006866:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8050 00000100:00080000:1.0:1746147718.006880:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147718.006901:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:1.0:1746147718.006921:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (1880064->2097151) req@ffff8800a0227b80 x1830967793718912/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:339/0 lens 488/0 e 0 to 0 dl 1746147729 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147718.006928:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0227b80 with x1830967793718912 ext(1880064->2097151) 00010000:00010000:1.0:1746147718.006933:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7c26e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab6d expref: 23 pid: 21480 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.006942:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7c26e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab6d expref: 23 pid: 21480 timeout: 897 lvb_type: 0 00002000:00010000:1.0:1746147718.006947:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0227b80 00000100:00100000:1.0:1746147718.006959:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1384 00000100:00100000:1.0:1746147718.006963:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967793718912:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:0.0:1746147718.009302:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.009330:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.009355:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.009379:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.009404:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147718.009457:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793719168 00000100:00100000:1.0:1746147718.009463:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793719168 00002000:00100000:1.0:1746147718.009484:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2371584->2703359) req@ffff8800a0226a00 x1830967793719168/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:339/0 lens 488/0 e 0 to 0 dl 1746147729 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147718.009496:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0226a00 with x1830967793719168 ext(2371584->2703359) 00010000:00010000:1.0:1746147718.009502:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ffcc400/0xe64d3fbf12a7c34e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2371584->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabf9 expref: 19 pid: 22183 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.009512:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ffcc400/0xe64d3fbf12a7c34e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2371584->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabf9 expref: 19 pid: 22183 timeout: 897 lvb_type: 0 00002000:00010000:1.0:1746147718.009518:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0226a00 00000100:00100000:1.0:1746147718.009531:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1385 00000100:00100000:1.0:1746147718.009536:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967793719168:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:1.0:1746147718.009914:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793719552 00000100:00100000:1.0:1746147718.009917:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793719552 00010000:00010000:1.0:1746147718.009930:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736aa00/0xe64d3fbf12a7c2a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab89 expref: 21 pid: 22183 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746147718.009943:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793719808 00000100:00100000:1.0:1746147718.009944:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793719808 00010000:00010000:1.0:1746147718.009953:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffcce00/0xe64d3fbf12a7c2f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabd6 expref: 25 pid: 22183 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746147718.009964:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793719680 00000100:00100000:1.0:1746147718.009965:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793719680 00010000:00010000:1.0:1746147718.009973:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095234400/0xe64d3fbf12a7c148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaad3 expref: 9 pid: 21480 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746147718.009979:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793720064 00000100:00100000:1.0:1746147718.009981:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793720064 00010000:00010000:1.0:1746147718.009988:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091560400/0xe64d3fbf12a7c109 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa94 expref: 26 pid: 8470 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746147718.009996:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8052 00000100:00100000:1.0:1746147718.010000:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967793719552:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147718.010009:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147718.010019:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a736aa00/0xe64d3fbf12a7c2a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab89 expref: 21 pid: 22183 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746147718.010027:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a736aa00/0xe64d3fbf12a7c2a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab89 expref: 21 pid: 22183 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746147718.010041:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a736aa00/0xe64d3fbf12a7c2a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab89 expref: 21 pid: 22183 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746147718.010051:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147718.010053:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147718.010057:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095445600/0xe64d3fbf12a7c3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.010064:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095445600/0xe64d3fbf12a7c3da lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.010083:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147718.010103:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967793719552:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 102us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147718.010109:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8052 00000100:00100000:1.0:1746147718.010123:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8053 00000100:00100000:1.0:1746147718.010127:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967793719808:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147718.010134:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147718.010145:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ffcce00/0xe64d3fbf12a7c2f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabd6 expref: 26 pid: 22183 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.010153:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ffcce00/0xe64d3fbf12a7c2f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabd6 expref: 26 pid: 22183 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.010164:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffcce00/0xe64d3fbf12a7c2f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabd6 expref: 26 pid: 22183 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.010173:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147718.010184:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967793719808:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 57us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147718.010189:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8053 00000100:00100000:1.0:1746147718.010198:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8054 00000100:00100000:1.0:1746147718.010202:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967793719680:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147718.010207:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147718.010214:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095234400/0xe64d3fbf12a7c148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaad3 expref: 9 pid: 21480 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.010220:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095234400/0xe64d3fbf12a7c148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaad3 expref: 9 pid: 21480 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.010229:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095234400/0xe64d3fbf12a7c148 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaad3 expref: 9 pid: 21480 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.010239:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147718.010250:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1960:x1830967793719680:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 48us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147718.010255:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8054 00000100:00100000:1.0:1746147718.010283:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8055 00000100:00100000:1.0:1746147718.010287:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967793720064:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147718.010292:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147718.010299:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091560400/0xe64d3fbf12a7c109 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa94 expref: 24 pid: 8470 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.010306:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091560400/0xe64d3fbf12a7c109 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa94 expref: 24 pid: 8470 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.010315:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091560400/0xe64d3fbf12a7c109 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa94 expref: 24 pid: 8470 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.010322:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147718.010333:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967793720064:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 46us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147718.010338:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8055 00010000:00010000:1.0:1746147718.010356:0:8469:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095445600/0xe64d3fbf12a7c3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.010363:0:8469:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095445600/0xe64d3fbf12a7c3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.010380:0:8469:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095445600/0xe64d3fbf12a7c3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.010387:0:8469:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095445600/0xe64d3fbf12a7c3da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.010392:0:8469:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095445600/0xe64d3fbf12a7c3da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.010397:0:8469:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095445600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147718.010399:0:8469:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095445600/0xe64d3fbf12a7c3da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.010404:0:8469:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095445600/0xe64d3fbf12a7c3da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.010411:0:8469:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095445600/0xe64d3fbf12a7c3da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.010416:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095445600/0xe64d3fbf12a7c3da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147718.010446:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793718016:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 13154us (13289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147718.010453:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15905 00000100:00100000:1.0:1746147718.019462:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793718912:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 12491us (15257us total) trans 17179874242 rc 0/0 00000100:00100000:1.0:1746147718.019472:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1384 00002000:00100000:1.0:1746147718.019479:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (1880064->2097151) req@ffff8800a0227b80 x1830967793718912/t17179874242(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:339/0 lens 488/448 e 0 to 0 dl 1746147729 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147718.019486:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0227b80 with x1830967793718912 ext(1880064->2097151) 00010000:00010000:1.0:1746147718.019494:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7c26e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab6d expref: 25 pid: 21480 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.019505:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7c26e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab6d expref: 25 pid: 21480 timeout: 897 lvb_type: 0 00002000:00010000:1.0:1746147718.019510:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0227b80 00000100:00100000:0.0:1746147718.021733:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.021757:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793720448 00000100:00100000:0.0:1746147718.021763:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793720448 00010000:00010000:0.0:1746147718.021795:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffcd400/0xe64d3fbf12a7c355 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac00 expref: 12 pid: 22183 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746147718.021834:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8057 00000100:00100000:0.0:1746147718.021841:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1958:x1830967793720448:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147718.021853:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147718.021869:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ffcd400/0xe64d3fbf12a7c355 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac00 expref: 12 pid: 22183 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746147718.021878:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ffcd400/0xe64d3fbf12a7c355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1695743) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac00 expref: 12 pid: 22183 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746147718.021919:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ffcd400/0xe64d3fbf12a7c355 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1695743) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac00 expref: 12 pid: 22183 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746147718.021936:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147718.021938:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147718.021941:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.021948:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c3ef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.021967:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147718.021995:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967793720448:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 155us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.022001:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8057 00000100:00100000:0.0:1746147718.022582:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.022593:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793720576 00000100:00100000:0.0:1746147718.022596:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793720576 00010000:00010000:0.0:1746147718.022609:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7c26e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab6d expref: 25 pid: 21480 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746147718.022623:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8058 00000100:00100000:0.0:1746147718.022628:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967793720576:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147718.022635:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147718.022646:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7c26e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab6d expref: 25 pid: 21480 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746147718.022658:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7c26e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab6d expref: 25 pid: 21480 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746147718.022670:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7c26e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1880064->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafab6d expref: 25 pid: 21480 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746147718.022681:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147718.022683:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147718.022685:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a932b000/0xe64d3fbf12a7c3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.022691:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a932b000/0xe64d3fbf12a7c3e1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.022702:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147718.022717:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967793720576:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 88us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.022722:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8058 00010000:00010000:0.0:1746147718.022926:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.022934:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.022952:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.022963:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c3ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.022969:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c3ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.022974:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5529a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147718.022977:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c3ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.022983:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c3ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.022992:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c3ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.022998:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5529a00/0xe64d3fbf12a7c3ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147718.023587:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793718144:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 25970us (26314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147718.023588:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967793719168:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 14052us (14232us total) trans 21474841475 rc 0/0 00000100:00100000:1.0:1746147718.023595:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1385 00000100:00100000:0.0:1746147718.023595:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15908 00002000:00100000:1.0:1746147718.023603:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2371584->2703359) req@ffff8800a0226a00 x1830967793719168/t21474841475(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:339/0 lens 488/448 e 0 to 0 dl 1746147729 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147718.023611:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0226a00 with x1830967793719168 ext(2371584->2703359) 00010000:00010000:1.0:1746147718.023617:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ffcc400/0xe64d3fbf12a7c34e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2371584->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabf9 expref: 20 pid: 22183 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.023626:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ffcc400/0xe64d3fbf12a7c34e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2371584->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafabf9 expref: 20 pid: 22183 timeout: 897 lvb_type: 0 00002000:00010000:1.0:1746147718.023631:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0226a00 00000100:00100000:0.0:1746147718.025604:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.028882:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147718.029512:0:4592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cc31000/0xe64d3fbf12a7c3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.029524:0:4592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc31000/0xe64d3fbf12a7c3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.029540:0:4592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cc31000/0xe64d3fbf12a7c3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.029547:0:4592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc31000/0xe64d3fbf12a7c3f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.029553:0:4592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cc31000/0xe64d3fbf12a7c3f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.029558:0:4592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc31000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147718.029561:0:4592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cc31000/0xe64d3fbf12a7c3f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.029567:0:4592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cc31000/0xe64d3fbf12a7c3f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.029576:0:4592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cc31000/0xe64d3fbf12a7c3f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.029581:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc31000/0xe64d3fbf12a7c3f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147718.029863:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+5:1960:x1830967793718400:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 28136us (28303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.029870:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15909 00000100:00100000:1.0:1746147718.032029:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793721088 00000100:00100000:1.0:1746147718.032034:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793721088 00000100:00100000:1.0:1746147718.032083:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11881 00000100:00100000:1.0:1746147718.032090:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+10:31933:x1830967793721088:12345-192.168.202.10@tcp:36:mirror_io.0 00010000:00010000:1.0:1746147718.032193:0:14546:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147718.032213:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd200/0xe64d3fbf12a7c3cc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac46 expref: 10 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.032240:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147718.032244:0:14546:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147718.032270:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7c00/0xe64d3fbf12a7c3fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147718.032281:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa99f expref: 339 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.032287:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ed800/0xe64d3fbf12a7bfb9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9b4 expref: 21 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.032292:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ed200/0xe64d3fbf12a7bfc0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9bb expref: 339 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.032296:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7c08b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa47 expref: 21 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.032301:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7c0df lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa71 expref: 21 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.032306:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095234600/0xe64d3fbf12a7c164 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaada expref: 339 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.032312:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7c00/0xe64d3fbf12a7c3fd lrc: 9/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147718.032334:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095234600/0xe64d3fbf12a7c164 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaada expref: 339 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.032343:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095234600/0xe64d3fbf12a7c164 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaada expref: 339 pid: 14546 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746147718.032354:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796362112:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147718.032427:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7c0df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa71 expref: 21 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.032435:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7c0df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa71 expref: 21 pid: 14546 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746147718.032448:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796362240:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147718.032468:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7c08b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa47 expref: 21 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.032474:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7c08b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa47 expref: 21 pid: 14545 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746147718.032480:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796362368:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147718.032492:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ed200/0xe64d3fbf12a7bfc0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9bb expref: 339 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.032502:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ed200/0xe64d3fbf12a7bfc0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9bb expref: 339 pid: 15085 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746147718.032507:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094339500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796362496:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147718.032520:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ed800/0xe64d3fbf12a7bfb9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9b4 expref: 21 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.032525:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950ed800/0xe64d3fbf12a7bfb9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa9b4 expref: 21 pid: 17544 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746147718.032530:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796362624:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147718.032544:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa99f expref: 339 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147718.032554:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa99f expref: 339 pid: 14546 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746147718.032561:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cba300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796362752:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147718.032575:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c22d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147718.036459:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.036513:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147718.036602:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013582c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796362112:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147718.036611:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013582ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796362240:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147718.036618:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796362368:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147718.036624:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094339500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796362496:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147718.036630:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b6cb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796362624:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147718.036636:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b6cba300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796362752:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147718.036661:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7c00/0xe64d3fbf12a7c3fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147718.036774:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.036814:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.036962:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.037013:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147718.037266:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8065 00000100:00100000:1.0:1746147718.037273:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+342:1957:x1830967793721984:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147718.037279:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147718.037282:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa99f expref: 342 pid: 14546 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.038069:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa99f expref: 338 pid: 14546 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.038081:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093da8a00/0xe64d3fbf12a7bfa4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafa99f expref: 338 pid: 14546 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.038089:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147718.038092:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7c00/0xe64d3fbf12a7c3fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147718.038096:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147718.038113:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+337:1957:x1830967793721984:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 842us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147718.038119:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8065 00000100:00100000:0.0:1746147718.039346:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147718.039386:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793722112 00000100:00100000:1.0:1746147718.039391:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793722112 00010000:00010000:1.0:1746147718.039406:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7c08b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa47 expref: 21 pid: 14545 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746147718.039434:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8066 00000100:00100000:1.0:1746147718.039439:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967793722112:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147718.039447:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147718.039451:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7c08b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa47 expref: 21 pid: 14545 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.039459:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7c08b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa47 expref: 21 pid: 14545 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.039470:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7c08b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaa47 expref: 21 pid: 14545 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746147718.039479:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147718.039482:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7c00/0xe64d3fbf12a7c3fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147718.039488:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7c00/0xe64d3fbf12a7c3fd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147718.039493:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7c00/0xe64d3fbf12a7c3fd lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147718.039515:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147718.039547:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1957:x1830967793722112:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 108us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147718.039993:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8066 00000001:00080000:1.0:1746147718.064360:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945857 is committed 00000001:00080000:1.0:1746147718.064370:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945856 is committed 00000001:00080000:1.0:1746147718.064387:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945869 is committed 00000004:00080000:1.0:1746147718.064391:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2663 committed 00000004:00080000:1.0:1746147718.064398:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2644 committed 00000004:00080000:1.0:1746147718.064403:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2643 committed 00000004:00080000:1.0:1746147718.064404:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2642 committed 00000004:00080000:1.0:1746147718.064406:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2641 committed 00000004:00080000:1.0:1746147718.064407:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2662 committed 00000004:00080000:1.0:1746147718.064408:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2640 committed 00000004:00080000:1.0:1746147718.064410:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2661 committed 00000004:00080000:1.0:1746147718.064411:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2639 committed 00000004:00080000:1.0:1746147718.064413:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2660 committed 00000004:00080000:1.0:1746147718.064414:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2659 committed 00000004:00080000:1.0:1746147718.064416:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2658 committed 00000004:00080000:1.0:1746147718.064417:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2638 committed 00000004:00080000:1.0:1746147718.064418:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2637 committed 00000004:00080000:1.0:1746147718.064420:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2657 committed 00000004:00080000:1.0:1746147718.064421:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2656 committed 00000004:00080000:1.0:1746147718.064422:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2636 committed 00000001:00080000:1.0:1746147718.064426:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945868 is committed 00000001:00080000:1.0:1746147718.064433:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945865 is committed 00000100:00100000:1.0:1746147718.064665:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796362880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147718.064711:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.064742:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796363392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147718.064768:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.064795:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796363904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.064811:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.064821:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796364416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.064833:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.064848:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746147718.064853:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796363264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147718.064868:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.064879:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796363776:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147718.064914:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.064928:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091119500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796364288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.064940:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.064949:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796364800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.064960:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.064979:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796363008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147718.064993:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.065004:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796363520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147718.065015:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.065023:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091118700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796364032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147718.065305:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796363264 00000100:00100000:0.0:1746147718.065308:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796363264 00000100:00100000:0.0:1746147718.065318:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796364800 00000100:00100000:0.0:1746147718.065319:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796364800 00000100:00100000:0.0:1746147718.065324:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796363520 00000100:00100000:0.0:1746147718.065326:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796363520 00000100:00100000:0.0:1746147718.065340:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15911 00000100:00100000:0.0:1746147718.065344:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3304:x1830967796363392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147718.065525:0:4591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:0.0:1746147718.065528:0:4591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147718.065531:0:4591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147718.065532:0:4591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147718.065535:0:4591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:1.0:1746147718.066493:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.066517:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796364544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.066537:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.066548:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746147718.066554:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796363136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147718.066568:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.066576:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796363648:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147718.066587:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.066593:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009111ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796364160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.066604:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.066610:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796364672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.066620:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147718.066640:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796364032 00000100:00100000:1.0:1746147718.066643:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796364032 00000100:00100000:1.0:1746147718.066655:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796364544 00000100:00100000:1.0:1746147718.066656:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796364544 00000100:00100000:1.0:1746147718.066661:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796363136 00000100:00100000:1.0:1746147718.066662:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796363136 00000100:00100000:1.0:1746147718.066667:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796363648 00000100:00100000:1.0:1746147718.066668:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796363648 00000100:00100000:1.0:1746147718.066672:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796364160 00000100:00100000:1.0:1746147718.066673:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796364160 00000100:00100000:1.0:1746147718.066677:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796364672 00000100:00100000:1.0:1746147718.066678:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796364672 00000100:00100000:1.0:1746147718.066685:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15913 00000100:00100000:1.0:1746147718.066689:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3304:x1830967796364416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.066820:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3304:x1830967796364416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 129us (1985us total) trans 17179874245 rc 0/0 00000100:00100000:1.0:1746147718.066826:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15913 00000100:00100000:1.0:1746147718.066838:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15914 00000100:00100000:1.0:1746147718.066842:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aabb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3304:x1830967796363264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147718.066987:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aabb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3304:x1830967796363264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (2117us total) trans 21474841477 rc 0/0 00000100:00100000:1.0:1746147718.066992:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15914 00000100:00100000:1.0:1746147718.067003:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15915 00000100:00100000:1.0:1746147718.067008:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3304:x1830967796363776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147718.067093:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3304:x1830967796363776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (2178us total) trans 21474841478 rc 0/0 00000100:00100000:1.0:1746147718.067101:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15915 00000100:00100000:1.0:1746147718.067110:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15916 00000100:00100000:1.0:1746147718.067115:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3304:x1830967796364288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.067192:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3304:x1830967796364288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (2250us total) trans 17179874246 rc 0/0 00000100:00100000:1.0:1746147718.067197:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15916 00000100:00100000:1.0:1746147718.067206:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15917 00000100:00100000:1.0:1746147718.067210:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3304:x1830967796364800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.067286:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3304:x1830967796364800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (2325us total) trans 17179874247 rc 0/0 00000100:00100000:1.0:1746147718.067291:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15917 00000100:00100000:1.0:1746147718.067299:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15918 00000100:00100000:1.0:1746147718.067303:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3301:x1830967796363008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147718.067382:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3301:x1830967796363008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (2387us total) trans 21474841479 rc 0/0 00000100:00100000:1.0:1746147718.067386:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15918 00000100:00100000:1.0:1746147718.067394:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15919 00000100:00100000:1.0:1746147718.067398:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3301:x1830967796363520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147718.067465:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3301:x1830967796363520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (2449us total) trans 21474841480 rc 0/0 00000100:00100000:1.0:1746147718.067469:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15919 00000100:00100000:1.0:1746147718.067477:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15920 00000100:00100000:1.0:1746147718.067480:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3301:x1830967796364032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.067544:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3301:x1830967796364032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (1051us total) trans 17179874248 rc 0/0 00000100:00100000:1.0:1746147718.067548:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15920 00000100:00100000:1.0:1746147718.067555:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15921 00000100:00100000:1.0:1746147718.067559:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3301:x1830967796364544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.068413:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3301:x1830967796364544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 852us (1874us total) trans 17179874249 rc 0/0 00000100:00100000:1.0:1746147718.068418:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15921 00000100:00100000:1.0:1746147718.068428:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15923 00000100:00100000:1.0:1746147718.068432:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3301:x1830967796363648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147718.068519:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3301:x1830967796363648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1930us total) trans 21474841482 rc 0/0 00000100:00100000:1.0:1746147718.068524:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15923 00000100:00100000:1.0:1746147718.068533:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15924 00000100:00100000:1.0:1746147718.068537:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3301:x1830967796364160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.068615:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3301:x1830967796364160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (2010us total) trans 17179874250 rc 0/0 00000100:00100000:1.0:1746147718.068620:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15924 00000100:00100000:1.0:1746147718.068628:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15925 00000100:00100000:1.0:1746147718.068632:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3301:x1830967796364672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.069616:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3301:x1830967796364672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 982us (2993us total) trans 17179874251 rc 0/0 00000100:00100000:1.0:1746147718.069621:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15925 00000100:00100000:0.0:1746147718.069719:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3304:x1830967796363392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4373us (4948us total) trans 21474841476 rc 0/0 00000100:00100000:0.0:1746147718.069725:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15911 00000100:00100000:0.0:1746147718.069802:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.069932:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3304:x1830967796362880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4594us (5220us total) trans 21474841483 rc 0/0 00000100:00100000:0.0:1746147718.069940:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15910 00000004:00080000:1.0:1746147718.070479:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b6cbbb80/2, rc 0, transno 21474841477 00000100:00100000:1.0:1746147718.070484:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b6cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796363264:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147718.070863:0:14594:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 40 in progress, 4 in flight, 31 done 00000004:00080000:1.0:1746147718.071005:0:14594:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 32 done 00000100:00100000:1.0:1746147718.071035:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746147718.071044:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796364928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147718.071071:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147718.071103:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013582ca80/2, rc 0, transno 21474841478 00000100:00100000:1.0:1746147718.071107:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013582ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796363776:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147718.071115:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091119500/2, rc 0, transno 17179874246 00000100:00100000:1.0:1746147718.071117:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091119500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796364288:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147718.071124:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2139180/2, rc 0, transno 17179874247 00000100:00100000:1.0:1746147718.071126:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796364800:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147718.071132:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b6cba300/2, rc 0, transno 21474841483 00000100:00100000:1.0:1746147718.071135:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b6cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796362880:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147718.071141:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b6cb9880/2, rc 0, transno 21474841476 00000100:00100000:1.0:1746147718.071143:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b6cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796363392:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147718.071149:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013582c000/2, rc 0, transno 17179874244 00000100:00100000:1.0:1746147718.071151:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013582c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796363904:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147718.071157:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd1a300/2, rc 0, transno 17179874245 00000100:00100000:1.0:1746147718.071159:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796364416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147718.071306:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796364928 00000100:00100000:0.0:1746147718.071310:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796364928 00000100:00100000:0.0:1746147718.071332:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15926 00000100:00100000:0.0:1746147718.071337:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796364928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147718.071443:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3303:x1830967796364928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (372us total) trans 17179874252 rc 0/0 00000100:00100000:0.0:1746147718.071449:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15926 00000004:00080000:1.0:1746147718.071878:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2ab100/2, rc 0, transno 17179874252 00000100:00100000:1.0:1746147718.072096:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796364928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147718.077538:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793722368 00000100:00100000:0.0:1746147718.077547:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793722368 00000100:00100000:0.0:1746147718.077593:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11883 00000100:00100000:0.0:1746147718.077601:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+8:31933:x1830967793722368:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147718.077618:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147718.077635:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4800/0xe64d3fbf12a7c40b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafac54 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.077707:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7c412 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147718.077718:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7c412 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147718.077727:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7c412 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:0.0:1746147718.077750:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:0.0:1746147718.077754:0:14545:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147718.077767:0:14545:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7c412 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147718.077801:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4800/0xe64d3fbf12a7c40b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac54 expref: 10 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.077825:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7c412 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac54 expref: 9 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147718.077831:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147718.077833:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147718.077836:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d5200, rc 0) 00000100:00100000:0.0:1746147718.077901:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+9:31933:x1830967793722368:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 285us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.077906:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11883 00000100:00100000:1.0:1746147718.083222:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793722496 00000100:00100000:1.0:1746147718.083230:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793722496 00000100:00100000:1.0:1746147718.083742:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793722752 00000100:00100000:1.0:1746147718.083746:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793722752 00000100:00100000:1.0:1746147718.083778:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793723008 00000100:00100000:1.0:1746147718.083789:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793723008 00000100:00100000:1.0:1746147718.083801:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793722624 00000100:00100000:1.0:1746147718.083803:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793722624 00000100:00100000:1.0:1746147718.083811:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793722880 00000100:00100000:1.0:1746147718.083813:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793722880 00000100:00100000:0.0:1746147718.083862:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15927 00000100:00100000:0.0:1746147718.083871:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793722496:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147718.083901:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147718.083916:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e99e00/0xe64d3fbf12a7c419 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafac5b expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147718.083937:0:8184:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x68141985, atime: 0x68141984, ctime: 0x68141985, blocks: 0x79f 00010000:00010000:0.0:1746147718.083953:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147718.083954:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147718.083961:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e99e00/0xe64d3fbf12a7c419 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac5b expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147718.083974:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e99e00/0xe64d3fbf12a7c419 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac5b expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147718.084102:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e99e00, rc 0) 00000100:00100000:0.0:1746147718.084141:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793722496:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 272us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.084146:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15927 00000100:00100000:0.0:1746147718.084161:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15928 00000100:00100000:0.0:1746147718.084165:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793722752:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147718.084171:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147718.084181:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136574c00/0xe64d3fbf12a7c420 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafac69 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147718.084190:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15929 00002000:00010000:0.0:1746147718.084192:0:8184:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x68141987, atime: 0x68141986, ctime: 0x68141987, blocks: 0x821 00000100:00100000:1.0:1746147718.084197:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793723008:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147718.084199:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147718.084200:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147718.084204:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147718.084210:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136574c00/0xe64d3fbf12a7c420 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac69 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147718.084219:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136574c00/0xe64d3fbf12a7c420 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac69 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147718.084226:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136574c00, rc 0) 00000100:00100000:0.0:1746147718.084240:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793722752:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 75us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.084245:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15928 00000100:00100000:0.0:1746147718.084255:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15931 00000100:00100000:0.0:1746147718.084259:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793722880:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147718.084265:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147718.084271:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7c42e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafac70 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147718.084280:0:8184:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x68141986, atime: 0x68141986, ctime: 0x68141986, blocks: 0x81f 00010000:00010000:0.0:1746147718.084286:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147718.084287:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147718.084290:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7c42e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac70 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147718.084297:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7c42e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac70 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147718.084303:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c85800, rc 0) 00000100:00100000:0.0:1746147718.084318:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793722880:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 58us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.084324:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15931 00010000:00010000:1.0:1746147718.084446:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d71fa00/0xe64d3fbf12a7c43c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafac77 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147718.084457:0:10613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x458:0x0] initial LVB size: 5013696, mtime: 0x68141986, atime: 0x68141986, ctime: 0x68141986, blocks: 0x1691 00010000:00010000:1.0:1746147718.084463:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147718.084465:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147718.084469:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d71fa00/0xe64d3fbf12a7c43c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac77 expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147718.084477:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d71fa00/0xe64d3fbf12a7c43c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac77 expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147718.084483:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d71fa00, rc 0) 00000100:00100000:1.0:1746147718.084497:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793723008:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 302us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147718.084501:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15929 00000100:00100000:0.0:1746147718.698290:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.698331:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.698362:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.698375:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.698388:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.698427:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.698443:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.698455:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.698468:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.698496:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147718.698518:0:14542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793723264 00000100:00100000:0.0:1746147718.698525:0:14542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793723264 00000100:00100000:0.0:1746147718.698562:0:14542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 216 00000100:00100000:0.0:1746147718.698569:0:14542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febf1b7c-e040-48da-83a3-5da159ba5e63+15:1957:x1830967793723264:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1746147718.698616:0:14542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febf1b7c-e040-48da-83a3-5da159ba5e63+15:1957:x1830967793723264:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 47us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.698621:0:14542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 216 00000100:00100000:0.0:1746147718.698648:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793723648 00000100:00100000:0.0:1746147718.698650:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793723648 00000100:00100000:0.0:1746147718.698666:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793723904 00000100:00100000:0.0:1746147718.698668:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793723904 00000100:00100000:0.0:1746147718.698679:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793724416 00000100:00100000:0.0:1746147718.698680:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793724416 00000100:00100000:0.0:1746147718.698690:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793723520 00000100:00100000:0.0:1746147718.698691:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793723520 00000100:00100000:0.0:1746147718.698703:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793724032 00000100:00100000:0.0:1746147718.698704:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793724032 00000100:00100000:0.0:1746147718.698714:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793724288 00000100:00100000:0.0:1746147718.698715:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793724288 00000100:00100000:0.0:1746147718.698724:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 330 00000100:00100000:0.0:1746147718.698729:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967793723648:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1746147718.698750:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967793723648:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 21us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.698755:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 330 00000100:00100000:0.0:1746147718.698764:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 331 00000100:00100000:0.0:1746147718.698767:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967793723904:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1746147718.698817:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967793723904:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 49us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.698825:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 331 00000100:00100000:0.0:1746147718.698834:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 332 00000100:00100000:0.0:1746147718.698838:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967793724416:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1746147718.698854:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967793724416:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 16us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.698859:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 332 00000100:00100000:0.0:1746147718.698867:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 333 00000100:00100000:0.0:1746147718.698871:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1957:x1830967793723520:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1746147718.698907:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1957:x1830967793723520:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 35us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.698911:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 333 00000100:00100000:0.0:1746147718.698917:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 334 00000100:00100000:0.0:1746147718.698921:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1957:x1830967793724032:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1746147718.698937:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1957:x1830967793724032:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 16us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.698940:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 334 00000100:00100000:0.0:1746147718.698945:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 335 00000100:00100000:0.0:1746147718.698949:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967793724288:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1746147718.698962:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967793724288:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 13us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.698966:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 335 00000100:00100000:0.0:1746147718.699002:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793723392 00000100:00100000:0.0:1746147718.699005:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793723392 00000100:00100000:0.0:1746147718.699023:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793724160 00000100:00100000:0.0:1746147718.699025:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793724160 00000100:00100000:0.0:1746147718.699033:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793723776 00000100:00100000:0.0:1746147718.699034:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793723776 00000100:00100000:0.0:1746147718.699045:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 197 00000100:00100000:0.0:1746147718.699049:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:1957:x1830967793723392:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1746147718.699081:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:1957:x1830967793723392:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 32us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.699086:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 197 00000100:00100000:0.0:1746147718.699094:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 198 00000100:00100000:0.0:1746147718.699098:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967793724160:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1746147718.699111:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967793724160:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 13us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.699115:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 198 00000100:00100000:0.0:1746147718.699120:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 199 00000100:00100000:0.0:1746147718.699123:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+6:1957:x1830967793723776:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1746147718.699135:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+6:1957:x1830967793723776:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 11us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147718.699139:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 199 00010000:00010000:0.0:1746147718.767101:0:7099:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147719.107132:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.110234:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793725056 00000100:00100000:1.0:1746147719.110241:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793725056 00000100:00100000:1.0:1746147719.110284:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7058 00000100:00100000:1.0:1746147719.110291:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793725056:12345-192.168.202.10@tcp:3:mirror_io.0 00010000:00010000:1.0:1746147719.110317:0:31360:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a00f6600/0xe64d3fbf12a7c44a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.110328:0:31360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.110330:0:31360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.110334:0:31360:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00f6600/0xe64d3fbf12a7c44a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.110344:0:31360:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00f6600/0xe64d3fbf12a7c44a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147719.111287:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.111303:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793725312 00000100:00100000:1.0:1746147719.111307:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793725312 00000100:00100000:1.0:1746147719.111329:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7060 00000100:00100000:1.0:1746147719.111333:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793725312:12345-192.168.202.10@tcp:3:mirror_io.0 00010000:00010000:1.0:1746147719.111350:0:31357:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7c458 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.111358:0:31357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.111359:0:31357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.111362:0:31357:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7c458 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.111371:0:31357:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7c458 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147719.124040:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.125345:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.125429:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793725696 00000100:00100000:1.0:1746147719.125437:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793725696 00000100:00100000:1.0:1746147719.125490:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793725952 00000100:00100000:1.0:1746147719.125492:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793725952 00000100:00100000:1.0:1746147719.125519:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7061 00000100:00100000:1.0:1746147719.125526:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967793725696:12345-192.168.202.10@tcp:3:mirror_io.0 00010000:00010000:1.0:1746147719.125557:0:31359:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7c45f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.125568:0:31359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.125570:0:31359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.125574:0:31359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7c45f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.125585:0:31359:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7c45f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147719.129690:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.129744:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.133124:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7064 00000100:00100000:1.0:1746147719.133134:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41587371-240a-4781-aecb-638f17200fbd+15:1959:x1830967793726464:12345-192.168.202.10@tcp:3:mirror_io.0 00010000:00010000:1.0:1746147719.133160:0:31356:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5643000/0xe64d3fbf12a7c474 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.133169:0:31356:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.133171:0:31356:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.133175:0:31356:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5643000/0xe64d3fbf12a7c474 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.133189:0:31356:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5643000/0xe64d3fbf12a7c474 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.152312:0:31357:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7c458 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.152325:0:31357:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7c458 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.152332:0:31357:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7c458 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.152338:0:31357:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5287e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147719.152341:0:31357:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7c458 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.152346:0:31357:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7c458 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.152362:0:31357:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7c458 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.152368:0:31357:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7c458 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147719.154456:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41587371-240a-4781-aecb-638f17200fbd+13:1959:x1830967793725312:12345-192.168.202.10@tcp:3:mirror_io.0 Request processed in 43111us (43160us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147719.154468:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7060 00010000:00010000:1.0:1746147719.156716:0:31360:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a00f6600/0xe64d3fbf12a7c44a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.156734:0:31360:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00f6600/0xe64d3fbf12a7c44a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.156741:0:31360:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a00f6600/0xe64d3fbf12a7c44a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.156747:0:31360:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00f6600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147719.156751:0:31360:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a00f6600/0xe64d3fbf12a7c44a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.156758:0:31360:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a00f6600/0xe64d3fbf12a7c44a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.156784:0:31360:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a00f6600/0xe64d3fbf12a7c44a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.156790:0:31360:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00f6600/0xe64d3fbf12a7c44a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147719.156861:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967793725056:12345-192.168.202.10@tcp:3:mirror_io.0 Request processed in 46568us (46698us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147719.156873:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7058 00010000:00010000:1.0:1746147719.163286:0:31359:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7c45f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.163301:0:31359:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7c45f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.163309:0:31359:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7c45f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.163320:0:31359:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5642a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147719.163324:0:31359:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7c45f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.163330:0:31359:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7c45f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.163346:0:31359:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7c45f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.163352:0:31359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7c45f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147719.163408:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793725696:12345-192.168.202.10@tcp:3:mirror_io.0 Request processed in 37878us (39372us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147719.163417:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7061 00000100:00100000:0.0:1746147719.184291:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.184418:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793726592 00000100:00100000:1.0:1746147719.184427:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793726592 00000100:00100000:1.0:1746147719.184583:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 892 00000100:00100000:1.0:1746147719.184591:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+9:31933:x1830967793726592:12345-192.168.202.10@tcp:103:mirror_io.0 00010000:00010000:1.0:1746147719.184605:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147719.184628:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7c3be lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac3f expref: 9 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.184657:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147719.184661:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147719.184710:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:31933:x1830967793726592:12345-192.168.202.10@tcp:103:mirror_io.0 Request processed in 120us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147719.184717:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 892 00000100:00100000:0.0:1746147719.190812:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.194378:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.221163:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.221218:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.226740:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.232169:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.232185:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.232724:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.235050:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15940 00000100:00100000:1.0:1746147719.235055:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967793729280:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147719.235065:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147719.235072:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5642800/0xe64d3fbf12a7c4f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafacd2 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.235084:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.235086:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.235090:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5642800/0xe64d3fbf12a7c4f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacd2 expref: 20 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147719.235100:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5642800/0xe64d3fbf12a7c4f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacd2 expref: 20 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147719.235107:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5642800, rc 0) 00000100:00100000:1.0:1746147719.235125:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967793729280:12345-192.168.202.10@tcp:101:cat.0 Request processed in 70us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147719.235130:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15940 00000100:00100000:0.0:1746147719.235283:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.235300:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793730304 00000100:00100000:0.0:1746147719.235303:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793730304 00000100:00100000:0.0:1746147719.235323:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11887 00000100:00100000:0.0:1746147719.235327:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:31942:x1830967793730304:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147719.235338:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147719.235348:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287a00/0xe64d3fbf12a7c500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafacee expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.235426:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287200/0xe64d3fbf12a7c507 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235435:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287200/0xe64d3fbf12a7c507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235443:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287200/0xe64d3fbf12a7c507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235452:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7c515 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235457:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7c515 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235462:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7c515 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235541:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7c00/0xe64d3fbf12a7c51c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235549:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7c00/0xe64d3fbf12a7c51c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235555:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7c00/0xe64d3fbf12a7c51c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:0.0:1746147719.235562:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147719.235683:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287200/0xe64d3fbf12a7c507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235689:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287200/0xe64d3fbf12a7c507 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235694:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287200/0xe64d3fbf12a7c507 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235698:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5287200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147719.235701:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287200/0xe64d3fbf12a7c507 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235706:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287200/0xe64d3fbf12a7c507 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235715:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147719.235717:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147719.235720:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287200/0xe64d3fbf12a7c507 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235725:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287200/0xe64d3fbf12a7c507 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235754:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7c515 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235759:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7c515 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235763:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7c515 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235767:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcc7a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147719.235778:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7c515 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235783:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7c515 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235789:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a024b200) 00010000:00010000:0.0:1746147719.235790:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147719.235792:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7c515 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235797:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7a00/0xe64d3fbf12a7c515 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.235824:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287a00/0xe64d3fbf12a7c500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacee expref: 328 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.235832:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7c00/0xe64d3fbf12a7c51c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacee expref: 327 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.235837:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147719.235840:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147719.235842:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcc7c00, rc 0) 00000100:00100000:0.0:1746147719.235858:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:31942:x1830967793730304:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 530us (575us total) trans 8589945875 rc 0/0 00000100:00100000:0.0:1746147719.235863:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11887 00000100:00100000:0.0:1746147719.242106:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15944 00000100:00100000:0.0:1746147719.242113:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967793729664:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147719.242118:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147719.242124:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc24600/0xe64d3fbf12a7c53f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aaface7 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.242138:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147719.242139:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147719.242146:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc24600/0xe64d3fbf12a7c53f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaface7 expref: 23 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147719.242158:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cc24600/0xe64d3fbf12a7c53f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaface7 expref: 23 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147719.242166:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc24600, rc 0) 00000100:00100000:0.0:1746147719.242200:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967793729664:12345-192.168.202.10@tcp:101:cat.0 Request processed in 88us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147719.242208:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15944 00000100:00100000:0.0:1746147719.245128:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.245149:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.245161:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.245176:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.245196:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793730432 00000100:00100000:0.0:1746147719.245199:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793730432 00000100:00100000:0.0:1746147719.245229:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11888 00000100:00100000:0.0:1746147719.245234:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:31945:x1830967793730432:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147719.245246:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147719.245264:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7c546 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafacf5 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.245309:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7c546 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacf5 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.245318:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7c546 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacf5 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147719.245375:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8068 00000100:00100000:1.0:1746147719.245381:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1957:x1830967793729920:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147719.245388:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147719.245392:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a913f200/0xe64d3fbf12a7c4ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac85 expref: 12 pid: 14546 timeout: 898 lvb_type: 0 00010000:00010000:0.0:1746147719.245484:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147719.245487:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147719.245490:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd6c400, rc 0) 00000100:00100000:0.0:1746147719.245523:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:31945:x1830967793730432:12345-192.168.202.10@tcp:101:cat.0 Request processed in 289us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147719.245529:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11888 00000100:00100000:0.0:1746147719.245583:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.245596:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793730688 00000100:00100000:0.0:1746147719.245599:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793730688 00000100:00100000:0.0:1746147719.245613:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11889 00000100:00100000:0.0:1746147719.245617:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:31942:x1830967793730688:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147719.245624:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147719.245625:0:14546:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147719.245634:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcc7c00/0xe64d3fbf12a7c51c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacee expref: 326 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.245661:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a913f200/0xe64d3fbf12a7c4ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac85 expref: 11 pid: 14546 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746147719.245671:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a913f200/0xe64d3fbf12a7c4ac lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac85 expref: 11 pid: 14546 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746147719.245682:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147719.245685:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc25800/0xe64d3fbf12a7c4c8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147719.245690:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc25800/0xe64d3fbf12a7c4c8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147719.245695:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc25800/0xe64d3fbf12a7c4c8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147719.245711:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147719.245730:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1957:x1830967793729920:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 349us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147719.245735:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8068 00010000:00010000:0.0:1746147719.245857:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147719.245860:0:14546:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147719.245867:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6d200/0xe64d3fbf12a7c54d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafacfc expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.246005:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6dc00/0xe64d3fbf12a7c554 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.246013:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091560400/0xe64d3fbf12a7c404 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac4d expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.246018:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7c546 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacf5 expref: 9 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.246023:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6dc00/0xe64d3fbf12a7c554 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.246041:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7c546 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacf5 expref: 9 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.246048:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7c546 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacf5 expref: 9 pid: 14546 timeout: 898 lvb_type: 0 00000100:00100000:0.0:1746147719.246057:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796365440:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147719.246570:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091560400/0xe64d3fbf12a7c404 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac4d expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.246577:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091560400/0xe64d3fbf12a7c404 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac4d expref: 8 pid: 14546 timeout: 898 lvb_type: 0 00000100:00100000:0.0:1746147719.246584:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796365568:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147719.246603:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147719.249529:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793730816 00000100:00100000:0.0:1746147719.249534:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793730816 00000100:00100000:0.0:1746147719.249608:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11890 00000100:00100000:0.0:1746147719.249613:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:31946:x1830967793730816:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147719.249623:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147719.249633:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed2800/0xe64d3fbf12a7c562 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafad03 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.249668:0:14545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6dc00/0xe64d3fbf12a7c554 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.249673:0:14545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed2800/0xe64d3fbf12a7c562 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad03 expref: 328 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.249683:0:14545:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6dc00/0xe64d3fbf12a7c554 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.249693:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed2800/0xe64d3fbf12a7c562 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad03 expref: 328 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.249700:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147719.249701:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147719.249702:0:14545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6dc00/0xe64d3fbf12a7c554 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.249706:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed2800, rc 0) 00000100:00100000:0.0:1746147719.249990:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:31946:x1830967793730816:12345-192.168.202.10@tcp:101:cat.0 Request processed in 376us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147719.249994:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11890 00000100:00100000:0.0:1746147719.253962:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.254042:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.254128:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793730944 00000100:00100000:1.0:1746147719.254135:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793730944 00010000:00010000:1.0:1746147719.254170:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7c546 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacf5 expref: 10 pid: 14546 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746147719.254198:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793731072 00000100:00100000:1.0:1746147719.254201:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793731072 00000100:00100000:0.0:1746147719.254209:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8070 00010000:00010000:1.0:1746147719.254214:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091560400/0xe64d3fbf12a7c404 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac4d expref: 9 pid: 14546 timeout: 898 lvb_type: 0 00000100:00100000:0.0:1746147719.254216:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967793730944:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147719.254228:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147719.254234:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7c546 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacf5 expref: 10 pid: 14546 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746147719.254243:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8071 00010000:00010000:0.0:1746147719.254243:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7c546 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacf5 expref: 10 pid: 14546 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746147719.254249:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793731072:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147719.254260:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147719.254261:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147719.254264:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091560400/0xe64d3fbf12a7c404 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac4d expref: 9 pid: 14546 timeout: 898 lvb_type: 0 00010000:00010000:0.0:1746147719.254265:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6dc00/0xe64d3fbf12a7c554 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.254271:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6dc00/0xe64d3fbf12a7c554 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147719.254276:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147719.254279:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091560400/0xe64d3fbf12a7c404 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac4d expref: 9 pid: 14546 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746147719.254290:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147719.254292:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6dc00/0xe64d3fbf12a7c554 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147719.254299:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6dc00/0xe64d3fbf12a7c554 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147719.254304:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6dc00/0xe64d3fbf12a7c554 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147719.254310:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed2800/0xe64d3fbf12a7c562 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad03 expref: 327 pid: 14545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147719.254310:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967793730944:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 95us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147719.254316:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8070 00010000:00010000:1.0:1746147719.254329:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147719.254352:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793731072:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 102us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147719.254358:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8071 00000100:00100000:1.0:1746147719.268809:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7065 00000100:00100000:1.0:1746147719.268818:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967793731328:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147719.268944:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7066 00000100:00100000:0.0:1746147719.268952:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967793731584:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147719.269546:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.269558:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793732096 00000100:00100000:0.0:1746147719.269561:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793732096 00002000:00100000:0.0:1746147719.269574:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009505ed80 x1830967793732096/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:340/0 lens 488/0 e 0 to 0 dl 1746147730 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147719.270326:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505ed80 with x1830967793732096 ext(1048576->2097151) 00002000:00010000:0.0:1746147719.270330:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009505ed80 00000100:00100000:0.0:1746147719.291614:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967793731584:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22656us (23504us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147719.291625:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7066 00002000:00100000:0.0:1746147719.291635:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800951d7800 x1830967793731584/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:340/0 lens 488/440 e 0 to 0 dl 1746147730 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147719.291643:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d7800 with x1830967793731584 ext(1048576->2097151) 00002000:00010000:0.0:1746147719.291648:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d7800 00000001:00080000:1.0:1746147719.301646:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945875 is committed 00000001:00080000:1.0:1746147719.301658:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945877 is committed 00000004:00080000:1.0:1746147719.301661:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2671 committed 00000004:00080000:1.0:1746147719.301667:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2653 committed 00000004:00080000:1.0:1746147719.301670:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2652 committed 00000004:00080000:1.0:1746147719.301672:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2651 committed 00000004:00080000:1.0:1746147719.301673:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2650 committed 00000004:00080000:1.0:1746147719.301674:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2670 committed 00000004:00080000:1.0:1746147719.301676:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2649 committed 00000004:00080000:1.0:1746147719.301677:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2669 committed 00000004:00080000:1.0:1746147719.301679:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2648 committed 00000004:00080000:1.0:1746147719.301680:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2668 committed 00000004:00080000:1.0:1746147719.301681:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2667 committed 00000004:00080000:1.0:1746147719.301683:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2666 committed 00000004:00080000:1.0:1746147719.301684:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2647 committed 00000004:00080000:1.0:1746147719.301686:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2646 committed 00000004:00080000:1.0:1746147719.301688:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2665 committed 00000004:00080000:1.0:1746147719.301689:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2664 committed 00000004:00080000:1.0:1746147719.301690:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2645 committed 00000001:00080000:1.0:1746147719.301697:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945872 is committed 00000001:00080000:1.0:1746147719.301701:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945871 is committed 00000001:00080000:1.0:1746147719.301706:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945876 is committed 00000100:00100000:0.0:1746147719.301756:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746147719.301780:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796365824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147719.301818:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147719.301835:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796365952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147719.301851:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147719.301852:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796365696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147719.301862:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796366464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147719.301865:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147719.301873:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147719.301877:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796366336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147719.301899:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796366976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147719.301904:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147719.301913:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147719.301926:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796366080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147719.301926:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796366848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147719.301943:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147719.302325:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147719.302331:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796367360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147719.302337:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796366592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147719.302347:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147719.302356:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1746147719.302358:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796366080 00000100:00100000:0.0:1746147719.302360:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796366208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147719.302361:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796366080 00000100:00100000:1.0:1746147719.302372:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796367360 00000100:00100000:1.0:1746147719.302373:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796367360 00000100:00100000:0.0:1746147719.302373:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147719.302379:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796366208 00000100:00100000:0.0:1746147719.302380:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796366720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147719.302381:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796366208 00000100:00100000:1.0:1746147719.302388:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15946 00000100:00100000:0.0:1746147719.302390:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147719.302392:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3303:x1830967796365952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147719.302396:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796367232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147719.302406:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746147719.302464:0:7050:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:1.0:1746147719.302467:0:7050:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147718 -> 1746147718 00002000:00010000:1.0:1746147719.302469:0:7050:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147718 -> 1746147718 00002000:00010000:1.0:1746147719.302470:0:7050:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147718 -> 1746147718 00002000:00010000:1.0:1746147719.302472:0:7050:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:1.0:1746147719.302491:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3303:x1830967796365952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (638us total) trans 17179874254 rc 0/0 00000100:00100000:1.0:1746147719.302496:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15946 00000100:00100000:1.0:1746147719.302507:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796366720 00000100:00100000:1.0:1746147719.302509:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796366720 00000100:00100000:1.0:1746147719.302517:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796367232 00000100:00100000:1.0:1746147719.302518:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796367232 00000100:00100000:1.0:1746147719.302524:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15947 00000100:00100000:1.0:1746147719.302528:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3302:x1830967796365696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147719.302585:0:7050:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147719.302587:0:7050:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147717 -> 1746147717 00002000:00010000:1.0:1746147719.302589:0:7050:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147716 -> 1746147716 00002000:00010000:1.0:1746147719.302590:0:7050:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147717 -> 1746147717 00002000:00010000:1.0:1746147719.302592:0:7050:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:1.0:1746147719.302610:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3302:x1830967796365696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (743us total) trans 17179874255 rc 0/0 00000100:00100000:1.0:1746147719.302614:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15947 00000100:00100000:1.0:1746147719.302621:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15948 00000100:00100000:1.0:1746147719.302624:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3303:x1830967796366464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147719.302947:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967793731328:12345-192.168.202.10@tcp:3:cat.0 Request processed in 34131us (34877us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147719.302954:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7065 00002000:00100000:0.0:1746147719.302960:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800951d7480 x1830967793731328/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:340/0 lens 488/440 e 0 to 0 dl 1746147730 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147719.302968:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d7480 with x1830967793731328 ext(0->1048575) 00002000:00010000:0.0:1746147719.302971:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800951d7480 00000100:00100000:0.0:1746147719.302989:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15955 00000100:00100000:0.0:1746147719.302993:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3302:x1830967796366720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147719.303055:0:8468:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147719.303057:0:8468:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147718 -> 1746147718 00002000:00010000:0.0:1746147719.303059:0:8468:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147718 -> 1746147718 00002000:00010000:0.0:1746147719.303061:0:8468:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147718 -> 1746147718 00002000:00010000:0.0:1746147719.303063:0:8468:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147719.303079:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3302:x1830967796366720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (688us total) trans 21474841487 rc 0/0 00000100:00100000:0.0:1746147719.303084:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15955 00000004:00080000:0.0:1746147719.303114:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0434a80/2, rc 0, transno 17179874259 00000100:00100000:0.0:1746147719.303123:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796366208:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147719.303131:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800951d5500/2, rc 0, transno 21474841487 00000100:00100000:0.0:1746147719.303133:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796366720:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147719.303138:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e384000/2, rc 0, transno 21474841486 00000100:00100000:0.0:1746147719.303141:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796367360:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147719.303147:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0437800/2, rc 0, transno 17179874257 00000100:00100000:0.0:1746147719.303149:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796366336:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147719.303155:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800951d4380/2, rc 0, transno 21474841485 00000100:00100000:0.0:1746147719.303157:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796366848:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147719.303163:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2a8700/2, rc 0, transno 17179874253 00000100:00100000:0.0:1746147719.303165:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796365824:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147719.303170:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2abb80/2, rc 0, transno 17179874255 00000100:00100000:0.0:1746147719.303172:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796365696:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147719.303184:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e385880/2, rc 0, transno 21474841488 00000100:00100000:0.0:1746147719.303187:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796367232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147719.303210:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746147719.303212:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3303:x1830967796366464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 587us (1338us total) trans 17179874256 rc 0/0 00000100:00100000:0.0:1746147719.303214:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013582d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796367872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147719.303217:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15948 00000100:00100000:0.0:1746147719.303230:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147719.303311:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796367872 00000100:00100000:1.0:1746147719.303314:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796367872 00000100:00100000:1.0:1746147719.303326:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15957 00000100:00100000:1.0:1746147719.303330:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013582d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3302:x1830967796367872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147719.303419:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013582d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3302:x1830967796367872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (187us total) trans 17179874260 rc 0/0 00000100:00100000:1.0:1746147719.303424:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15957 00000004:00080000:1.0:1746147719.303446:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800951d5180/2, rc 0, transno 21474841484 00000100:00100000:1.0:1746147719.303450:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796366976:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147719.303457:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2a8380/2, rc 0, transno 17179874254 00000100:00100000:1.0:1746147719.303459:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796365952:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147719.303465:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0435880/2, rc 0, transno 17179874256 00000100:00100000:1.0:1746147719.303467:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796366464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147719.303474:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796367488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147719.303492:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147719.303492:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013582d500/2, rc 0, transno 17179874260 00000100:00100000:0.0:1746147719.303495:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013582d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796367872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147719.303508:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796367488 00000100:00100000:1.0:1746147719.303510:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796367488 00000100:00100000:1.0:1746147719.303522:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15958 00000100:00100000:1.0:1746147719.303526:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3303:x1830967796367488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147719.303597:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3303:x1830967796367488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (104us total) trans 21474841489 rc 0/0 00000100:00100000:1.0:1746147719.303601:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15958 00000100:00100000:1.0:1746147719.303682:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147719.303694:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796367104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147719.303708:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147719.303716:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796367616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147719.303726:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147719.303751:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2a8000/2, rc 0, transno 17179874258 00000100:00100000:1.0:1746147719.303753:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796366080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147719.303762:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796366592 00000100:00100000:1.0:1746147719.303764:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796366592 00000100:00100000:1.0:1746147719.303784:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796367104 00000100:00100000:1.0:1746147719.303786:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796367104 00000100:00100000:1.0:1746147719.303792:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796367616 00000100:00100000:1.0:1746147719.303794:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796367616 00000100:00100000:1.0:1746147719.303801:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15959 00000100:00100000:1.0:1746147719.303804:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3304:x1830967796366592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147719.303839:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15961 00000100:00100000:0.0:1746147719.303844:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3304:x1830967796367616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147719.303875:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3304:x1830967796366592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (193us total) trans 17179874261 rc 0/0 00000100:00100000:1.0:1746147719.303880:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15959 00000004:00080000:1.0:1746147719.303915:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0435f80/2, rc 0, transno 17179874261 00000100:00100000:1.0:1746147719.303918:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796366592:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147719.303947:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd18380/2, rc 0, transno 21474841490 00000100:00100000:0.0:1746147719.303947:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3304:x1830967796367616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (220us total) trans 21474841490 rc 0/0 00000100:00100000:1.0:1746147719.303949:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796367616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147719.303954:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15961 00000004:00080000:1.0:1746147719.303956:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800951d4e00/2, rc 0, transno 21474841491 00000100:00100000:1.0:1746147719.303958:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796367104:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147719.303970:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e387800/2, rc 0, transno 21474841489 00000100:00100000:0.0:1746147719.303974:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796367488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147719.306019:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.311303:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.314425:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.320371:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.326695:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.326738:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.326757:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793732736 00000100:00100000:0.0:1746147719.326762:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793732736 00010000:00010000:0.0:1746147719.326814:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0356400/0xe64d3fbf12a7c4f2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacbd expref: 14 pid: 8184 timeout: 898 lvb_type: 1 00000100:00100000:0.0:1746147719.326846:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793732864 00000100:00100000:0.0:1746147719.326848:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793732864 00010000:00010000:0.0:1746147719.326856:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc24600/0xe64d3fbf12a7c53f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaface7 expref: 24 pid: 8468 timeout: 898 lvb_type: 1 00000100:00100000:0.0:1746147719.326871:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8072 00000100:00100000:0.0:1746147719.326876:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967793732736:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147719.327087:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147719.327109:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0356400/0xe64d3fbf12a7c4f2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacbd expref: 14 pid: 8184 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746147719.327118:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0356400/0xe64d3fbf12a7c4f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacbd expref: 14 pid: 8184 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746147719.327624:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0356400/0xe64d3fbf12a7c4f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacbd expref: 14 pid: 8184 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746147719.327642:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147719.327646:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.327657:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967793732736:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 781us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147719.327662:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8072 00000100:00100000:0.0:1746147719.327671:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793732992 00000100:00100000:0.0:1746147719.327674:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793732992 00010000:00010000:0.0:1746147719.327683:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7a6e00/0xe64d3fbf12a7c435 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac7e expref: 9 pid: 22183 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746147719.327691:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.327696:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8074 00000100:00100000:0.0:1746147719.327700:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a22d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967793732992:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147719.327706:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147719.327712:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b7a6e00/0xe64d3fbf12a7c435 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac7e expref: 9 pid: 22183 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746147719.327716:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147719.327720:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b7a6e00/0xe64d3fbf12a7c435 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac7e expref: 9 pid: 22183 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746147719.327730:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b7a6e00/0xe64d3fbf12a7c435 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac7e expref: 9 pid: 22183 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746147719.327738:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147719.327740:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147719.327763:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.327788:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.327835:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.327853:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793733248 00000100:00100000:1.0:1746147719.327856:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793733248 00002000:00100000:1.0:1746147719.327878:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009433b480 x1830967793733248/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:340/0 lens 488/0 e 0 to 0 dl 1746147730 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.327906:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433b480 with x1830967793733248 ext(1048576->2097151) 00002000:00010000:1.0:1746147719.327909:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009433b480 00000100:00100000:1.0:1746147719.327920:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793733504 00000100:00100000:1.0:1746147719.327923:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793733504 00002000:00100000:1.0:1746147719.327937:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c2a8a80 x1830967793733504/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 488/0 e 0 to 0 dl 1746147730 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.327944:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a8a80 with x1830967793733504 ext(0->1048575) 00002000:00010000:1.0:1746147719.327947:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c2a8a80 00000100:00100000:1.0:1746147719.327957:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793733888 00000100:00100000:1.0:1746147719.327958:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793733888 00002000:00100000:1.0:1746147719.327968:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009c2a9180 x1830967793733888/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 488/0 e 0 to 0 dl 1746147730 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.327974:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a9180 with x1830967793733888 ext(1048576->2097151) 00002000:00010000:1.0:1746147719.327977:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a9180 00000100:00100000:1.0:1746147719.327987:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7069 00000100:00100000:1.0:1746147719.327993:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967793733248:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:0.0:1746147719.328050:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0265400/0xe64d3fbf12a7c570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2117632->2158591) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad11 expref: 23 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.328058:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0265400/0xe64d3fbf12a7c570 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2117632->2158591) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad11 expref: 23 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.328082:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0265400/0xe64d3fbf12a7c570 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2117632->2158591) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad11 expref: 23 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147719.328091:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796368384:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147719.328140:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147719.328154:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7071 00000100:00100000:0.0:1746147719.328160:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967793733760:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147719.328361:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7072 00000100:00100000:1.0:1746147719.328368:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967793733888:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147719.332793:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796368384:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147719.332814:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147719.332841:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a22d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967793732992:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5138us (5194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147719.332851:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8074 00000100:00100000:0.0:1746147719.335932:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.338195:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967793733888:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9824us (10402us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147719.338202:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7072 00002000:00100000:1.0:1746147719.338208:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009c2a9180 x1830967793733888/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 488/440 e 0 to 0 dl 1746147730 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.338216:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a9180 with x1830967793733888 ext(1048576->2097151) 00002000:00010000:1.0:1746147719.338219:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a9180 00000100:00100000:0.0:1746147719.358362:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967793733760:12345-192.168.202.10@tcp:3:cat.0 Request processed in 30194us (30590us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147719.358372:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7071 00002000:00100000:0.0:1746147719.358381:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009c2a8e00 x1830967793733760/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 488/440 e 0 to 0 dl 1746147730 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147719.358394:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a8e00 with x1830967793733760 ext(1048576->2097151) 00002000:00010000:0.0:1746147719.358399:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a8e00 00000100:00100000:0.0:1746147719.359354:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.365505:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.365550:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.365638:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793735296 00000100:00100000:1.0:1746147719.365646:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793735296 00002000:00100000:1.0:1746147719.365678:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800956b7800 x1830967793735296/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:340/0 lens 488/0 e 0 to 0 dl 1746147730 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.365685:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b7800 with x1830967793735296 ext(1048576->2097151) 00002000:00010000:1.0:1746147719.365690:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800956b7800 00000100:00100000:0.0:1746147719.367476:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.367531:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7076 00000100:00100000:1.0:1746147719.367539:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967793735296:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147719.378831:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.378858:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.378871:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.378906:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.378931:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.378951:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793735808 00000100:00100000:0.0:1746147719.378957:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793735808 00000100:00100000:1.0:1746147719.378959:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793735680 00000100:00100000:1.0:1746147719.378963:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793735680 00010000:00010000:0.0:1746147719.378988:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a913f000/0xe64d3fbf12a7c4d6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaca1 expref: 17 pid: 8470 timeout: 898 lvb_type: 1 00002000:00100000:1.0:1746147719.378992:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800956b5c00 x1830967793735680/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 488/0 e 0 to 0 dl 1746147730 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.378999:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b5c00 with x1830967793735680 ext(2097152->3145727) 00002000:00010000:1.0:1746147719.379004:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b5c00 00000100:00100000:1.0:1746147719.379013:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793736064 00000100:00100000:0.0:1746147719.379013:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8075 00000100:00100000:1.0:1746147719.379015:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793736064 00000100:00100000:0.0:1746147719.379019:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967793735808:12345-192.168.202.10@tcp:103:ldlm_bl.0 00002000:00100000:1.0:1746147719.379023:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800956b6a00 x1830967793736064/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 488/0 e 0 to 0 dl 1746147730 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.379029:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b6a00 with x1830967793736064 ext(3145728->4194303) 00002000:00010000:1.0:1746147719.379031:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b6a00 00010000:00010000:0.0:1746147719.379031:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147719.379038:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793736320 00000100:00100000:1.0:1746147719.379041:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793736320 00002000:00100000:1.0:1746147719.379048:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3186687) req@ffff8800956b5180 x1830967793736320/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 504/0 e 0 to 0 dl 1746147730 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746147719.379051:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a913f000/0xe64d3fbf12a7c4d6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaca1 expref: 17 pid: 8470 timeout: 898 lvb_type: 1 00002000:00100000:1.0:1746147719.379054:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b5180 with x1830967793736320 ext(2097152->3186687) 00002000:00010000:1.0:1746147719.379057:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800956b5180 00010000:00010000:0.0:1746147719.379061:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a913f000/0xe64d3fbf12a7c4d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaca1 expref: 17 pid: 8470 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746147719.379063:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793736576 00000100:00100000:1.0:1746147719.379065:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793736576 00002000:00100000:1.0:1746147719.379071:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3186688->4194303) req@ffff8800956b4380 x1830967793736576/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 488/0 e 0 to 0 dl 1746147730 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.379076:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b4380 with x1830967793736576 ext(3186688->4194303) 00002000:00010000:1.0:1746147719.379078:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800956b4380 00010000:00010000:0.0:1746147719.379080:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147719.379085:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7077 00000100:00100000:1.0:1746147719.379089:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967793735680:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147719.379114:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967793735808:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 95us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147719.379118:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8075 00000100:00100000:0.0:1746147719.379140:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7078 00000100:00100000:0.0:1746147719.379145:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967793736064:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147719.392226:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796368896:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147719.392242:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147719.392273:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967793736704:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 9221us (9278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147719.392281:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8077 00000100:00100000:1.0:1746147719.396662:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967793735680:12345-192.168.202.10@tcp:3:cat.0 Request processed in 17563us (17830us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147719.396672:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7077 00002000:00100000:1.0:1746147719.396682:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800956b5c00 x1830967793735680/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 488/440 e 0 to 0 dl 1746147730 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.396689:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b5c00 with x1830967793735680 ext(2097152->3145727) 00002000:00010000:1.0:1746147719.396762:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b5c00 00000100:00100000:0.0:1746147719.409256:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.427185:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.432349:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.433493:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1957:x1830967793737344:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 23347us (24239us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147719.433504:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7082 00002000:00100000:1.0:1746147719.433513:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800956b6300 x1830967793737344/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:340/0 lens 488/440 e 0 to 0 dl 1746147730 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.433521:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b6300 with x1830967793737344 ext(1048576->2097151) 00002000:00010000:1.0:1746147719.433526:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b6300 00000100:00100000:0.0:1746147719.438680:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.438818:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.439425:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.439680:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8078 00000100:00100000:1.0:1746147719.439688:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967793737728:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147719.439703:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147719.439715:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a913e600/0xe64d3fbf12a7c4dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaca8 expref: 14 pid: 8470 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746147719.439724:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a913e600/0xe64d3fbf12a7c4dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaca8 expref: 14 pid: 8470 timeout: 898 lvb_type: 1 00000100:00100000:0.0:1746147719.439739:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8080 00000100:00100000:0.0:1746147719.439745:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793737856:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147719.439781:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a913e600/0xe64d3fbf12a7c4dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaca8 expref: 14 pid: 8470 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746147719.439784:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147719.439794:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136574c00/0xe64d3fbf12a7c420 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac69 expref: 7 pid: 8184 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746147719.439799:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147719.439801:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136574c00/0xe64d3fbf12a7c420 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac69 expref: 7 pid: 8184 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746147719.439812:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136574c00/0xe64d3fbf12a7c420 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac69 expref: 7 pid: 8184 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746147719.439824:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147719.439840:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967793737856:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 96us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147719.439844:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8080 00000100:00100000:1.0:1746147719.439999:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967793737728:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 313us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147719.440005:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8078 00000100:00100000:0.0:1746147719.445552:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.447199:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.450587:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.450672:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793738752 00000100:00100000:1.0:1746147719.450679:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793738752 00002000:00100000:1.0:1746147719.450720:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009b108380 x1830967793738752/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 488/0 e 0 to 0 dl 1746147730 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.450729:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b108380 with x1830967793738752 ext(4194304->5017599) 00002000:00010000:1.0:1746147719.450733:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b108380 00000100:00100000:1.0:1746147719.450766:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7083 00000100:00100000:1.0:1746147719.450782:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967793738752:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147719.460636:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.461099:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967793738752:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10315us (10517us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147719.461106:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7083 00002000:00100000:1.0:1746147719.461112:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009b108380 x1830967793738752/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 488/440 e 0 to 0 dl 1746147730 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.461119:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b108380 with x1830967793738752 ext(4194304->5017599) 00002000:00010000:1.0:1746147719.461123:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b108380 00000100:00100000:0.0:1746147719.469346:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.470005:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.470188:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15969 00000100:00100000:0.0:1746147719.470196:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967793739264:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147719.470204:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147719.470212:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957b2a00/0xe64d3fbf12a7c5a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafad42 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147719.470235:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b109500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796370048:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147719.470290:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147719.474697:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.477474:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793739648 00000100:00100000:0.0:1746147719.477480:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793739648 00000100:00100000:0.0:1746147719.477539:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793739392 00000100:00100000:0.0:1746147719.477541:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793739392 00000100:00100000:0.0:1746147719.477555:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15971 00000100:00100000:0.0:1746147719.477560:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967793739648:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147719.477572:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147719.477585:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957b3800/0xe64d3fbf12a7c5af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafad57 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147719.477619:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b109500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796370304:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147719.477821:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147719.478974:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.481256:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b109500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796370304:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147719.481287:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957b3800/0xe64d3fbf12a7c5af lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad57 expref: 25 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147719.481298:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800957b3800/0xe64d3fbf12a7c5af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad57 expref: 25 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147719.481311:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957b3800, rc 0) 00000100:00100000:1.0:1746147719.481349:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967793739648:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3789us (4644us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147719.481356:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15971 00000100:00100000:0.0:1746147719.487942:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.499194:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.499237:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.499957:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7087 00000100:00100000:1.0:1746147719.499965:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967793740416:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147719.500129:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.520701:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967793740416:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20729us (21455us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147719.520712:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7087 00002000:00100000:1.0:1746147719.520721:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009c9a8700 x1830967793740416/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:340/0 lens 488/440 e 0 to 0 dl 1746147730 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.520729:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a8700 with x1830967793740416 ext(3145728->4194303) 00002000:00010000:1.0:1746147719.520735:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9a8700 00000100:00100000:0.0:1746147719.530311:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.549555:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.592429:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.626497:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.634218:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.634414:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793741824 00000100:00100000:1.0:1746147719.634419:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793741824 00000100:00100000:0.0:1746147719.638457:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.644503:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.644581:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.644697:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793742080 00000100:00100000:1.0:1746147719.644706:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793742080 00000100:00100000:1.0:1746147719.644753:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793742208 00000100:00100000:1.0:1746147719.644756:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793742208 00000100:00100000:1.0:1746147719.644789:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15973 00000100:00100000:1.0:1746147719.644796:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793742080:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147719.644811:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147719.644826:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c4cde00/0xe64d3fbf12a7c5fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafad6c expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147719.644871:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796370816:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147719.644958:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2085000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147719.645452:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.651305:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796370816:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147719.651320:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c4cde00/0xe64d3fbf12a7c5fc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad6c expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147719.651328:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c4cde00/0xe64d3fbf12a7c5fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad6c expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147719.651611:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c4cde00, rc 0) 00000100:00100000:1.0:1746147719.651646:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793742080:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 6849us (7150us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147719.651651:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15973 00000100:00100000:0.0:1746147719.656955:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.663996:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.673559:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.676737:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.676992:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.677066:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793743232 00000100:00100000:1.0:1746147719.677071:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793743232 00000100:00100000:1.0:1746147719.677131:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15977 00000100:00100000:1.0:1746147719.677136:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967793743232:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147719.677143:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147719.677150:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c4cde00/0xe64d3fbf12a7c63b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafad96 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147719.677180:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796371328:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147719.677526:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2085000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147719.686144:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796371328:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147719.686164:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c4cde00/0xe64d3fbf12a7c63b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad96 expref: 8 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147719.686173:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c4cde00/0xe64d3fbf12a7c63b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad96 expref: 8 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147719.686193:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c4cde00, rc 0) 00000100:00100000:1.0:1746147719.686219:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+7:1958:x1830967793743232:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 9083us (9227us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147719.686224:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15977 00000100:00100000:0.0:1746147719.688157:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.695557:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.705362:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.708200:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.710462:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.713552:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.713601:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.713659:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793745024 00000100:00100000:1.0:1746147719.713668:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793745024 00000100:00100000:1.0:1746147719.713715:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793745280 00000100:00100000:1.0:1746147719.713717:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793745280 00000100:00100000:1.0:1746147719.713735:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4927 00000100:00100000:1.0:1746147719.713740:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:31955:x1830967793745280:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:1.0:1746147719.714050:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:31955:x1830967793745280:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 309us (447us total) trans 8589945887 rc 0/0 00000100:00100000:1.0:1746147719.714056:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4927 00000100:00100000:0.0:1746147719.715963:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.715996:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.716029:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.716089:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793745408 00000100:00100000:1.0:1746147719.716094:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793745408 00000100:00100000:1.0:1746147719.716118:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793745536 00000100:00100000:1.0:1746147719.716120:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793745536 00000100:00100000:1.0:1746147719.716130:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793745664 00000100:00100000:1.0:1746147719.716131:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793745664 00000100:00100000:1.0:1746147719.716143:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15978 00000100:00100000:1.0:1746147719.716148:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967793745408:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147719.716160:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147719.716182:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8dbea00/0xe64d3fbf12a7c696 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafadb2 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147719.716225:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796371584:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147719.716288:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2085000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147719.720257:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796371584:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147719.720294:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8dbea00/0xe64d3fbf12a7c696 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadb2 expref: 25 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147719.720306:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8dbea00/0xe64d3fbf12a7c696 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadb2 expref: 25 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147719.720317:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8dbea00, rc 0) 00000100:00100000:1.0:1746147719.720373:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967793745408:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4223us (4412us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147719.720381:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15978 00000100:00100000:0.0:1746147719.728735:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.729149:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15981 00000100:00100000:1.0:1746147719.729158:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:31959:x1830967793745792:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147719.729179:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147719.729193:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801354ea400/0xe64d3fbf12a7c6ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafadc7 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.729216:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c910c00/0xe64d3fbf12a7c577 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad18 expref: 13 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.729223:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147719.729224:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147719.729227:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801354ea400/0xe64d3fbf12a7c6ab lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadc7 expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.729250:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c910c00/0xe64d3fbf12a7c577 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad18 expref: 13 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.729259:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c910c00/0xe64d3fbf12a7c577 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad18 expref: 13 pid: 8184 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746147719.729269:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796371840:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147719.729344:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2085000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147719.731600:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796371840:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147719.731633:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801354ea400/0xe64d3fbf12a7c6ab lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadc7 expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.731650:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801354ea400, rc 0) 00000100:00100000:1.0:1746147719.731706:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:31959:x1830967793745792:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2537us (2968us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147719.731714:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15981 00000100:00100000:0.0:1746147719.733954:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.756248:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.756639:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793746048 00000100:00100000:1.0:1746147719.756646:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793746048 00010000:00010000:1.0:1746147719.756676:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c910c00/0xe64d3fbf12a7c577 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad18 expref: 16 pid: 8184 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746147719.756715:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8085 00000100:00100000:1.0:1746147719.756722:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967793746048:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147719.756734:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147719.756751:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c910c00/0xe64d3fbf12a7c577 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad18 expref: 16 pid: 8184 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746147719.756762:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c910c00/0xe64d3fbf12a7c577 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad18 expref: 16 pid: 8184 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746147719.756793:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c910c00/0xe64d3fbf12a7c577 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1273856->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad18 expref: 16 pid: 8184 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746147719.756824:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.756826:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.756831:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801354ea400/0xe64d3fbf12a7c6ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadc7 expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.756843:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801354ea400/0xe64d3fbf12a7c6ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadc7 expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.756872:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801354ea400/0xe64d3fbf12a7c6ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadc7 expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147719.756915:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796371968:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147719.756986:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2085000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147719.758296:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796371968:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147719.758313:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147719.758350:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967793746048:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1628us (2109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147719.758358:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8085 00000100:00100000:0.0:1746147719.760309:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147719.769193:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147719.776579:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.782600:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.782712:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793746688 00000100:00100000:1.0:1746147719.782721:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793746688 00000100:00100000:1.0:1746147719.782789:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15982 00000100:00100000:1.0:1746147719.782797:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1957:x1830967793746688:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147719.782813:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147719.782830:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7c6c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafadd5 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.782848:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.782850:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.782858:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7c6c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadd5 expref: 16 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147719.782875:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7c6c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadd5 expref: 16 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147719.782912:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931cfa00, rc 0) 00000100:00100000:1.0:1746147719.782953:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1957:x1830967793746688:12345-192.168.202.10@tcp:101:cat.0 Request processed in 156us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147719.782959:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15982 00000100:00100000:0.0:1746147719.783920:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.790247:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.790308:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.790509:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793746944 00000100:00100000:1.0:1746147719.790517:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793746944 00002000:00100000:1.0:1746147719.790553:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2068479) req@ffff88009fe40a80 x1830967793746944/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:340/0 lens 504/0 e 0 to 0 dl 1746147730 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.790561:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe40a80 with x1830967793746944 ext(1048576->2068479) 00010000:00010000:1.0:1746147719.790568:0:31359:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095520800/0xe64d3fbf12a7c57e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad1f expref: 16 pid: 8184 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746147719.790579:0:31359:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095520800/0xe64d3fbf12a7c57e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad1f expref: 16 pid: 8184 timeout: 898 lvb_type: 0 00002000:00010000:1.0:1746147719.790585:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe40a80 00000100:00100000:1.0:1746147719.790608:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793747328 00000100:00100000:1.0:1746147719.790611:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793747328 00002000:00100000:1.0:1746147719.790622:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fe40e00 x1830967793747328/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:340/0 lens 488/0 e 0 to 0 dl 1746147730 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.790629:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe40e00 with x1830967793747328 ext(0->1048575) 00002000:00010000:1.0:1746147719.790632:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe40e00 00000100:00100000:1.0:1746147719.790642:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1389 00000100:00100000:1.0:1746147719.790647:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967793746944:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147719.792598:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.795365:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.808374:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.808399:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793747712 00000100:00100000:0.0:1746147719.808403:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793747712 00010000:00010000:0.0:1746147719.808425:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a913e000/0xe64d3fbf12a7c52a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacc4 expref: 27 pid: 8470 timeout: 898 lvb_type: 1 00000100:00100000:0.0:1746147719.808456:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8086 00000100:00100000:0.0:1746147719.808462:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967793747712:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147719.808472:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147719.808484:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a913e000/0xe64d3fbf12a7c52a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacc4 expref: 27 pid: 8470 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746147719.808494:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a913e000/0xe64d3fbf12a7c52a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacc4 expref: 27 pid: 8470 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746147719.808510:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a913e000/0xe64d3fbf12a7c52a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacc4 expref: 27 pid: 8470 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746147719.808524:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147719.808539:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967793747712:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 78us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147719.808545:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8086 00000100:00100000:0.0:1746147719.808573:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.808582:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793747840 00000100:00100000:0.0:1746147719.808584:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793747840 00010000:00010000:0.0:1746147719.808599:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e99e00/0xe64d3fbf12a7c419 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac5b expref: 8 pid: 8184 timeout: 898 lvb_type: 1 00000100:00100000:0.0:1746147719.808612:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8087 00000100:00100000:0.0:1746147719.808615:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793747840:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147719.808621:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147719.808627:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e99e00/0xe64d3fbf12a7c419 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac5b expref: 8 pid: 8184 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746147719.808634:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e99e00/0xe64d3fbf12a7c419 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac5b expref: 8 pid: 8184 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746147719.808699:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e99e00/0xe64d3fbf12a7c419 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac5b expref: 8 pid: 8184 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746147719.808709:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147719.808722:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967793747840:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 106us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147719.808726:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8087 00000100:00100000:1.0:1746147719.810879:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793746944:12345-192.168.202.10@tcp:4:cat.0 Request processed in 20227us (20635us total) trans 21474841494 rc 0/0 00000100:00100000:1.0:1746147719.810900:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1389 00002000:00100000:1.0:1746147719.810907:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2068479) req@ffff88009fe40a80 x1830967793746944/t21474841494(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:340/0 lens 504/448 e 0 to 0 dl 1746147730 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.810915:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe40a80 with x1830967793746944 ext(1048576->2068479) 00010000:00010000:1.0:1746147719.810922:0:31359:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095520800/0xe64d3fbf12a7c57e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad1f expref: 20 pid: 8184 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746147719.810934:0:31359:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095520800/0xe64d3fbf12a7c57e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad1f expref: 20 pid: 8184 timeout: 898 lvb_type: 0 00002000:00010000:1.0:1746147719.810939:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe40a80 00000100:00100000:0.0:1746147719.819239:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.821995:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.827379:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.827492:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.827566:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7096 00000100:00100000:1.0:1746147719.827574:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967793748608:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147719.827696:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967793748608:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 123us (203us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147719.827702:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7096 00002000:00100000:1.0:1746147719.827707:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (98304->102399) req@ffff8800a8acd180 x1830967793748608/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 488/4536 e 0 to 0 dl 1746147730 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.827714:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acd180 with x1830967793748608 ext(98304->102399) 00002000:00010000:1.0:1746147719.827717:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acd180 00000100:00100000:0.0:1746147719.829758:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.844542:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.844621:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.845629:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.848090:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.848825:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.849089:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793749632 00000100:00100000:0.0:1746147719.849093:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793749632 00010000:00010000:0.0:1746147719.849113:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801354ea400/0xe64d3fbf12a7c6ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadc7 expref: 25 pid: 8468 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746147719.849140:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8091 00000100:00100000:0.0:1746147719.849146:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793749632:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147719.849153:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147719.849164:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801354ea400/0xe64d3fbf12a7c6ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadc7 expref: 25 pid: 8468 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746147719.849173:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801354ea400/0xe64d3fbf12a7c6ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadc7 expref: 25 pid: 8468 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746147719.849210:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801354ea400/0xe64d3fbf12a7c6ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadc7 expref: 25 pid: 8468 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746147719.849234:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147719.849236:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147719.849243:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fceb200/0xe64d3fbf12a7c6e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadf1 expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.849250:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fceb200/0xe64d3fbf12a7c6e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadf1 expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147719.849274:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fceb200/0xe64d3fbf12a7c6e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadf1 expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147719.849284:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094691500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796373504:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147719.850037:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147719.850662:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.850731:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.851322:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8093 00000100:00100000:1.0:1746147719.851330:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967793749888:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147719.851337:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147719.851342:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0259c00/0xe64d3fbf12a7c657 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad9d expref: 16 pid: 14546 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746147719.851353:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0259c00/0xe64d3fbf12a7c657 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad9d expref: 16 pid: 14546 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746147719.851364:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0259c00/0xe64d3fbf12a7c657 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad9d expref: 16 pid: 14546 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746147719.851377:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147719.851381:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea000/0xe64d3fbf12a7c6f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147719.851387:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea000/0xe64d3fbf12a7c6f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147719.851392:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147719.852873:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.852950:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094691500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796373504:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147719.852968:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147719.852987:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967793749632:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3842us (4163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147719.852993:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8091 00000100:00100000:1.0:1746147719.853192:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967793749888:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1861us (2459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147719.853200:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8093 00000100:00100000:0.0:1746147719.859171:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.859222:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.860746:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7099 00000100:00100000:1.0:1746147719.860757:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967793750272:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147719.867749:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.870090:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793750784 00000100:00100000:0.0:1746147719.870101:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793750784 00002000:00100000:0.0:1746147719.870142:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x454:0x0] (1138688->1142783) req@ffff88009c2a9f80 x1830967793750784/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 488/0 e 0 to 0 dl 1746147730 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147719.870152:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a9f80 with x1830967793750784 ext(1138688->1142783) 00002000:00010000:0.0:1746147719.870156:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a9f80 00000100:00100000:0.0:1746147719.870193:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7100 00000100:00100000:0.0:1746147719.870201:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967793750784:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147719.870378:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967793750784:12345-192.168.202.10@tcp:3:cat.0 Request processed in 176us (2635us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147719.870384:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7100 00002000:00100000:0.0:1746147719.870390:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x454:0x0] (1138688->1142783) req@ffff88009c2a9f80 x1830967793750784/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 488/4536 e 0 to 0 dl 1746147730 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147719.870396:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a9f80 with x1830967793750784 ext(1138688->1142783) 00002000:00010000:0.0:1746147719.870399:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a9f80 00000100:00100000:1.0:1746147719.870515:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.872991:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.877110:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967793750272:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16350us (17881us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147719.877122:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7099 00002000:00100000:1.0:1746147719.877132:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880094692a00 x1830967793750272/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:340/0 lens 488/440 e 0 to 0 dl 1746147730 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147719.877142:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094692a00 with x1830967793750272 ext(2097152->3145727) 00002000:00010000:1.0:1746147719.877146:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094692a00 00000100:00100000:1.0:1746147719.882564:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.899325:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.900835:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.912341:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796374016:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147719.912371:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a932b000/0xe64d3fbf12a7c714 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae0d expref: 10 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147719.912383:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a932b000/0xe64d3fbf12a7c714 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae0d expref: 10 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147719.912401:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a932b000, rc 0) 00000100:00100000:0.0:1746147719.912447:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967793751424:12345-192.168.202.10@tcp:101:cat.0 Request processed in 10194us (11614us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147719.912455:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15990 00000100:00100000:0.0:1746147719.920228:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.920310:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.984454:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.987293:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.987554:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793752064 00000100:00100000:1.0:1746147719.987560:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793752064 00010000:00010000:1.0:1746147719.987585:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a213de00/0xe64d3fbf12a7c60a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad7a expref: 7 pid: 7050 timeout: 899 lvb_type: 1 00000100:00100000:1.0:1746147719.987617:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8095 00000100:00100000:1.0:1746147719.987624:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a237b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967793752064:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147719.987634:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147719.987652:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a213de00/0xe64d3fbf12a7c60a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad7a expref: 7 pid: 7050 timeout: 899 lvb_type: 1 00010000:00010000:1.0:1746147719.987663:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a213de00/0xe64d3fbf12a7c60a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad7a expref: 7 pid: 7050 timeout: 899 lvb_type: 1 00010000:00010000:1.0:1746147719.987681:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a213de00/0xe64d3fbf12a7c60a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad7a expref: 7 pid: 7050 timeout: 899 lvb_type: 1 00010000:00010000:1.0:1746147719.987706:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147719.987733:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a237b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967793752064:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 109us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147719.987739:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8095 00000100:00100000:0.0:1746147719.991371:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147719.994358:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147719.994540:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793752320 00000100:00100000:1.0:1746147719.994546:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793752320 00010000:00010000:1.0:1746147719.994570:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0259800/0xe64d3fbf12a7c5a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad50 expref: 18 pid: 8184 timeout: 899 lvb_type: 0 00000100:00100000:1.0:1746147719.995711:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8097 00000100:00100000:1.0:1746147719.995720:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967793752320:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147719.995733:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147719.995752:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0259800/0xe64d3fbf12a7c5a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad50 expref: 18 pid: 8184 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746147719.995773:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0259800/0xe64d3fbf12a7c5a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad50 expref: 18 pid: 8184 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746147719.995793:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0259800/0xe64d3fbf12a7c5a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad50 expref: 18 pid: 8184 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746147719.995816:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.995818:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147719.995823:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095234600/0xe64d3fbf12a7c729 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae29 expref: 17 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.995829:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095234600/0xe64d3fbf12a7c729 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae29 expref: 17 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147719.995860:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095234600/0xe64d3fbf12a7c729 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae29 expref: 17 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147719.995871:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796374784:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147719.997909:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2085000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147720.000202:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.000556:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796374784:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147720.000572:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147720.000611:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967793752320:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4893us (6258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147720.000621:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8097 00000100:00100000:0.0:1746147720.010171:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.024221:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.024272:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.024350:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793752832 00000100:00100000:1.0:1746147720.024357:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793752832 00010000:00010000:1.0:1746147720.024387:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a913f400/0xe64d3fbf12a7c4eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacb6 expref: 11 pid: 8470 timeout: 899 lvb_type: 1 00000100:00100000:1.0:1746147720.024410:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793752960 00000100:00100000:1.0:1746147720.024412:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793752960 00010000:00010000:1.0:1746147720.026422:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d71fa00/0xe64d3fbf12a7c43c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac77 expref: 7 pid: 10613 timeout: 899 lvb_type: 1 00000100:00100000:1.0:1746147720.026452:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8099 00000100:00100000:1.0:1746147720.026458:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967793752960:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147720.026467:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147720.026480:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d71fa00/0xe64d3fbf12a7c43c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac77 expref: 7 pid: 10613 timeout: 899 lvb_type: 1 00010000:00010000:1.0:1746147720.026491:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d71fa00/0xe64d3fbf12a7c43c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac77 expref: 7 pid: 10613 timeout: 899 lvb_type: 1 00010000:00010000:1.0:1746147720.026505:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d71fa00/0xe64d3fbf12a7c43c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac77 expref: 7 pid: 10613 timeout: 899 lvb_type: 1 00010000:00010000:1.0:1746147720.026517:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147720.026534:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967793752960:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 77us (2263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147720.026539:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8099 00000100:00100000:0.0:1746147720.036244:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.042669:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.127665:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147720.128726:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147720.130865:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.131776:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793753728 00000100:00100000:1.0:1746147720.131788:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793753728 00000100:00100000:1.0:1746147720.131867:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4929 00000100:00100000:1.0:1746147720.131874:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:15394:x1830967793753728:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147720.132173:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:15394:x1830967793753728:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 298us (1317us total) trans 8589945891 rc 0/0 00000100:00100000:1.0:1746147720.132180:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4929 00000100:00080000:0.0:1746147720.132935:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147720.135462:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.144657:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147720.145221:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147720.146417:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.146482:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.146571:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793754240 00000100:00100000:1.0:1746147720.146579:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793754240 00000100:00100000:1.0:1746147720.146619:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793754368 00000100:00100000:1.0:1746147720.146621:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793754368 00000100:00100000:1.0:1746147720.146642:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15995 00000100:00100000:1.0:1746147720.146649:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aabb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967793754240:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147720.146663:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147720.146679:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe37e00/0xe64d3fbf12a7c761 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafae45 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147720.146722:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796375680:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147720.146789:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147720.146902:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15996 00000100:00100000:0.0:1746147720.146908:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967793754368:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147720.146917:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147720.146926:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7c768 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafae4c expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147720.146947:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d24e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796375808:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147720.146978:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147720.151149:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:1.0:1746147720.151720:0:8469:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime: 1746147718 -> 1746147721 00002000:00010000:1.0:1746147720.151724:0:8469:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147718 -> 1746147720 00002000:00010000:1.0:1746147720.151726:0:8469:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime: 1746147718 -> 1746147721 00000100:00100000:1.0:1746147720.151744:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796375680:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147720.151776:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe37e00/0xe64d3fbf12a7c761 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae45 expref: 26 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147720.151788:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe37e00/0xe64d3fbf12a7c761 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae45 expref: 26 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147720.151810:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe37e00, rc 0) 00000100:00100000:1.0:1746147720.151860:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aabb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967793754240:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5211us (5449us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147720.151869:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15995 00000100:00100000:0.0:1746147720.153469:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:1.0:1746147720.156635:0:8468:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime: 1746147720 -> 1746147721 00002000:00010000:1.0:1746147720.156642:0:8468:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime: 1746147720 -> 1746147721 00000100:00100000:1.0:1746147720.156668:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d24e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796375808:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147720.156707:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7c768 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae4c expref: 24 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147720.156720:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7c768 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae4c expref: 24 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147720.156732:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e7800, rc 0) 00000100:00100000:1.0:1746147720.156791:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967793754368:12345-192.168.202.10@tcp:101:cat.0 Request processed in 9882us (10311us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147720.156799:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15996 00000100:00100000:0.0:1746147720.169391:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.171333:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.171755:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793755008 00000100:00100000:1.0:1746147720.171769:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793755008 00002000:00100000:1.0:1746147720.171810:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (0->98303) req@ffff880130d25880 x1830967793755008/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147720.171820:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d25880 with x1830967793755008 ext(0->98303) 00002000:00010000:1.0:1746147720.171825:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d25880 00000100:00100000:1.0:1746147720.171856:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7103 00000100:00100000:1.0:1746147720.171863:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793755008:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147720.174110:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.174150:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.174179:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.174193:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.177633:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793755392 00000100:00100000:1.0:1746147720.177647:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793755392 00000100:00100000:1.0:1746147720.177685:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793755520 00000100:00100000:1.0:1746147720.177688:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793755520 00000100:00100000:1.0:1746147720.178830:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793755648 00000100:00100000:1.0:1746147720.178835:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793755648 00000100:00100000:1.0:1746147720.179511:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15999 00000100:00100000:1.0:1746147720.179518:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967793755648:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147720.179525:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147720.179532:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe36400/0xe64d3fbf12a7c78b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafae68 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147720.179545:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147720.179548:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147720.179557:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe36400/0xe64d3fbf12a7c78b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae68 expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147720.179571:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe36400/0xe64d3fbf12a7c78b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae68 expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147720.179581:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe36400, rc 0) 00000100:00100000:1.0:1746147720.179604:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967793755648:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 86us (5409us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147720.179609:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15999 00000100:00080000:1.0:1746147720.180493:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147720.180789:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.184612:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+6:1958:x1830967793755392:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147720.184636:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147720.184655:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02e7400/0xe64d3fbf12a7c792 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafae5a expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147720.184709:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796376064:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147720.184782:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147720.184836:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793755776 00000100:00100000:1.0:1746147720.184843:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793755776 00000100:00100000:0.0:1746147720.187492:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:1.0:1746147720.203721:0:7050:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime: 1746147720 -> 1746147721 00002000:00010000:1.0:1746147720.203723:0:7050:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime: 1746147720 -> 1746147721 00002000:00010000:1.0:1746147720.203725:0:7050:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime: 1746147720 -> 1746147721 00000100:00100000:1.0:1746147720.203734:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796376064:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147720.203772:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e7400/0xe64d3fbf12a7c792 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae5a expref: 7 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147720.203781:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e7400/0xe64d3fbf12a7c792 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae5a expref: 7 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147720.203791:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e7400, rc 0) 00000100:00100000:1.0:1746147720.203808:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+6:1958:x1830967793755392:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 24509us (29657us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147720.203812:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15997 00000100:00100000:1.0:1746147720.205754:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793756416 00000100:00100000:1.0:1746147720.205770:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793756416 00000100:00100000:1.0:1746147720.205812:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4930 00000100:00100000:1.0:1746147720.205819:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:31978:x1830967793756416:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:1.0:1746147720.206193:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:31978:x1830967793756416:12345-192.168.202.10@tcp:35:cat.0 Request processed in 374us (785us total) trans 8589945894 rc 0/0 00000100:00100000:1.0:1746147720.206199:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4930 00000100:00100000:0.0:1746147720.208600:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.222526:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796376832:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147720.222572:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095445200/0xe64d3fbf12a7c802 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaeae expref: 10 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.222592:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095445200/0xe64d3fbf12a7c802 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaeae expref: 10 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.222607:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095445200, rc 0) 00000100:00100000:0.0:1746147720.222655:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967793757440:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 6241us (6329us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147720.222663:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16005 00000100:00100000:0.0:1746147720.222719:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796376960:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147720.222733:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095445600/0xe64d3fbf12a7c809 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae99 expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.222742:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095445600/0xe64d3fbf12a7c809 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae99 expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.222750:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095445600, rc 0) 00000100:00100000:0.0:1746147720.222773:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967793757056:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 6294us (6408us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147720.222778:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16006 00000100:00100000:0.0:1746147720.222809:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796377088:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147720.222826:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ffcce00/0xe64d3fbf12a7c810 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaea7 expref: 7 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.222833:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffcce00/0xe64d3fbf12a7c810 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaea7 expref: 7 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.222845:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffcce00, rc 0) 00000100:00100000:0.0:1746147720.222857:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967793757312:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 6273us (6305us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147720.222861:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16007 00000100:00100000:0.0:1746147720.223028:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796376704:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147720.223040:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095445a00/0xe64d3fbf12a7c7fb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaea0 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.223048:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095445a00/0xe64d3fbf12a7c7fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaea0 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.223054:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095445a00, rc 0) 00000100:00100000:0.0:1746147720.223069:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967793757184:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 6813us (7140us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147720.223073:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16004 00000100:00100000:0.0:1746147720.231994:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.232842:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.233517:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16009 00000100:00100000:0.0:1746147720.233983:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793757696:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147720.233999:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147720.234013:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02e7200/0xe64d3fbf12a7c81e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaeb5 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147720.234056:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796377344:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147720.234128:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147720.238268:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793758080 00000100:00100000:0.0:1746147720.238280:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793758080 00000100:00100000:0.0:1746147720.238320:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11906 00000100:00100000:0.0:1746147720.238328:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+10:31971:x1830967793758080:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147720.238346:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147720.238362:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e7600/0xe64d3fbf12a7c82c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaec3 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.238440:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c833 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147720.238451:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c833 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147720.238460:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c833 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147720.238470:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c833 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147720.238475:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c833 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147720.238480:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c833 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147720.238485:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02e6e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147720.238488:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c833 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147720.238493:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c833 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147720.238503:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147720.238506:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147720.238510:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c833 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147720.238515:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c833 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147720.238538:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e7600/0xe64d3fbf12a7c82c lrc: 1/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaec3 expref: 11 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.238544:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e7600/0xe64d3fbf12a7c82c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaec3 expref: 11 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.238552:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e7600, rc 0) 00000100:00100000:0.0:1746147720.238587:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+10:31971:x1830967793758080:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 260us (415us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147720.238594:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11906 00002000:00010000:0.0:1746147720.254303:0:8184:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147720 -> 1746147721 00000100:00100000:0.0:1746147720.254331:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796377344:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147720.254373:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e7200/0xe64d3fbf12a7c81e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaeb5 expref: 26 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.254387:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e7200/0xe64d3fbf12a7c81e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaeb5 expref: 26 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.254409:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e7200, rc 0) 00000100:00100000:0.0:1746147720.254623:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793757696:12345-192.168.202.10@tcp:101:cat.0 Request processed in 20644us (21780us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147720.254631:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16009 00000100:00100000:0.0:1746147720.254864:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793758336 00000100:00100000:0.0:1746147720.254870:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793758336 00002000:00100000:0.0:1746147720.254932:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x455:0x0] (98304->1048575) req@ffff88012ee5b800 x1830967793758336/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147720.254941:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee5b800 with x1830967793758336 ext(98304->1048575) 00010000:00010000:0.0:1746147720.254947:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092c24e00/0xe64d3fbf12a7c6d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafade3 expref: 25 pid: 7050 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746147720.254958:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092c24e00/0xe64d3fbf12a7c6d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafade3 expref: 25 pid: 7050 timeout: 899 lvb_type: 0 00002000:00010000:0.0:1746147720.254964:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ee5b800 00000100:00100000:0.0:1746147720.254985:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1390 00000100:00100000:0.0:1746147720.254990:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793758336:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147720.261265:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.262569:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.262609:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793758720 00000100:00100000:1.0:1746147720.262613:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793758720 00000100:00100000:0.0:1746147720.275439:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.284049:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.284109:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.290608:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.290649:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.290676:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.290926:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793759360 00000100:00100000:0.0:1746147720.290932:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793759360 00010000:00010000:0.0:1746147720.290952:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7c730 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae30 expref: 12 pid: 7050 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746147720.290971:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793759488 00000100:00100000:0.0:1746147720.290973:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793759488 00010000:00010000:0.0:1746147720.290983:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801317ad400/0xe64d3fbf12a7c6ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaddc expref: 24 pid: 7050 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746147720.290997:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8106 00000100:00100000:0.0:1746147720.291002:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967793759360:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147720.291014:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147720.291031:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7c730 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae30 expref: 12 pid: 7050 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746147720.291040:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7c730 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae30 expref: 12 pid: 7050 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746147720.291060:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7c730 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae30 expref: 12 pid: 7050 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746147720.291076:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147720.291078:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147720.291084:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095234400/0xe64d3fbf12a7c83a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaed1 expref: 27 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.291092:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095234400/0xe64d3fbf12a7c83a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaed1 expref: 27 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.291118:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095234400/0xe64d3fbf12a7c83a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaed1 expref: 27 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147720.291129:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796378368:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147720.291159:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147720.295977:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.296012:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.296027:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.296043:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793759872 00000100:00100000:1.0:1746147720.296048:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793759872 00010000:00010000:1.0:1746147720.296070:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0505e00/0xe64d3fbf12a7c7bc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae7d expref: 20 pid: 14545 timeout: 899 lvb_type: 0 00000100:00100000:1.0:1746147720.296091:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8108 00000100:00100000:1.0:1746147720.296098:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a237ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793759872:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147720.296110:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147720.296115:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0505e00/0xe64d3fbf12a7c7bc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae7d expref: 20 pid: 14545 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746147720.296125:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0505e00/0xe64d3fbf12a7c7bc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae7d expref: 20 pid: 14545 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746147720.296150:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0505e00/0xe64d3fbf12a7c7bc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae7d expref: 20 pid: 14545 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746147720.296661:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796378368:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147720.296677:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147720.296700:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793759360:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5697us (6050us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147720.296707:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8106 00000100:00100000:0.0:1746147720.296719:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793760000 00000100:00100000:0.0:1746147720.296721:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793760000 00010000:00010000:0.0:1746147720.296732:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092c24e00/0xe64d3fbf12a7c6d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafade3 expref: 29 pid: 7050 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746147720.296745:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8110 00000100:00100000:0.0:1746147720.296749:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967793760000:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147720.296755:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147720.296782:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092c24e00/0xe64d3fbf12a7c6d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 98304->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafade3 expref: 29 pid: 7050 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746147720.296790:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092c24e00/0xe64d3fbf12a7c6d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 98304->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafade3 expref: 29 pid: 7050 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746147720.296804:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092c24e00/0xe64d3fbf12a7c6d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 98304->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafade3 expref: 29 pid: 7050 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746147720.296829:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147720.296832:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147720.296838:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffcc400/0xe64d3fbf12a7c825 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaeca expref: 10 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.296846:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffcc400/0xe64d3fbf12a7c825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaeca expref: 10 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.296870:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ffcc400/0xe64d3fbf12a7c825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaeca expref: 10 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147720.296880:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796378624:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147720.296939:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d69c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147720.297238:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147720.297243:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147720.297260:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a237ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967793759872:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1163us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147720.297267:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8108 00000100:00100000:0.0:1746147720.303871:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.309393:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.314533:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.321296:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.328231:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.329458:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.329844:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793761664 00000100:00100000:0.0:1746147720.329847:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793761664 00002000:00100000:0.0:1746147720.329871:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3387392->4194303) req@ffff88009fe39f80 x1830967793761664/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147720.329880:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39f80 with x1830967793761664 ext(3387392->4194303) 00010000:00010000:0.0:1746147720.329905:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095234600/0xe64d3fbf12a7c729 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae29 expref: 16 pid: 7050 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746147720.329916:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095234600/0xe64d3fbf12a7c729 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae29 expref: 16 pid: 7050 timeout: 899 lvb_type: 0 00002000:00010000:0.0:1746147720.329922:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe39f80 00000100:00100000:0.0:1746147720.329939:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1392 00000100:00100000:0.0:1746147720.329945:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967793761664:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:0.0:1746147720.334324:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.337668:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.337853:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793762048 00000100:00100000:1.0:1746147720.337858:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793762048 00002000:00100000:1.0:1746147720.337904:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (2846720->2850815) req@ffff88009fe3a680 x1830967793762048/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147720.337914:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe3a680 with x1830967793762048 ext(2846720->2850815) 00002000:00010000:1.0:1746147720.337918:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe3a680 00000100:00100000:1.0:1746147720.337943:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7108 00000100:00100000:1.0:1746147720.337949:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967793762048:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147720.338073:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967793762048:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 124us (406us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147720.338079:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7108 00002000:00100000:1.0:1746147720.338084:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (2846720->2850815) req@ffff88009fe3a680 x1830967793762048/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:341/0 lens 488/4536 e 0 to 0 dl 1746147731 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147720.338091:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe3a680 with x1830967793762048 ext(2846720->2850815) 00002000:00010000:1.0:1746147720.338093:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe3a680 00000100:00100000:0.0:1746147720.342120:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.351196:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967793761664:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 21242us (21729us total) trans 21474841495 rc 0/0 00000100:00100000:1.0:1746147720.351207:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1392 00002000:00100000:1.0:1746147720.351220:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3387392->4194303) req@ffff88009fe39f80 x1830967793761664/t21474841495(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:341/0 lens 488/448 e 0 to 0 dl 1746147731 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147720.351228:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39f80 with x1830967793761664 ext(3387392->4194303) 00010000:00010000:1.0:1746147720.351237:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095234600/0xe64d3fbf12a7c729 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae29 expref: 19 pid: 7050 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746147720.351250:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095234600/0xe64d3fbf12a7c729 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafae29 expref: 19 pid: 7050 timeout: 899 lvb_type: 0 00002000:00010000:1.0:1746147720.351256:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe39f80 00000100:00100000:0.0:1746147720.353711:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793762432 00000100:00100000:0.0:1746147720.353720:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793762432 00002000:00100000:0.0:1746147720.353752:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3096576->3100671) req@ffff88009172f100 x1830967793762432/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147720.353772:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172f100 with x1830967793762432 ext(3096576->3100671) 00002000:00010000:0.0:1746147720.353776:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172f100 00000100:00100000:0.0:1746147720.354013:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7109 00000100:00100000:0.0:1746147720.354020:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1957:x1830967793762432:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147720.356032:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1957:x1830967793762432:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 2007us (2709us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147720.356040:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7109 00002000:00100000:0.0:1746147720.356048:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3096576->3100671) req@ffff88009172f100 x1830967793762432/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:341/0 lens 488/4536 e 0 to 0 dl 1746147731 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147720.356056:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172f100 with x1830967793762432 ext(3096576->3100671) 00002000:00010000:0.0:1746147720.356061:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172f100 00000100:00100000:0.0:1746147720.359513:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.361378:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.369533:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.371414:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.393396:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793763328 00000100:00100000:0.0:1746147720.393404:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793763328 00000100:00100000:0.0:1746147720.393441:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16016 00000100:00100000:0.0:1746147720.393449:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:31978:x1830967793763328:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147720.393464:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147720.393479:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013553d400/0xe64d3fbf12a7c872 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaefb expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.393504:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801317ac600/0xe64d3fbf12a7c841 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaed8 expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.393511:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147720.393512:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147720.393515:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013553d400/0xe64d3fbf12a7c872 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaefb expref: 19 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.393541:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801317ac600/0xe64d3fbf12a7c841 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaed8 expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.393551:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801317ac600/0xe64d3fbf12a7c841 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaed8 expref: 26 pid: 10613 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746147720.393562:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796379520:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147720.394332:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147720.398360:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.400575:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.403387:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.405575:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.413653:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.415735:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.429255:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.429306:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.429396:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793764608 00000100:00100000:1.0:1746147720.429405:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793764608 00002000:00100000:1.0:1746147720.429442:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a8acdf80 x1830967793764608/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147720.429451:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acdf80 with x1830967793764608 ext(3145728->4194303) 00002000:00010000:1.0:1746147720.429456:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acdf80 00000100:00100000:1.0:1746147720.429471:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793764736 00000100:00100000:1.0:1746147720.429473:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793764736 00002000:00100000:1.0:1746147720.429484:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a8acea00 x1830967793764736/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147720.429490:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acea00 with x1830967793764736 ext(3145728->4194303) 00002000:00010000:1.0:1746147720.429493:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acea00 00000100:00100000:1.0:1746147720.429526:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7113 00000100:00100000:1.0:1746147720.429533:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967793764608:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147720.452585:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967793764608:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 23043us (23329us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147720.452597:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7113 00002000:00100000:1.0:1746147720.452606:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a8acdf80 x1830967793764608/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 488/440 e 0 to 0 dl 1746147731 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147720.452614:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acdf80 with x1830967793764608 ext(3145728->4194303) 00002000:00010000:1.0:1746147720.452620:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acdf80 00000100:00100000:0.0:1746147720.453863:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.453926:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.453993:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16019 00000100:00100000:0.0:1746147720.454000:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967793764864:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147720.454010:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147720.454019:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7c887 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaf09 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.454037:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147720.454039:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147720.454046:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7c887 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf09 expref: 14 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.454058:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7c887 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf09 expref: 14 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.454067:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a9400, rc 0) 00000100:00100000:0.0:1746147720.454099:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967793764864:12345-192.168.202.10@tcp:101:cat.0 Request processed in 100us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147720.454104:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16019 00000100:00100000:0.0:1746147720.454382:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967793764736:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 23473us (25075us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147720.454392:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7114 00002000:00100000:0.0:1746147720.454398:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a8acea00 x1830967793764736/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 488/440 e 0 to 0 dl 1746147731 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147720.454405:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acea00 with x1830967793764736 ext(3145728->4194303) 00002000:00010000:0.0:1746147720.454408:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acea00 00000100:00100000:0.0:1746147720.461637:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.462925:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.462946:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.462966:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.462989:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793765504 00000100:00100000:0.0:1746147720.462993:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793765504 00000100:00100000:0.0:1746147720.463017:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793765376 00000100:00100000:0.0:1746147720.463020:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793765376 00000100:00100000:0.0:1746147720.463031:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793765632 00000100:00100000:0.0:1746147720.463033:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793765632 00000100:00100000:0.0:1746147720.463045:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16020 00000100:00100000:0.0:1746147720.463051:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967793765504:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147720.463061:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147720.463072:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095445200/0xe64d3fbf12a7c8a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaf25 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.463086:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147720.463088:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147720.463096:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095445200/0xe64d3fbf12a7c8a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf25 expref: 28 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.463105:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095445200/0xe64d3fbf12a7c8a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf25 expref: 28 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.463112:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095445200, rc 0) 00000100:00100000:0.0:1746147720.463130:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967793765504:12345-192.168.202.10@tcp:101:cat.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147720.463135:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16020 00000100:00100000:0.0:1746147720.463147:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16021 00000100:00100000:0.0:1746147720.463151:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967793765376:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147720.463157:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147720.463166:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095444600/0xe64d3fbf12a7c8aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaf1e expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.463174:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147720.463176:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147720.463179:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095444600/0xe64d3fbf12a7c8aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf1e expref: 28 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.463188:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095444600/0xe64d3fbf12a7c8aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf1e expref: 28 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.463194:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095444600, rc 0) 00000100:00100000:0.0:1746147720.463206:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967793765376:12345-192.168.202.10@tcp:101:cat.0 Request processed in 55us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147720.463212:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16021 00000100:00100000:0.0:1746147720.463220:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16022 00000100:00100000:0.0:1746147720.463223:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967793765632:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147720.463228:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147720.463233:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095444800/0xe64d3fbf12a7c8b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafaf2c expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.463240:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147720.463242:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147720.463245:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095444800/0xe64d3fbf12a7c8b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf2c expref: 28 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.463252:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095444800/0xe64d3fbf12a7c8b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf2c expref: 28 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147720.463257:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095444800, rc 0) 00000100:00100000:0.0:1746147720.463269:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967793765632:12345-192.168.202.10@tcp:101:cat.0 Request processed in 45us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147720.463272:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16022 00000100:00100000:0.0:1746147720.465008:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.466403:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.469286:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793766016 00000100:00100000:0.0:1746147720.469291:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793766016 00002000:00100000:0.0:1746147720.469319:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009c2aa300 x1830967793766016/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147720.469327:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2aa300 with x1830967793766016 ext(2097152->3145727) 00002000:00010000:0.0:1746147720.469331:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c2aa300 00000100:00100000:0.0:1746147720.469355:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793766272 00000100:00100000:0.0:1746147720.469357:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793766272 00002000:00100000:0.0:1746147720.469368:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009172d880 x1830967793766272/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147720.469376:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172d880 with x1830967793766272 ext(3145728->4194303) 00002000:00010000:0.0:1746147720.469379:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172d880 00000100:00100000:0.0:1746147720.469392:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793766784 00000100:00100000:0.0:1746147720.469394:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793766784 00002000:00100000:0.0:1746147720.469404:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009172d180 x1830967793766784/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147720.469410:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172d180 with x1830967793766784 ext(3145728->4194303) 00002000:00010000:0.0:1746147720.469412:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009172d180 00000100:00100000:0.0:1746147720.469422:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7115 00000100:00100000:0.0:1746147720.469637:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1958:x1830967793766016:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147720.470740:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7118 00000100:00100000:0.0:1746147720.470747:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967793766528:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147720.477648:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.477715:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.477756:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.492800:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.498658:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1958:x1830967793766528:12345-192.168.202.10@tcp:3:cat.0 Request processed in 27910us (29331us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147720.498668:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7118 00002000:00100000:1.0:1746147720.498676:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009172f800 x1830967793766528/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:341/0 lens 488/440 e 0 to 0 dl 1746147731 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147720.498688:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172f800 with x1830967793766528 ext(2097152->3145727) 00002000:00010000:1.0:1746147720.498692:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009172f800 00000100:00100000:0.0:1746147720.499710:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.499777:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793767808 00000100:00100000:1.0:1746147720.499781:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793767808 00002000:00100000:1.0:1746147720.499803:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1085440->1089535) req@ffff880094691c00 x1830967793767808/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147720.499811:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094691c00 with x1830967793767808 ext(1085440->1089535) 00002000:00010000:1.0:1746147720.499814:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094691c00 00000100:00100000:1.0:1746147720.499836:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7120 00000100:00100000:1.0:1746147720.499841:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967793767808:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147720.499957:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967793767808:12345-192.168.202.10@tcp:3:cat.0 Request processed in 114us (248us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147720.499962:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7120 00002000:00100000:1.0:1746147720.499967:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1085440->1089535) req@ffff880094691c00 x1830967793767808/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 488/4536 e 0 to 0 dl 1746147731 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147720.499973:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094691c00 with x1830967793767808 ext(1085440->1089535) 00002000:00010000:1.0:1746147720.499976:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094691c00 00000100:00100000:0.0:1746147720.505826:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.513705:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.514632:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.536178:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.562003:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.586866:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.604559:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.614867:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.616663:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.620464:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.623295:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.630687:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.635160:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.650322:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.656525:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.661301:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.675144:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.675195:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.681249:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793771264 00000100:00100000:0.0:1746147720.681258:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793771264 00002000:00100000:0.0:1746147720.681293:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009172fb80 x1830967793771264/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 504/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147720.681301:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172fb80 with x1830967793771264 ext(1048576->2097151) 00002000:00010000:0.0:1746147720.681305:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009172fb80 00000100:00100000:0.0:1746147720.681334:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7127 00000100:00100000:0.0:1746147720.681341:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967793771264:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147720.718942:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.718992:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.727705:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.730617:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.756836:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.766167:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.768024:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147720.775373:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147720.784412:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.788753:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.788846:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.790713:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.792505:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.793204:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.793225:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793772928 00000100:00100000:0.0:1746147720.793231:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793772928 00002000:00100000:0.0:1746147720.793263:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1691648->1695743) req@ffff88012e384700 x1830967793772928/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147720.793271:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e384700 with x1830967793772928 ext(1691648->1695743) 00002000:00010000:0.0:1746147720.793276:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e384700 00000100:00100000:0.0:1746147720.793295:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793773312 00000100:00100000:0.0:1746147720.793298:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793773312 00002000:00100000:0.0:1746147720.793310:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3104768->3145727) req@ffff88012e384e00 x1830967793773312/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147720.793317:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e384e00 with x1830967793773312 ext(3104768->3145727) 00010000:00010000:0.0:1746147720.793324:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800aa62fa00/0xe64d3fbf12a7c8f7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf56 expref: 18 pid: 8184 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746147720.793337:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800aa62fa00/0xe64d3fbf12a7c8f7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf56 expref: 18 pid: 8184 timeout: 899 lvb_type: 0 00002000:00010000:0.0:1746147720.793343:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e384e00 00000100:00100000:0.0:1746147720.793360:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1397 00000100:00100000:0.0:1746147720.793367:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967793773312:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:0.0:1746147720.795434:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793773312:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 2067us (2229us total) trans 21474841498 rc 0/0 00000100:00100000:0.0:1746147720.795441:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1397 00002000:00100000:0.0:1746147720.795447:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3104768->3145727) req@ffff88012e384e00 x1830967793773312/t21474841498(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:341/0 lens 488/448 e 0 to 0 dl 1746147731 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147720.795454:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e384e00 with x1830967793773312 ext(3104768->3145727) 00010000:00010000:0.0:1746147720.795460:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800aa62fa00/0xe64d3fbf12a7c8f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf56 expref: 20 pid: 8184 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746147720.795470:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800aa62fa00/0xe64d3fbf12a7c8f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf56 expref: 20 pid: 8184 timeout: 899 lvb_type: 0 00002000:00010000:0.0:1746147720.795476:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e384e00 00000100:00100000:0.0:1746147720.796712:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.797859:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.800347:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.800390:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.807432:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.809149:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.809855:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.810172:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.810471:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793774464 00000100:00100000:1.0:1746147720.810479:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793774464 00002000:00100000:1.0:1746147720.810515:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009505c700 x1830967793774464/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147720.810524:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505c700 with x1830967793774464 ext(2097152->3145727) 00010000:00010000:1.0:1746147720.810531:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a615c00/0xe64d3fbf12a7c92f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf8e expref: 28 pid: 22183 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746147720.810544:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a615c00/0xe64d3fbf12a7c92f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf8e expref: 28 pid: 22183 timeout: 899 lvb_type: 0 00002000:00010000:1.0:1746147720.810549:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009505c700 00000100:00100000:1.0:1746147720.810718:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793774592 00000100:00100000:1.0:1746147720.810721:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793774592 00002000:00100000:1.0:1746147720.810734:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009505d500 x1830967793774592/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147720.810742:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505d500 with x1830967793774592 ext(3145728->4194303) 00010000:00010000:1.0:1746147720.810746:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a615c00/0xe64d3fbf12a7c92f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf8e expref: 29 pid: 22183 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746147720.810765:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a615c00/0xe64d3fbf12a7c92f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf8e expref: 29 pid: 22183 timeout: 899 lvb_type: 0 00002000:00010000:1.0:1746147720.810771:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009505d500 00000100:00100000:1.0:1746147720.813169:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7131 00000100:00100000:1.0:1746147720.813177:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967793774976:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147720.813191:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796382976:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147720.813211:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f818800/0xe64d3fbf12a7c959 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2449408->2617343] (req 2449408->2617343) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf9c expref: 20 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.813224:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f818800, rc 0) 00000100:00100000:0.0:1746147720.813253:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32000:x1830967793774208:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5663us (5830us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147720.813258:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16036 00000100:00100000:0.0:1746147720.813975:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.829501:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967793774976:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 16317us (19321us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147720.829512:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7131 00002000:00100000:1.0:1746147720.829520:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009505ca80 x1830967793774976/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 488/440 e 0 to 0 dl 1746147731 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147720.829529:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505ca80 with x1830967793774976 ext(3145728->4194303) 00002000:00010000:1.0:1746147720.829534:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009505ca80 00000100:00100000:0.0:1746147720.835720:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.835773:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.835857:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.836037:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793775744 00000100:00100000:1.0:1746147720.836045:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793775744 00010000:00010000:1.0:1746147720.836075:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a615c00/0xe64d3fbf12a7c92f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf8e expref: 28 pid: 22183 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147720.836107:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793775616 00000100:00100000:1.0:1746147720.836110:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793775616 00000100:00100000:1.0:1746147720.836127:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8126 00000100:00100000:1.0:1746147720.836134:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967793775744:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147720.836144:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147720.836162:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a615c00/0xe64d3fbf12a7c92f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf8e expref: 28 pid: 22183 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746147720.836173:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a615c00/0xe64d3fbf12a7c92f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf8e expref: 28 pid: 22183 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746147720.836193:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a615c00/0xe64d3fbf12a7c92f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf8e expref: 28 pid: 22183 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746147720.836211:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147720.836212:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147720.836218:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f818800/0xe64d3fbf12a7c959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2449408->2617343) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf9c expref: 19 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147720.836225:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f818800/0xe64d3fbf12a7c959 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2449408->2617343) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf9c expref: 19 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147720.836267:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f818800/0xe64d3fbf12a7c959 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2449408->2617343) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf9c expref: 19 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147720.836278:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d25500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796383104:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147720.836343:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147720.839094:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d25500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796383104:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147720.839110:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147720.839314:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967793775744:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3178us (3538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147720.839323:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8126 00000100:00100000:0.0:1746147720.839537:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.839600:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.839617:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793776128 00000100:00100000:0.0:1746147720.839622:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793776128 00000100:00100000:0.0:1746147720.840101:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16037 00000100:00100000:0.0:1746147720.840108:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967793776128:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147720.840116:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147720.840128:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136272a00/0xe64d3fbf12a7c983 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafafaa expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147720.840167:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796383232:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147720.840290:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147720.841608:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.842178:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.842215:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.842229:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793776256 00000100:00100000:0.0:1746147720.842233:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793776256 00000100:00100000:0.0:1746147720.842251:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793776384 00000100:00100000:0.0:1746147720.842253:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793776384 00000100:00100000:0.0:1746147720.842262:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793776512 00000100:00100000:0.0:1746147720.842263:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793776512 00000100:00100000:0.0:1746147720.842287:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16038 00000100:00100000:0.0:1746147720.842292:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967793776256:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147720.842302:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147720.842313:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136273400/0xe64d3fbf12a7c98a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafafb1 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147720.842343:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796383360:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147720.842391:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147720.842407:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16040 00000100:00100000:0.0:1746147720.842413:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:31995:x1830967793776512:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147720.842420:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147720.842427:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136273800/0xe64d3fbf12a7c998 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafafbf expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.842442:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f818800/0xe64d3fbf12a7c959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2449408->2617343) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf9c expref: 23 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.842447:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147720.842449:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147720.842451:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136273800/0xe64d3fbf12a7c998 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafbf expref: 28 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.842465:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f818800/0xe64d3fbf12a7c959 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2449408->2617343) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf9c expref: 23 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.842475:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f818800/0xe64d3fbf12a7c959 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2449408->2617343) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf9c expref: 23 pid: 22183 timeout: 900 lvb_type: 0 00000100:00100000:0.0:1746147720.842483:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796383488:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147720.842503:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147720.844878:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.846479:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796383488:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147720.846492:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136273800/0xe64d3fbf12a7c998 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafbf expref: 28 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147720.846502:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136273800, rc 0) 00000100:00100000:0.0:1746147720.846520:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:31995:x1830967793776512:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4107us (4304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147720.846525:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16040 00000100:00100000:0.0:1746147720.851845:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.851913:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.861448:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.869542:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.877103:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.877358:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.879253:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793777792 00000100:00100000:0.0:1746147720.879259:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793777792 00002000:00100000:0.0:1746147720.879295:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880094efa680 x1830967793777792/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 488/0 e 0 to 0 dl 1746147731 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147720.879303:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efa680 with x1830967793777792 ext(3145728->4194303) 00002000:00010000:0.0:1746147720.879306:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efa680 00000100:00100000:0.0:1746147720.879323:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7133 00000100:00100000:0.0:1746147720.879328:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967793777792:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147720.886235:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796383872:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147720.886258:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147720.886981:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967793777536:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 9126us (9883us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147720.886996:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8128 00000100:00100000:0.0:1746147720.888033:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.889809:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967793777792:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 10478us (12448us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147720.889817:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7133 00002000:00100000:1.0:1746147720.889823:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880094efa680 x1830967793777792/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:341/0 lens 488/440 e 0 to 0 dl 1746147731 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147720.889830:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efa680 with x1830967793777792 ext(3145728->4194303) 00002000:00010000:1.0:1746147720.889833:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efa680 00000100:00100000:0.0:1746147720.893039:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.905558:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.912668:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.920300:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.922327:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.930916:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.932496:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793779072 00000100:00100000:1.0:1746147720.932500:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793779072 00010000:00010000:1.0:1746147720.932519:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800aa62f800/0xe64d3fbf12a7c8b8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf33 expref: 34 pid: 8184 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147720.932794:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8129 00000100:00100000:1.0:1746147720.932801:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967793779072:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147720.932810:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147720.932829:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800aa62f800/0xe64d3fbf12a7c8b8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1085440->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf33 expref: 34 pid: 8184 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746147720.932838:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800aa62f800/0xe64d3fbf12a7c8b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1085440->1150975) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf33 expref: 34 pid: 8184 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746147720.932860:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147720.932862:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147720.932867:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7c9ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafd4 expref: 22 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147720.932874:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7c9ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafd4 expref: 22 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147720.932922:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7c9ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafd4 expref: 22 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147720.932931:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d24a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796384384:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147720.932978:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147720.937603:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796384640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746147720.937631:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1746147720.937668:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147720.937745:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091119c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1830967796385024:0@lo:400:kworker.0 00000100:00100000:0.0:1746147720.937781:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147720.937827:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a634195-95c6-4e3b-860d-2cf2df4961a5:3304:1830967796384768:0@lo:400:kworker.0 00000100:00100000:1.0:1746147720.937851:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147720.937871:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746147720.937874:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091119f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1830967796385152:0@lo:400:kworker.0 00000100:00100000:1.0:1746147720.937904:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1746147720.937920:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746147720.937922:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147720.937935:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796384640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746147720.938098:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091119f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1830967796385152:0@lo:400:kworker.0 00000100:00100000:0.0:1746147720.938313:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091119c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1830967796385024:0@lo:400:kworker.0 00000100:00100000:0.0:1746147720.938330:0:14541:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796384768 00000100:00100000:0.0:1746147720.938333:0:14541:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796384768 00000100:00100000:0.0:1746147720.938364:0:14541:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1746147720.938369:0:14541:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a634195-95c6-4e3b-860d-2cf2df4961a5+18:3304:x1830967796384768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147720.938396:0:14541:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a634195-95c6-4e3b-860d-2cf2df4961a5+18:3304:x1830967796384768:12345-0@lo:400:kworker.0 Request processed in 27us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147720.938401:0:14541:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1746147720.938482:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a634195-95c6-4e3b-860d-2cf2df4961a5:3304:1830967796384768:0@lo:400:kworker.0 00000100:00100000:0.0:1746147720.938727:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.939136:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d24a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796384384:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147720.939148:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147720.939172:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1958:x1830967793779072:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6372us (7095us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147720.939178:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8129 00000100:00100000:0.0:1746147720.959065:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.980237:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.997280:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.997319:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147720.997356:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147720.997767:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7139 00000100:00100000:1.0:1746147720.997774:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967793780480:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147721.027052:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967793780480:12345-192.168.202.10@tcp:3:cat.0 Request processed in 29269us (29723us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147721.027063:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7139 00002000:00100000:1.0:1746147721.027074:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009111a680 x1830967793780480/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:341/0 lens 488/440 e 0 to 0 dl 1746147731 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147721.027082:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111a680 with x1830967793780480 ext(3145728->4194303) 00002000:00010000:1.0:1746147721.027087:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009111a680 00000100:00100000:0.0:1746147721.044521:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.045069:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793780736 00000100:00100000:1.0:1746147721.045078:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793780736 00002000:00100000:1.0:1746147721.045118:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880091119f80 x1830967793780736/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:342/0 lens 488/0 e 0 to 0 dl 1746147732 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147721.045129:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091119f80 with x1830967793780736 ext(4194304->5017599) 00002000:00010000:1.0:1746147721.045134:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091119f80 00000100:00100000:1.0:1746147721.045168:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7141 00000100:00100000:1.0:1746147721.045175:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967793780736:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147721.073732:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967793780736:12345-192.168.202.10@tcp:3:cat.0 Request processed in 28550us (29210us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147721.073742:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7141 00002000:00100000:1.0:1746147721.073750:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880091119f80 x1830967793780736/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:342/0 lens 488/440 e 0 to 0 dl 1746147732 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147721.073769:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091119f80 with x1830967793780736 ext(4194304->5017599) 00002000:00010000:1.0:1746147721.073774:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091119f80 00000100:00100000:0.0:1746147721.097370:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.110186:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.110272:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.110364:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793781376 00000100:00100000:1.0:1746147721.110368:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793781376 00000100:00100000:1.0:1746147721.110397:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 896 00000100:00100000:1.0:1746147721.110402:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1957:x1830967793781376:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147721.110414:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147721.110433:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013503da00/0xe64d3fbf12a7c9de lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaff0 expref: 29 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.111168:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147721.111172:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147721.111193:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967793781376:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 790us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.111199:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 896 00000100:00100000:0.0:1746147721.115164:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.123093:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.123590:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.123658:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147721.125109:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147721.125113:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147721.129281:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793782144 00000100:00100000:1.0:1746147721.129286:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793782144 00002000:00100000:1.0:1746147721.129317:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x454:0x0] (1384448->1388543) req@ffff88012ee59f80 x1830967793782144/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:342/0 lens 488/0 e 0 to 0 dl 1746147732 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147721.129326:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee59f80 with x1830967793782144 ext(1384448->1388543) 00002000:00010000:1.0:1746147721.129331:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee59f80 00000100:00100000:1.0:1746147721.129344:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7142 00000100:00100000:1.0:1746147721.129350:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793782144:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147721.129470:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793782144:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 119us (257us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147721.129476:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7142 00002000:00100000:1.0:1746147721.129481:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x454:0x0] (1384448->1388543) req@ffff88012ee59f80 x1830967793782144/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:342/0 lens 488/4536 e 0 to 0 dl 1746147732 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147721.129488:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee59f80 with x1830967793782144 ext(1384448->1388543) 00002000:00010000:1.0:1746147721.129491:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee59f80 00000100:00100000:0.0:1746147721.133525:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.133581:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.133979:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793782272 00000100:00100000:1.0:1746147721.133986:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793782272 00010000:00010000:1.0:1746147721.134013:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e6400/0xe64d3fbf12a7c921 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf80 expref: 29 pid: 22183 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.134132:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793782400 00000100:00100000:1.0:1746147721.134134:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793782400 00010000:00010000:1.0:1746147721.134143:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e6c00/0xe64d3fbf12a7c991 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafb8 expref: 16 pid: 8469 timeout: 900 lvb_type: 1 00000100:00100000:0.0:1746147721.139855:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.146146:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.155072:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.158667:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.158704:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.163609:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.163649:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.174321:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.174415:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.176857:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793784320 00000100:00100000:0.0:1746147721.176864:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793784320 00000100:00100000:0.0:1746147721.176906:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16051 00000100:00100000:0.0:1746147721.176911:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967793784320:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147721.176919:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147721.176929:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136272600/0xe64d3fbf12a7ca24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb021 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147721.176960:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796386432:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147721.176994:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147721.181546:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.181572:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793784192 00000100:00100000:0.0:1746147721.181578:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793784192 00000100:00100000:0.0:1746147721.181619:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16052 00000100:00100000:0.0:1746147721.181626:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793784192:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147721.181642:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147721.181657:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136272e00/0xe64d3fbf12a7ca2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb01a expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.181676:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.181678:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.181685:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136272e00/0xe64d3fbf12a7ca2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb01a expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147721.181697:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136272e00/0xe64d3fbf12a7ca2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb01a expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147721.181706:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136272e00, rc 0) 00000100:00100000:0.0:1746147721.181735:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793784192:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 110us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147721.181740:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16052 00000100:00100000:0.0:1746147721.181788:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.181797:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793784448 00000100:00100000:0.0:1746147721.181800:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793784448 00000100:00100000:0.0:1746147721.181820:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16053 00000100:00100000:0.0:1746147721.181824:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793784448:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147721.181829:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147721.181835:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136273000/0xe64d3fbf12a7ca32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb028 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.181843:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.181845:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.181849:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136273000/0xe64d3fbf12a7ca32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb028 expref: 10 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147721.181856:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136273000/0xe64d3fbf12a7ca32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb028 expref: 10 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147721.181862:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136273000, rc 0) 00000100:00100000:0.0:1746147721.181874:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793784448:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 49us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147721.181878:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16053 00002000:00010000:1.0:1746147721.185701:0:22183:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime: 1746147721 -> 1746147722 00002000:00010000:1.0:1746147721.185707:0:22183:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime: 1746147721 -> 1746147722 00000100:00100000:1.0:1746147721.185727:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796386432:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147721.185767:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136272600/0xe64d3fbf12a7ca24 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb021 expref: 8 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.185779:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136272600/0xe64d3fbf12a7ca24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb021 expref: 8 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.185805:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136272600, rc 0) 00000100:00100000:1.0:1746147721.185840:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967793784320:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 8928us (10456us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147721.185848:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16051 00000100:00100000:0.0:1746147721.188867:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.191178:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11914 00000100:00100000:1.0:1746147721.191189:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+11:32015:x1830967793784704:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147721.191206:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.191223:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0600/0xe64d3fbf12a7ca39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb02f expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.191307:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7ca40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147721.191320:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013503d600/0xe64d3fbf12a7ca0f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb005 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.191326:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7ca40 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147721.191352:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013503d600/0xe64d3fbf12a7ca0f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb005 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.191367:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013503d600/0xe64d3fbf12a7ca0f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb005 expref: 12 pid: 17544 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.191378:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d27b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796386560:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147721.191447:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147721.194969:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.195047:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d27b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796386560:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147721.195067:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7ca40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147721.195779:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7ca40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147721.195787:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7ca40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:1.0:1746147721.195804:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147721.195946:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0600/0xe64d3fbf12a7ca39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb02f expref: 13 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.195972:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7ca40 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb02f expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.195979:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147721.195981:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147721.195983:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935e1800, rc 0) 00000100:00100000:1.0:1746147721.196010:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+12:32015:x1830967793784704:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 4825us (7151us total) trans 8589945910 rc 0/0 00000100:00100000:1.0:1746147721.196019:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11914 00000100:00100000:0.0:1746147721.200465:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.200565:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793784960 00000100:00100000:1.0:1746147721.200572:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793784960 00000100:00100000:1.0:1746147721.200673:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11915 00000100:00100000:1.0:1746147721.200680:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+12:32015:x1830967793784960:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147721.200702:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.200720:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca4e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb036 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.200797:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7ca55 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147721.200809:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7ca40 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb02f expref: 13 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.200815:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7ca55 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147721.200839:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7ca40 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb02f expref: 13 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.200849:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7ca40 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb02f expref: 13 pid: 14547 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.200859:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d27b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796386688:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147721.201481:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147721.203602:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d27b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796386688:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147721.203626:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7ca55 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746147721.204118:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.208529:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.208680:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.229409:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.229457:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.229598:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.229630:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.229659:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793785728 00000100:00100000:0.0:1746147721.229669:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793785728 00000100:00100000:0.0:1746147721.229714:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793785856 00000100:00100000:0.0:1746147721.229716:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793785856 00000100:00100000:0.0:1746147721.229726:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793786112 00000100:00100000:0.0:1746147721.229728:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793786112 00000100:00100000:0.0:1746147721.229832:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16057 00000100:00100000:0.0:1746147721.229838:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793785984:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:0.0:1746147721.229862:0:7050:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7ca86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.229875:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7c9ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafd4 expref: 23 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.229911:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136272e00/0xe64d3fbf12a7ca2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb01a expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147721.229917:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.229918:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.229920:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7ca86 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.229937:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136272e00/0xe64d3fbf12a7ca2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb01a expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147721.229945:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136272e00/0xe64d3fbf12a7ca2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb01a expref: 9 pid: 10613 timeout: 900 lvb_type: 1 00000100:00100000:0.0:1746147721.229955:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796387200:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147721.230001:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16059 00000100:00100000:1.0:1746147721.230009:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793786112:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:1.0:1746147721.230028:0:22183:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.230038:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7c42e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac70 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.230046:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0357a00/0xe64d3fbf12a7c531 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacd9 expref: 27 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.230052:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130eea600/0xe64d3fbf12a7c4e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacaf expref: 14 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.230062:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.230064:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.230066:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca94 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.230089:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130eea600/0xe64d3fbf12a7c4e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacaf expref: 14 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.230096:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130eea600/0xe64d3fbf12a7c4e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacaf expref: 14 pid: 4591 timeout: 900 lvb_type: 1 00000100:00100000:1.0:1746147721.230105:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796387584:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147721.231118:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7c9ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafd4 expref: 23 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.231131:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7c9ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafd4 expref: 23 pid: 4591 timeout: 900 lvb_type: 0 00000100:00100000:0.0:1746147721.231145:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796387712:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147721.231172:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147721.231335:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.231363:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793786368 00000100:00100000:0.0:1746147721.231369:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793786368 00000100:00100000:0.0:1746147721.231408:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16060 00000100:00100000:0.0:1746147721.231415:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793786368:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:0.0:1746147721.231443:0:10613:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7ca9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.231456:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136273800/0xe64d3fbf12a7c998 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafbf expref: 29 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.231463:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136273000/0xe64d3fbf12a7ca32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb028 expref: 10 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147721.231469:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c9c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafe9 expref: 23 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.231475:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.231476:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.231478:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7ca9b lrc: 6/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.231494:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c9c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafe9 expref: 23 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.231506:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c9c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafe9 expref: 23 pid: 4591 timeout: 900 lvb_type: 0 00000100:00100000:0.0:1746147721.231514:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796387840:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147721.231542:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136273000/0xe64d3fbf12a7ca32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb028 expref: 10 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147721.231548:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136273000/0xe64d3fbf12a7ca32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb028 expref: 10 pid: 10613 timeout: 900 lvb_type: 1 00000100:00100000:0.0:1746147721.231555:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796387968:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147721.231578:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136273800/0xe64d3fbf12a7c998 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafbf expref: 29 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.231585:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136273800/0xe64d3fbf12a7c998 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafbf expref: 29 pid: 20619 timeout: 900 lvb_type: 0 00000100:00100000:0.0:1746147721.231592:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796388096:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147721.231648:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0357a00/0xe64d3fbf12a7c531 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacd9 expref: 27 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.231656:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0357a00/0xe64d3fbf12a7c531 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacd9 expref: 27 pid: 8469 timeout: 900 lvb_type: 1 00000100:00100000:1.0:1746147721.231662:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d24000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796388352:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147721.231681:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7c42e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac70 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.231687:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7c42e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafac70 expref: 8 pid: 8184 timeout: 900 lvb_type: 1 00000100:00100000:1.0:1746147721.231693:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796388480:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147721.231704:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147721.231790:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147721.232164:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.242012:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.242257:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796387200:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147721.242270:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796387712:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147721.242304:0:7050:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7ca86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147721.249177:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.249193:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.249237:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796387584:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147721.249247:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d24000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796388352:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147721.249255:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796388480:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147721.249276:0:22183:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147721.249776:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.249789:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.249807:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.249820:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.249833:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.249842:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.249852:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.249863:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.249874:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.249927:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.249951:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796387456:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147721.249963:0:4591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013503ce00/0xe64d3fbf12a7ca8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147721.250098:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8140 00000100:00100000:0.0:1746147721.250104:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2379850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967793787520:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147721.250113:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147721.250129:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136273800/0xe64d3fbf12a7c998 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafbf expref: 30 pid: 20619 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746147721.250137:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136273800/0xe64d3fbf12a7c998 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafbf expref: 30 pid: 20619 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746147721.250149:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136273800/0xe64d3fbf12a7c998 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafbf expref: 30 pid: 20619 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746147721.250161:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147721.250176:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2379850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967793787520:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 73us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147721.250181:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8140 00000100:00100000:0.0:1746147721.250214:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8142 00000100:00100000:0.0:1746147721.250218:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793787392:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147721.250223:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147721.250230:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013503cc00/0xe64d3fbf12a7ca16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb00c expref: 10 pid: 4591 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746147721.250241:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013503cc00/0xe64d3fbf12a7ca16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb00c expref: 9 pid: 4591 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746147721.250251:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013503cc00/0xe64d3fbf12a7ca16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb00c expref: 9 pid: 4591 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746147721.250267:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147721.250279:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793787392:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 61us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147721.250284:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8142 00000100:00100000:0.0:1746147721.250294:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8144 00000100:00100000:0.0:1746147721.250298:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967793787904:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147721.250304:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147721.250310:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130eea600/0xe64d3fbf12a7c4e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacaf expref: 14 pid: 4591 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746147721.250317:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130eea600/0xe64d3fbf12a7c4e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacaf expref: 14 pid: 4591 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746147721.250326:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130eea600/0xe64d3fbf12a7c4e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacaf expref: 14 pid: 4591 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746147721.250333:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147721.250345:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967793787904:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 47us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147721.250353:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8144 00000100:00100000:0.0:1746147721.250362:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8146 00000100:00100000:0.0:1746147721.250365:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967793787008:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147721.250371:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147721.250377:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0357a00/0xe64d3fbf12a7c531 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacd9 expref: 27 pid: 8469 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746147721.250384:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0357a00/0xe64d3fbf12a7c531 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacd9 expref: 27 pid: 8469 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746147721.250392:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0357a00/0xe64d3fbf12a7c531 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacd9 expref: 27 pid: 8469 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746147721.250399:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.250401:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.250403:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.250410:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca94 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.250425:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147721.250440:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967793787008:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 73us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147721.250445:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8146 00000100:00100000:0.0:1746147721.250455:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8148 00000100:00100000:0.0:1746147721.250460:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1957:x1830967793788032:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147721.250465:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147721.250471:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c9c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafe9 expref: 23 pid: 4591 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746147721.250479:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c9c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafe9 expref: 23 pid: 4591 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746147721.250488:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e6e00/0xe64d3fbf12a7c9c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafafe9 expref: 23 pid: 4591 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746147721.250495:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.250496:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.250498:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7ca9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.250504:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7ca9b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.250515:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147721.250524:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967793788032:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 64us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147721.250529:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8148 00010000:00010000:0.0:1746147721.250548:0:22183:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.250555:0:22183:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.250577:0:22183:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.250584:0:22183:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.250590:0:22183:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.250596:0:22183:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800935e1400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147721.250600:0:22183:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.250606:0:22183:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.250614:0:22183:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca94 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.250619:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935e1400/0xe64d3fbf12a7ca94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147721.250662:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1405 00000100:00100000:0.0:1746147721.250666:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967793787136:12345-192.168.202.10@tcp:4:multiop.0 00010000:00010000:1.0:1746147721.252023:0:7050:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7ca86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.252034:0:7050:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7ca86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.252055:0:7050:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7ca86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.252061:0:7050:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7ca86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.252067:0:7050:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7ca86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.252072:0:7050:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136272400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147721.252075:0:7050:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7ca86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.252081:0:7050:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7ca86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.252092:0:7050:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7ca86 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.252098:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7ca86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147721.252163:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967793785984:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 22324us (22705us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.252171:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16057 00000100:00100000:0.0:1746147721.252823:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967793786112:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 22813us (23190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147721.252829:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16059 00000100:00100000:0.0:1746147721.264097:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147721.264866:0:4591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013503ce00/0xe64d3fbf12a7ca8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.264877:0:4591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013503ce00/0xe64d3fbf12a7ca8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.264925:0:4591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013503ce00/0xe64d3fbf12a7ca8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.264932:0:4591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013503ce00/0xe64d3fbf12a7ca8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.264940:0:4591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013503ce00/0xe64d3fbf12a7ca8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.264947:0:4591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013503ce00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147721.264950:0:4591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013503ce00/0xe64d3fbf12a7ca8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.264957:0:4591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013503ce00/0xe64d3fbf12a7ca8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.264967:0:4591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013503ce00/0xe64d3fbf12a7ca8d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.264973:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013503ce00/0xe64d3fbf12a7ca8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147721.265019:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967793785856:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 35171us (35420us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.265026:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16058 00000100:00100000:0.0:1746147721.290811:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.302426:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.319613:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.321459:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.321576:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.321603:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793788672 00000100:00100000:0.0:1746147721.321611:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793788672 00010000:00010000:0.0:1746147721.321647:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62ec00/0xe64d3fbf12a7c8d4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafaf3a expref: 28 pid: 14546 timeout: 900 lvb_type: 0 00000100:00100000:0.0:1746147721.321671:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793788800 00000100:00100000:0.0:1746147721.321674:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793788800 00010000:00010000:0.0:1746147721.321683:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0259a00/0xe64d3fbf12a7c5d2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad5e expref: 334 pid: 14546 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.322316:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793789056 00000100:00100000:1.0:1746147721.322321:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793789056 00000100:00100000:1.0:1746147721.322349:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4939 00000100:00100000:1.0:1746147721.322354:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:7669:x1830967793789056:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147721.322547:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:7669:x1830967793789056:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 193us (2947us total) trans 8589945912 rc 0/0 00000100:00100000:1.0:1746147721.322554:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4939 00000100:00100000:0.0:1746147721.327183:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.327218:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.327245:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.327257:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793789184 00000100:00100000:1.0:1746147721.327266:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793789184 00010000:00010000:1.0:1746147721.327308:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0264c00/0xe64d3fbf12a7c569 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad0a expref: 28 pid: 14546 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.327336:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793789440 00000100:00100000:1.0:1746147721.327339:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793789440 00010000:00010000:1.0:1746147721.327352:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd6dc00/0xe64d3fbf12a7c554 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafacfc expref: 333 pid: 14546 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.327367:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793789312 00000100:00100000:1.0:1746147721.327369:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793789312 00010000:00010000:1.0:1746147721.327377:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed2800/0xe64d3fbf12a7c562 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad03 expref: 334 pid: 14545 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.327392:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8153 00000100:00100000:1.0:1746147721.327400:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793789184:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147721.327415:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147721.327420:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0264c00/0xe64d3fbf12a7c569 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad0a expref: 28 pid: 14546 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746147721.327432:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0264c00/0xe64d3fbf12a7c569 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad0a expref: 28 pid: 14546 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746147721.327455:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147721.327460:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880134ede400/0xe64d3fbf12a7caa9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147721.327469:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147721.327576:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.327721:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793789568 00000100:00100000:0.0:1746147721.327725:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793789568 00010000:00010000:0.0:1746147721.327739:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801317ac200/0xe64d3fbf12a7c6b9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadce expref: 29 pid: 14546 timeout: 900 lvb_type: 0 00000100:00100000:0.0:1746147721.327765:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8155 00000100:00100000:0.0:1746147721.327770:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:1960:x1830967793789312:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147721.327781:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147721.327785:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed2800/0xe64d3fbf12a7c562 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad03 expref: 334 pid: 14545 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746147721.327791:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed2800/0xe64d3fbf12a7c562 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafad03 expref: 334 pid: 14545 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746147721.327801:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147721.327804:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880134ede400/0xe64d3fbf12a7caa9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147721.327808:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147721.327826:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:1960:x1830967793789312:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 56us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147721.327832:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8155 00000100:00100000:0.0:1746147721.327846:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8156 00000100:00100000:0.0:1746147721.327851:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1957:x1830967793789568:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147721.327858:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147721.327861:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801317ac200/0xe64d3fbf12a7c6b9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadce expref: 29 pid: 14546 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746147721.327869:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801317ac200/0xe64d3fbf12a7c6b9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadce expref: 29 pid: 14546 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746147721.327879:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801317ac200/0xe64d3fbf12a7c6b9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafadce expref: 29 pid: 14546 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746147721.327925:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147721.327929:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880134ede400/0xe64d3fbf12a7caa9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147721.327936:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ede400/0xe64d3fbf12a7caa9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147721.327943:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ede400/0xe64d3fbf12a7caa9 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147721.327964:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147721.327978:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967793789568:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 126us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147721.327984:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8156 00000100:00100000:1.0:1746147721.328092:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793789184:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 219us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.328099:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8153 00000001:00080000:1.0:1746147721.390663:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945912 is committed 00000001:00080000:1.0:1746147721.390679:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945910 is committed 00000001:00080000:1.0:1746147721.390692:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945913 is committed 00000004:00080000:1.0:1746147721.390696:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2679 committed 00000004:00080000:1.0:1746147721.390704:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2662 committed 00000004:00080000:1.0:1746147721.390711:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2661 committed 00000004:00080000:1.0:1746147721.390713:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2660 committed 00000004:00080000:1.0:1746147721.390715:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2659 committed 00000004:00080000:1.0:1746147721.390716:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2678 committed 00000004:00080000:1.0:1746147721.390718:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2658 committed 00000004:00080000:1.0:1746147721.390719:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2677 committed 00000004:00080000:1.0:1746147721.390721:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2657 committed 00000004:00080000:1.0:1746147721.390723:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2676 committed 00000004:00080000:1.0:1746147721.390724:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2675 committed 00000004:00080000:1.0:1746147721.390726:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2674 committed 00000004:00080000:1.0:1746147721.390727:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2656 committed 00000004:00080000:1.0:1746147721.390729:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2655 committed 00000004:00080000:1.0:1746147721.390730:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2673 committed 00000004:00080000:1.0:1746147721.390734:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2672 committed 00000004:00080000:1.0:1746147721.390735:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2654 committed 00000001:00080000:1.0:1746147721.390767:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945899 is committed 00000001:00080000:1.0:1746147721.390797:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945908 is committed 00000100:00100000:0.0:1746147721.391264:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796389504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147721.391330:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.391679:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796389888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.391703:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.391718:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796390400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.391731:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.391762:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796390912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147721.391779:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.391791:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796391424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147721.391803:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.391814:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1746147721.391817:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796390016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147721.391830:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.391839:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796390528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.391851:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.391861:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796391040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147721.391873:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.391910:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796389504 00000100:00100000:1.0:1746147721.391917:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796389504 00000100:00100000:1.0:1746147721.391946:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796389888 00000100:00100000:1.0:1746147721.391948:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796389888 00000100:00100000:1.0:1746147721.391958:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796390400 00000100:00100000:1.0:1746147721.391959:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796390400 00000100:00100000:1.0:1746147721.391968:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796390912 00000100:00100000:1.0:1746147721.391969:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796390912 00000100:00100000:1.0:1746147721.391977:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796391424 00000100:00100000:1.0:1746147721.391979:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796391424 00000100:00100000:1.0:1746147721.391984:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796390016 00000100:00100000:1.0:1746147721.391986:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796390016 00000100:00100000:1.0:1746147721.391992:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796390528 00000100:00100000:1.0:1746147721.391994:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796390528 00000100:00100000:1.0:1746147721.391999:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796391040 00000100:00100000:1.0:1746147721.392001:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796391040 00000100:00100000:1.0:1746147721.392006:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796389632 00000100:00100000:1.0:1746147721.392007:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796389632 00000100:00100000:1.0:1746147721.392014:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16062 00000100:00100000:1.0:1746147721.392019:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3304:x1830967796389504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.393142:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3304:x1830967796389504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1122us (1812us total) trans 17179874268 rc 0/0 00000100:00100000:1.0:1746147721.393152:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16062 00000100:00100000:1.0:1746147721.393162:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16070 00000100:00100000:1.0:1746147721.393168:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3301:x1830967796389632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147721.393731:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3301:x1830967796389632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 562us (1807us total) trans 21474841508 rc 0/0 00000100:00100000:1.0:1746147721.393736:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16070 00000100:00100000:1.0:1746147721.393746:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16076 00000100:00100000:1.0:1746147721.393764:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3301:x1830967796390784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147721.393842:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3301:x1830967796390784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (1707us total) trans 21474841509 rc 0/0 00000100:00100000:1.0:1746147721.393848:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16076 00000004:00080000:0.0:1746147721.394393:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d0dd500/2, rc 0, transno 17179874268 00000100:00100000:0.0:1746147721.394407:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796389504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147721.394655:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796391552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147721.394684:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.394842:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796391552 00000100:00100000:1.0:1746147721.394847:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796391552 00000100:00100000:1.0:1746147721.394870:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16078 00000100:00100000:1.0:1746147721.394874:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3304:x1830967796391552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.394994:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3304:x1830967796391552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (309us total) trans 17179874273 rc 0/0 00000100:00100000:1.0:1746147721.395000:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16078 00000004:00080000:0.0:1746147721.395061:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc13480/2, rc 0, transno 17179874273 00000100:00100000:0.0:1746147721.395065:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796391552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147721.395789:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.396764:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3303:x1830967796390528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3763us (4897us total) trans 17179874275 rc 0/0 00000100:00100000:0.0:1746147721.396770:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16068 00000100:00100000:0.0:1746147721.402463:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.410874:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.412698:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.415661:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.415736:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.417013:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.417047:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.417104:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793790336 00000100:00100000:1.0:1746147721.417109:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793790336 00000100:00100000:1.0:1746147721.417136:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793790592 00000100:00100000:1.0:1746147721.417138:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793790592 00000100:00100000:1.0:1746147721.417162:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16083 00000100:00100000:1.0:1746147721.417171:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793790336:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147721.417181:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.417192:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935e1000/0xe64d3fbf12a7cae1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb075 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147721.417210:0:8184:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x68141986, atime: 0x68141986, ctime: 0x68141986, blocks: 0x81f 00010000:00010000:1.0:1746147721.417221:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.417222:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.417228:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935e1000/0xe64d3fbf12a7cae1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb075 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.417242:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935e1000/0xe64d3fbf12a7cae1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb075 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.417250:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935e1000, rc 0) 00000100:00100000:1.0:1746147721.417286:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793790336:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 117us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.417293:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16083 00000100:00100000:1.0:1746147721.417312:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16084 00000100:00100000:1.0:1746147721.417319:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793790592:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147721.417328:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.417340:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935e0000/0xe64d3fbf12a7cae8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb083 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147721.417356:0:8184:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x456:0x0] initial LVB size: 4194304, mtime: 0x68141989, atime: 0x68141989, ctime: 0x68141989, blocks: 0x1029 00010000:00010000:1.0:1746147721.417367:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.417368:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.417374:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935e0000/0xe64d3fbf12a7cae8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb083 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.417385:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935e0000/0xe64d3fbf12a7cae8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb083 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.417392:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935e0000, rc 0) 00000100:00100000:1.0:1746147721.417410:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793790592:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 92us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.417414:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16084 00000100:00100000:0.0:1746147721.425422:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.425490:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.426617:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7145 00000100:00100000:0.0:1746147721.426626:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967793790848:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:0.0:1746147721.426665:0:2402:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013013b000/0xe64d3fbf12a7caef lrc: 3/1,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.426679:0:2402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.426681:0:2402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.426685:0:2402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013013b000/0xe64d3fbf12a7caef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.426697:0:2402:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013013b000/0xe64d3fbf12a7caef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147721.437325:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.437367:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.451664:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.451712:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.451767:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.451788:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.451805:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793792128 00000100:00100000:0.0:1746147721.451809:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793792128 00000100:00100000:0.0:1746147721.451834:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793792640 00000100:00100000:0.0:1746147721.451837:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793792640 00000100:00100000:0.0:1746147721.451869:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7150 00000100:00100000:0.0:1746147721.451875:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41587371-240a-4781-aecb-638f17200fbd+14:1957:x1830967793792128:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:0.0:1746147721.451916:0:21459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7cb12 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.451927:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.451930:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147721.451934:0:21459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7cb12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.451947:0:21459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7cb12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.452738:0:2402:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013013b000/0xe64d3fbf12a7caef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.452761:0:2402:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013013b000/0xe64d3fbf12a7caef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.452767:0:2402:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013013b000/0xe64d3fbf12a7caef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.452773:0:2402:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013013b000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147721.452776:0:2402:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013013b000/0xe64d3fbf12a7caef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.452783:0:2402:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013013b000/0xe64d3fbf12a7caef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.452799:0:2402:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013013b000/0xe64d3fbf12a7caef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.452809:0:2402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013013b000/0xe64d3fbf12a7caef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147721.452906:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41587371-240a-4781-aecb-638f17200fbd+13:1958:x1830967793790848:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 26278us (27490us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147721.452915:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7145 00000100:00100000:1.0:1746147721.452942:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7151 00000100:00100000:1.0:1746147721.452951:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967793792384:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:1.0:1746147721.452979:0:2402:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136272200/0xe64d3fbf12a7cb19 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.452988:0:2402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.452990:0:2402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.452995:0:2402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136272200/0xe64d3fbf12a7cb19 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.453004:0:2402:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136272200/0xe64d3fbf12a7cb19 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.453841:0:31356:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7600/0xe64d3fbf12a7caf6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.453852:0:31356:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7600/0xe64d3fbf12a7caf6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.453859:0:31356:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7600/0xe64d3fbf12a7caf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.453865:0:31356:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02e7600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147721.453868:0:31356:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7600/0xe64d3fbf12a7caf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.453874:0:31356:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7600/0xe64d3fbf12a7caf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.453905:0:31356:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7600/0xe64d3fbf12a7caf6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.453915:0:31356:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7600/0xe64d3fbf12a7caf6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147721.453958:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41587371-240a-4781-aecb-638f17200fbd+14:1958:x1830967793791104:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 27301us (28467us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147721.453965:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7146 00010000:00010000:0.0:1746147721.470951:0:21459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7cb12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.470969:0:21459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7cb12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.470977:0:21459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7cb12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.470984:0:21459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013013b200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147721.470988:0:21459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7cb12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.470996:0:21459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7cb12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.471018:0:21459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7cb12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147721.471025:0:21459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7cb12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147721.471157:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967793792128:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 19276us (19437us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147721.471169:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7150 00010000:00010000:1.0:1746147721.475186:0:2402:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136272200/0xe64d3fbf12a7cb19 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.475205:0:2402:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136272200/0xe64d3fbf12a7cb19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.475214:0:2402:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136272200/0xe64d3fbf12a7cb19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.475221:0:2402:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136272200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147721.475225:0:2402:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136272200/0xe64d3fbf12a7cb19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.475232:0:2402:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136272200/0xe64d3fbf12a7cb19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.475250:0:2402:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136272200/0xe64d3fbf12a7cb19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.475256:0:2402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136272200/0xe64d3fbf12a7cb19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147721.476229:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967793792384:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 23271us (24451us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147721.476242:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7151 00000100:00100000:0.0:1746147721.489539:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.493813:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793793024 00000100:00100000:0.0:1746147721.493823:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793793024 00000100:00100000:0.0:1746147721.493875:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16085 00000100:00100000:0.0:1746147721.494073:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793793024:12345-192.168.202.10@tcp:2:lfs.0 00002000:00010000:0.0:1746147721.494411:0:22183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147721.494413:0:22183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147721 -> 1746147722 00002000:00010000:0.0:1746147721.494415:0:22183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147721 -> 1746147722 00002000:00010000:0.0:1746147721.494417:0:22183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147720 -> 1746147722 00002000:00010000:0.0:1746147721.494419:0:22183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:1.0:1746147721.494459:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16088 00000100:00100000:1.0:1746147721.494466:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967793793664:12345-192.168.202.10@tcp:2:lfs.0 00002000:00010000:1.0:1746147721.494527:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147721.494529:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147721 -> 1746147722 00002000:00010000:1.0:1746147721.494531:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147721 -> 1746147722 00002000:00010000:1.0:1746147721.494532:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147721 -> 1746147722 00002000:00010000:1.0:1746147721.494535:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147721.495115:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967793793024:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 1233us (1411us total) trans 17179874277 rc 0/0 00000100:00100000:0.0:1746147721.495120:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16085 00000100:00100000:1.0:1746147721.495311:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967793793664:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 845us (1307us total) trans 21474841512 rc 0/0 00000100:00100000:1.0:1746147721.495316:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16088 00000100:00100000:0.0:1746147721.501212:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.514007:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000001:00080000:1.0:1746147721.549364:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945915 is committed 00000004:00080000:1.0:1746147721.549374:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2687 committed 00000004:00080000:1.0:1746147721.549382:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2671 committed 00000004:00080000:1.0:1746147721.549387:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2670 committed 00000004:00080000:1.0:1746147721.549389:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2669 committed 00000004:00080000:1.0:1746147721.549391:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2668 committed 00000004:00080000:1.0:1746147721.549392:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2686 committed 00000004:00080000:1.0:1746147721.549394:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2667 committed 00000004:00080000:1.0:1746147721.549395:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2685 committed 00000004:00080000:1.0:1746147721.549397:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2666 committed 00000004:00080000:1.0:1746147721.549398:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2684 committed 00000004:00080000:1.0:1746147721.549400:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2683 committed 00000004:00080000:1.0:1746147721.549401:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2682 committed 00000004:00080000:1.0:1746147721.549403:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2665 committed 00000004:00080000:1.0:1746147721.549404:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2664 committed 00000004:00080000:1.0:1746147721.549406:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2681 committed 00000004:00080000:1.0:1746147721.549407:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2680 committed 00000004:00080000:1.0:1746147721.549409:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2663 committed 00000100:00100000:0.0:1746147721.550352:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796391936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147721.550380:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796392192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.551096:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796391808 00000100:00100000:1.0:1746147721.551104:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796391808 00000100:00100000:1.0:1746147721.551135:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796392320 00000100:00100000:1.0:1746147721.551138:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796392320 00000100:00100000:1.0:1746147721.551148:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796392832 00000100:00100000:1.0:1746147721.551150:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796392832 00000100:00100000:1.0:1746147721.551161:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796392064 00000100:00100000:1.0:1746147721.551163:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796392064 00000100:00100000:1.0:1746147721.551174:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16091 00000100:00100000:1.0:1746147721.551180:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3301:x1830967796391808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147721.551371:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147721.551374:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147722 -> 1746147722 00002000:00010000:1.0:1746147721.551376:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147722 -> 1746147722 00002000:00010000:1.0:1746147721.551378:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147722 -> 1746147722 00002000:00010000:1.0:1746147721.551379:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:1.0:1746147721.551404:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3301:x1830967796391808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 224us (1716us total) trans 17179874279 rc 0/0 00000100:00100000:1.0:1746147721.551410:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16091 00000100:00100000:1.0:1746147721.551422:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16092 00000100:00100000:1.0:1746147721.551426:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3301:x1830967796392320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.551506:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3301:x1830967796392320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (1760us total) trans 17179874280 rc 0/0 00000100:00100000:1.0:1746147721.551511:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16092 00000100:00100000:1.0:1746147721.551520:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16093 00000100:00100000:1.0:1746147721.551525:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3301:x1830967796392832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147721.551621:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147721.551624:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147722 -> 1746147722 00002000:00010000:1.0:1746147721.551626:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147722 -> 1746147722 00002000:00010000:1.0:1746147721.551628:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147722 -> 1746147722 00002000:00010000:1.0:1746147721.551630:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147721.551649:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3301:x1830967796392832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (1857us total) trans 21474841514 rc 0/0 00000100:00100000:1.0:1746147721.551654:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16093 00000100:00100000:1.0:1746147721.551663:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16094 00000100:00100000:1.0:1746147721.551668:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3303:x1830967796392064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147721.551734:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:1.0:1746147721.551736:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147722 -> 1746147722 00002000:00010000:1.0:1746147721.551738:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147722 -> 1746147722 00002000:00010000:1.0:1746147721.551740:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147722 -> 1746147722 00002000:00010000:1.0:1746147721.551742:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:1.0:1746147721.551772:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3303:x1830967796392064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (978us total) trans 17179874281 rc 0/0 00000100:00100000:1.0:1746147721.551777:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16094 00010000:00010000:0.0:1746147721.552494:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819e00/0xe64d3fbf12a7cb2e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16639 initiator: MDT0 00010000:00010000:0.0:1746147721.552506:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819e00/0xe64d3fbf12a7cb2e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16639 initiator: MDT0 00010000:00010000:0.0:1746147721.552514:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819e00/0xe64d3fbf12a7cb2e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16639 initiator: MDT0 00010000:00010000:0.0:1746147721.552523:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f819e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147721.552527:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819e00/0xe64d3fbf12a7cb2e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16639 initiator: MDT0 00010000:00010000:0.0:1746147721.552534:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819e00/0xe64d3fbf12a7cb2e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16639 initiator: MDT0 00010000:00010000:0.0:1746147721.552548:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147721.552550:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147721.552554:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819e00/0xe64d3fbf12a7cb2e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16639 initiator: MDT0 00010000:00010000:0.0:1746147721.552558:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819e00/0xe64d3fbf12a7cb2e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16639 initiator: MDT0 00000100:00100000:0.0:1746147721.553563:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147721.553581:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796392448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147721.553599:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147721.553609:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796392960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.553622:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147721.553632:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796393472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.553645:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147721.553664:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147721.553678:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796392704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147721.553693:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147721.553703:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796393216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.553716:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147721.553726:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796393728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.553739:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147721.553771:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796391936 00000100:00100000:0.0:1746147721.553774:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796391936 00000100:00100000:0.0:1746147721.553786:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796392448 00000100:00100000:0.0:1746147721.553788:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796392448 00000100:00100000:0.0:1746147721.553793:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796392960 00000100:00100000:0.0:1746147721.553795:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796392960 00000100:00100000:0.0:1746147721.553801:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796393472 00000100:00100000:0.0:1746147721.553803:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796393472 00000100:00100000:0.0:1746147721.553808:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796392192 00000100:00100000:0.0:1746147721.553810:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796392192 00000100:00100000:0.0:1746147721.553816:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796392704 00000100:00100000:0.0:1746147721.553818:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796392704 00000100:00100000:0.0:1746147721.553824:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796393216 00000100:00100000:0.0:1746147721.553825:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796393216 00000100:00100000:0.0:1746147721.553831:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796393728 00000100:00100000:0.0:1746147721.553833:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796393728 00000100:00100000:0.0:1746147721.553840:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16099 00000100:00100000:0.0:1746147721.553845:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3302:x1830967796391936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147721.553959:0:21480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147721.553961:0:21480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147722 -> 1746147722 00002000:00010000:0.0:1746147721.553963:0:21480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147722 -> 1746147722 00002000:00010000:0.0:1746147721.553965:0:21480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147722 -> 1746147722 00002000:00010000:0.0:1746147721.553967:0:21480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147721.553990:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3302:x1830967796391936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (428us total) trans 17179874283 rc 0/0 00000100:00100000:0.0:1746147721.553995:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16099 00000100:00100000:0.0:1746147721.554007:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16100 00000100:00100000:0.0:1746147721.554011:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3302:x1830967796392448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147721.554087:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3302:x1830967796392448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (486us total) trans 17179874284 rc 0/0 00000100:00100000:0.0:1746147721.554092:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16100 00000100:00100000:0.0:1746147721.554101:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16101 00000100:00100000:0.0:1746147721.554105:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3302:x1830967796392960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147721.554176:0:21480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147721.554179:0:21480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147722 -> 1746147722 00002000:00010000:0.0:1746147721.554181:0:21480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147722 -> 1746147722 00002000:00010000:0.0:1746147721.554183:0:21480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147722 -> 1746147722 00002000:00010000:0.0:1746147721.554184:0:21480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147721.554202:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3302:x1830967796392960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (578us total) trans 21474841518 rc 0/0 00000100:00100000:0.0:1746147721.554207:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16101 00000100:00100000:0.0:1746147721.554216:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16102 00000100:00100000:0.0:1746147721.554220:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3302:x1830967796393472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.554288:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3302:x1830967796393472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (641us total) trans 21474841519 rc 0/0 00000100:00100000:0.0:1746147721.554293:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16102 00000100:00100000:0.0:1746147721.554301:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16103 00000100:00100000:0.0:1746147721.554305:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3304:x1830967796392192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147721.554377:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3304:x1830967796392192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (712us total) trans 17179874285 rc 0/0 00000100:00100000:0.0:1746147721.554382:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16103 00000100:00100000:0.0:1746147721.554390:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16104 00000100:00100000:0.0:1746147721.554394:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3304:x1830967796392704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147721.554461:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3304:x1830967796392704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (767us total) trans 17179874286 rc 0/0 00000100:00100000:0.0:1746147721.554465:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16104 00000100:00100000:0.0:1746147721.554474:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16105 00000100:00100000:0.0:1746147721.554478:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3304:x1830967796393216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.554554:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3304:x1830967796393216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (837us total) trans 21474841520 rc 0/0 00000100:00100000:0.0:1746147721.554559:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16105 00000100:00100000:0.0:1746147721.554567:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16106 00000100:00100000:0.0:1746147721.554571:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3304:x1830967796393728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.554641:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3304:x1830967796393728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (900us total) trans 21474841521 rc 0/0 00000100:00100000:0.0:1746147721.554646:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16106 00000004:00080000:0.0:1746147721.554674:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135811c00/2, rc 0, transno 17179874283 00000100:00100000:0.0:1746147721.554678:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796391936:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147721.554685:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135811500/2, rc 0, transno 17179874284 00000100:00100000:0.0:1746147721.554687:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796392448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147721.554694:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009505df80/2, rc 0, transno 21474841518 00000100:00100000:0.0:1746147721.554696:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796392960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147721.554702:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094691f80/2, rc 0, transno 21474841519 00000100:00100000:0.0:1746147721.554705:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796393472:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147721.554717:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135810e00/2, rc 0, transno 17179874285 00000100:00100000:0.0:1746147721.554720:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796392192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147721.554729:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0436300/2, rc 0, transno 17179874286 00000100:00100000:0.0:1746147721.554731:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796392704:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147721.554737:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009505e680/2, rc 0, transno 21474841520 00000100:00100000:0.0:1746147721.554740:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796393216:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147721.554745:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094690e00/2, rc 0, transno 21474841521 00000100:00100000:0.0:1746147721.554761:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796393728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147721.557797:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.567321:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.586835:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.586934:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.590524:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.593197:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.594951:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.597056:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.598517:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.604419:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.607836:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.607868:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793796352 00000100:00100000:0.0:1746147721.607877:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793796352 00010000:00010000:0.0:1746147721.607938:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7cb74 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb098 expref: 10 pid: 14547 timeout: 900 lvb_type: 0 00000100:00100000:0.0:1746147721.607970:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8158 00000100:00100000:0.0:1746147721.607978:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1957:x1830967793796352:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147721.607992:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147721.607998:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7cb74 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb098 expref: 10 pid: 14547 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746147721.608013:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7cb74 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb098 expref: 10 pid: 14547 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746147721.608037:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147721.608042:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819e00/0xe64d3fbf12a7cba5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147721.608049:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819e00/0xe64d3fbf12a7cba5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147721.608054:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147721.608088:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1957:x1830967793796352:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 110us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147721.608094:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8158 00000100:00100000:0.0:1746147721.608155:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.608186:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793796480 00000100:00100000:0.0:1746147721.608189:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793796480 00010000:00010000:0.0:1746147721.608201:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ac00/0xe64d3fbf12a7cb51 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb091 expref: 327 pid: 14547 timeout: 900 lvb_type: 0 00000100:00100000:0.0:1746147721.616482:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.618186:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.628050:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.628162:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793797120 00000100:00100000:1.0:1746147721.628170:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793797120 00010000:00010000:1.0:1746147721.628202:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819a00/0xe64d3fbf12a7cb35 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb08a expref: 8 pid: 14547 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.628225:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8160 00000100:00100000:1.0:1746147721.628232:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967793797120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147721.628245:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147721.628250:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819a00/0xe64d3fbf12a7cb35 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb08a expref: 8 pid: 14547 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746147721.628259:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819a00/0xe64d3fbf12a7cb35 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb08a expref: 8 pid: 14547 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746147721.628278:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819a00/0xe64d3fbf12a7cb35 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb08a expref: 8 pid: 14547 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746147721.628309:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147721.628314:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7cbc1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147721.628321:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7cbc1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147721.628326:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7cbc1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147721.628344:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147721.628395:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+7:1958:x1830967793797120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 163us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.628401:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8160 00000100:00100000:1.0:1746147721.642916:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.654949:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.655952:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.667166:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.667213:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793797632 00000100:00100000:1.0:1746147721.667224:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793797632 00000100:00100000:1.0:1746147721.667276:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11928 00000100:00100000:1.0:1746147721.667287:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32027:x1830967793797632:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147721.667312:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.667336:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136272400/0xe64d3fbf12a7cbdd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb0d7 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.667404:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136272400/0xe64d3fbf12a7cbdd lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0d7 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.667423:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136272400/0xe64d3fbf12a7cbdd lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0d7 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.667436:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147721.667440:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147721.667444:0:17544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bbc00/0xe64d3fbf12a7cbd6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0d0 expref: 326 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.667451:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136272400, rc 0) 00000100:00100000:1.0:1746147721.667507:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32027:x1830967793797632:12345-192.168.202.10@tcp:101:cat.0 Request processed in 220us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.667515:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11928 00000001:00080000:1.0:1746147721.672391:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945922 is committed 00000004:00080000:1.0:1746147721.672398:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2695 committed 00000004:00080000:1.0:1746147721.672406:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2680 committed 00000004:00080000:1.0:1746147721.672412:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2679 committed 00000004:00080000:1.0:1746147721.672414:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2678 committed 00000004:00080000:1.0:1746147721.672415:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2677 committed 00000004:00080000:1.0:1746147721.672417:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2694 committed 00000004:00080000:1.0:1746147721.672418:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2676 committed 00000004:00080000:1.0:1746147721.672419:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2693 committed 00000004:00080000:1.0:1746147721.672420:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2675 committed 00000004:00080000:1.0:1746147721.672422:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2692 committed 00000004:00080000:1.0:1746147721.672423:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2691 committed 00000004:00080000:1.0:1746147721.672424:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2690 committed 00000004:00080000:1.0:1746147721.672425:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2674 committed 00000004:00080000:1.0:1746147721.672427:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2673 committed 00000004:00080000:1.0:1746147721.672428:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2689 committed 00000004:00080000:1.0:1746147721.672430:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2688 committed 00000004:00080000:1.0:1746147721.672431:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2672 committed 00000001:00080000:1.0:1746147721.672437:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945921 is committed 00000001:00080000:1.0:1746147721.672449:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945916 is committed 00000100:00100000:1.0:1746147721.672577:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796395008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.672615:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.672631:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796395520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.672644:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.672659:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746147721.672663:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796394496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.672675:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.672684:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796395136:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.672697:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.672717:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796395008 00000100:00100000:1.0:1746147721.672725:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796395008 00000100:00100000:1.0:1746147721.672762:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796395520 00000100:00100000:1.0:1746147721.672764:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796395520 00000100:00100000:0.0:1746147721.673815:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796395648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.673849:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147721.674174:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796396160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.674193:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.674365:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796394496 00000100:00100000:1.0:1746147721.674369:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796394496 00000100:00100000:1.0:1746147721.674385:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796395136 00000100:00100000:1.0:1746147721.674387:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796395136 00000100:00100000:1.0:1746147721.674393:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796395392 00000100:00100000:1.0:1746147721.674395:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796395392 00000100:00100000:1.0:1746147721.674404:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16112 00000100:00100000:1.0:1746147721.674410:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3301:x1830967796395008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.674481:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16115 00000100:00100000:1.0:1746147721.674485:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3301:x1830967796394496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.674532:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16117 00000100:00100000:1.0:1746147721.674536:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3303:x1830967796394880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147721.674575:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746147721.674576:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796396160 00000100:00100000:1.0:1746147721.674579:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796396160 00000100:00100000:0.0:1746147721.674581:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796396032:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147721.674592:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16118 00000100:00100000:1.0:1746147721.674595:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aaba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3301:x1830967796395136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147721.674600:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147721.674608:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796396544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.674624:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147721.674638:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009433a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796395904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.674655:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147721.674663:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796396416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.674677:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147721.674679:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aaba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+51:3301:x1830967796395136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (1979us total) trans 17179874291 rc 0/0 00000100:00100000:1.0:1746147721.674685:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16118 00000100:00100000:1.0:1746147721.674696:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16120 00000100:00100000:1.0:1746147721.674700:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3302:x1830967796395648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.674701:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16121 00000100:00100000:0.0:1746147721.674714:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3302:x1830967796396160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147721.674728:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16123 00000100:00100000:1.0:1746147721.674732:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:3302:x1830967796396544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.674735:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16124 00000100:00100000:0.0:1746147721.674740:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3304:x1830967796395904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147721.674831:0:21480:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 12 min 3 max 116 00000100:00100000:0.0:1746147721.674839:0:21480:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'll_ost00_012' 00000100:00100000:1.0:1746147721.674870:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3302:x1830967796396544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (245us total) trans 21474841525 rc 0/0 00000100:00100000:1.0:1746147721.674874:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16123 00002000:00010000:0.0:1746147721.674943:0:4592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:0.0:1746147721.674946:0:4592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147721.674948:0:4592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147721.674950:0:4592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00000100:00100000:1.0:1746147721.674951:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:0.0:1746147721.674952:0:4592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:0.0:1746147721.674972:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3302:x1830967796396160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 266us (778us total) trans 21474841526 rc 0/0 00000100:00100000:0.0:1746147721.674978:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16121 00002000:00010000:0.0:1746147721.675021:0:7050:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:1.0:1746147721.675022:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:0.0:1746147721.675023:0:7050:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147722 -> 1746147722 00002000:00010000:0.0:1746147721.675025:0:7050:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147722 -> 1746147722 00002000:00010000:0.0:1746147721.675028:0:7050:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147722 -> 1746147722 00002000:00010000:0.0:1746147721.675029:0:7050:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746147721.675039:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793797760 00000100:00100000:1.0:1746147721.675042:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793797760 00000100:00100000:0.0:1746147721.675052:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3304:x1830967796395904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 312us (396us total) trans 21474841523 rc 0/0 00000100:00100000:1.0:1746147721.675058:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793797888 00000100:00100000:0.0:1746147721.675058:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16124 00000100:00100000:1.0:1746147721.675060:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793797888 00000100:00100000:1.0:1746147721.675072:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4943 00000100:00100000:1.0:1746147721.675076:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32027:x1830967793797760:12345-192.168.202.10@tcp:49:cat.0 00000004:00080000:0.0:1746147721.675082:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009433a680/2, rc 0, transno 21474841523 00000100:00100000:0.0:1746147721.675087:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009433a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796395904:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147721.675105:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b6cb8700/2, rc 0, transno 17179874290 00000100:00100000:0.0:1746147721.675113:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b6cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796394496:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147721.675120:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b7100/2, rc 0, transno 17179874291 00000100:00100000:0.0:1746147721.675123:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796395136:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147721.675130:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b4700/2, rc 0, transno 17179874293 00000100:00100000:0.0:1746147721.675133:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796395008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147721.675140:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b4000/2, rc 0, transno 17179874294 00000100:00100000:0.0:1746147721.675143:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796395520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.675149:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32027:x1830967793797760:12345-192.168.202.10@tcp:49:cat.0 Request processed in 72us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.675157:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4943 00000100:00100000:1.0:1746147721.675165:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4944 00000100:00100000:1.0:1746147721.675169:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32024:x1830967793797888:12345-192.168.202.10@tcp:49:cat.0 00000100:00100000:1.0:1746147721.675202:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32024:x1830967793797888:12345-192.168.202.10@tcp:49:cat.0 Request processed in 33us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.675207:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4944 00000100:00100000:0.0:1746147721.675223:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147721.675229:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796396672:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147721.675242:0:8468:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147721.675245:0:8468:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147722 -> 1746147722 00002000:00010000:1.0:1746147721.675247:0:8468:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147722 -> 1746147722 00002000:00010000:1.0:1746147721.675248:0:8468:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147722 -> 1746147722 00000100:00100000:0.0:1746147721.675249:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746147721.675250:0:8468:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147721.675264:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796396672 00000100:00100000:1.0:1746147721.675266:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3302:x1830967796395648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 566us (1417us total) trans 21474841524 rc 0/0 00000100:00100000:0.0:1746147721.675268:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796396672 00000100:00100000:1.0:1746147721.675271:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16120 00000100:00100000:1.0:1746147721.675280:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16126 00000100:00100000:1.0:1746147721.675284:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3301:x1830967796396672:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147721.675307:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094339c00/2, rc 0, transno 21474841522 00000100:00100000:0.0:1746147721.675311:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796396032:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147721.675317:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094338000/2, rc 0, transno 21474841525 00000100:00100000:0.0:1746147721.675320:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796396544:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147721.675329:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800943c7100/2, rc 0, transno 21474841524 00000100:00100000:0.0:1746147721.675331:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796395648:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147721.675337:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094339880/2, rc 0, transno 21474841526 00000100:00100000:0.0:1746147721.675339:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796396160:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147721.675351:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094338380/2, rc 0, transno 21474841527 00000100:00100000:0.0:1746147721.675353:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796396416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147721.675366:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+51:3301:x1830967796396672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (116us total) trans 17179874295 rc 0/0 00000100:00100000:1.0:1746147721.675370:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16126 00000004:00080000:0.0:1746147721.675380:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5488e00/2, rc 0, transno 17179874295 00000100:00100000:0.0:1746147721.675383:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796396672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147721.675483:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796395776 00000100:00100000:1.0:1746147721.675487:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796395776 00000100:00100000:1.0:1746147721.675498:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796396288 00000100:00100000:1.0:1746147721.675500:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796396288 00000100:00100000:1.0:1746147721.675509:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16127 00000100:00100000:1.0:1746147721.675517:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3303:x1830967796395776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147721.675595:0:8468:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147721.675598:0:8468:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147722 -> 1746147722 00002000:00010000:1.0:1746147721.675600:0:8468:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147722 -> 1746147722 00002000:00010000:1.0:1746147721.675602:0:8468:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147722 -> 1746147722 00002000:00010000:1.0:1746147721.675604:0:8468:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147721.675623:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3303:x1830967796395776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (185us total) trans 21474841529 rc 0/0 00000100:00100000:1.0:1746147721.675628:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16127 00000100:00100000:0.0:1746147721.682409:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.682551:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793798016 00000100:00100000:1.0:1746147721.682561:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793798016 00000100:00100000:1.0:1746147721.682619:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16129 00000100:00100000:1.0:1746147721.682629:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32025:x1830967793798016:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147721.682650:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.682669:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc28800/0xe64d3fbf12a7cbe4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb0de expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.682700:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e7400/0xe64d3fbf12a7cac5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb060 expref: 10 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.682853:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7400/0xe64d3fbf12a7cbac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0b4 expref: 15 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.682861:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7cb97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0a6 expref: 27 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.682867:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.682869:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.682872:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc28800/0xe64d3fbf12a7cbe4 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [798720->1048575] (req 798720->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0de expref: 15 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147721.683038:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.683135:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147721.683866:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7cb97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0a6 expref: 27 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.683901:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7cb97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0a6 expref: 27 pid: 22183 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.683916:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796396800:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147721.684052:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7400/0xe64d3fbf12a7cbac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0b4 expref: 15 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.684061:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7400/0xe64d3fbf12a7cbac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0b4 expref: 15 pid: 9615 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.684068:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796396928:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147721.684094:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02e7400/0xe64d3fbf12a7cac5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb060 expref: 10 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.684101:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e7400/0xe64d3fbf12a7cac5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb060 expref: 10 pid: 10613 timeout: 900 lvb_type: 1 00000100:00100000:1.0:1746147721.684109:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796397056:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147721.684123:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147721.694095:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796396800:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147721.694108:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796396928:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147721.694116:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796397056:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147721.694150:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc28800/0xe64d3fbf12a7cbe4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [798720->1048575] (req 798720->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0de expref: 15 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.694171:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc28800, rc 0) 00000100:00100000:1.0:1746147721.694234:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32025:x1830967793798016:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 11605us (11834us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.694244:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16129 00000100:00100000:0.0:1746147721.694582:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.694657:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793798912 00000100:00100000:1.0:1746147721.694664:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793798912 00010000:00010000:1.0:1746147721.694814:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e7400/0xe64d3fbf12a7cac5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb060 expref: 11 pid: 10613 timeout: 900 lvb_type: 1 00000100:00100000:1.0:1746147721.694847:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8161 00000100:00100000:1.0:1746147721.694855:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2378c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967793798912:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147721.694867:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147721.694929:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02e7400/0xe64d3fbf12a7cac5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb060 expref: 11 pid: 10613 timeout: 900 lvb_type: 1 00010000:00010000:1.0:1746147721.694939:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02e7400/0xe64d3fbf12a7cac5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb060 expref: 11 pid: 10613 timeout: 900 lvb_type: 1 00010000:00010000:1.0:1746147721.694963:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e7400/0xe64d3fbf12a7cac5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb060 expref: 11 pid: 10613 timeout: 900 lvb_type: 1 00010000:00010000:1.0:1746147721.694978:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147721.695006:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2378c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793798912:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 153us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.695013:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8161 00000100:00100000:0.0:1746147721.695744:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.695788:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.702767:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.706147:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.706216:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793799296 00000100:00100000:1.0:1746147721.706226:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793799296 00000100:00100000:1.0:1746147721.706268:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16130 00000100:00100000:1.0:1746147721.706276:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:32027:x1830967793799296:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147721.706295:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.706314:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc28c00/0xe64d3fbf12a7cbeb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb0e5 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.706340:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.706341:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.706348:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc28c00/0xe64d3fbf12a7cbeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0e5 expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.706362:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc28c00/0xe64d3fbf12a7cbeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0e5 expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.706372:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc28c00, rc 0) 00000100:00100000:1.0:1746147721.706425:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32027:x1830967793799296:12345-192.168.202.10@tcp:101:cat.0 Request processed in 149us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.706431:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16130 00000100:00100000:0.0:1746147721.707152:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.707422:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793799424 00000100:00100000:1.0:1746147721.707426:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793799424 00000100:00100000:1.0:1746147721.707447:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16131 00000100:00100000:1.0:1746147721.707452:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32025:x1830967793799424:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147721.707462:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.707472:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc28a00/0xe64d3fbf12a7cbf2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb0ec expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.707490:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e6800/0xe64d3fbf12a7cada lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb067 expref: 11 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.707497:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f7e00/0xe64d3fbf12a7cbcf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0c9 expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.707504:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00bb800/0xe64d3fbf12a7cbc8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0c2 expref: 29 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.707510:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.707511:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.707662:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc28a00/0xe64d3fbf12a7cbf2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [1048576->1175551] (req 1048576->1175551) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0ec expref: 26 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.707693:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00bb800/0xe64d3fbf12a7cbc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0c2 expref: 29 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.707710:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a00bb800/0xe64d3fbf12a7cbc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0c2 expref: 29 pid: 22183 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.707723:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796397312:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147721.707818:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7f7e00/0xe64d3fbf12a7cbcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0c9 expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.707827:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7f7e00/0xe64d3fbf12a7cbcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0c9 expref: 26 pid: 9615 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.707834:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796397440:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147721.707859:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02e6800/0xe64d3fbf12a7cada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb067 expref: 11 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.707867:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e6800/0xe64d3fbf12a7cada lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb067 expref: 11 pid: 10613 timeout: 900 lvb_type: 1 00000100:00100000:1.0:1746147721.707875:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796397568:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147721.707938:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147721.708023:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.708106:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793799552 00000100:00100000:1.0:1746147721.708109:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793799552 00000100:00100000:1.0:1746147721.708129:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16132 00000100:00100000:1.0:1746147721.708133:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32024:x1830967793799552:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147721.708141:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.708148:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc29800/0xe64d3fbf12a7cbf9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb0f3 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.708160:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.708161:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.708166:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc29800/0xe64d3fbf12a7cbf9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0f3 expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.708178:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc29800/0xe64d3fbf12a7cbf9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0f3 expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.708186:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc29800, rc 0) 00000100:00100000:1.0:1746147721.708205:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:32024:x1830967793799552:12345-192.168.202.10@tcp:101:cat.0 Request processed in 70us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.708211:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16132 00000100:00100000:0.0:1746147721.711451:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.711598:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796397312:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147721.711608:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796397440:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147721.711615:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796397568:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147721.711644:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc28a00/0xe64d3fbf12a7cbf2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [1048576->1175551] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0ec expref: 26 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.711661:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc28a00, rc 0) 00000100:00100000:1.0:1746147721.711716:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32025:x1830967793799424:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4263us (4564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.711725:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16131 00000100:00100000:0.0:1746147721.712528:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.712560:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.712615:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793799808 00000100:00100000:1.0:1746147721.712619:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793799808 00010000:00010000:1.0:1746147721.712632:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7f7e00/0xe64d3fbf12a7cbcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0c9 expref: 27 pid: 9615 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.712647:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8165 00000100:00100000:1.0:1746147721.712651:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967793799808:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147721.712658:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147721.712667:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7f7e00/0xe64d3fbf12a7cbcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0c9 expref: 27 pid: 9615 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746147721.712674:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7f7e00/0xe64d3fbf12a7cbcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0c9 expref: 27 pid: 9615 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746147721.712685:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f7e00/0xe64d3fbf12a7cbcf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0c9 expref: 27 pid: 9615 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746147721.712696:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147721.712711:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793799808:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 59us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.712715:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8165 00000100:00100000:1.0:1746147721.712934:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.723766:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.724367:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.725306:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793800704 00000100:00100000:1.0:1746147721.725314:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793800704 00002000:00100000:1.0:1746147721.725349:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1171456->1175551) req@ffff88008fb74700 x1830967793800704/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:342/0 lens 488/0 e 0 to 0 dl 1746147732 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147721.725359:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb74700 with x1830967793800704 ext(1171456->1175551) 00002000:00010000:1.0:1746147721.725364:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb74700 00000100:00100000:1.0:1746147721.725394:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7160 00000100:00100000:1.0:1746147721.725400:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967793800704:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147721.725553:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967793800704:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 153us (1186us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147721.725562:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7160 00002000:00100000:1.0:1746147721.725566:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1171456->1175551) req@ffff88008fb74700 x1830967793800704/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:342/0 lens 488/4536 e 0 to 0 dl 1746147732 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147721.725573:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb74700 with x1830967793800704 ext(1171456->1175551) 00002000:00010000:1.0:1746147721.725575:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb74700 00000100:00100000:0.0:1746147721.734216:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.734681:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.734771:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793801088 00000100:00100000:1.0:1746147721.734780:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793801088 00000100:00100000:1.0:1746147721.734843:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16133 00000100:00100000:1.0:1746147721.734849:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:32026:x1830967793801088:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147721.734862:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.734880:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc29a00/0xe64d3fbf12a7cc00 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb0fa expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.734928:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc28800/0xe64d3fbf12a7cbe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0de expref: 13 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.734936:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147721.734938:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147721.734941:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc29a00/0xe64d3fbf12a7cc00 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [335872->1048575] (req 335872->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0fa expref: 28 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.734972:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc28800/0xe64d3fbf12a7cbe4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0de expref: 13 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.734984:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc28800/0xe64d3fbf12a7cbe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0de expref: 13 pid: 6715 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.735001:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796397824:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147721.735147:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147721.740634:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793801216 00000100:00100000:1.0:1746147721.740643:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793801216 00000100:00100000:1.0:1746147721.740683:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16134 00000100:00100000:1.0:1746147721.740690:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32027:x1830967793801216:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147721.740708:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.740723:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc29200/0xe64d3fbf12a7cc07 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb101 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.740742:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.740744:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.740761:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc29200/0xe64d3fbf12a7cc07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb101 expref: 15 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.740773:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc29200/0xe64d3fbf12a7cc07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb101 expref: 15 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.740780:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc29200, rc 0) 00000100:00100000:1.0:1746147721.740797:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32027:x1830967793801216:12345-192.168.202.10@tcp:101:cat.0 Request processed in 108us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.740801:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16134 00000100:00100000:0.0:1746147721.741147:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967793800448:12345-192.168.202.10@tcp:3:cat.0 Request processed in 17162us (17399us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147721.741155:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7159 00002000:00100000:0.0:1746147721.741164:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88008fb75c00 x1830967793800448/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:342/0 lens 488/440 e 0 to 0 dl 1746147732 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147721.741172:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb75c00 with x1830967793800448 ext(1048576->2097151) 00002000:00010000:0.0:1746147721.741176:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb75c00 00000100:00100000:1.0:1746147721.742632:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.743216:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793801344 00000100:00100000:0.0:1746147721.743225:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793801344 00002000:00100000:0.0:1746147721.743267:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x455:0x0] (798720->1048575) req@ffff88009fd19180 x1830967793801344/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:342/0 lens 488/0 e 0 to 0 dl 1746147732 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147721.743277:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19180 with x1830967793801344 ext(798720->1048575) 00010000:00010000:0.0:1746147721.743285:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fc28800/0xe64d3fbf12a7cbe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0de expref: 15 pid: 6715 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746147721.743300:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fc28800/0xe64d3fbf12a7cbe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0de expref: 15 pid: 6715 timeout: 900 lvb_type: 0 00002000:00010000:0.0:1746147721.743307:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd19180 00000100:00100000:0.0:1746147721.743378:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1406 00000100:00100000:0.0:1746147721.743386:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1958:x1830967793801344:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:0.0:1746147721.750056:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.753361:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.754414:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1958:x1830967793801344:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 11026us (11783us total) trans 17179874297 rc 0/0 00000100:00100000:1.0:1746147721.754426:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1406 00002000:00100000:1.0:1746147721.754433:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x455:0x0] (798720->1048575) req@ffff88009fd19180 x1830967793801344/t17179874297(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:342/0 lens 488/448 e 0 to 0 dl 1746147732 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147721.754442:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19180 with x1830967793801344 ext(798720->1048575) 00010000:00010000:1.0:1746147721.754451:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fc28800/0xe64d3fbf12a7cbe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0de expref: 19 pid: 6715 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746147721.754466:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fc28800/0xe64d3fbf12a7cbe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0de expref: 19 pid: 6715 timeout: 900 lvb_type: 0 00002000:00010000:1.0:1746147721.754474:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd19180 00000100:00100000:0.0:1746147721.757724:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.757785:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.758102:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793802112 00000100:00100000:0.0:1746147721.758106:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793802112 00002000:00100000:0.0:1746147721.758135:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88008fb75880 x1830967793802112/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:342/0 lens 488/0 e 0 to 0 dl 1746147732 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147721.758144:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb75880 with x1830967793802112 ext(1048576->2097151) 00002000:00010000:0.0:1746147721.758148:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb75880 00000100:00100000:0.0:1746147721.758162:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7162 00000100:00100000:0.0:1746147721.758167:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967793802112:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147721.772649:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147721.778625:0:20300:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147721.782197:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.782227:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.782350:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.782534:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793802624 00000100:00100000:1.0:1746147721.782544:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793802624 00000100:00100000:1.0:1746147721.782880:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793802496 00000100:00100000:1.0:1746147721.782914:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793802496 00000100:00100000:0.0:1746147721.786078:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.786431:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793802880 00000100:00100000:1.0:1746147721.786440:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793802880 00000100:00100000:1.0:1746147721.786488:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16139 00000100:00100000:1.0:1746147721.786494:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967793802880:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147721.786509:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.786525:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc28e00/0xe64d3fbf12a7cc2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb124 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147721.786570:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796398208:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147721.786635:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147721.787154:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.787948:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.788004:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793803136 00000100:00100000:1.0:1746147721.788008:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793803136 00000100:00100000:1.0:1746147721.788028:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16141 00000100:00100000:1.0:1746147721.788032:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793803136:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147721.788039:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.788049:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc28200/0xe64d3fbf12a7cc38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb132 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.788061:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.788062:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.788066:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc28200/0xe64d3fbf12a7cc38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb132 expref: 33 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.788075:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc28200/0xe64d3fbf12a7cc38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb132 expref: 33 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.788081:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc28200, rc 0) 00000100:00100000:1.0:1746147721.788098:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967793803136:12345-192.168.202.10@tcp:101:cat.0 Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.788103:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16141 00000100:00100000:1.0:1746147721.790216:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796398208:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147721.790246:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc28e00/0xe64d3fbf12a7cc2a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb124 expref: 32 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.790259:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc28e00/0xe64d3fbf12a7cc2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb124 expref: 32 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.790292:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc28e00, rc 0) 00000100:00100000:1.0:1746147721.790339:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967793802880:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3844us (4267us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147721.790346:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16139 00000100:00100000:0.0:1746147721.791598:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.791785:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793803264 00000100:00100000:1.0:1746147721.791795:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793803264 00000100:00100000:1.0:1746147721.791925:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16142 00000100:00100000:1.0:1746147721.791934:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:32026:x1830967793803264:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147721.791952:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.791968:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc29600/0xe64d3fbf12a7cc3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb139 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.791995:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc28a00/0xe64d3fbf12a7cbf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0ec expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.792003:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147721.792005:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147721.792008:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc29600/0xe64d3fbf12a7cc3f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->1077247] (req 1048576->1077247) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb139 expref: 32 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.792039:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc28a00/0xe64d3fbf12a7cbf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0ec expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.792051:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc28a00/0xe64d3fbf12a7cbf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0ec expref: 25 pid: 6715 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746147721.792069:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796398336:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147721.792141:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147721.798557:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796398336:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147721.798592:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc29600/0xe64d3fbf12a7cc3f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->1077247] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb139 expref: 32 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.798613:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc29600, rc 0) 00000100:00100000:1.0:1746147721.798771:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:32026:x1830967793803264:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 6835us (7176us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.798780:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16142 00000100:00100000:0.0:1746147721.805190:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.805342:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.805359:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.805379:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.805585:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793803776 00000100:00100000:1.0:1746147721.805594:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793803776 00002000:00100000:1.0:1746147721.805637:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880093cd7800 x1830967793803776/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:342/0 lens 488/0 e 0 to 0 dl 1746147732 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147721.805646:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd7800 with x1830967793803776 ext(2097152->3145727) 00002000:00010000:1.0:1746147721.805652:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd7800 00000100:00100000:1.0:1746147721.805701:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793804288 00000100:00100000:1.0:1746147721.805704:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793804288 00002000:00100000:1.0:1746147721.805717:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880093cd7100 x1830967793804288/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:342/0 lens 488/0 e 0 to 0 dl 1746147732 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147721.805724:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd7100 with x1830967793804288 ext(3145728->4194303) 00002000:00010000:1.0:1746147721.805727:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd7100 00000100:00100000:1.0:1746147721.805805:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7164 00000100:00100000:1.0:1746147721.805812:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967793803904:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147721.806125:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7167 00000100:00100000:0.0:1746147721.806131:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967793804160:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147721.812090:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.812121:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.812148:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793804672 00000100:00100000:0.0:1746147721.812157:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793804672 00002000:00100000:0.0:1746147721.812204:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800956b4a80 x1830967793804672/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:342/0 lens 488/0 e 0 to 0 dl 1746147732 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147721.812214:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b4a80 with x1830967793804672 ext(2097152->3145727) 00002000:00010000:0.0:1746147721.812220:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b4a80 00000100:00100000:0.0:1746147721.812236:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793804928 00000100:00100000:0.0:1746147721.812239:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793804928 00002000:00100000:0.0:1746147721.812256:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800956b4e00 x1830967793804928/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:342/0 lens 488/0 e 0 to 0 dl 1746147732 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147721.812262:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b4e00 with x1830967793804928 ext(3145728->4194303) 00002000:00010000:0.0:1746147721.812264:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b4e00 00000100:00100000:0.0:1746147721.812285:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7168 00000100:00100000:0.0:1746147721.812292:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1958:x1830967793804672:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147721.812711:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7169 00000100:00100000:1.0:1746147721.812720:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1958:x1830967793804928:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147721.819870:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.826861:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967793804160:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20726us (21476us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147721.826874:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7167 00002000:00100000:0.0:1746147721.826903:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880093cd4a80 x1830967793804160/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:342/0 lens 488/440 e 0 to 0 dl 1746147732 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147721.826913:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4a80 with x1830967793804160 ext(2097152->3145727) 00002000:00010000:0.0:1746147721.826919:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd4a80 00000100:00100000:0.0:1746147721.830301:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.842132:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.843017:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967793803904:12345-192.168.202.10@tcp:3:cat.0 Request processed in 37196us (37665us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147721.843028:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7164 00002000:00100000:1.0:1746147721.843039:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880093cd5880 x1830967793803904/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:342/0 lens 488/440 e 0 to 0 dl 1746147732 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147721.843048:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5880 with x1830967793803904 ext(3145728->4194303) 00002000:00010000:1.0:1746147721.843052:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd5880 00000100:00100000:1.0:1746147721.851582:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967793804928:12345-192.168.202.10@tcp:3:cat.0 Request processed in 38854us (39450us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147721.851594:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7169 00002000:00100000:1.0:1746147721.851604:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800956b4e00 x1830967793804928/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:342/0 lens 488/440 e 0 to 0 dl 1746147732 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147721.851613:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b4e00 with x1830967793804928 ext(3145728->4194303) 00002000:00010000:1.0:1746147721.851618:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b4e00 00000100:00100000:1.0:1746147721.864645:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.864698:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.865489:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16144 00000100:00100000:0.0:1746147721.865500:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793806080:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147721.865512:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147721.865526:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc49c00/0xe64d3fbf12a7cc4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb147 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147721.865577:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796398720:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147721.866335:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147721.873378:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796398720:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147721.873424:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc49c00/0xe64d3fbf12a7cc4d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb147 expref: 28 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.873437:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc49c00/0xe64d3fbf12a7cc4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb147 expref: 28 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.873471:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc49c00, rc 0) 00000100:00100000:1.0:1746147721.873537:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793806080:12345-192.168.202.10@tcp:101:cat.0 Request processed in 8037us (8835us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147721.873545:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16144 00000100:00100000:0.0:1746147721.875967:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.878234:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.878271:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793806592 00000100:00100000:0.0:1746147721.878276:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793806592 00002000:00100000:0.0:1746147721.878309:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88013584aa00 x1830967793806592/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:342/0 lens 488/0 e 0 to 0 dl 1746147732 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147721.878818:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584aa00 with x1830967793806592 ext(4194304->5017599) 00002000:00010000:0.0:1746147721.878823:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584aa00 00000100:00100000:1.0:1746147721.878849:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.879011:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7173 00000100:00100000:0.0:1746147721.879018:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967793806592:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147721.896391:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793806976 00000100:00100000:1.0:1746147721.896401:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793806976 00000100:00100000:1.0:1746147721.896448:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793807104 00000100:00100000:1.0:1746147721.896453:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793807104 00000100:00100000:1.0:1746147721.896483:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16145 00000100:00100000:1.0:1746147721.896492:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967793806976:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147721.896510:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.896528:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6200/0xe64d3fbf12a7cc77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb155 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147721.896575:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796398848:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147721.897874:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147721.902150:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796398848:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147721.902184:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6200/0xe64d3fbf12a7cc77 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb155 expref: 18 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.902198:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6200/0xe64d3fbf12a7cc77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb155 expref: 18 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.902214:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f6200, rc 0) 00000100:00100000:1.0:1746147721.902259:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967793806976:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5767us (5923us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147721.902586:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16145 00000100:00100000:0.0:1746147721.904788:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.904841:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.904932:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793807232 00000100:00100000:1.0:1746147721.904941:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793807232 00000100:00100000:1.0:1746147721.904992:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16148 00000100:00100000:1.0:1746147721.904998:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967793807232:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147721.905007:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147721.905024:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6800/0xe64d3fbf12a7cc85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb163 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147721.905076:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796399104:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147721.905394:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147721.906511:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796399104:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147721.906536:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6800/0xe64d3fbf12a7cc85 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb163 expref: 18 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.906549:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6800/0xe64d3fbf12a7cc85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb163 expref: 18 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147721.906558:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f6800, rc 0) 00000100:00100000:1.0:1746147721.906587:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967793807232:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1588us (1744us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147721.906594:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16148 00000100:00100000:0.0:1746147721.917084:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.931614:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.935999:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.936051:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147721.936248:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8170 00000100:00100000:1.0:1746147721.936256:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1958:x1830967793807872:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147721.936266:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147721.936276:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc29200/0xe64d3fbf12a7cc07 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb101 expref: 19 pid: 21480 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147721.936284:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc29200/0xe64d3fbf12a7cc07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb101 expref: 19 pid: 21480 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147721.936296:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147721.936559:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967793807872:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 300us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.936566:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8170 00000100:00100000:1.0:1746147721.936586:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793808128 00000100:00100000:1.0:1746147721.936590:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793808128 00010000:00010000:1.0:1746147721.936602:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136404c00/0xe64d3fbf12a7cc0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb108 expref: 30 pid: 6715 timeout: 901 lvb_type: 0 00000100:00100000:1.0:1746147721.936618:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8171 00000100:00100000:1.0:1746147721.936623:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967793808128:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147721.936629:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147721.936637:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136404c00/0xe64d3fbf12a7cc0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb108 expref: 30 pid: 6715 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147721.936734:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136404c00/0xe64d3fbf12a7cc0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb108 expref: 30 pid: 6715 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147721.936757:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136404c00/0xe64d3fbf12a7cc0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb108 expref: 30 pid: 6715 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147721.936784:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.936786:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147721.936793:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7cc93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1744895) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb171 expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.936800:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7cc93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1744895) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb171 expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147721.936829:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7cc93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1744895) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb171 expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147721.936840:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796399744:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147721.936922:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147721.941533:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796399744:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147721.941556:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147721.941613:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967793808128:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4988us (5043us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147721.941624:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8171 00000100:00100000:0.0:1746147721.944663:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.955267:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147721.958655:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.108069:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147722.108378:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147722.114126:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.121485:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.131536:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.131633:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793809664 00000100:00100000:1.0:1746147722.131644:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793809664 00010000:00010000:1.0:1746147722.131688:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800935e1e00/0xe64d3fbf12a7cc31 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb12b expref: 31 pid: 7050 timeout: 901 lvb_type: 1 00000100:00100000:1.0:1746147722.131875:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8172 00000100:00100000:1.0:1746147722.131926:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967793809664:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147722.131939:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147722.131961:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800935e1e00/0xe64d3fbf12a7cc31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb12b expref: 31 pid: 7050 timeout: 901 lvb_type: 1 00010000:00010000:1.0:1746147722.131972:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800935e1e00/0xe64d3fbf12a7cc31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb12b expref: 31 pid: 7050 timeout: 901 lvb_type: 1 00010000:00010000:1.0:1746147722.131991:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935e1e00/0xe64d3fbf12a7cc31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb12b expref: 31 pid: 7050 timeout: 901 lvb_type: 1 00010000:00010000:1.0:1746147722.132023:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147722.132079:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967793809664:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 196us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.132086:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8172 00000100:00080000:0.0:1746147722.137721:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147722.140828:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147722.142534:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147722.142832:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.145365:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.149596:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.151167:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.151187:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.151202:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.151215:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793811200 00000100:00100000:0.0:1746147722.151218:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793811200 00000100:00100000:0.0:1746147722.151236:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793811328 00000100:00100000:0.0:1746147722.151237:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793811328 00000100:00100000:0.0:1746147722.151249:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16152 00000100:00100000:0.0:1746147722.151253:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967793811200:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147722.151264:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147722.151275:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc49800/0xe64d3fbf12a7cd11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb19b expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147722.151310:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796400768:192.168.202.10@tcp:106: 00000100:00080000:1.0:1746147722.151423:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147722.151595:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.151619:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.152154:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.152168:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.152185:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.152198:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.152211:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793811072 00000100:00100000:0.0:1746147722.152214:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793811072 00000100:00100000:0.0:1746147722.152234:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793811712 00000100:00100000:0.0:1746147722.152236:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793811712 00000100:00100000:1.0:1746147722.152431:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793811456 00000100:00100000:1.0:1746147722.152434:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793811456 00000100:00100000:1.0:1746147722.152450:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793811584 00000100:00100000:1.0:1746147722.152452:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793811584 00000100:00100000:1.0:1746147722.152463:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16154 00000100:00100000:1.0:1746147722.152467:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967793811456:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147722.152474:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.152482:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7200/0xe64d3fbf12a7cd1f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb1a9 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.152510:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796401024:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147722.152537:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147722.152552:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16155 00000100:00100000:1.0:1746147722.152557:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793811584:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147722.152563:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.152569:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7f6600/0xe64d3fbf12a7cd26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb1b0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.152578:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.152584:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7f6600/0xe64d3fbf12a7cd26 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1b0 expref: 29 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147722.152592:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f6600/0xe64d3fbf12a7cd26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1b0 expref: 29 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147722.152603:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f6600, rc 0) 00000100:00100000:1.0:1746147722.152620:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793811584:12345-192.168.202.10@tcp:101:cat.0 Request processed in 63us (450us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147722.152624:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16155 00010000:00010000:0.0:1746147722.153557:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935e0000/0xe64d3fbf12a7cae8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb083 expref: 11 pid: 8184 timeout: 901 lvb_type: 1 00000100:00100000:0.0:1746147722.153570:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793812224 00000100:00100000:0.0:1746147722.153572:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793812224 00010000:00010000:0.0:1746147722.153578:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc28200/0xe64d3fbf12a7cc38 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb132 expref: 34 pid: 21480 timeout: 901 lvb_type: 1 00000100:00100000:0.0:1746147722.153589:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8176 00000100:00100000:0.0:1746147722.153593:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967793811712:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147722.153598:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147722.153612:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935e0000/0xe64d3fbf12a7cae8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb083 expref: 11 pid: 8184 timeout: 901 lvb_type: 1 00010000:00010000:0.0:1746147722.153619:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935e0000/0xe64d3fbf12a7cae8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb083 expref: 11 pid: 8184 timeout: 901 lvb_type: 1 00010000:00010000:0.0:1746147722.153630:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147722.153641:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967793811712:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 48us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.153646:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8176 00000100:00100000:0.0:1746147722.153653:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8177 00000100:00100000:0.0:1746147722.153656:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967793812224:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147722.153663:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147722.153667:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc28200/0xe64d3fbf12a7cc38 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb132 expref: 34 pid: 21480 timeout: 901 lvb_type: 1 00010000:00010000:0.0:1746147722.153674:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc28200/0xe64d3fbf12a7cc38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb132 expref: 34 pid: 21480 timeout: 901 lvb_type: 1 00010000:00010000:0.0:1746147722.153682:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.153683:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.153688:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00bb000/0xe64d3fbf12a7ccd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb18d expref: 34 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.153694:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00bb000/0xe64d3fbf12a7ccd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb18d expref: 34 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.153711:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00bb000/0xe64d3fbf12a7ccd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb18d expref: 34 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147722.153718:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0596300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796401152:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147722.153738:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6cc0 going to sleep for 11 seconds 00000100:00080000:1.0:1746147722.154171:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147722.156773:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.156809:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0596300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796401152:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147722.156819:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147722.156836:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967793812224:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3178us (3754us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.156843:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8177 00002000:00010000:1.0:1746147722.157122:0:9615:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime: 1746147722 -> 1746147723 00002000:00010000:1.0:1746147722.157126:0:9615:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime: 1746147722 -> 1746147723 00000100:00100000:1.0:1746147722.157135:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796401024:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147722.157149:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7200/0xe64d3fbf12a7cd1f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1a9 expref: 17 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147722.157158:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7200/0xe64d3fbf12a7cd1f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1a9 expref: 17 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147722.157164:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f7200, rc 0) 00000100:00100000:1.0:1746147722.157183:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967793811456:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4715us (5563us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147722.157188:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16154 00000100:00100000:1.0:1746147722.157199:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793812352 00000100:00100000:1.0:1746147722.157203:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793812352 00000100:00100000:1.0:1746147722.157223:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16156 00000100:00100000:1.0:1746147722.157227:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967793812352:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147722.157236:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.157246:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7800/0xe64d3fbf12a7cd2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb1b7 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.157277:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796401280:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147722.157315:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147722.165637:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.168610:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793812608 00000100:00100000:0.0:1746147722.168619:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793812608 00002000:00100000:0.0:1746147722.168652:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2129920->2134015) req@ffff88009fe39880 x1830967793812608/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147722.168661:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39880 with x1830967793812608 ext(2129920->2134015) 00002000:00010000:0.0:1746147722.168665:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe39880 00000100:00100000:0.0:1746147722.168683:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7178 00000100:00100000:0.0:1746147722.168688:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793812608:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147722.168824:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793812608:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 134us (4903us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147722.168830:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7178 00002000:00100000:0.0:1746147722.168835:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2129920->2134015) req@ffff88009fe39880 x1830967793812608/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/4536 e 0 to 0 dl 1746147733 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147722.168841:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39880 with x1830967793812608 ext(2129920->2134015) 00002000:00010000:0.0:1746147722.168844:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe39880 00000100:00100000:0.0:1746147722.207047:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793813632 00000100:00100000:0.0:1746147722.207052:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793813632 00000100:00100000:0.0:1746147722.207077:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4950 00000100:00100000:0.0:1746147722.207083:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:7670:x1830967793813632:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147722.207238:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:7670:x1830967793813632:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 154us (827us total) trans 8589945932 rc 0/0 00000100:00100000:0.0:1746147722.207244:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4950 00000100:00100000:1.0:1746147722.217547:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8179 00000100:00100000:1.0:1746147722.217560:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1957:x1830967793814016:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147722.217575:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147722.217595:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc29a00/0xe64d3fbf12a7cc00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0fa expref: 32 pid: 6715 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.217612:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc29a00/0xe64d3fbf12a7cc00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0fa expref: 32 pid: 6715 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.217630:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc29a00/0xe64d3fbf12a7cc00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 335872->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0fa expref: 32 pid: 6715 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.217645:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.217646:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.217652:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba600/0xe64d3fbf12a7cd34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1be expref: 16 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.217659:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba600/0xe64d3fbf12a7cd34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1be expref: 16 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.217665:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.217666:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.217669:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7cd3b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1c5 expref: 31 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.217674:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7cd3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1c5 expref: 31 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.217696:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7cd3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1c5 expref: 31 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.217706:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796401664:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147722.217772:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba600/0xe64d3fbf12a7cd34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1be expref: 16 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.217779:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796401792:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147722.217794:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147722.223273:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.223342:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.223366:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793814144 00000100:00100000:1.0:1746147722.223373:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793814144 00000100:00100000:1.0:1746147722.223400:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793814272 00000100:00100000:1.0:1746147722.223402:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793814272 00000100:00100000:1.0:1746147722.223417:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16159 00000100:00100000:1.0:1746147722.223423:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793814144:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147722.223436:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.223450:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7200/0xe64d3fbf12a7cd81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb1da expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.223467:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.223469:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.223475:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7200/0xe64d3fbf12a7cd81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1da expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147722.223487:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7200/0xe64d3fbf12a7cd81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1da expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147722.223496:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f7200, rc 0) 00000100:00100000:1.0:1746147722.223527:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793814144:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 104us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.223535:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16159 00000100:00100000:0.0:1746147722.224245:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796401664:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147722.224350:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796401792:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147722.224368:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147722.224396:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1957:x1830967793814016:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6839us (7036us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.224403:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8179 00000100:00100000:0.0:1746147722.227658:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.227686:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793814400 00000100:00100000:0.0:1746147722.227692:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793814400 00000100:00100000:0.0:1746147722.227721:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16161 00000100:00100000:0.0:1746147722.227727:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793814400:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147722.227906:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147722.227920:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc48000/0xe64d3fbf12a7cd8f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb1e8 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147722.227961:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b10b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796402048:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147722.228014:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.228062:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.228123:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.228145:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.228160:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793814784 00000100:00100000:0.0:1746147722.228163:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793814784 00002000:00100000:0.0:1746147722.228183:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009b10a300 x1830967793814784/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147722.228190:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10a300 with x1830967793814784 ext(0->1048575) 00002000:00010000:0.0:1746147722.228194:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b10a300 00000100:00100000:0.0:1746147722.228207:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7179 00000100:00100000:0.0:1746147722.228212:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967793814784:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147722.230844:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793814528 00000100:00100000:1.0:1746147722.230853:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793814528 00000100:00100000:1.0:1746147722.230881:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793814912 00000100:00100000:1.0:1746147722.230900:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793814912 00000100:00100000:1.0:1746147722.230920:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16162 00000100:00100000:1.0:1746147722.230926:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aaba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967793814528:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147722.230938:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.230950:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6400/0xe64d3fbf12a7cd96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb1ef expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.230989:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796402176:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147722.231017:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16163 00000100:00100000:0.0:1746147722.231024:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967793814912:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147722.231033:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147722.231043:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc49800/0xe64d3fbf12a7cd9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb1f6 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.231053:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.231068:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b109880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796402304:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147722.231090:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a57d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.231548:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793815168 00000100:00100000:0.0:1746147722.231552:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793815168 00002000:00100000:0.0:1746147722.231571:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880135813b80 x1830967793815168/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147722.231579:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135813b80 with x1830967793815168 ext(0->1048575) 00002000:00010000:0.0:1746147722.231582:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135813b80 00000100:00100000:0.0:1746147722.231597:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7180 00000100:00100000:0.0:1746147722.231602:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1957:x1830967793815168:12345-192.168.202.10@tcp:3:cat.0 00002000:00010000:0.0:1746147722.235981:0:9615:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime: 1746147722 -> 1746147723 00002000:00010000:0.0:1746147722.235988:0:9615:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime: 1746147722 -> 1746147723 00002000:00010000:0.0:1746147722.235990:0:9615:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime: 1746147722 -> 1746147723 00000100:00100000:0.0:1746147722.236009:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b109880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796402304:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147722.236036:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc49800/0xe64d3fbf12a7cd9d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1f6 expref: 11 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147722.236050:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc49800/0xe64d3fbf12a7cd9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1f6 expref: 11 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147722.236060:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc49800, rc 0) 00000100:00100000:0.0:1746147722.236085:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793814912:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 5059us (7936us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147722.236093:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16163 00000100:00100000:0.0:1746147722.251652:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1957:x1830967793815168:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20041us (20243us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147722.251665:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7180 00002000:00100000:0.0:1746147722.251675:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880135813b80 x1830967793815168/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/440 e 0 to 0 dl 1746147733 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147722.251684:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135813b80 with x1830967793815168 ext(0->1048575) 00002000:00010000:0.0:1746147722.251688:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135813b80 00000100:00100000:0.0:1746147722.251803:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.256305:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967793814784:12345-192.168.202.10@tcp:3:cat.0 Request processed in 28091us (28180us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147722.256314:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7179 00002000:00100000:0.0:1746147722.256322:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009b10a300 x1830967793814784/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:343/0 lens 488/440 e 0 to 0 dl 1746147733 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147722.256331:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10a300 with x1830967793814784 ext(0->1048575) 00002000:00010000:0.0:1746147722.256335:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b10a300 00000100:00100000:0.0:1746147722.259326:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793815808 00000100:00100000:0.0:1746147722.259334:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793815808 00010000:00010000:0.0:1746147722.259364:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57bd400/0xe64d3fbf12a7cd57 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1cc expref: 9 pid: 5744 timeout: 901 lvb_type: 0 00000100:00100000:0.0:1746147722.259395:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8180 00000100:00100000:0.0:1746147722.259402:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967793815808:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147722.259414:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147722.259527:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57bd400/0xe64d3fbf12a7cd57 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1cc expref: 9 pid: 5744 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746147722.259539:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57bd400/0xe64d3fbf12a7cd57 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1cc expref: 9 pid: 5744 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746147722.259557:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147722.259562:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57bc600/0xe64d3fbf12a7cdab lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.259569:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57bc600/0xe64d3fbf12a7cdab lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.259574:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57bc600/0xe64d3fbf12a7cdab lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.259590:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147722.259621:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967793815808:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 220us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.259627:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8180 00000100:00100000:0.0:1746147722.264809:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.277997:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.278043:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.278063:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793816832 00000100:00100000:1.0:1746147722.278069:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793816832 00002000:00100000:1.0:1746147722.278098:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1077247) req@ffff88012f514700 x1830967793816832/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.278106:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514700 with x1830967793816832 ext(1048576->1077247) 00010000:00010000:1.0:1746147722.278116:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fc29600/0xe64d3fbf12a7cc3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb139 expref: 32 pid: 8468 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.278128:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fc29600/0xe64d3fbf12a7cc3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb139 expref: 32 pid: 8468 timeout: 901 lvb_type: 0 00002000:00010000:1.0:1746147722.278139:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f514700 00000100:00100000:1.0:1746147722.278154:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1409 00000100:00100000:1.0:1746147722.278160:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793816832:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147722.282328:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.282357:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793817216 00000100:00100000:0.0:1746147722.282364:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793817216 00000100:00100000:0.0:1746147722.282395:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11937 00000100:00100000:0.0:1746147722.282401:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+8:32046:x1830967793817216:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147722.282415:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147722.282430:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4a00/0xe64d3fbf12a7cdf1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb235 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.282507:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4600/0xe64d3fbf12a7cdf8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147722.282518:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4600/0xe64d3fbf12a7cdf8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147722.282527:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4600/0xe64d3fbf12a7cdf8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147722.282537:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4600/0xe64d3fbf12a7cdf8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147722.282542:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4600/0xe64d3fbf12a7cdf8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147722.282547:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4600/0xe64d3fbf12a7cdf8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147722.282552:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cef4600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147722.282555:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4600/0xe64d3fbf12a7cdf8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147722.282561:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4600/0xe64d3fbf12a7cdf8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147722.282568:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147722.282571:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147722.282574:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4600/0xe64d3fbf12a7cdf8 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147722.282579:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4600/0xe64d3fbf12a7cdf8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147722.282601:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4a00/0xe64d3fbf12a7cdf1 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb235 expref: 9 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.282607:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4a00/0xe64d3fbf12a7cdf1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb235 expref: 9 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.282613:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cef4a00, rc 0) 00000100:00100000:0.0:1746147722.282645:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+8:32046:x1830967793817216:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 244us (324us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147722.282651:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11937 00000100:00100000:1.0:1746147722.286909:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793816832:12345-192.168.202.10@tcp:4:cat.0 Request processed in 8744us (8911us total) trans 21474841531 rc 0/0 00000100:00100000:1.0:1746147722.286919:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1409 00002000:00100000:1.0:1746147722.286929:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1077247) req@ffff88012f514700 x1830967793816832/t21474841531(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/448 e 0 to 0 dl 1746147733 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.286937:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514700 with x1830967793816832 ext(1048576->1077247) 00010000:00010000:1.0:1746147722.286945:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fc29600/0xe64d3fbf12a7cc3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb139 expref: 34 pid: 8468 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.286956:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fc29600/0xe64d3fbf12a7cc3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb139 expref: 34 pid: 8468 timeout: 901 lvb_type: 0 00002000:00010000:1.0:1746147722.286963:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f514700 00000100:00100000:1.0:1746147722.296149:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.296224:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.296270:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793817600 00000100:00100000:1.0:1746147722.296275:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793817600 00000100:00100000:1.0:1746147722.296300:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4951 00000100:00100000:1.0:1746147722.296306:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6669850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+8:32046:x1830967793817600:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:1.0:1746147722.296435:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6669850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+9:32046:x1830967793817600:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 129us (211us total) trans 8589945935 rc 0/0 00000100:00100000:1.0:1746147722.296441:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4951 00000100:00100000:1.0:1746147722.296498:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793817344 00000100:00100000:1.0:1746147722.296501:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793817344 00002000:00100000:1.0:1746147722.296521:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1196032->1744895) req@ffff88012f514e00 x1830967793817344/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.296530:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514e00 with x1830967793817344 ext(1196032->1744895) 00010000:00010000:1.0:1746147722.296535:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7cc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb171 expref: 17 pid: 7050 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.296544:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7cc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb171 expref: 17 pid: 7050 timeout: 901 lvb_type: 0 00002000:00010000:1.0:1746147722.296550:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f514e00 00000100:00100000:1.0:1746147722.296562:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1410 00000100:00100000:1.0:1746147722.296567:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967793817344:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147722.302518:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.305058:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793817728 00000100:00100000:0.0:1746147722.305067:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793817728 00010000:00010000:0.0:1746147722.305097:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc29600/0xe64d3fbf12a7cc3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb139 expref: 34 pid: 8468 timeout: 901 lvb_type: 0 00000100:00100000:0.0:1746147722.305120:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8182 00000100:00100000:0.0:1746147722.305126:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793817728:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147722.305136:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147722.305152:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc29600/0xe64d3fbf12a7cc3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb139 expref: 34 pid: 8468 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746147722.305162:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc29600/0xe64d3fbf12a7cc3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb139 expref: 34 pid: 8468 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746147722.305183:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc29600/0xe64d3fbf12a7cc3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb139 expref: 34 pid: 8468 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746147722.305194:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.305196:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.305201:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136404a00/0xe64d3fbf12a7cdc7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb20b expref: 26 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.305208:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136404a00/0xe64d3fbf12a7cdc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb20b expref: 26 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.305235:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136404a00/0xe64d3fbf12a7cdc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb20b expref: 26 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147722.305245:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b108e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796403456:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147722.305309:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ea0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147722.313640:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.313664:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793817984 00000100:00100000:1.0:1746147722.313670:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793817984 00000100:00100000:1.0:1746147722.313706:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11938 00000100:00100000:1.0:1746147722.313712:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:32048:x1830967793817984:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147722.313730:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.313751:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62f800/0xe64d3fbf12a7cdff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb23c expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.313835:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62fa00/0xe64d3fbf12a7ce06 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.313845:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62fa00/0xe64d3fbf12a7ce06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.313853:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62fa00/0xe64d3fbf12a7ce06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.313862:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62f400/0xe64d3fbf12a7ce0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.313866:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62f400/0xe64d3fbf12a7ce0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.313870:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62f400/0xe64d3fbf12a7ce0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.320796:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62ec00/0xe64d3fbf12a7ce14 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.320811:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62ec00/0xe64d3fbf12a7ce14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.320820:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62ec00/0xe64d3fbf12a7ce14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:1.0:1746147722.320829:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147722.320922:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62fa00/0xe64d3fbf12a7ce06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.320929:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62fa00/0xe64d3fbf12a7ce06 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.320938:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62fa00/0xe64d3fbf12a7ce06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.320942:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800aa62fa00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147722.320945:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62fa00/0xe64d3fbf12a7ce06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.320951:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62fa00/0xe64d3fbf12a7ce06 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.320961:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147722.320963:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147722.320967:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62fa00/0xe64d3fbf12a7ce06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.320971:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62fa00/0xe64d3fbf12a7ce06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.320984:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62f400/0xe64d3fbf12a7ce0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.320989:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62f400/0xe64d3fbf12a7ce0d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.320993:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62f400/0xe64d3fbf12a7ce0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.320996:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800aa62f400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147722.320998:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62f400/0xe64d3fbf12a7ce0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.321003:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62f400/0xe64d3fbf12a7ce0d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.321012:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c2ae400) 00010000:00010000:1.0:1746147722.321014:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147722.321016:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62f400/0xe64d3fbf12a7ce0d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.321020:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62f400/0xe64d3fbf12a7ce0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.321061:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62f800/0xe64d3fbf12a7cdff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb23c expref: 332 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.321070:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62ec00/0xe64d3fbf12a7ce14 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb23c expref: 331 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.321076:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147722.321077:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147722.321079:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800aa62ec00, rc 0) 00000100:00100000:1.0:1746147722.321120:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+331:32048:x1830967793817984:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 7407us (7484us total) trans 8589945936 rc 0/0 00000100:00100000:1.0:1746147722.321126:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11938 00000100:00100000:1.0:1746147722.321266:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.321302:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b108e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796403456:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147722.321321:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147722.321344:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967793817728:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 16219us (18834us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.321352:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8182 00000100:00100000:1.0:1746147722.321375:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793818240 00000100:00100000:1.0:1746147722.321380:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793818240 00002000:00100000:1.0:1746147722.321405:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88012f515880 x1830967793818240/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.321414:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f515880 with x1830967793818240 ext(1048576->2097151) 00002000:00010000:1.0:1746147722.321417:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f515880 00000100:00100000:1.0:1746147722.321433:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7182 00000100:00100000:1.0:1746147722.321439:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967793818240:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147722.356181:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.356239:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.356259:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793818368 00000100:00100000:1.0:1746147722.356265:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793818368 00000100:00100000:1.0:1746147722.356294:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16170 00000100:00100000:1.0:1746147722.356300:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:32041:x1830967793818368:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147722.356314:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.356327:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801317ac200/0xe64d3fbf12a7ce22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb243 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.356345:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147722.356349:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317ac200/0xe64d3fbf12a7ce22 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb243 expref: 20 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.356359:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801317ac200/0xe64d3fbf12a7ce22 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb243 expref: 20 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.356368:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801317ac200, rc 0) 00000100:00100000:1.0:1746147722.356402:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32041:x1830967793818368:12345-192.168.202.10@tcp:101:cat.0 Request processed in 102us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.356410:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16170 00000100:00100000:1.0:1746147722.356427:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793818496 00000100:00100000:1.0:1746147722.356429:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793818496 00010000:00010000:1.0:1746147722.356440:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7cc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb171 expref: 20 pid: 7050 timeout: 901 lvb_type: 0 00000100:00100000:1.0:1746147722.356454:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8183 00000100:00100000:1.0:1746147722.356459:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1957:x1830967793818496:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147722.356465:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147722.356478:0:7095:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:1.0:1746147722.356483:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7cc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1196032->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb171 expref: 20 pid: 7050 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.356491:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7cc93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1196032->1744895) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb171 expref: 20 pid: 7050 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.357326:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7cc93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1196032->1744895) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb171 expref: 20 pid: 7050 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.357336:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.357337:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.357342:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136404e00/0xe64d3fbf12a7cdea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb22e expref: 31 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.357349:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136404e00/0xe64d3fbf12a7cdea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb22e expref: 31 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.357359:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.357360:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.357363:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801317ac200/0xe64d3fbf12a7ce22 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb243 expref: 19 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.357369:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801317ac200/0xe64d3fbf12a7ce22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb243 expref: 19 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.357393:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801317ac200/0xe64d3fbf12a7ce22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb243 expref: 19 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.357403:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796403584:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147722.358315:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136404e00/0xe64d3fbf12a7cdea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb22e expref: 31 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.358325:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796403712:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147722.358353:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a917900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147722.360248:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796403584:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147722.362939:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.367142:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796403712:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147722.367164:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147722.367199:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967793818496:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 10738us (10957us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.367208:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8183 00000100:00100000:1.0:1746147722.372870:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793818880 00000100:00100000:1.0:1746147722.372877:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793818880 00000100:00100000:1.0:1746147722.372921:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16171 00000100:00100000:1.0:1746147722.372927:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:32045:x1830967793818880:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147722.372942:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.372955:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013013ba00/0xe64d3fbf12a7ce29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb24a expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.372978:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00bb000/0xe64d3fbf12a7ccd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb18d expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.372984:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147722.372985:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147722.372988:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013013ba00/0xe64d3fbf12a7ce29 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3944448->4194303] (req 3944448->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb24a expref: 8 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.373010:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00bb000/0xe64d3fbf12a7ccd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb18d expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.373019:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a00bb000/0xe64d3fbf12a7ccd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb18d expref: 16 pid: 7050 timeout: 901 lvb_type: 0 00000100:00100000:1.0:1746147722.373029:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796403840:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147722.373216:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793819136 00000100:00100000:0.0:1746147722.373220:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793819136 00002000:00100000:0.0:1746147722.373243:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a02adf80 x1830967793819136/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147722.373251:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02adf80 with x1830967793819136 ext(1048576->2097151) 00002000:00010000:0.0:1746147722.373255:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02adf80 00000100:00100000:0.0:1746147722.373266:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7184 00000100:00100000:0.0:1746147722.373270:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1957:x1830967793819136:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147722.391489:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1957:x1830967793819136:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18207us (18286us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147722.391506:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7184 00002000:00100000:0.0:1746147722.391518:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a02adf80 x1830967793819136/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/440 e 0 to 0 dl 1746147733 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147722.391527:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02adf80 with x1830967793819136 ext(1048576->2097151) 00002000:00010000:0.0:1746147722.391533:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02adf80 00000100:00100000:0.0:1746147722.395991:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796404096:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147722.396018:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935e0400/0xe64d3fbf12a7ce37 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb251 expref: 20 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147722.396030:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935e0400/0xe64d3fbf12a7ce37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb251 expref: 20 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147722.396039:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935e0400, rc 0) 00000100:00100000:0.0:1746147722.396060:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967793819392:12345-192.168.202.10@tcp:101:cat.0 Request processed in 10945us (11116us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147722.396066:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16173 00000100:00100000:0.0:1746147722.403141:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.403806:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16174 00000100:00100000:1.0:1746147722.403820:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32041:x1830967793819648:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147722.403836:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.403853:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013013a800/0xe64d3fbf12a7ce3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb25f expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.403879:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe53800/0xe64d3fbf12a7ccbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb17f expref: 19 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.403902:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147722.403904:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147722.403907:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013013a800/0xe64d3fbf12a7ce3e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb25f expref: 10 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.403933:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe53800/0xe64d3fbf12a7ccbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb17f expref: 19 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.403942:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe53800/0xe64d3fbf12a7ccbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb17f expref: 19 pid: 7050 timeout: 901 lvb_type: 0 00000100:00100000:1.0:1746147722.403952:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796404224:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147722.404020:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.410251:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.410283:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.410357:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.410382:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793820032 00000100:00100000:0.0:1746147722.410389:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793820032 00002000:00100000:0.0:1746147722.410425:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3108863) req@ffff88009b10b480 x1830967793820032/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147722.410440:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10b480 with x1830967793820032 ext(2097152->3108863) 00010000:00010000:0.0:1746147722.410448:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe53800/0xe64d3fbf12a7ccbd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb17f expref: 20 pid: 7050 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746147722.410459:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe53800/0xe64d3fbf12a7ccbd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb17f expref: 20 pid: 7050 timeout: 901 lvb_type: 0 00002000:00010000:0.0:1746147722.410467:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b10b480 00000100:00100000:1.0:1746147722.410630:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793820160 00000100:00100000:1.0:1746147722.410634:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793820160 00010000:00010000:1.0:1746147722.410657:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00bb000/0xe64d3fbf12a7ccd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb18d expref: 19 pid: 7050 timeout: 901 lvb_type: 0 00000100:00100000:0.0:1746147722.411233:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1412 00000100:00100000:0.0:1746147722.411241:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967793820032:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147722.411324:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8184 00000100:00100000:1.0:1746147722.411329:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ace300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1957:x1830967793820160:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147722.411337:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147722.411352:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00bb000/0xe64d3fbf12a7ccd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb18d expref: 19 pid: 7050 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.411361:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00bb000/0xe64d3fbf12a7ccd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb18d expref: 19 pid: 7050 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.411379:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00bb000/0xe64d3fbf12a7ccd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb18d expref: 19 pid: 7050 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.411394:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.411395:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.411401:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013013ba00/0xe64d3fbf12a7ce29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb24a expref: 7 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.411408:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013013ba00/0xe64d3fbf12a7ce29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb24a expref: 7 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.411432:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013013ba00/0xe64d3fbf12a7ce29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb24a expref: 7 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.411442:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796404352:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147722.411479:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.417735:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.417866:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796404352:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147722.417910:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147722.417950:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ace300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1957:x1830967793820160:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6619us (7591us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.417960:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8184 00000100:00100000:0.0:1746147722.431452:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.431963:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.433828:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.434398:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793820800 00000100:00100000:1.0:1746147722.434406:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793820800 00010000:00010000:1.0:1746147722.434434:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe53800/0xe64d3fbf12a7ccbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb17f expref: 22 pid: 7050 timeout: 901 lvb_type: 0 00000100:00100000:1.0:1746147722.434468:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8185 00000100:00100000:1.0:1746147722.434474:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967793820800:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147722.434485:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147722.434503:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe53800/0xe64d3fbf12a7ccbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb17f expref: 22 pid: 7050 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.434514:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe53800/0xe64d3fbf12a7ccbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb17f expref: 22 pid: 7050 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.434533:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe53800/0xe64d3fbf12a7ccbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb17f expref: 22 pid: 7050 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.434555:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.434556:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.434562:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013013a800/0xe64d3fbf12a7ce3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb25f expref: 10 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.434570:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013013a800/0xe64d3fbf12a7ce3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb25f expref: 10 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.434577:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.434578:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.434581:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135564000/0xe64d3fbf12a7ce45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4800511) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb266 expref: 10 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.434592:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135564000/0xe64d3fbf12a7ce45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4800511) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb266 expref: 10 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.434617:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135564000/0xe64d3fbf12a7ce45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4800511) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb266 expref: 10 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.434627:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796404608:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147722.434708:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013013a800/0xe64d3fbf12a7ce3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb25f expref: 10 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.434715:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796404736:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147722.434731:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.435043:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.444089:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.445418:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796404608:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147722.445531:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.445556:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793821440 00000100:00100000:0.0:1746147722.445559:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793821440 00000100:00100000:1.0:1746147722.445627:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796404736:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147722.445652:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147722.445696:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967793820800:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 11221us (11871us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.445705:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8185 00002000:00100000:0.0:1746147722.446241:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4796416->4800511) req@ffff88009fe38380 x1830967793821440/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147722.446249:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe38380 with x1830967793821440 ext(4796416->4800511) 00002000:00010000:0.0:1746147722.446253:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe38380 00000100:00100000:0.0:1746147722.446274:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7187 00000100:00100000:0.0:1746147722.446280:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967793821440:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147722.446406:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967793821440:12345-192.168.202.10@tcp:3:cat.0 Request processed in 126us (875us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147722.446412:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7187 00002000:00100000:0.0:1746147722.446417:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4796416->4800511) req@ffff88009fe38380 x1830967793821440/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:343/0 lens 488/4536 e 0 to 0 dl 1746147733 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147722.446423:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe38380 with x1830967793821440 ext(4796416->4800511) 00002000:00010000:0.0:1746147722.446425:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe38380 00000100:00100000:0.0:1746147722.453983:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.454018:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.454172:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793821568 00000100:00100000:1.0:1746147722.454182:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793821568 00010000:00010000:1.0:1746147722.454217:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013013ba00/0xe64d3fbf12a7ce29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb24a expref: 10 pid: 21480 timeout: 901 lvb_type: 0 00000100:00100000:1.0:1746147722.454245:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8186 00000100:00100000:1.0:1746147722.454252:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2378050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1957:x1830967793821568:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147722.454264:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147722.454286:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013013ba00/0xe64d3fbf12a7ce29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb24a expref: 10 pid: 21480 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.454298:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013013ba00/0xe64d3fbf12a7ce29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb24a expref: 10 pid: 21480 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.454322:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013013ba00/0xe64d3fbf12a7ce29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb24a expref: 10 pid: 21480 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.454340:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.454342:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.454349:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a542ee00/0xe64d3fbf12a7ce4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb26d expref: 18 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.454357:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a542ee00/0xe64d3fbf12a7ce4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb26d expref: 18 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.454387:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a542ee00/0xe64d3fbf12a7ce4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb26d expref: 18 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.454398:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796404864:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147722.454473:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.456144:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.456183:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793821952 00000100:00100000:1.0:1746147722.456187:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793821952 00000100:00100000:1.0:1746147722.456222:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4952 00000100:00100000:1.0:1746147722.456228:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32045:x1830967793821952:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:1.0:1746147722.456524:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32045:x1830967793821952:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 296us (380us total) trans 8589945937 rc 0/0 00000100:00100000:1.0:1746147722.456530:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4952 00000100:00100000:1.0:1746147722.458905:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796404864:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147722.458909:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147722.458923:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147722.458930:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.458954:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2378050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1957:x1830967793821568:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4702us (4985us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.458963:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8186 00000100:00100000:1.0:1746147722.459004:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8187 00000100:00100000:1.0:1746147722.459010:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+6:1958:x1830967793822208:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147722.459019:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147722.459035:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7200/0xe64d3fbf12a7cd81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1da expref: 6 pid: 8468 timeout: 901 lvb_type: 1 00010000:00010000:1.0:1746147722.459045:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7200/0xe64d3fbf12a7cd81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1da expref: 6 pid: 8468 timeout: 901 lvb_type: 1 00010000:00010000:1.0:1746147722.459074:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7200/0xe64d3fbf12a7cd81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb1da expref: 6 pid: 8468 timeout: 901 lvb_type: 1 00010000:00010000:1.0:1746147722.459085:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147722.459102:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+5:1958:x1830967793822208:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 93us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.459108:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8187 00000100:00100000:0.0:1746147722.465421:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793822464 00000100:00100000:0.0:1746147722.465425:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793822464 00000100:00100000:0.0:1746147722.465449:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16178 00000100:00100000:0.0:1746147722.465453:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32041:x1830967793822464:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147722.465464:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147722.465483:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0029200/0xe64d3fbf12a7ce5a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb27b expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.465495:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.465496:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.465500:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0029200/0xe64d3fbf12a7ce5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb27b expref: 10 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.465514:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0029200/0xe64d3fbf12a7ce5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb27b expref: 10 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.465521:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0029200, rc 0) 00000100:00100000:0.0:1746147722.465821:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32041:x1830967793822464:12345-192.168.202.10@tcp:101:cat.0 Request processed in 365us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.465827:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16178 00000100:00100000:0.0:1746147722.466353:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.470779:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.481269:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793823104 00000100:00100000:0.0:1746147722.481274:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793823104 00000100:00100000:0.0:1746147722.482045:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16179 00000100:00100000:0.0:1746147722.482053:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:32048:x1830967793823104:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147722.482062:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147722.482077:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7ce61 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb282 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.482099:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136404a00/0xe64d3fbf12a7cdc7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb20b expref: 10 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.482106:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.482108:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.482111:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7ce61 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->1601535] (req 1048576->1601535) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb282 expref: 20 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.482134:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136404a00/0xe64d3fbf12a7cdc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb20b expref: 10 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.482145:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136404a00/0xe64d3fbf12a7cdc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb20b expref: 10 pid: 8468 timeout: 901 lvb_type: 0 00000100:00100000:0.0:1746147722.482154:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796405504:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147722.482218:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.482654:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.482690:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.482752:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793823616 00000100:00100000:1.0:1746147722.482757:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793823616 00002000:00100000:1.0:1746147722.482779:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fd18700 x1830967793823616/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.482786:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18700 with x1830967793823616 ext(3145728->4194303) 00002000:00010000:1.0:1746147722.482790:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd18700 00000100:00100000:1.0:1746147722.482799:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793823872 00000100:00100000:1.0:1746147722.482801:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793823872 00002000:00100000:1.0:1746147722.482810:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fd19880 x1830967793823872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.482815:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19880 with x1830967793823872 ext(3145728->4194303) 00002000:00010000:1.0:1746147722.482818:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd19880 00000100:00100000:1.0:1746147722.482826:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7191 00000100:00100000:1.0:1746147722.482830:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793823616:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147722.485378:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.486644:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796405504:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147722.486670:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7ce61 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->1601535] (req 1048576->1601535) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb282 expref: 20 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.486683:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931ce400, rc 0) 00000100:00100000:0.0:1746147722.486711:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:32048:x1830967793823104:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4659us (6357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.486718:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16179 00000100:00100000:0.0:1746147722.486750:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793824000 00000100:00100000:0.0:1746147722.486754:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793824000 00000100:00100000:0.0:1746147722.486779:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16180 00000100:00100000:0.0:1746147722.486784:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32042:x1830967793824000:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147722.486794:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147722.486806:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931ce600/0xe64d3fbf12a7ce68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb289 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.486825:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.486827:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.486833:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931ce600/0xe64d3fbf12a7ce68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb289 expref: 22 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.486842:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931ce600/0xe64d3fbf12a7ce68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb289 expref: 22 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.486848:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931ce600, rc 0) 00000100:00100000:0.0:1746147722.486862:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:32042:x1830967793824000:12345-192.168.202.10@tcp:101:cat.0 Request processed in 78us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.486866:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16180 00000100:00100000:0.0:1746147722.495721:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.501616:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.501663:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.512625:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.515404:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793824896 00000100:00100000:1.0:1746147722.515416:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793824896 00002000:00100000:1.0:1746147722.515458:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1597440->1601535) req@ffff88009ce63800 x1830967793824896/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.515467:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63800 with x1830967793824896 ext(1597440->1601535) 00002000:00010000:1.0:1746147722.515473:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce63800 00000100:00100000:1.0:1746147722.516248:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7195 00000100:00100000:1.0:1746147722.516256:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967793824896:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147722.516405:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967793824896:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 151us (3787us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147722.516410:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7195 00002000:00100000:1.0:1746147722.516415:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1597440->1601535) req@ffff88009ce63800 x1830967793824896/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/4536 e 0 to 0 dl 1746147733 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.516422:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63800 with x1830967793824896 ext(1597440->1601535) 00002000:00010000:1.0:1746147722.516424:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce63800 00000100:00100000:0.0:1746147722.518435:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.521332:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793825152 00000100:00100000:1.0:1746147722.521340:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793825152 00000100:00100000:1.0:1746147722.521380:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4953 00000100:00100000:1.0:1746147722.521385:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+331:32048:x1830967793825152:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:1.0:1746147722.521559:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+332:32048:x1830967793825152:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 172us (3124us total) trans 8589945938 rc 0/0 00000100:00100000:1.0:1746147722.521565:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4953 00000100:00100000:0.0:1746147722.521939:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.521953:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.521968:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.529806:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.530040:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793825664 00000100:00100000:0.0:1746147722.530045:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793825664 00000100:00100000:0.0:1746147722.530071:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16184 00000100:00100000:0.0:1746147722.530078:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967793825664:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147722.530088:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147722.530099:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7ce84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb2a5 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147722.530133:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5488000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796406144:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147722.530179:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.535944:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.537210:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.540261:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793826176 00000100:00100000:0.0:1746147722.540266:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793826176 00002000:00100000:0.0:1746147722.540290:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4800511) req@ffff88012ee58700 x1830967793826176/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147722.540298:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58700 with x1830967793826176 ext(4194304->4800511) 00010000:00010000:0.0:1746147722.540304:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135564000/0xe64d3fbf12a7ce45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4800511) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb266 expref: 12 pid: 8468 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746147722.540315:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135564000/0xe64d3fbf12a7ce45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4800511) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb266 expref: 12 pid: 8468 timeout: 901 lvb_type: 0 00002000:00010000:0.0:1746147722.540320:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ee58700 00000100:00100000:0.0:1746147722.540346:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1415 00000100:00100000:0.0:1746147722.540352:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967793826176:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147722.557309:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.557354:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.557541:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16187 00000100:00100000:0.0:1746147722.557547:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967793826304:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147722.557555:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147722.557567:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935e0a00/0xe64d3fbf12a7ce99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb2b3 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147722.557847:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5488380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796406528:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147722.561428:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.564630:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796406784:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147722.564644:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147722.564683:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967793826688:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3076us (3255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.564692:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8191 00000100:00100000:0.0:1746147722.565483:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.569585:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.580380:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.588353:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.593100:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.593385:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793827840 00000100:00100000:1.0:1746147722.593393:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793827840 00000100:00100000:1.0:1746147722.593442:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11939 00000100:00100000:1.0:1746147722.593448:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32053:x1830967793827840:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147722.593469:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.593484:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7cebc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb2dd expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.593622:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cec3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.593634:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.593642:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.593656:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5e00/0xe64d3fbf12a7ceca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.593661:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5e00/0xe64d3fbf12a7ceca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.593666:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5e00/0xe64d3fbf12a7ceca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.593846:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ced1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.593854:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ced1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.593859:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ced1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:1.0:1746147722.593867:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147722.593955:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.593962:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cec3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.593967:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cec3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.593973:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801348e5400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147722.593975:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cec3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.593981:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cec3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.593990:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147722.593993:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147722.593996:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cec3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.594001:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.594027:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5e00/0xe64d3fbf12a7ceca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.595243:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5e00/0xe64d3fbf12a7ceca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.595248:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5e00/0xe64d3fbf12a7ceca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.595252:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801348e5e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147722.595254:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5e00/0xe64d3fbf12a7ceca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.595259:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5e00/0xe64d3fbf12a7ceca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.595266:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801354cb200) 00010000:00010000:1.0:1746147722.595268:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147722.595271:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5e00/0xe64d3fbf12a7ceca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.595275:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5e00/0xe64d3fbf12a7ceca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.595317:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7cebc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2dd expref: 19 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.595328:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ced1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2dd expref: 18 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.595333:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147722.595335:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147722.595337:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0249a00, rc 0) 00000100:00100000:1.0:1746147722.597723:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32053:x1830967793827840:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4268us (4623us total) trans 8589945939 rc 0/0 00000100:00100000:1.0:1746147722.597733:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11939 00000100:00100000:0.0:1746147722.621385:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.631449:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.631511:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.631556:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793828352 00000100:00100000:0.0:1746147722.631565:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793828352 00010000:00010000:0.0:1746147722.631604:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0029200/0xe64d3fbf12a7ce5a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb27b expref: 11 pid: 9615 timeout: 901 lvb_type: 0 00000100:00100000:0.0:1746147722.631641:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793828480 00000100:00100000:0.0:1746147722.631643:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793828480 00010000:00010000:0.0:1746147722.631654:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a542ee00/0xe64d3fbf12a7ce4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb26d expref: 20 pid: 9615 timeout: 901 lvb_type: 0 00000100:00100000:0.0:1746147722.631670:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8192 00000100:00100000:0.0:1746147722.631678:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967793828352:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147722.631693:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147722.631719:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0029200/0xe64d3fbf12a7ce5a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb27b expref: 11 pid: 9615 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746147722.631730:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0029200/0xe64d3fbf12a7ce5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb27b expref: 11 pid: 9615 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746147722.631771:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147722.631816:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967793828352:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 138us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.631824:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8192 00000100:00100000:0.0:1746147722.637013:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.642187:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.646301:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.709444:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.721491:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.723631:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.723660:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793829888 00000100:00100000:0.0:1746147722.723663:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793829888 00002000:00100000:0.0:1746147722.723680:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1601536->2097151) req@ffff88008fb76300 x1830967793829888/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147722.723687:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb76300 with x1830967793829888 ext(1601536->2097151) 00002000:00010000:0.0:1746147722.723690:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb76300 00000100:00100000:0.0:1746147722.724703:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7202 00000100:00100000:0.0:1746147722.724710:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1958:x1830967793829888:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147722.736215:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1958:x1830967793829888:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11497us (12575us total) trans 0 rc 495616/495616 00000100:00100000:1.0:1746147722.736228:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7202 00002000:00100000:1.0:1746147722.736238:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1601536->2097151) req@ffff88008fb76300 x1830967793829888/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/440 e 0 to 0 dl 1746147733 ref 1 fl Complete:/200/0 rc 495616/495616 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.736246:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb76300 with x1830967793829888 ext(1601536->2097151) 00002000:00010000:1.0:1746147722.736251:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb76300 00000100:00100000:0.0:1746147722.755782:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.757841:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793830144 00000100:00100000:1.0:1746147722.757855:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793830144 00000100:00100000:1.0:1746147722.757961:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11940 00000100:00100000:1.0:1746147722.757968:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+332:32062:x1830967793830144:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147722.757995:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.758015:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7ceed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb2f2 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.758114:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249600/0xe64d3fbf12a7cef4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.758129:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136405200/0xe64d3fbf12a7cdc0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb204 expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.758140:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62ec00/0xe64d3fbf12a7ce14 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb23c expref: 333 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.758148:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ced1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2dd expref: 19 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.758154:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249600/0xe64d3fbf12a7cef4 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.758184:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ced1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2dd expref: 19 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.758194:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ced1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2dd expref: 19 pid: 5744 timeout: 901 lvb_type: 0 00000100:00100000:1.0:1746147722.758205:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796407680:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147722.758325:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62ec00/0xe64d3fbf12a7ce14 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb23c expref: 333 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.758334:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62ec00/0xe64d3fbf12a7ce14 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb23c expref: 333 pid: 5744 timeout: 901 lvb_type: 0 00000100:00100000:1.0:1746147722.758341:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796407808:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147722.758366:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136405200/0xe64d3fbf12a7cdc0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb204 expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.760796:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136405200/0xe64d3fbf12a7cdc0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb204 expref: 8 pid: 14546 timeout: 901 lvb_type: 0 00000100:00100000:1.0:1746147722.760811:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796407936:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147722.760922:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.761328:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.766916:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.766947:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.766976:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.767022:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793830528 00000100:00100000:0.0:1746147722.767030:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793830528 00010000:00010000:0.0:1746147722.767064:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ced1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2dd expref: 20 pid: 5744 timeout: 901 lvb_type: 0 00000100:00100000:0.0:1746147722.767088:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793830656 00000100:00100000:0.0:1746147722.767090:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793830656 00010000:00010000:0.0:1746147722.767099:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62ec00/0xe64d3fbf12a7ce14 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb23c expref: 334 pid: 5744 timeout: 901 lvb_type: 0 00000100:00100000:0.0:1746147722.767111:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793830784 00000100:00100000:0.0:1746147722.767112:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793830784 00010000:00010000:0.0:1746147722.767120:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136405200/0xe64d3fbf12a7cdc0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb204 expref: 9 pid: 14546 timeout: 901 lvb_type: 0 00000100:00100000:0.0:1746147722.767132:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8194 00000100:00100000:0.0:1746147722.767138:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793830528:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147722.767152:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147722.767157:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ced1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2dd expref: 20 pid: 5744 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746147722.767167:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ced1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2dd expref: 20 pid: 5744 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746147722.767195:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147722.767200:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249600/0xe64d3fbf12a7cef4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.767208:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249600/0xe64d3fbf12a7cef4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.767214:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147722.767254:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793830528:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 116us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.767261:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8194 00000100:00100000:0.0:1746147722.767278:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8196 00000100:00100000:0.0:1746147722.767282:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793830784:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147722.767289:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147722.767294:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136405200/0xe64d3fbf12a7cdc0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb204 expref: 9 pid: 14546 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746147722.767316:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136405200/0xe64d3fbf12a7cdc0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb204 expref: 9 pid: 14546 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746147722.767326:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147722.767329:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249600/0xe64d3fbf12a7cef4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.767336:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249600/0xe64d3fbf12a7cef4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.767343:0:7312:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249600/0xe64d3fbf12a7cef4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.767360:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147722.767377:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793830784:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 94us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.767382:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8196 00010000:00010000:1.0:1746147722.767484:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ced1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2dd expref: 19 pid: 5744 timeout: 901 lvb_type: 0 00000100:00100000:1.0:1746147722.767508:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796407680:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147722.767517:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800aa62ec00/0xe64d3fbf12a7ce14 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb23c expref: 333 pid: 5744 timeout: 901 lvb_type: 0 00000100:00100000:1.0:1746147722.767525:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796407808:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147722.767532:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136405200/0xe64d3fbf12a7cdc0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb204 expref: 8 pid: 14546 timeout: 901 lvb_type: 0 00000100:00100000:1.0:1746147722.767540:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796407936:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147722.767560:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249600/0xe64d3fbf12a7cef4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.767568:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249600/0xe64d3fbf12a7cef4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.767572:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249600/0xe64d3fbf12a7cef4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:1.0:1746147722.767591:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147722.767726:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7ceed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2f2 expref: 334 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.767748:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249600/0xe64d3fbf12a7cef4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2f2 expref: 333 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.767753:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147722.767756:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147722.767758:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0249600, rc 0) 00000100:00100000:1.0:1746147722.767783:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:32062:x1830967793830144:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 9816us (12014us total) trans 8589945942 rc 0/0 00000100:00100000:1.0:1746147722.767790:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11940 00000100:00100000:0.0:1746147722.781618:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147722.781703:0:7099:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147722.784778:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.788718:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.788997:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793831296 00000100:00100000:1.0:1746147722.789010:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793831296 00000100:00100000:1.0:1746147722.789080:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11941 00000100:00100000:1.0:1746147722.789089:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:32064:x1830967793831296:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147722.789116:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.789135:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248600/0xe64d3fbf12a7cf09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb300 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.789247:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7cf10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.789260:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7cf10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.789270:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7cf10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.789287:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7cf17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.789291:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7cf17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.789296:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7cf17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.789396:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7cf1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.789404:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7cf1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.789410:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7cf1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:1.0:1746147722.789418:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147722.790642:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7cf10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.790650:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7cf10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.790656:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7cf10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.790660:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0248c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147722.790664:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7cf10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.790669:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7cf10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.790680:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147722.790683:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147722.790687:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7cf10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.790692:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7cf10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.791276:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7cf17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.791282:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7cf17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.791287:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7cf17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.791292:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0249000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147722.791294:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7cf17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.791299:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7cf17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.791307:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a8a08500) 00010000:00010000:1.0:1746147722.791309:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147722.791311:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7cf17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.791315:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7cf17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.791372:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248600/0xe64d3fbf12a7cf09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb300 expref: 22 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.791384:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7cf1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb300 expref: 21 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.791390:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147722.791392:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147722.791394:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248200, rc 0) 00000100:00100000:1.0:1746147722.791450:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32064:x1830967793831296:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2362us (2736us total) trans 8589945943 rc 0/0 00000100:00100000:1.0:1746147722.791458:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11941 00000100:00100000:1.0:1746147722.795328:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.797692:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.804158:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.820918:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.820968:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.821059:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793831936 00000100:00100000:1.0:1746147722.821068:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793831936 00002000:00100000:1.0:1746147722.821107:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a0227480 x1830967793831936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.821115:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0227480 with x1830967793831936 ext(2097152->3145727) 00010000:00010000:1.0:1746147722.821124:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fc4400/0xe64d3fbf12a7cf02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2f9 expref: 21 pid: 21480 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.821136:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fc4400/0xe64d3fbf12a7cf02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2f9 expref: 21 pid: 21480 timeout: 901 lvb_type: 0 00002000:00010000:1.0:1746147722.821142:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0227480 00000100:00100000:1.0:1746147722.821158:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793832192 00000100:00100000:1.0:1746147722.821160:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793832192 00002000:00100000:1.0:1746147722.821169:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a0226d80 x1830967793832192/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.821180:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0226d80 with x1830967793832192 ext(3145728->4194303) 00010000:00010000:1.0:1746147722.821184:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fc4400/0xe64d3fbf12a7cf02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2f9 expref: 22 pid: 21480 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746147722.821190:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fc4400/0xe64d3fbf12a7cf02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2f9 expref: 22 pid: 21480 timeout: 901 lvb_type: 0 00002000:00010000:1.0:1746147722.821195:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0226d80 00000100:00100000:1.0:1746147722.821208:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1417 00000100:00100000:1.0:1746147722.821214:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967793831936:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147722.840810:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967793831936:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 19587us (19890us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147722.840820:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1417 00002000:00100000:1.0:1746147722.840829:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a0227480 x1830967793831936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/440 e 0 to 0 dl 1746147733 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.840837:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0227480 with x1830967793831936 ext(2097152->3145727) 00010000:00010000:1.0:1746147722.840844:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fc4400/0xe64d3fbf12a7cf02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2f9 expref: 21 pid: 21480 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.840857:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fc4400/0xe64d3fbf12a7cf02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2f9 expref: 21 pid: 21480 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746147722.840863:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0227480 00000100:00100000:0.0:1746147722.841647:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.844953:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.848661:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.848700:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.849848:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.849862:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793832704 00000100:00100000:0.0:1746147722.849865:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793832704 00000100:00100000:0.0:1746147722.849898:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793832832 00000100:00100000:0.0:1746147722.849900:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793832832 00000100:00100000:0.0:1746147722.849910:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793832960 00000100:00100000:0.0:1746147722.849912:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793832960 00000100:00100000:0.0:1746147722.849922:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16196 00000100:00100000:0.0:1746147722.849926:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967793832704:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147722.849938:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147722.849950:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800943c9400/0xe64d3fbf12a7cf56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb315 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147722.849990:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796408448:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147722.850045:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.850108:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16197 00000100:00100000:0.0:1746147722.850113:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967793832832:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147722.850120:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147722.850136:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5421600/0xe64d3fbf12a7cf5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb31c expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147722.850157:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796408576:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147722.850177:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.850193:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16198 00000100:00100000:0.0:1746147722.850197:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967793832960:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147722.850202:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147722.850208:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5421000/0xe64d3fbf12a7cf64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb323 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.850216:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.850222:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5421000/0xe64d3fbf12a7cf64 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb323 expref: 13 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147722.850230:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5421000/0xe64d3fbf12a7cf64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb323 expref: 13 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147722.850242:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5421000, rc 0) 00000100:00100000:0.0:1746147722.850256:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967793832960:12345-192.168.202.10@tcp:101:cat.0 Request processed in 59us (410us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147722.850261:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16198 00000100:00100000:0.0:1746147722.857382:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.857536:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793833088 00000100:00100000:1.0:1746147722.857544:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793833088 00010000:00010000:1.0:1746147722.857573:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fc4400/0xe64d3fbf12a7cf02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2f9 expref: 21 pid: 21480 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147722.857943:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8198 00000100:00100000:1.0:1746147722.857953:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967793833088:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147722.857964:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147722.857974:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fc4400/0xe64d3fbf12a7cf02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2f9 expref: 21 pid: 21480 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.857984:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fc4400/0xe64d3fbf12a7cf02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2f9 expref: 21 pid: 21480 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.858001:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fc4400/0xe64d3fbf12a7cf02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2f9 expref: 21 pid: 21480 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.858077:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.858079:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.858086:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 20 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.858092:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 20 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.858118:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 20 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.858128:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796408704:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147722.858167:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.861297:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.861328:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.861420:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793833216 00000100:00100000:0.0:1746147722.861427:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793833216 00000100:00100000:0.0:1746147722.861456:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793833344 00000100:00100000:0.0:1746147722.861458:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793833344 00000100:00100000:0.0:1746147722.861470:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16199 00000100:00100000:0.0:1746147722.861478:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32060:x1830967793833216:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147722.861494:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147722.861510:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5421000/0xe64d3fbf12a7cf6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb32a expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.861535:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 22 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.861542:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147722.861544:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147722.861547:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5421000/0xe64d3fbf12a7cf6b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb32a expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.861575:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 22 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.861587:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 22 pid: 21480 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746147722.861598:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796408832:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147722.861662:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.861678:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16200 00000100:00100000:0.0:1746147722.861684:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32064:x1830967793833344:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147722.861690:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147722.861695:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943c9600/0xe64d3fbf12a7cf72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb331 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.861708:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147722.861710:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147722.861712:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943c9600/0xe64d3fbf12a7cf72 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2932736->3145727] (req 2932736->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb331 expref: 11 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.861720:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800943c9600/0xe64d3fbf12a7cf72 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2932736->3145727] (req 2932736->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb331 expref: 11 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.861728:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943c9600, rc 0) 00000100:00100000:0.0:1746147722.861759:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32064:x1830967793833344:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 74us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.861764:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16200 00000100:00100000:1.0:1746147722.862986:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796408704:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147722.863003:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147722.863030:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967793833088:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5079us (5656us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.863038:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8198 00000100:00100000:0.0:1746147722.863399:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.863490:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793833600 00000100:00100000:1.0:1746147722.863495:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793833600 00002000:00100000:1.0:1746147722.863517:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2482176->2486271) req@ffff88009fe40380 x1830967793833600/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.863524:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe40380 with x1830967793833600 ext(2482176->2486271) 00010000:00010000:1.0:1746147722.863530:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 22 pid: 21480 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.863539:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 22 pid: 21480 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746147722.863545:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe40380 00000100:00100000:1.0:1746147722.863572:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1419 00000100:00100000:1.0:1746147722.863578:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967793833600:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147722.864387:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967793833600:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 805us (985us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147722.864393:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1419 00002000:00100000:1.0:1746147722.864398:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2482176->2486271) req@ffff88009fe40380 x1830967793833600/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/4536 e 0 to 0 dl 1746147733 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.864414:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe40380 with x1830967793833600 ext(2482176->2486271) 00010000:00010000:1.0:1746147722.864423:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 22 pid: 21480 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.864433:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 22 pid: 21480 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746147722.864443:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe40380 00000100:00100000:1.0:1746147722.866213:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796408832:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147722.866235:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5421000/0xe64d3fbf12a7cf6b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb32a expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.866249:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5421000, rc 0) 00000100:00100000:1.0:1746147722.866286:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32060:x1830967793833216:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4809us (4996us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.866293:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16199 00000100:00100000:0.0:1746147722.869267:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.869313:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793833728 00000100:00100000:1.0:1746147722.869319:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793833728 00000100:00100000:1.0:1746147722.869369:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16201 00000100:00100000:1.0:1746147722.869376:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32067:x1830967793833728:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147722.869390:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.869404:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cf79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb338 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.869428:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009359be00/0xe64d3fbf12a7ce53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb274 expref: 22 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.869435:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147722.869437:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147722.869439:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cf79 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb338 expref: 13 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.869465:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009359be00/0xe64d3fbf12a7ce53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb274 expref: 22 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.869474:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009359be00/0xe64d3fbf12a7ce53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb274 expref: 22 pid: 9615 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147722.869483:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796408960:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147722.870678:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.871543:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.871588:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793833984 00000100:00100000:1.0:1746147722.871592:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793833984 00002000:00100000:1.0:1746147722.871622:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2883584->2887679) req@ffff88009fe42a00 x1830967793833984/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.871630:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe42a00 with x1830967793833984 ext(2883584->2887679) 00010000:00010000:1.0:1746147722.871645:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 21 pid: 21480 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.871656:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 21 pid: 21480 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746147722.871667:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe42a00 00000100:00100000:1.0:1746147722.872274:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1420 00000100:00100000:1.0:1746147722.872281:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967793833984:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147722.873184:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967793833984:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 902us (1642us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147722.873191:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1420 00002000:00100000:1.0:1746147722.873197:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2883584->2887679) req@ffff88009fe42a00 x1830967793833984/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/4536 e 0 to 0 dl 1746147733 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.873204:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe42a00 with x1830967793833984 ext(2883584->2887679) 00010000:00010000:1.0:1746147722.873210:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 21 pid: 21480 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.873218:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 21 pid: 21480 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746147722.873224:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe42a00 00000100:00100000:1.0:1746147722.873360:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796408960:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147722.873381:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cf79 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb338 expref: 13 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.873393:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e5400, rc 0) 00000100:00100000:1.0:1746147722.873413:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32067:x1830967793833728:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4038us (4152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.873418:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16201 00000100:00100000:0.0:1746147722.873705:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.874234:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793834112 00000100:00100000:1.0:1746147722.874239:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793834112 00002000:00100000:1.0:1746147722.874258:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (774144->1048575) req@ffff88009fe43b80 x1830967793834112/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.874265:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe43b80 with x1830967793834112 ext(774144->1048575) 00010000:00010000:1.0:1746147722.874270:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009359be00/0xe64d3fbf12a7ce53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb274 expref: 23 pid: 9615 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.874279:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009359be00/0xe64d3fbf12a7ce53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb274 expref: 23 pid: 9615 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746147722.874284:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe43b80 00000100:00100000:1.0:1746147722.876317:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1421 00000100:00100000:1.0:1746147722.876329:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967793834112:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:0.0:1746147722.885473:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.887717:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793834112:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 11387us (14007us total) trans 17179874302 rc 0/0 00000100:00100000:1.0:1746147722.887727:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1421 00002000:00100000:1.0:1746147722.887734:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (774144->1048575) req@ffff88009fe43b80 x1830967793834112/t17179874302(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:343/0 lens 488/448 e 0 to 0 dl 1746147733 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.887753:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe43b80 with x1830967793834112 ext(774144->1048575) 00010000:00010000:1.0:1746147722.887759:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009359be00/0xe64d3fbf12a7ce53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb274 expref: 25 pid: 9615 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.887770:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009359be00/0xe64d3fbf12a7ce53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb274 expref: 25 pid: 9615 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746147722.887776:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe43b80 00000100:00100000:0.0:1746147722.891594:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.891682:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793834496 00000100:00100000:1.0:1746147722.891690:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793834496 00010000:00010000:1.0:1746147722.891720:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009359be00/0xe64d3fbf12a7ce53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb274 expref: 25 pid: 9615 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147722.891764:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8199 00000100:00100000:1.0:1746147722.891771:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013582d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967793834496:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147722.891785:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147722.891803:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009359be00/0xe64d3fbf12a7ce53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb274 expref: 25 pid: 9615 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.891814:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009359be00/0xe64d3fbf12a7ce53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb274 expref: 25 pid: 9615 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.891836:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009359be00/0xe64d3fbf12a7ce53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb274 expref: 25 pid: 9615 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.891855:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.891857:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.891863:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cf79 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb338 expref: 12 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.891871:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cf79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb338 expref: 12 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.891916:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cf79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb338 expref: 12 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.891932:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796409088:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147722.892006:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147722.897621:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796409088:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147722.897642:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147722.897688:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013582d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967793834496:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5916us (6100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.897698:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8199 00000100:00100000:0.0:1746147722.902022:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.904910:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.904991:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793834880 00000100:00100000:1.0:1746147722.904995:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793834880 00010000:00010000:1.0:1746147722.905016:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 23 pid: 21480 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147722.905052:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8200 00000100:00100000:1.0:1746147722.905059:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013582e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967793834880:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147722.905072:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147722.905089:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 23 pid: 21480 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.905100:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 23 pid: 21480 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.905118:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7cf2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2482176->2887679) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb307 expref: 23 pid: 21480 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.905135:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.905137:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.905143:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5421000/0xe64d3fbf12a7cf6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb32a expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.905150:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5421000/0xe64d3fbf12a7cf6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb32a expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.905156:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.905157:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.905168:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943c9600/0xe64d3fbf12a7cf72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2932736->3145727] (req 2932736->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb331 expref: 10 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.905175:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943c9600/0xe64d3fbf12a7cf72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2932736->3145727] (req 2932736->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb331 expref: 10 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.905200:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800943c9600/0xe64d3fbf12a7cf72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2932736->3145727] (req 2932736->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb331 expref: 10 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.905211:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796409216:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147722.905282:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5421000/0xe64d3fbf12a7cf6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb32a expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.905289:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796409344:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147722.905308:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147722.914457:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796409216:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147722.914469:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796409344:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147722.914489:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147722.914535:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013582e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967793834880:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 9476us (9627us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.914545:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8200 00000100:00100000:0.0:1746147722.915159:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.915196:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.915395:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793835136 00000100:00100000:1.0:1746147722.915401:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793835136 00002000:00100000:1.0:1746147722.915434:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2932736->2936831) req@ffff88013582ed80 x1830967793835136/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:343/0 lens 488/0 e 0 to 0 dl 1746147733 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.915443:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013582ed80 with x1830967793835136 ext(2932736->2936831) 00002000:00010000:1.0:1746147722.915447:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013582ed80 00000100:00100000:1.0:1746147722.915461:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7205 00000100:00100000:1.0:1746147722.915467:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013582ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967793835136:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147722.915590:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013582ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967793835136:12345-192.168.202.10@tcp:3:cat.0 Request processed in 123us (432us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147722.915596:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7205 00002000:00100000:1.0:1746147722.915600:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2932736->2936831) req@ffff88013582ed80 x1830967793835136/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:343/0 lens 488/4536 e 0 to 0 dl 1746147733 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147722.915606:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013582ed80 with x1830967793835136 ext(2932736->2936831) 00002000:00010000:1.0:1746147722.915609:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013582ed80 00000100:00100000:0.0:1746147722.929398:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.933767:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793835648 00000100:00100000:1.0:1746147722.933772:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793835648 00000100:00100000:1.0:1746147722.933804:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16202 00000100:00100000:1.0:1746147722.933810:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32064:x1830967793835648:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147722.933820:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.933829:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1600/0xe64d3fbf12a7cf9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb346 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.933845:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013013a800/0xe64d3fbf12a7ce3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb25f expref: 14 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.933852:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943c9e00/0xe64d3fbf12a7ce8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2ac expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.933858:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc28800/0xe64d3fbf12a7cea7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2c8 expref: 14 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.933863:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931ce600/0xe64d3fbf12a7ce68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb289 expref: 23 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.933868:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147722.933869:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147722.933871:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1600/0xe64d3fbf12a7cf9c lrc: 7/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [3145728->3461119] (req 3145728->3461119) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb346 expref: 14 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.933902:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931ce600/0xe64d3fbf12a7ce68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb289 expref: 23 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.933908:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931ce600/0xe64d3fbf12a7ce68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb289 expref: 23 pid: 9615 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147722.933915:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796409600:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147722.933952:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc28800/0xe64d3fbf12a7cea7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2c8 expref: 14 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.933959:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc28800/0xe64d3fbf12a7cea7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2c8 expref: 14 pid: 8468 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147722.933965:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796409728:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147722.933981:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943c9e00/0xe64d3fbf12a7ce8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2ac expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.933987:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943c9e00/0xe64d3fbf12a7ce8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb2ac expref: 23 pid: 7050 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147722.933993:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796409856:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147722.934006:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013013a800/0xe64d3fbf12a7ce3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb25f expref: 14 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.934012:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013013a800/0xe64d3fbf12a7ce3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb25f expref: 14 pid: 4592 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147722.934018:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796409984:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147722.934029:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.950309:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.950341:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.950423:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796409600:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147722.950434:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796409728:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147722.950562:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.950594:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.950620:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.950661:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796409856:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147722.950669:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796409984:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147722.950707:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1600/0xe64d3fbf12a7cf9c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [3145728->3461119] (req 3145728->3461119) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb346 expref: 14 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.950725:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2b1600, rc 0) 00000100:00100000:1.0:1746147722.950763:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32064:x1830967793835648:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 16953us (17043us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.950770:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16202 00000100:00100000:0.0:1746147722.951162:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.951165:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8201 00000100:00100000:1.0:1746147722.951174:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967793836032:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147722.951187:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147722.951207:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931ce600/0xe64d3fbf12a7ce68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb289 expref: 25 pid: 9615 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.951218:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931ce600/0xe64d3fbf12a7ce68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb289 expref: 25 pid: 9615 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.951235:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931ce600/0xe64d3fbf12a7ce68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb289 expref: 25 pid: 9615 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.951251:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147722.951273:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967793836032:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 101us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.951489:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.951555:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8201 00000100:00100000:1.0:1746147722.951574:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793836800 00000100:00100000:1.0:1746147722.951578:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793836800 00010000:00010000:1.0:1746147722.951592:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013013a800/0xe64d3fbf12a7ce3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb25f expref: 13 pid: 4592 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147722.951608:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8204 00000100:00100000:1.0:1746147722.951612:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967793836800:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147722.951619:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147722.951626:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013013a800/0xe64d3fbf12a7ce3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb25f expref: 13 pid: 4592 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.951633:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013013a800/0xe64d3fbf12a7ce3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb25f expref: 13 pid: 4592 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.951644:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013013a800/0xe64d3fbf12a7ce3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb25f expref: 13 pid: 4592 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147722.951653:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.951655:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147722.951660:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1600/0xe64d3fbf12a7cf9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb346 expref: 12 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.951667:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1600/0xe64d3fbf12a7cf9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb346 expref: 12 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.951690:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1600/0xe64d3fbf12a7cf9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb346 expref: 12 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147722.951704:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796410240:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147722.951754:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147722.951767:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793836544 00000100:00100000:1.0:1746147722.951769:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793836544 00000100:00100000:1.0:1746147722.951803:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16205 00000100:00100000:1.0:1746147722.951808:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967793836544:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147722.952422:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.952433:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7cfb1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb35b expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.952456:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7cfb1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb35b expref: 23 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147722.952464:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7cfb1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb35b expref: 23 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147722.952472:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff9600, rc 0) 00000100:00100000:1.0:1746147722.952491:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967793836544:12345-192.168.202.10@tcp:101:cat.0 Request processed in 682us (1329us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147722.952496:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16205 00010000:00010000:0.0:1746147722.952650:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7cf95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952658:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7cf95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:0.0:1746147722.952689:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:0.0:1746147722.952692:0:5744:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147722.952703:0:5744:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7cf95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952711:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7cf95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952719:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7cf87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952724:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7cf87 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952733:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7cf87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952749:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a221e000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147722.952752:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7cf87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952757:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7cf87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952766:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147722.952768:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147722.952770:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7cf87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952775:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7cf87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952787:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7cf8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952792:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7cf8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952796:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7cf8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952800:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a221e400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147722.952802:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7cf8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952806:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7cf8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952815:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091544300) 00010000:00010000:0.0:1746147722.952817:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147722.952820:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7cf8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952824:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7cf8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147722.952847:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221f800/0xe64d3fbf12a7cf80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb33f expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.952856:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7cf95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb33f expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.952860:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147722.952862:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147722.952864:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a221ec00, rc 0) 00000100:00100000:0.0:1746147722.952906:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+9:32069:x1830967793835520:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 20062us (23515us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.952913:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11943 00000100:00100000:0.0:1746147722.955129:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.960531:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.961021:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793837568 00000100:00100000:0.0:1746147722.961024:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793837568 00000100:00100000:0.0:1746147722.965972:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.969256:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.969313:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.969536:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793838720 00000100:00100000:1.0:1746147722.969540:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793838720 00000100:00100000:1.0:1746147722.969576:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11944 00000100:00100000:1.0:1746147722.969581:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+9:32069:x1830967793838720:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147722.969592:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.969605:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7cfe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb38c expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.969671:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8000/0xe64d3fbf12a7cfe9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.969682:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7cf95 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb33f expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.969688:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8000/0xe64d3fbf12a7cfe9 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.969717:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7cf95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb33f expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.969725:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7cf95 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb33f expref: 10 pid: 5744 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147722.969745:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796410752:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147722.969800:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f000 going to sleep for 11 seconds 00010000:00010000:1.0:1746147722.974633:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7cf95 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb33f expref: 10 pid: 5744 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147722.974649:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796410752:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147722.974663:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8000/0xe64d3fbf12a7cfe9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.974669:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8000/0xe64d3fbf12a7cfe9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.974675:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8000/0xe64d3fbf12a7cfe9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:1.0:1746147722.974695:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147722.974818:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7cfe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb38c expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.974829:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8000/0xe64d3fbf12a7cfe9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb38c expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.974835:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147722.974837:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147722.974839:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8000, rc 0) 00000100:00100000:1.0:1746147722.974870:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32069:x1830967793838720:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 5289us (5557us total) trans 8589945947 rc 0/0 00000100:00100000:1.0:1746147722.974876:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11944 00000100:00100000:1.0:1746147722.976781:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.976805:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793839232 00000100:00100000:1.0:1746147722.976809:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793839232 00000100:00100000:1.0:1746147722.976836:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11945 00000100:00100000:1.0:1746147722.976841:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32069:x1830967793839232:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147722.976857:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.976859:0:5744:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147722.976876:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8000/0xe64d3fbf12a7cfe9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb38c expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.976900:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147722.976904:0:5744:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147722.976913:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7cff7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb393 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.976987:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7cffe lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.976996:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7cffe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147722.977004:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7cffe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:1.0:1746147722.977012:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147722.977081:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7cff7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb393 expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.977091:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7cffe lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb393 expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.977096:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147722.977098:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147722.977100:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff9e00, rc 0) 00000100:00100000:1.0:1746147722.977120:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+11:32069:x1830967793839232:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 279us (343us total) trans 8589945948 rc 0/0 00000100:00100000:1.0:1746147722.977125:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11945 00000100:00100000:0.0:1746147722.978068:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.978485:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793839360 00000100:00100000:1.0:1746147722.978490:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793839360 00000100:00100000:1.0:1746147722.978526:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11946 00000100:00100000:1.0:1746147722.978531:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+11:32069:x1830967793839360:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147722.978545:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147722.978555:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d00c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb39a expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.978585:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d00c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb39a expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.978594:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d00c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb39a expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147722.978606:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147722.978608:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147722.978610:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8200, rc 0) 00000100:00100000:1.0:1746147722.978634:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+12:32069:x1830967793839360:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 102us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147722.978638:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11946 00000100:00100000:0.0:1746147722.982927:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.983024:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.983049:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.983062:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.983074:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.983336:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.983359:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.983373:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793839744 00000100:00100000:0.0:1746147722.983376:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793839744 00000100:00100000:0.0:1746147722.983394:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793839872 00000100:00100000:0.0:1746147722.983395:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793839872 00000100:00100000:0.0:1746147722.983406:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793840000 00000100:00100000:0.0:1746147722.983408:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793840000 00000100:00100000:0.0:1746147722.983416:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793840128 00000100:00100000:0.0:1746147722.983418:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793840128 00000100:00100000:0.0:1746147722.983426:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793840256 00000100:00100000:0.0:1746147722.983427:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793840256 00000100:00100000:0.0:1746147722.983436:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793840384 00000100:00100000:0.0:1746147722.983437:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793840384 00000100:00100000:0.0:1746147722.983448:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16212 00000100:00100000:0.0:1746147722.983453:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793839744:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147722.983475:0:4592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d013 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.983489:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cf79 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb338 expref: 13 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.983495:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ebc000/0xe64d3fbf12a7cfbf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb362 expref: 9 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147722.983501:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9213e00/0xe64d3fbf12a7cfaa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb354 expref: 23 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147722.983507:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.983508:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.983510:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d013 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.983534:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9213e00/0xe64d3fbf12a7cfaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb354 expref: 23 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147722.983543:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a9213e00/0xe64d3fbf12a7cfaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb354 expref: 23 pid: 7050 timeout: 902 lvb_type: 1 00000100:00100000:0.0:1746147722.983554:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796411008:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147722.983659:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4ebc000/0xe64d3fbf12a7cfbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb362 expref: 9 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147722.983666:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ebc000/0xe64d3fbf12a7cfbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb362 expref: 9 pid: 7050 timeout: 902 lvb_type: 1 00000100:00100000:0.0:1746147722.983673:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796411136:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147722.983697:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cf79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb338 expref: 13 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.983704:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cf79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb338 expref: 13 pid: 8468 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746147722.983715:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796411264:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147722.983730:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.985620:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796411136:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147722.985643:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796411008:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147722.985666:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796411264:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147722.985685:0:4592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d013 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147722.985717:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.985749:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793840640 00000100:00100000:0.0:1746147722.985754:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793840640 00010000:00010000:0.0:1746147722.985776:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ebc000/0xe64d3fbf12a7cfbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb362 expref: 10 pid: 7050 timeout: 902 lvb_type: 1 00000100:00100000:0.0:1746147722.985813:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8208 00000100:00100000:0.0:1746147722.985821:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793840640:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147722.985831:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147722.985853:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4ebc000/0xe64d3fbf12a7cfbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb362 expref: 10 pid: 7050 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746147722.985862:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4ebc000/0xe64d3fbf12a7cfbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb362 expref: 10 pid: 7050 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746147722.985913:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ebc000/0xe64d3fbf12a7cfbf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb362 expref: 10 pid: 7050 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746147722.985935:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147722.985976:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793840640:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 154us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.985982:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8208 00000100:00100000:0.0:1746147722.986024:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.986042:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793840512 00000100:00100000:0.0:1746147722.986046:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793840512 00010000:00010000:0.0:1746147722.986060:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1600/0xe64d3fbf12a7cf9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb346 expref: 14 pid: 8468 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746147722.986090:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8209 00000100:00100000:0.0:1746147722.986098:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967793840512:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147722.986106:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147722.986119:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1600/0xe64d3fbf12a7cf9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb346 expref: 14 pid: 8468 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147722.986127:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1600/0xe64d3fbf12a7cf9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb346 expref: 14 pid: 8468 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147722.986141:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a2b1600/0xe64d3fbf12a7cf9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb346 expref: 14 pid: 8468 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147722.986155:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.986157:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147722.986163:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7cfdb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb385 expref: 23 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.986170:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7cfdb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb385 expref: 23 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.986196:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7cfdb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb385 expref: 23 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147722.986207:0:7312:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7cfdb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb385 expref: 23 pid: 22183 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746147722.986216:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796412672:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147722.986272:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147722.986391:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147722.986408:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793840768 00000100:00100000:0.0:1746147722.986411:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793840768 00010000:00010000:0.0:1746147722.986425:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9213e00/0xe64d3fbf12a7cfaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb354 expref: 24 pid: 7050 timeout: 902 lvb_type: 1 00000100:00100000:0.0:1746147722.986448:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8210 00000100:00100000:0.0:1746147722.986454:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967793840768:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147722.986462:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147722.986474:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a9213e00/0xe64d3fbf12a7cfaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb354 expref: 24 pid: 7050 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746147722.986483:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a9213e00/0xe64d3fbf12a7cfaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb354 expref: 24 pid: 7050 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746147722.989546:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9213e00/0xe64d3fbf12a7cfaa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb354 expref: 24 pid: 7050 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746147722.989560:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147722.989592:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967793840768:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3137us (3202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147722.989599:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8210 00000100:00100000:0.0:1746147722.999193:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.999525:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793840896 00000100:00100000:0.0:1746147722.999526:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147722.999531:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793840896 00000100:00100000:0.0:1746147722.999538:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793841024 00000100:00100000:0.0:1746147722.999541:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793841024 00010000:00010000:1.0:1746147722.999556:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc29800/0xe64d3fbf12a7cbf9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0f3 expref: 23 pid: 7050 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147722.999556:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7cacc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb06e expref: 10 pid: 10613 timeout: 902 lvb_type: 1 00000100:00100000:0.0:1746147722.999576:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8211 00000100:00100000:0.0:1746147722.999581:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967793841024:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147722.999587:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8212 00010000:00010000:0.0:1746147722.999592:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147722.999593:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967793840896:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147722.999600:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147722.999610:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7cacc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb06e expref: 10 pid: 10613 timeout: 902 lvb_type: 1 00010000:00010000:1.0:1746147722.999611:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc29800/0xe64d3fbf12a7cbf9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0f3 expref: 23 pid: 7050 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147722.999618:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7cacc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb06e expref: 10 pid: 10613 timeout: 902 lvb_type: 1 00010000:00010000:1.0:1746147722.999627:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc29800/0xe64d3fbf12a7cbf9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0f3 expref: 23 pid: 7050 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.000316:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7cacc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb06e expref: 10 pid: 10613 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746147723.000329:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147723.000372:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967793841024:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 791us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.000379:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8211 00000100:00100000:0.0:1746147723.000712:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793841280 00000100:00100000:0.0:1746147723.000715:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793841280 00010000:00010000:0.0:1746147723.000728:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc28c00/0xe64d3fbf12a7cbeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0e5 expref: 14 pid: 6715 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746147723.000822:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8213 00000100:00100000:0.0:1746147723.000828:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1957:x1830967793841152:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147723.000837:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147723.000849:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cf79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb338 expref: 14 pid: 8468 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.000856:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cf79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb338 expref: 14 pid: 8468 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.000869:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7cf79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb338 expref: 14 pid: 8468 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.000878:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147723.000880:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147723.000897:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.000906:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d013 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.000924:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147723.000938:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967793841152:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 111us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.000944:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8213 00010000:00010000:0.0:1746147723.000961:0:4592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.000969:0:4592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.000986:0:4592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.000993:0:4592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.001000:0:4592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.001006:0:4592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0249a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147723.001009:0:4592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.001020:0:4592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d013 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.001029:0:4592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d013 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.001044:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc29800/0xe64d3fbf12a7cbf9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0f3 expref: 22 pid: 7050 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.001054:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.001055:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.001058:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e38c200/0xe64d3fbf12a7d021 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.001063:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e38c200/0xe64d3fbf12a7d021 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.001074:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147723.001087:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967793840896:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1495us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.001091:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8212 00010000:00010000:0.0:1746147723.001576:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d013 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147723.001621:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967793839744:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 18167us (18596us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.001629:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16212 00000100:00100000:0.0:1746147723.001686:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796412672:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147723.001698:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147723.001712:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793840512:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 15616us (15689us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.001718:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8209 00000100:00100000:0.0:1746147723.001818:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.032813:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793842432 00000100:00100000:1.0:1746147723.032823:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793842432 00010000:00010000:1.0:1746147723.032857:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7cfa3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb34d expref: 15 pid: 8184 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.032912:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8219 00000100:00100000:1.0:1746147723.032921:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967793842432:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147723.032935:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147723.032956:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7cfa3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb34d expref: 15 pid: 8184 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.032967:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7cfa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb34d expref: 15 pid: 8184 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.032987:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7cfa3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb34d expref: 15 pid: 8184 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.033005:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.033007:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.033011:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2301c00/0xe64d3fbf12a7d01a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.033019:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2301c00/0xe64d3fbf12a7d01a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.033055:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147723.033106:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967793842432:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 184us (4139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.033113:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8219 00000100:00100000:1.0:1746147723.033584:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.033596:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793843584 00000100:00100000:1.0:1746147723.033599:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793843584 00010000:00010000:1.0:1746147723.033610:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7cfdb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb385 expref: 25 pid: 22183 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.033625:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8220 00000100:00100000:1.0:1746147723.033629:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793843584:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147723.033635:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147723.033648:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7cfdb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb385 expref: 25 pid: 22183 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.033655:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7cfdb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb385 expref: 25 pid: 22183 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.033666:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7cfdb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb385 expref: 25 pid: 22183 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.033675:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.033677:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.033679:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d02f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.033685:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d02f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.033699:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147723.033955:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.033977:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793843712 00000100:00100000:0.0:1746147723.033981:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793843712 00010000:00010000:0.0:1746147723.033999:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800943c9600/0xe64d3fbf12a7cf72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2932736->3145727] (req 2932736->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb331 expref: 14 pid: 9615 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746147723.034021:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8221 00000100:00100000:0.0:1746147723.034028:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967793843712:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147723.034037:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147723.034048:0:7097:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147723 -> 1746147724 00010000:00010000:0.0:1746147723.034054:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800943c9600/0xe64d3fbf12a7cf72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2932736->3145727] (req 2932736->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb331 expref: 14 pid: 9615 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.034063:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800943c9600/0xe64d3fbf12a7cf72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2932736->3145727] (req 2932736->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb331 expref: 14 pid: 9615 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.034076:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943c9600/0xe64d3fbf12a7cf72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2932736->3145727] (req 2932736->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb331 expref: 14 pid: 9615 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.034091:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147723.034092:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147723.034096:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7d036 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.034102:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7d036 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.034119:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147723.034143:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967793843712:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 114us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.034148:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8221 00000100:00100000:1.0:1746147723.034294:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967793843584:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 87us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.034300:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8220 00010000:00010000:1.0:1746147723.034319:0:22183:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d02f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.034327:0:22183:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d02f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.034350:0:22183:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d02f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.034357:0:22183:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d02f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.034364:0:22183:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d02f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.034369:0:22183:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d5200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147723.034372:0:22183:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d02f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.034379:0:22183:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d02f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.034390:0:22183:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d02f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.034395:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d02f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147723.034444:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+5:1959:x1830967793840256:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 49937us (51106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.034452:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16216 00000100:00100000:0.0:1746147723.039685:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.054301:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.054340:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.055050:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.055098:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793844352 00000100:00100000:1.0:1746147723.055106:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793844352 00000100:00100000:1.0:1746147723.055143:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11947 00000100:00100000:1.0:1746147723.055150:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+12:32069:x1830967793844352:12345-192.168.202.10@tcp:36:mirror_io.0 00010000:00010000:1.0:1746147723.055194:0:5744:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147723.055214:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d00c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb39a expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.055232:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147723.055236:0:5744:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147723.055257:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d07c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147723.055268:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7cbc1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0bb expref: 21 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.055274:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bbc00/0xe64d3fbf12a7cbd6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0d0 expref: 332 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.055279:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136272400/0xe64d3fbf12a7cbdd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0d7 expref: 21 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.055285:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00baa00/0xe64d3fbf12a7cc69 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb14e expref: 21 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.055290:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7ccaf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb178 expref: 332 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.055296:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d07c lrc: 8/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147723.055322:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7ccaf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb178 expref: 332 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.055332:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7ccaf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb178 expref: 332 pid: 5744 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.055343:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796412800:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147723.055398:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00baa00/0xe64d3fbf12a7cc69 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb14e expref: 21 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.055405:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00baa00/0xe64d3fbf12a7cc69 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb14e expref: 21 pid: 5744 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.055412:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796412928:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147723.055433:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136272400/0xe64d3fbf12a7cbdd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0d7 expref: 21 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.055440:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136272400/0xe64d3fbf12a7cbdd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0d7 expref: 21 pid: 17544 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.055446:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796413056:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147723.055465:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bbc00/0xe64d3fbf12a7cbd6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0d0 expref: 332 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.055471:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bbc00/0xe64d3fbf12a7cbd6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0d0 expref: 332 pid: 17544 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.055481:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796413184:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147723.055504:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7cbc1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0bb expref: 21 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.055511:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7cbc1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0bb expref: 21 pid: 5744 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.055517:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796413312:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147723.055532:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147723.057762:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796412800:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147723.058953:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.059045:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796412928:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147723.059050:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.059054:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796413056:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147723.059134:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16228 00000100:00100000:1.0:1746147723.059141:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32067:x1830967793844480:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147723.059154:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147723.059167:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c4d3400/0xe64d3fbf12a7d08a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb3e7 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.059193:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.059195:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.059200:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4d3400/0xe64d3fbf12a7d08a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3e7 expref: 12 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.059212:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c4d3400/0xe64d3fbf12a7d08a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3e7 expref: 12 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.059221:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c4d3400, rc 0) 00000100:00100000:1.0:1746147723.059948:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32067:x1830967793844480:12345-192.168.202.10@tcp:101:cat.0 Request processed in 807us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.059953:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16228 00000100:00100000:0.0:1746147723.060718:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.060755:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.060847:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793844608 00000100:00100000:1.0:1746147723.060851:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793844608 00010000:00010000:1.0:1746147723.060872:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7ccaf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb178 expref: 333 pid: 5744 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.060905:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793844864 00000100:00100000:1.0:1746147723.060907:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793844864 00010000:00010000:1.0:1746147723.060916:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00baa00/0xe64d3fbf12a7cc69 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb14e expref: 22 pid: 5744 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.060929:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8222 00000100:00100000:1.0:1746147723.060934:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:1960:x1830967793844608:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147723.060943:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147723.060947:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7ccaf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb178 expref: 333 pid: 5744 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.060957:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7ccaf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb178 expref: 333 pid: 5744 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.060973:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7ccaf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb178 expref: 333 pid: 5744 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.060987:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147723.060992:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d07c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147723.061000:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147723.061021:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+332:1960:x1830967793844608:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 87us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.061026:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8222 00000100:00100000:1.0:1746147723.061036:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8223 00000100:00100000:1.0:1746147723.061041:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967793844864:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147723.061046:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147723.061049:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00baa00/0xe64d3fbf12a7cc69 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb14e expref: 22 pid: 5744 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.061056:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00baa00/0xe64d3fbf12a7cc69 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb14e expref: 22 pid: 5744 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.061065:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00baa00/0xe64d3fbf12a7cc69 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb14e expref: 22 pid: 5744 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.061073:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147723.061075:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d07c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147723.061079:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147723.061090:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967793844864:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 49us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.061095:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8223 00000100:00100000:1.0:1746147723.061848:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796413184:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147723.061858:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796413312:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147723.061901:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d07c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147723.061917:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8224 00000100:00100000:1.0:1746147723.061923:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967793845120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147723.061930:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147723.061934:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136272400/0xe64d3fbf12a7cbdd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0d7 expref: 21 pid: 17544 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.061941:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136272400/0xe64d3fbf12a7cbdd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0d7 expref: 21 pid: 17544 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.063111:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136272400/0xe64d3fbf12a7cbdd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb0d7 expref: 21 pid: 17544 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.063125:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147723.063128:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d07c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147723.063134:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d07c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147723.063140:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d07c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147723.063156:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147723.063178:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793845120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1255us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.063187:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8224 00010000:00010000:1.0:1746147723.063206:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d07c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147723.063212:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d07c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000040:00080000:1.0:1746147723.063830:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3612, 88 off302216 00000004:00080000:1.0:1746147723.063837:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802237952451ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.063908:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3628, 88 off303280 00000004:00080000:1.0:1746147723.063913:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802238028492ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147723.063926:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3629, 88 off303368 00000004:00080000:1.0:1746147723.063928:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802238043674ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147723.063935:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3613, 88 off302304 00000004:00080000:1.0:1746147723.063938:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802238053332ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.063944:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3614, 88 off302392 00000004:00080000:1.0:1746147723.063946:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802238061437ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.063951:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3630, 88 off303456 00000004:00080000:1.0:1746147723.063954:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802238069087ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147723.063959:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3631, 88 off303544 00000004:00080000:1.0:1746147723.063961:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802238076961ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147723.063967:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3632, 88 off303632 00000004:00080000:1.0:1746147723.063969:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802238084904ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147723.063979:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3615, 88 off302480 00000004:00080000:1.0:1746147723.063981:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802238096961ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.063987:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3633, 88 off303720 00000004:00080000:1.0:1746147723.063989:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802238104359ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147723.064029:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3616, 88 off302568 00000004:00080000:1.0:1746147723.064032:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802238147599ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.064042:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3634, 88 off303808 00000004:00080000:1.0:1746147723.064044:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802238159572ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147723.064049:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3617, 88 off302656 00000004:00080000:1.0:1746147723.064051:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802238166754ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.064056:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3618, 88 off302744 00000004:00080000:1.0:1746147723.064058:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802238173859ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.064063:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3619, 88 off302832 00000004:00080000:1.0:1746147723.064065:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802238180754ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.064070:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3620, 88 off302920 00000004:00080000:1.0:1746147723.064074:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802238189299ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.064080:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3635, 88 off303896 00000004:00080000:1.0:1746147723.064082:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802238197689ns, next at 756024029964ns, rc = 0 00000004:00010000:1.0:1746147723.097838:0:5744:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800954c0000 reply state ffff88008fa26c00 transno 8589945949 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d07c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147723.097850:0:5744:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746147723.097972:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+13:32069:x1830967793844352:12345-192.168.202.10@tcp:36:mirror_io.0 Request processed in 42818us (42918us total) trans 8589945949 rc 0/0 00000100:00100000:1.0:1746147723.097980:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11947 00000001:00080000:1.0:1746147723.098010:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945932 is committed 00000001:00080000:1.0:1746147723.098024:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945949 is committed 00000004:00080000:1.0:1746147723.098028:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2703 committed 00000004:00080000:1.0:1746147723.098033:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2689 committed 00000004:00080000:1.0:1746147723.098044:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2688 committed 00000004:00080000:1.0:1746147723.098046:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2687 committed 00000004:00080000:1.0:1746147723.098047:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2686 committed 00000004:00080000:1.0:1746147723.098049:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2702 committed 00000004:00080000:1.0:1746147723.098051:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2685 committed 00000004:00080000:1.0:1746147723.098052:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2701 committed 00000004:00080000:1.0:1746147723.098054:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2684 committed 00000004:00080000:1.0:1746147723.098055:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2700 committed 00000004:00080000:1.0:1746147723.098056:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2699 committed 00000004:00080000:1.0:1746147723.098058:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2698 committed 00000004:00080000:1.0:1746147723.098059:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2683 committed 00000004:00080000:1.0:1746147723.098060:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2682 committed 00000004:00080000:1.0:1746147723.098062:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2697 committed 00000004:00080000:1.0:1746147723.098063:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2696 committed 00000004:00080000:1.0:1746147723.098065:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2681 committed 00000001:00080000:1.0:1746147723.098072:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945943 is committed 00000001:00080000:1.0:1746147723.098074:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945942 is committed 00000001:00080000:1.0:1746147723.098085:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945944 is committed 00000001:00080000:1.0:1746147723.098100:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945946 is committed 00000001:00080000:1.0:1746147723.098105:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945945 is committed 00000100:00100000:0.0:1746147723.098286:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796413696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147723.098326:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147723.098365:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796414208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147723.098380:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147723.098393:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147723.098397:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796413824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147723.098408:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147723.098416:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796414336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147723.098426:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147723.098445:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796413696 00000100:00100000:0.0:1746147723.098451:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796413696 00000100:00100000:0.0:1746147723.098482:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796414208 00000100:00100000:0.0:1746147723.098484:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796414208 00000100:00100000:0.0:1746147723.098493:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796413824 00000100:00100000:0.0:1746147723.098494:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796413824 00000100:00100000:0.0:1746147723.098503:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796414336 00000100:00100000:0.0:1746147723.098504:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796414336 00000100:00100000:0.0:1746147723.098515:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16229 00000100:00100000:0.0:1746147723.098519:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3301:x1830967796413696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147723.098667:0:7050:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:0.0:1746147723.098670:0:7050:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147724 -> 1746147724 00002000:00010000:0.0:1746147723.098671:0:7050:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147723 -> 1746147723 00002000:00010000:0.0:1746147723.098673:0:7050:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147724 -> 1746147724 00002000:00010000:0.0:1746147723.098674:0:7050:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:0.0:1746147723.098695:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3301:x1830967796413696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (368us total) trans 17179874304 rc 0/0 00000100:00100000:0.0:1746147723.098699:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16229 00000100:00100000:0.0:1746147723.098710:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16230 00000100:00100000:0.0:1746147723.098714:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3301:x1830967796414208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147723.102944:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3301:x1830967796414208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4230us (4562us total) trans 17179874312 rc 0/0 00000100:00100000:0.0:1746147723.102950:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16230 00000100:00080000:0.0:1746147723.102966:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147723.102969:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1746147723.102987:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc12300/2, rc 0, transno 17179874305 00000100:00100000:0.0:1746147723.102990:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796413824:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147723.102997:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800951d5880/2, rc 0, transno 17179874306 00000100:00100000:0.0:1746147723.102999:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796414336:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147723.103007:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc12d80/2, rc 0, transno 17179874304 00000100:00100000:0.0:1746147723.103009:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796413696:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147723.103014:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800951d5c00/2, rc 0, transno 17179874312 00000100:00100000:0.0:1746147723.103017:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796414208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147723.103353:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796414720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147723.103375:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147723.103401:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796415232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147723.103412:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147723.103423:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147723.103427:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796415104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147723.103438:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147723.103447:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796415616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147723.103458:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147723.103476:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796414720 00000100:00100000:1.0:1746147723.103478:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796414720 00000100:00100000:1.0:1746147723.103491:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796415232 00000100:00100000:1.0:1746147723.103493:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796415232 00000100:00100000:1.0:1746147723.103500:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796415104 00000100:00100000:1.0:1746147723.103501:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796415104 00000100:00100000:1.0:1746147723.103506:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796415616 00000100:00100000:1.0:1746147723.103507:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796415616 00000100:00100000:1.0:1746147723.103514:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16242 00000100:00100000:1.0:1746147723.103518:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3304:x1830967796414720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147723.103589:0:22183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147723.103591:0:22183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147723 -> 1746147723 00002000:00010000:1.0:1746147723.103593:0:22183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147723 -> 1746147723 00002000:00010000:1.0:1746147723.103595:0:22183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147723 -> 1746147723 00002000:00010000:1.0:1746147723.103596:0:22183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746147723.103615:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3304:x1830967796414720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (239us total) trans 21474841542 rc 0/0 00000100:00100000:1.0:1746147723.103620:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16242 00000100:00100000:1.0:1746147723.103631:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16244 00000100:00100000:1.0:1746147723.103634:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3304:x1830967796415104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147723.103644:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16245 00000100:00100000:1.0:1746147723.103647:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3304:x1830967796415616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147723.103713:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3304:x1830967796415616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (253us total) trans 21474841543 rc 0/0 00000100:00100000:1.0:1746147723.103718:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16245 00000004:00080000:1.0:1746147723.103757:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fb77100/2, rc 0, transno 21474841543 00000100:00100000:1.0:1746147723.103760:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796415616:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147723.103766:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe43480/2, rc 0, transno 21474841542 00000100:00100000:1.0:1746147723.103768:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796414720:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147723.103773:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe42680/2, rc 0, transno 21474841544 00000100:00100000:1.0:1746147723.103776:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796415232:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147723.103911:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe40000/2, rc 0, transno 21474841545 00000100:00100000:1.0:1746147723.103915:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796415104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147723.104209:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.104428:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793846016 00000100:00100000:0.0:1746147723.104432:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793846016 00000100:00100000:0.0:1746147723.104465:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11950 00000100:00100000:0.0:1746147723.104470:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:32075:x1830967793846016:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147723.104483:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147723.104490:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7d0b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb3fc expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.104541:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d0bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.104547:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d0bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.104554:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d0bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.104561:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7d0c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.104566:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7d0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.104571:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7d0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.104621:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.104700:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.104706:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147723.106406:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.106593:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.106646:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793846272 00000100:00100000:1.0:1746147723.106651:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793846272 00010000:00010000:1.0:1746147723.106676:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7cffe lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb393 expref: 8 pid: 5744 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.106694:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8227 00000100:00100000:1.0:1746147723.106699:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013582ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793846272:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147723.106708:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147723.106713:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7cffe lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb393 expref: 9 pid: 5744 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.106721:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7cffe lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb393 expref: 9 pid: 5744 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.106746:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147723.106750:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88000/0xe64d3fbf12a7d0ad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147723.106757:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88000/0xe64d3fbf12a7d0ad lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147723.106761:0:7096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88000/0xe64d3fbf12a7d0ad lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147723.106771:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.106775:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.106779:0:7096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.106899:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147723.106905:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.106912:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147723.106924:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:1.0:1746147723.106930:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013582ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793846272:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 230us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.106935:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8227 00010000:00010000:1.0:1746147723.107027:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107031:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107035:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147723.107206:0:3288:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3288:1830967796414464:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147723.107218:0:3288:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d07c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.107223:0:3288:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d07c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147723.107629:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d5200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147723.107632:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107637:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107643:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147723.107645:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147723.107647:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107652:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5200/0xe64d3fbf12a7d0c9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107662:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d0bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107666:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d0bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107670:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d0bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107673:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0249a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147723.107675:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d0bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107679:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d0bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107684:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147723.107686:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147723.107688:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d0bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107692:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7d0bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107699:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7d0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107703:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7d0c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107707:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7d0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107711:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d5000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147723.107712:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7d0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107717:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7d0c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107721:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a0003d00) 00010000:00010000:1.0:1746147723.107723:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147723.107725:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7d0c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107728:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7d0c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.107763:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7d0b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3fc expref: 324 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.107769:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7d0b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3fc expref: 324 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.107776:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248200, rc 0) 00000100:00100000:1.0:1746147723.107792:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:32075:x1830967793846016:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3322us (3584us total) trans 8589945950 rc 301/301 00000100:00100000:1.0:1746147723.107797:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11950 00000100:00100000:0.0:1746147723.107985:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.114460:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.115210:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.116415:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.120594:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.124691:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.124760:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793847552 00000100:00100000:1.0:1746147723.124767:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793847552 00000100:00100000:1.0:1746147723.124817:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11953 00000100:00100000:1.0:1746147723.124825:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32075:x1830967793847552:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147723.124841:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147723.124844:0:17544:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147723.124865:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136273e00/0xe64d3fbf12a7d0e5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb40a expref: 324 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.124915:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147723.124920:0:17544:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147723.124934:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009527a000/0xe64d3fbf12a7d0ec lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb411 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.125063:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7d0f3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.125135:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7d091 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3ee expref: 7 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.125144:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136273600/0xe64d3fbf12a7d0d0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb403 expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.125150:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7d0f3 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.125173:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136273600/0xe64d3fbf12a7d0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb403 expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.125182:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136273600/0xe64d3fbf12a7d0d0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb403 expref: 8 pid: 14546 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.125193:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796415872:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147723.125473:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7d091 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3ee expref: 7 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.125480:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7d091 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3ee expref: 7 pid: 14546 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.125488:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796416000:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147723.125516:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e2c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147723.130873:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796415872:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147723.130912:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796416000:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147723.130936:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7d0f3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147723.131928:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.132140:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147723.132542:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7d0f3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.132548:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7d0f3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000040:00080000:1.0:1746147723.134252:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3621, 88 off303008 00000004:00080000:1.0:1746147723.134260:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802308375010ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.134452:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3636, 88 off303984 00000004:00080000:1.0:1746147723.134456:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802308570943ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147723.134473:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3637, 88 off304072 00000004:00080000:1.0:1746147723.134476:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802308591070ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147723.134509:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3623, 88 off303192 00000004:00080000:1.0:1746147723.134512:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802308627773ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.134519:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3624, 88 off303280 00000004:00080000:1.0:1746147723.134523:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802308638056ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.134529:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3638, 88 off304160 00000004:00080000:1.0:1746147723.134531:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802308646408ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147723.134536:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3639, 88 off304248 00000004:00080000:1.0:1746147723.134539:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802308654189ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147723.134545:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3640, 88 off304336 00000004:00080000:1.0:1746147723.134547:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802308662191ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147723.134552:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3625, 88 off303368 00000004:00080000:1.0:1746147723.134554:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802308669626ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.134560:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3641, 88 off304424 00000004:00080000:1.0:1746147723.134562:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802308678028ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147723.134568:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3626, 88 off303456 00000004:00080000:1.0:1746147723.134570:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802308685381ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.134576:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3642, 88 off304512 00000004:00080000:1.0:1746147723.134578:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802308693599ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147723.134584:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3627, 88 off303544 00000004:00080000:1.0:1746147723.134586:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802308701390ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.134591:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3628, 88 off303632 00000004:00080000:1.0:1746147723.134594:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802308709878ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.134600:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3629, 88 off303720 00000004:00080000:1.0:1746147723.134602:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802308717944ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.134608:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3630, 88 off303808 00000004:00080000:1.0:1746147723.134610:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802308725913ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147723.134617:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3643, 88 off304600 00000004:00080000:1.0:1746147723.134619:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 802308734379ns, next at 756024029964ns, rc = 0 00000100:00100000:0.0:1746147723.138908:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000001:00080000:1.0:1746147723.165844:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945950 is committed 00000001:00080000:1.0:1746147723.165856:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945954 is committed 00000004:00080000:1.0:1746147723.165860:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2711 committed 00010000:00010000:0.0:1746147723.165959:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7d0f3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb411 expref: 324 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.165971:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147723.165973:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746147723.165978:0:17544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7d0fa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb418 expref: 7 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.165986:0:17544:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7d0fa lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb418 expref: 7 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.165993:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7d0fa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb418 expref: 7 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.166026:0:17544:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7d0fa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb418 expref: 7 pid: 14546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147723.166038:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796416128:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147723.166111:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3b40 going to sleep for 11 seconds 00000004:00080000:1.0:1746147723.166390:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2698 committed 00000004:00080000:1.0:1746147723.166397:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2697 committed 00000004:00080000:1.0:1746147723.166399:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2696 committed 00000004:00080000:1.0:1746147723.166400:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2695 committed 00000004:00080000:1.0:1746147723.166402:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2710 committed 00000004:00080000:1.0:1746147723.166404:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2694 committed 00000004:00080000:1.0:1746147723.166405:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2709 committed 00000004:00080000:1.0:1746147723.166407:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2693 committed 00000004:00080000:1.0:1746147723.166408:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2708 committed 00000004:00080000:1.0:1746147723.166409:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2707 committed 00000004:00080000:1.0:1746147723.166411:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2706 committed 00000004:00080000:1.0:1746147723.166412:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2692 committed 00000004:00080000:1.0:1746147723.166414:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2691 committed 00000004:00080000:1.0:1746147723.166415:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2705 committed 00000004:00080000:1.0:1746147723.166416:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2704 committed 00000004:00080000:1.0:1746147723.166418:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2690 committed 00000001:00080000:1.0:1746147723.166426:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945951 is committed 00000001:00080000:1.0:1746147723.166431:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945953 is committed 00000100:00100000:1.0:1746147723.167526:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796416256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147723.167547:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147723.167560:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796416768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147723.167572:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147723.167582:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147723.167586:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796416640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147723.167598:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147723.167607:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796417152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147723.167618:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147723.167632:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796416256 00000100:00100000:1.0:1746147723.167636:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796416256 00000100:00100000:1.0:1746147723.167650:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796416768 00000100:00100000:1.0:1746147723.167651:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796416768 00000100:00100000:1.0:1746147723.167660:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796416640 00000100:00100000:1.0:1746147723.167661:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796416640 00000100:00100000:1.0:1746147723.167672:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796417152 00000100:00100000:1.0:1746147723.167673:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796417152 00000100:00100000:1.0:1746147723.167682:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16250 00000100:00100000:1.0:1746147723.167687:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3304:x1830967796416256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147723.167771:0:22183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147723.167774:0:22183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147723 -> 1746147723 00002000:00010000:1.0:1746147723.167776:0:22183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147723 -> 1746147723 00002000:00010000:1.0:1746147723.167778:0:22183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147723 -> 1746147723 00002000:00010000:1.0:1746147723.167780:0:22183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746147723.167801:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3304:x1830967796416256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (253us total) trans 21474841550 rc 0/0 00000100:00100000:1.0:1746147723.167806:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16250 00000100:00100000:1.0:1746147723.167815:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16251 00000100:00100000:1.0:1746147723.167819:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3304:x1830967796416768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147723.167877:0:22183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:1.0:1746147723.167880:0:22183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147723.167903:0:22183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147723.167905:0:22183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147723.167906:0:22183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:1.0:1746147723.167924:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3304:x1830967796416768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (350us total) trans 21474841551 rc 0/0 00000100:00100000:1.0:1746147723.167929:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16251 00000100:00100000:1.0:1746147723.167938:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16252 00000100:00100000:1.0:1746147723.167942:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3304:x1830967796416640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147723.168011:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3304:x1830967796416640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (412us total) trans 21474841552 rc 0/0 00000100:00100000:1.0:1746147723.168017:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16252 00000100:00100000:1.0:1746147723.168025:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16253 00000100:00100000:1.0:1746147723.168029:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3304:x1830967796417152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147723.168092:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3304:x1830967796417152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (472us total) trans 21474841553 rc 0/0 00000100:00100000:1.0:1746147723.168096:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16253 00000004:00080000:1.0:1746147723.168118:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e386a00/2, rc 0, transno 21474841552 00000100:00100000:1.0:1746147723.168121:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796416640:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147723.168127:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800951d4e00/2, rc 0, transno 21474841553 00000100:00100000:1.0:1746147723.168130:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796417152:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147723.168135:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e384000/2, rc 0, transno 21474841550 00000100:00100000:1.0:1746147723.168138:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796416256:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147723.168143:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800951d5180/2, rc 0, transno 21474841551 00000100:00100000:1.0:1746147723.168146:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796416768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147723.170451:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.170646:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796416128:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147723.170673:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009527a000/0xe64d3fbf12a7d0ec lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb411 expref: 324 pid: 17544 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746147723.170686:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7d0f3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb411 expref: 323 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.170709:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009527ba00, rc 0) 00000100:00100000:0.0:1746147723.170747:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:32075:x1830967793847552:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 45911us (46052us total) trans 8589945954 rc 0/0 00000100:00100000:0.0:1746147723.170753:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11953 00000100:00100000:0.0:1746147723.175134:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.178000:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.178932:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.179401:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8230 00000100:00100000:1.0:1746147723.179408:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967793848448:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147723.179416:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147723.179432:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e60400/0xe64d3fbf12a7d06e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3d2 expref: 25 pid: 7050 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.179447:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e60400/0xe64d3fbf12a7d06e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3d2 expref: 25 pid: 7050 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.179462:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e60400/0xe64d3fbf12a7d06e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3d2 expref: 25 pid: 7050 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.179471:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.179472:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.179477:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a932b000/0xe64d3fbf12a7d101 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2596864->2633727) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb41f expref: 24 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.179484:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a932b000/0xe64d3fbf12a7d101 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2596864->2633727) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb41f expref: 24 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.179500:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a932b000/0xe64d3fbf12a7d101 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2596864->2633727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb41f expref: 24 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.179509:0:7096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a932b000/0xe64d3fbf12a7d101 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2596864->2633727) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb41f expref: 24 pid: 10613 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.179519:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796418688:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147723.179573:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147723.181626:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.181645:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796418688:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147723.181658:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147723.181685:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967793848448:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2278us (2754us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.181693:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8230 00000100:00100000:0.0:1746147723.184344:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.188197:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.188371:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.196450:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.197627:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793849600 00000100:00100000:1.0:1746147723.197635:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793849600 00010000:00010000:1.0:1746147723.197675:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a932b000/0xe64d3fbf12a7d101 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2596864->2633727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb41f expref: 26 pid: 10613 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.197719:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8231 00000100:00100000:1.0:1746147723.197725:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967793849600:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147723.197747:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147723.197767:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a932b000/0xe64d3fbf12a7d101 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2596864->2633727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb41f expref: 26 pid: 10613 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.197778:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a932b000/0xe64d3fbf12a7d101 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2596864->2633727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb41f expref: 26 pid: 10613 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.197798:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a932b000/0xe64d3fbf12a7d101 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2596864->2633727) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb41f expref: 26 pid: 10613 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.197834:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.197837:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.197843:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aa10a00/0xe64d3fbf12a7d108 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb426 expref: 12 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.197851:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa10a00/0xe64d3fbf12a7d108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb426 expref: 12 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.197881:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009aa10a00/0xe64d3fbf12a7d108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb426 expref: 12 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147723.197920:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796418816:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147723.198003:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147723.202956:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796418816:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147723.202977:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147723.203025:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967793849600:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5298us (6581us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.203035:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8231 00000100:00100000:0.0:1746147723.208782:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.255466:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793849984 00000100:00100000:0.0:1746147723.255474:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793849984 00000100:00100000:0.0:1746147723.256176:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16265 00000100:00100000:0.0:1746147723.256185:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32067:x1830967793849984:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147723.256200:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147723.256215:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f818800/0xe64d3fbf12a7d10f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb42d expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.256235:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147723.256237:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147723.256243:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f818800/0xe64d3fbf12a7d10f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb42d expref: 13 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.256256:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f818800/0xe64d3fbf12a7d10f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb42d expref: 13 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.256265:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f818800, rc 0) 00000100:00100000:0.0:1746147723.256315:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32067:x1830967793849984:12345-192.168.202.10@tcp:101:cat.0 Request processed in 132us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.256321:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16265 00000100:00100000:0.0:1746147723.262383:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.262423:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.262992:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.263023:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793850624 00000100:00100000:0.0:1746147723.263026:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793850624 00002000:00100000:0.0:1746147723.263045:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88012e386300 x1830967793850624/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147723.263051:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e386300 with x1830967793850624 ext(3145728->4194303) 00002000:00010000:0.0:1746147723.263055:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e386300 00000100:00100000:0.0:1746147723.263128:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7214 00000100:00100000:1.0:1746147723.263265:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967793850624:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147723.284063:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967793850624:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20919us (21062us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147723.284075:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7214 00002000:00100000:1.0:1746147723.284084:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88012e386300 x1830967793850624/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/440 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.284093:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e386300 with x1830967793850624 ext(3145728->4194303) 00002000:00010000:1.0:1746147723.284098:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e386300 00000100:00100000:0.0:1746147723.293713:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967793850240:12345-192.168.202.10@tcp:3:cat.0 Request processed in 30632us (31280us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147723.293725:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7213 00002000:00100000:0.0:1746147723.293744:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a5488700 x1830967793850240/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/440 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147723.293753:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5488700 with x1830967793850240 ext(2097152->3145727) 00002000:00010000:0.0:1746147723.293759:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5488700 00000100:00100000:0.0:1746147723.303521:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.303571:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.303649:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793850880 00000100:00100000:1.0:1746147723.303657:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793850880 00000100:00100000:1.0:1746147723.303688:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793851008 00000100:00100000:1.0:1746147723.303690:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793851008 00000100:00100000:1.0:1746147723.303717:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16266 00000100:00100000:1.0:1746147723.303723:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967793850880:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147723.303749:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147723.303764:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7d116 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb434 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.303786:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.303788:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.303795:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7d116 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb434 expref: 14 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147723.303807:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7d116 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb434 expref: 14 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147723.303816:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009527a000, rc 0) 00000100:00100000:1.0:1746147723.303851:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1957:x1830967793850880:12345-192.168.202.10@tcp:101:cat.0 Request processed in 128us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.303856:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16266 00000100:00100000:1.0:1746147723.303871:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16267 00000100:00100000:1.0:1746147723.303875:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967793851008:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147723.303901:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147723.303910:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7d11d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb43b expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.303923:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.303924:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.303928:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7d11d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb43b expref: 14 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147723.303936:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7d11d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb43b expref: 14 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147723.303946:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009527be00, rc 0) 00000100:00100000:1.0:1746147723.303959:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967793851008:12345-192.168.202.10@tcp:101:cat.0 Request processed in 83us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.303963:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16267 00000100:00100000:0.0:1746147723.304742:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.307213:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.323518:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.327855:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.328141:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.328166:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.328184:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793852800 00000100:00100000:1.0:1746147723.328187:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793852800 00000100:00100000:1.0:1746147723.328204:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793852928 00000100:00100000:1.0:1746147723.328206:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793852928 00000100:00100000:1.0:1746147723.328218:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16269 00000100:00100000:1.0:1746147723.328222:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967793852800:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147723.328231:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147723.328245:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d14e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb450 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.328261:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.328263:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.328269:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d14e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb450 expref: 26 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147723.328281:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00bac00/0xe64d3fbf12a7d14e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb450 expref: 26 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147723.328289:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00bac00, rc 0) 00000100:00100000:1.0:1746147723.328304:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967793852800:12345-192.168.202.10@tcp:101:cat.0 Request processed in 81us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.328309:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16269 00000100:00100000:0.0:1746147723.333010:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.342279:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.345461:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.353764:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.353799:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.353825:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.353861:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.353905:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793853568 00000100:00100000:1.0:1746147723.353913:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793853568 00002000:00100000:1.0:1746147723.353949:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800954c2680 x1830967793853568/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.353957:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c2680 with x1830967793853568 ext(0->1048575) 00002000:00010000:1.0:1746147723.353962:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c2680 00000100:00100000:1.0:1746147723.353975:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793854080 00000100:00100000:1.0:1746147723.353977:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793854080 00000100:00100000:0.0:1746147723.354069:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7217 00000100:00100000:0.0:1746147723.354079:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967793853568:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:1.0:1746147723.354808:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800954c1180 x1830967793854080/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.354815:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1180 with x1830967793854080 ext(1048576->2097151) 00002000:00010000:1.0:1746147723.354819:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800954c1180 00000100:00100000:1.0:1746147723.354832:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7219 00000100:00100000:1.0:1746147723.354840:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967793854080:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147723.363072:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.383958:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.407012:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.407069:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.414909:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.424457:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.427645:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.428430:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.432761:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793856000 00000100:00100000:0.0:1746147723.432770:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793856000 00000100:00100000:0.0:1746147723.432815:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16275 00000100:00100000:0.0:1746147723.432821:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32084:x1830967793856000:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147723.432836:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147723.432850:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801361d2e00/0xe64d3fbf12a7d18d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb481 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.432875:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801361d3e00/0xe64d3fbf12a7d124 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb442 expref: 13 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.432880:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147723.432882:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147723.433333:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801361d2e00/0xe64d3fbf12a7d18d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2527232->2654207] (req 2527232->2654207) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb481 expref: 24 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.433359:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801361d3e00/0xe64d3fbf12a7d124 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb442 expref: 13 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.433370:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801361d3e00/0xe64d3fbf12a7d124 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb442 expref: 13 pid: 20619 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746147723.433458:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796420480:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147723.433515:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147723.437185:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.437631:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793856384 00000100:00100000:1.0:1746147723.437637:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793856384 00002000:00100000:1.0:1746147723.437668:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2514944->3145727) req@ffff88009fe39500 x1830967793856384/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.437677:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39500 with x1830967793856384 ext(2514944->3145727) 00010000:00010000:1.0:1746147723.437683:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801361d3e00/0xe64d3fbf12a7d124 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb442 expref: 14 pid: 20619 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.437694:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801361d3e00/0xe64d3fbf12a7d124 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb442 expref: 14 pid: 20619 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746147723.437700:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe39500 00000100:00100000:1.0:1746147723.437725:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1432 00000100:00100000:1.0:1746147723.437740:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967793856384:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147723.455459:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967793856384:12345-192.168.202.10@tcp:4:cat.0 Request processed in 17718us (18271us total) trans 21474841554 rc 0/0 00000100:00100000:1.0:1746147723.455471:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1432 00002000:00100000:1.0:1746147723.455481:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2514944->3145727) req@ffff88009fe39500 x1830967793856384/t21474841554(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/448 e 0 to 0 dl 1746147734 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.455490:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39500 with x1830967793856384 ext(2514944->3145727) 00010000:00010000:1.0:1746147723.455500:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801361d3e00/0xe64d3fbf12a7d124 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb442 expref: 16 pid: 20619 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.455514:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801361d3e00/0xe64d3fbf12a7d124 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb442 expref: 16 pid: 20619 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746147723.455521:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe39500 00000100:00100000:0.0:1746147723.459535:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.459988:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.464508:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.465036:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793856896 00000100:00100000:1.0:1746147723.465043:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793856896 00002000:00100000:1.0:1746147723.465076:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2527232->2531327) req@ffff880094efb800 x1830967793856896/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.465085:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efb800 with x1830967793856896 ext(2527232->2531327) 00010000:00010000:1.0:1746147723.465092:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801361d2e00/0xe64d3fbf12a7d18d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb481 expref: 25 pid: 4591 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.465110:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801361d2e00/0xe64d3fbf12a7d18d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb481 expref: 25 pid: 4591 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746147723.465116:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094efb800 00000100:00100000:1.0:1746147723.465144:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1433 00000100:00100000:1.0:1746147723.465149:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793856896:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147723.465291:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793856896:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 141us (785us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147723.465298:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1433 00002000:00100000:1.0:1746147723.465303:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2527232->2531327) req@ffff880094efb800 x1830967793856896/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/4536 e 0 to 0 dl 1746147734 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.465308:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efb800 with x1830967793856896 ext(2527232->2531327) 00010000:00010000:1.0:1746147723.465313:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801361d2e00/0xe64d3fbf12a7d18d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb481 expref: 25 pid: 4591 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.465322:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801361d2e00/0xe64d3fbf12a7d18d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb481 expref: 25 pid: 4591 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746147723.465326:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094efb800 00000100:00100000:0.0:1746147723.471477:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.473149:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.477984:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.483723:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.483770:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.483835:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793857792 00000100:00100000:1.0:1746147723.483842:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793857792 00000100:00100000:1.0:1746147723.483871:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793857920 00000100:00100000:1.0:1746147723.483873:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793857920 00000100:00100000:1.0:1746147723.483905:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16277 00000100:00100000:1.0:1746147723.483912:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967793857792:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147723.483926:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147723.483938:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc79c00/0xe64d3fbf12a7d1be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb496 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.483956:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.483957:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.483963:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc79c00/0xe64d3fbf12a7d1be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb496 expref: 16 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147723.483975:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc79c00/0xe64d3fbf12a7d1be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb496 expref: 16 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147723.483984:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc79c00, rc 0) 00000100:00100000:1.0:1746147723.484008:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967793857792:12345-192.168.202.10@tcp:101:cat.0 Request processed in 96us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.484013:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16277 00000100:00100000:1.0:1746147723.484023:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16278 00000100:00100000:1.0:1746147723.484027:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967793857920:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147723.484033:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147723.484041:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d1c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb49d expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147723.484069:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796420864:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147723.484120:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147723.485032:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147723.485207:0:10613:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.10@tcp) returned -22 from glimpse AST (req@ffff88012f514a80 x1830967796420864) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8801361d2e00/0xe64d3fbf12a7d18d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->2654207) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb481 expref: 26 pid: 4591 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.485241:0:10613:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801361d2e00/0xe64d3fbf12a7d18d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->2654207) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb481 expref: 26 pid: 4591 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746147723.485260:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801361d2e00/0xe64d3fbf12a7d18d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->2654207) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb481 expref: 26 pid: 4591 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.485274:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796420864:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147723.485286:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.485288:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.485292:0:10613:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8200/0xe64d3fbf12a7d194 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb488 expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.485299:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8200/0xe64d3fbf12a7d194 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb488 expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.485316:0:10613:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8200/0xe64d3fbf12a7d194 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb488 expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147723.485324:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796420992:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147723.485363:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147723.487362:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796420992:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147723.487390:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d1c5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb49d expref: 16 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147723.487407:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d1c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb49d expref: 16 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147723.487416:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc79600, rc 0) 00000100:00100000:1.0:1746147723.487785:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967793857920:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3754us (4011us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147723.487793:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16278 00000100:00100000:0.0:1746147723.500355:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.500385:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.500408:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.500431:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.501222:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7226 00000100:00100000:1.0:1746147723.501228:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967793859072:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147723.508620:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.508712:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793859584 00000100:00100000:1.0:1746147723.508719:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793859584 00002000:00100000:1.0:1746147723.508763:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88013584ad80 x1830967793859584/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.508772:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584ad80 with x1830967793859584 ext(1048576->2097151) 00002000:00010000:1.0:1746147723.508777:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584ad80 00000100:00100000:1.0:1746147723.508809:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7227 00000100:00100000:1.0:1746147723.508816:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967793859584:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147723.532245:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.532301:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.532589:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967793858304:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 31779us (32239us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147723.532598:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7223 00002000:00100000:0.0:1746147723.532608:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009505df80 x1830967793858304/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/440 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147723.532616:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505df80 with x1830967793858304 ext(2097152->3145727) 00002000:00010000:0.0:1746147723.532620:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009505df80 00000100:00100000:0.0:1746147723.532640:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793859328 00000100:00100000:0.0:1746147723.532645:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793859328 00002000:00100000:0.0:1746147723.532667:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880135849c00 x1830967793859328/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147723.532674:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849c00 with x1830967793859328 ext(1048576->2097151) 00002000:00010000:0.0:1746147723.532677:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135849c00 00000100:00100000:0.0:1746147723.532690:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7229 00000100:00100000:0.0:1746147723.532695:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967793859328:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147723.534015:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793860096 00000100:00100000:0.0:1746147723.534023:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793860096 00000100:00100000:0.0:1746147723.534053:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11958 00000100:00100000:0.0:1746147723.534059:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32090:x1830967793860096:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147723.534074:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147723.534090:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d3400/0xe64d3fbf12a7d1cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb4a4 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.534173:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7d1d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534184:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7d1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534193:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7d1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534203:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2600/0xe64d3fbf12a7d1da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534209:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2600/0xe64d3fbf12a7d1da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534217:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2600/0xe64d3fbf12a7d1da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534307:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d3800/0xe64d3fbf12a7d1e1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534314:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d3800/0xe64d3fbf12a7d1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534321:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d3800/0xe64d3fbf12a7d1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:0.0:1746147723.534329:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147723.534400:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7d1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534405:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7d1d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534410:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7d1d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534416:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801361d2200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147723.534418:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7d1d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534424:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7d1d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534433:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147723.534436:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147723.534439:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7d1d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534446:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2200/0xe64d3fbf12a7d1d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534471:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2600/0xe64d3fbf12a7d1da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534475:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2600/0xe64d3fbf12a7d1da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534478:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2600/0xe64d3fbf12a7d1da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534481:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801361d2600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147723.534483:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2600/0xe64d3fbf12a7d1da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534487:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2600/0xe64d3fbf12a7d1da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534492:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06ee800) 00010000:00010000:0.0:1746147723.534494:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147723.534496:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2600/0xe64d3fbf12a7d1da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534499:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d2600/0xe64d3fbf12a7d1da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147723.534530:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d3400/0xe64d3fbf12a7d1cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4a4 expref: 14 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.534538:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d3800/0xe64d3fbf12a7d1e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4a4 expref: 13 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.534548:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147723.534550:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147723.534552:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801361d3800, rc 0) 00000100:00100000:0.0:1746147723.534574:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32090:x1830967793860096:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 515us (2272us total) trans 8589945962 rc 0/0 00000100:00100000:0.0:1746147723.534579:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11958 00000100:00100000:0.0:1746147723.541003:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967793858944:12345-192.168.202.10@tcp:3:cat.0 Request processed in 40121us (40584us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147723.541014:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7225 00002000:00100000:0.0:1746147723.541025:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800943c7100 x1830967793858944/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/440 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147723.541034:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c7100 with x1830967793858944 ext(0->1048575) 00002000:00010000:0.0:1746147723.541039:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c7100 00000100:00100000:1.0:1746147723.547708:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967793859072:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 46472us (47267us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147723.547720:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7226 00002000:00100000:1.0:1746147723.547742:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800943c5500 x1830967793859072/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/440 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.547756:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5500 with x1830967793859072 ext(3145728->4194303) 00002000:00010000:1.0:1746147723.547761:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c5500 00000100:00100000:1.0:1746147723.552153:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967793859584:12345-192.168.202.10@tcp:3:cat.0 Request processed in 43328us (43530us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147723.552163:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7227 00002000:00100000:1.0:1746147723.552173:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88013584ad80 x1830967793859584/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/440 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.552182:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584ad80 with x1830967793859584 ext(1048576->2097151) 00002000:00010000:1.0:1746147723.552188:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584ad80 00000100:00100000:0.0:1746147723.558984:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.560117:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1957:x1830967793859328:12345-192.168.202.10@tcp:3:cat.0 Request processed in 27420us (27877us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147723.560123:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7229 00002000:00100000:1.0:1746147723.560128:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880135849c00 x1830967793859328/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/440 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.560134:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849c00 with x1830967793859328 ext(1048576->2097151) 00002000:00010000:1.0:1746147723.560137:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135849c00 00000100:00100000:0.0:1746147723.561174:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.561772:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793860480 00000100:00100000:0.0:1746147723.561777:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793860480 00000100:00100000:0.0:1746147723.561812:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 903 00000100:00100000:0.0:1746147723.561819:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967793860480:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147723.561829:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147723.561849:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801361d3800/0xe64d3fbf12a7d1e1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4a4 expref: 13 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.561866:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147723.561870:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147723.561911:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1957:x1830967793860480:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 92us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.561917:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 903 00000100:00100000:0.0:1746147723.575797:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.595768:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.595860:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793860864 00000100:00100000:1.0:1746147723.595868:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793860864 00000100:00100000:1.0:1746147723.595939:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16279 00000100:00100000:1.0:1746147723.595946:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32087:x1830967793860864:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147723.595960:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147723.595976:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c84600/0xe64d3fbf12a7d1ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb4ab expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.596001:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.596003:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147723.596009:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c84600/0xe64d3fbf12a7d1ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ab expref: 16 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.596021:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c84600/0xe64d3fbf12a7d1ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ab expref: 16 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.596030:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c84600, rc 0) 00000100:00100000:1.0:1746147723.596063:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32087:x1830967793860864:12345-192.168.202.10@tcp:101:cat.0 Request processed in 118us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.596069:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16279 00000100:00100000:0.0:1746147723.608484:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.608520:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.608562:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.608594:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793861248 00000100:00100000:0.0:1746147723.608601:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793861248 00002000:00100000:0.0:1746147723.608638:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a2139c00 x1830967793861248/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147723.608648:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2139c00 with x1830967793861248 ext(2097152->3145727) 00002000:00010000:0.0:1746147723.608652:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2139c00 00000100:00100000:0.0:1746147723.608665:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793861376 00000100:00100000:0.0:1746147723.608667:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793861376 00002000:00100000:0.0:1746147723.608676:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fe39c00 x1830967793861376/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147723.608683:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39c00 with x1830967793861376 ext(3145728->4194303) 00002000:00010000:0.0:1746147723.608685:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe39c00 00000100:00100000:0.0:1746147723.608706:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793861632 00000100:00100000:0.0:1746147723.608708:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793861632 00002000:00100000:0.0:1746147723.608720:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88008fb76a00 x1830967793861632/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147723.608726:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb76a00 with x1830967793861632 ext(3145728->4194303) 00002000:00010000:0.0:1746147723.608739:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb76a00 00000100:00100000:0.0:1746147723.608751:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7232 00000100:00100000:0.0:1746147723.608758:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967793861248:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147723.609333:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7233 00000100:00100000:1.0:1746147723.609341:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967793861376:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147723.631547:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967793861376:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22199us (23017us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147723.631558:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7233 00002000:00100000:1.0:1746147723.631569:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fe39c00 x1830967793861376/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/440 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.631578:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39c00 with x1830967793861376 ext(3145728->4194303) 00002000:00010000:1.0:1746147723.631583:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe39c00 00000100:00100000:0.0:1746147723.644171:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.644237:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.644322:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793861760 00000100:00100000:1.0:1746147723.644329:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793861760 00000100:00100000:1.0:1746147723.644377:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11959 00000100:00100000:1.0:1746147723.644385:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+6:32092:x1830967793861760:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147723.644405:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147723.644421:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85e00/0xe64d3fbf12a7d1f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb4b2 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.644469:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d1fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.644478:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d1fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.644487:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d1fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.644498:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7d204 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.644503:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7d204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.644508:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7d204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.644591:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.644600:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7d17f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb47a expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.644606:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.644629:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7d17f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb47a expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.644639:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7d17f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb47a expref: 327 pid: 5744 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.644650:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796421120:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147723.644726:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147723.647326:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.647724:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796421120:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147723.647751:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147723.650013:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793862400 00000100:00100000:0.0:1746147723.650018:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793862400 00000100:00100000:0.0:1746147723.650052:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4966 00000100:00100000:0.0:1746147723.650058:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:27451:x1830967793862400:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147723.650902:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:27451:x1830967793862400:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 843us (1076us total) trans 8589945963 rc 0/0 00000100:00100000:0.0:1746147723.650907:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4966 00000100:00100000:0.0:1746147723.651999:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.653254:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.653270:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793862528 00000100:00100000:0.0:1746147723.653276:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793862528 00010000:00010000:0.0:1746147723.653299:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a7d04b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3b6 expref: 26 pid: 9615 timeout: 902 lvb_type: 1 00000100:00100000:0.0:1746147723.653326:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793862656 00000100:00100000:0.0:1746147723.653327:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793862656 00010000:00010000:0.0:1746147723.653335:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e61400/0xe64d3fbf12a7d03d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3a1 expref: 17 pid: 4591 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746147723.653347:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8239 00000100:00100000:0.0:1746147723.653351:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967793862528:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147723.653365:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147723.653381:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a7d04b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3b6 expref: 26 pid: 9615 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746147723.653390:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a7d04b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3b6 expref: 26 pid: 9615 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746147723.653405:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a7d04b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3b6 expref: 26 pid: 9615 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746147723.653416:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147723.656499:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967793862528:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3144us (4499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.656506:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8239 00000100:00100000:0.0:1746147723.656633:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.656648:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793862784 00000100:00100000:0.0:1746147723.656653:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793862784 00010000:00010000:0.0:1746147723.656669:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7d17f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb47a expref: 329 pid: 5744 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746147723.656682:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8241 00000100:00100000:0.0:1746147723.656686:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:1959:x1830967793862784:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147723.656692:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147723.656695:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7d17f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb47a expref: 329 pid: 5744 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.656702:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7d17f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb47a expref: 329 pid: 5744 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.656713:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095150e00/0xe64d3fbf12a7d17f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb47a expref: 329 pid: 5744 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.656723:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147723.656727:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656749:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656755:0:7096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656769:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147723.656792:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:1959:x1830967793862784:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 105us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.656796:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8241 00010000:00010000:0.0:1746147723.656843:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656848:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147723.656880:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:0.0:1746147723.656898:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147723.656912:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656919:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656929:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d1fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656934:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d1fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656939:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d1fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656943:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c84a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147723.656946:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d1fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656950:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d1fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656956:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147723.656958:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147723.656961:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d1fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656964:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d1fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656972:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7d204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656975:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7d204 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656979:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7d204 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656982:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c85800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147723.656985:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7d204 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656988:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7d204 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656993:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130b32100) 00010000:00010000:0.0:1746147723.656994:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147723.656996:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7d204 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.656999:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7d204 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.657038:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85e00/0xe64d3fbf12a7d1f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4b2 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.657046:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4b2 expref: 7 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.657050:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147723.657051:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147723.657053:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c85400, rc 0) 00000100:00100000:0.0:1746147723.657072:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+7:32092:x1830967793861760:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 12689us (12835us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.657077:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11959 00000100:00100000:0.0:1746147723.661505:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.663273:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.664203:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.664249:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.664270:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.664285:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793863168 00000100:00100000:0.0:1746147723.664288:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793863168 00000100:00100000:0.0:1746147723.664304:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793863424 00000100:00100000:0.0:1746147723.664306:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793863424 00000100:00100000:0.0:1746147723.664315:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793863552 00000100:00100000:0.0:1746147723.664317:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793863552 00000100:00100000:0.0:1746147723.664326:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16282 00000100:00100000:0.0:1746147723.664330:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967793863168:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147723.664338:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147723.664347:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e60400/0xe64d3fbf12a7d220 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb4c0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.664359:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147723.664360:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147723.664364:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e60400/0xe64d3fbf12a7d220 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c0 expref: 7 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147723.664373:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e60400/0xe64d3fbf12a7d220 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c0 expref: 7 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147723.664380:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e60400, rc 0) 00000100:00100000:0.0:1746147723.664398:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793863168:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.664402:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16282 00000100:00100000:0.0:1746147723.664413:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16283 00000100:00100000:0.0:1746147723.664417:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793863424:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147723.664427:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147723.664432:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7d227 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb4ce expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147723.664462:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796421632:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147723.664504:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147723.664519:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16284 00000100:00100000:0.0:1746147723.664523:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967793863552:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147723.664528:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147723.664533:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e60200/0xe64d3fbf12a7d22e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb4d5 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.664542:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147723.664543:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147723.664547:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e60200/0xe64d3fbf12a7d22e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4d5 expref: 7 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147723.664555:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e60200/0xe64d3fbf12a7d22e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4d5 expref: 7 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147723.664560:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e60200, rc 0) 00000100:00100000:0.0:1746147723.664571:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793863552:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 47us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.664574:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16284 00000100:00100000:0.0:1746147723.664596:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.664616:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793863680 00000100:00100000:0.0:1746147723.664618:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793863680 00000100:00100000:0.0:1746147723.664629:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16285 00000100:00100000:0.0:1746147723.664632:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793863680:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147723.664638:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147723.665500:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e61c00/0xe64d3fbf12a7d235 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb4dc expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.665877:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147723.665879:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147723.666049:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e61c00/0xe64d3fbf12a7d235 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4dc expref: 8 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147723.666060:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e61c00/0xe64d3fbf12a7d235 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4dc expref: 8 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147723.666067:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e61c00, rc 0) 00000100:00100000:1.0:1746147723.666524:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793864064 00000100:00100000:1.0:1746147723.666528:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793864064 00000100:00100000:1.0:1746147723.666553:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4967 00000100:00100000:1.0:1746147723.666558:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32087:x1830967793864064:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:0.0:1746147723.666723:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793863680:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 2088us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.666739:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16285 00000100:00100000:1.0:1746147723.667957:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32087:x1830967793864064:12345-192.168.202.10@tcp:35:cat.0 Request processed in 1397us (1820us total) trans 8589945964 rc 0/0 00000100:00100000:1.0:1746147723.667964:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4967 00000100:00100000:0.0:1746147723.669166:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.669525:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.669565:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793864448 00000100:00100000:1.0:1746147723.669569:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793864448 00000100:00100000:1.0:1746147723.669597:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11960 00000100:00100000:1.0:1746147723.669603:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+7:32092:x1830967793864448:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147723.669615:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147723.669630:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84200/0xe64d3fbf12a7d243 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb4f1 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.669715:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85000/0xe64d3fbf12a7d251 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.669728:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4b2 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.669742:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85000/0xe64d3fbf12a7d251 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.669765:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4b2 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.669773:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4b2 expref: 8 pid: 17544 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.669781:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796421760:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147723.669833:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147723.678937:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.678962:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.678979:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.678995:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793864704 00000100:00100000:0.0:1746147723.679001:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793864704 00010000:00010000:0.0:1746147723.679028:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4d3400/0xe64d3fbf12a7d08a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3e7 expref: 18 pid: 22183 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746147723.679046:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793864576 00000100:00100000:0.0:1746147723.679047:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793864576 00010000:00010000:0.0:1746147723.679056:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4b2 expref: 9 pid: 17544 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746147723.679066:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793864832 00000100:00100000:0.0:1746147723.679067:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793864832 00010000:00010000:0.0:1746147723.679073:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e60200/0xe64d3fbf12a7d22e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4d5 expref: 8 pid: 9615 timeout: 902 lvb_type: 1 00000100:00100000:0.0:1746147723.679084:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8242 00000100:00100000:0.0:1746147723.679089:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967793864704:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147723.679099:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147723.679116:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c4d3400/0xe64d3fbf12a7d08a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3e7 expref: 18 pid: 22183 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.679123:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c4d3400/0xe64d3fbf12a7d08a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3e7 expref: 18 pid: 22183 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.679145:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147723.679174:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967793864704:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 85us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.679179:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8242 00000100:00100000:0.0:1746147723.679190:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8243 00000100:00100000:0.0:1746147723.679194:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967793864576:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147723.679199:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147723.679203:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4b2 expref: 9 pid: 17544 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.679214:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4b2 expref: 9 pid: 17544 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.679224:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147723.679227:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85000/0xe64d3fbf12a7d251 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.679235:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85000/0xe64d3fbf12a7d251 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.679240:0:7312:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85000/0xe64d3fbf12a7d251 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.679252:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147723.679260:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967793864576:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 66us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.679264:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8243 00000100:00100000:0.0:1746147723.679270:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8244 00000100:00100000:0.0:1746147723.679273:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793864832:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147723.679277:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147723.679282:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e60200/0xe64d3fbf12a7d22e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4d5 expref: 8 pid: 9615 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746147723.679288:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e60200/0xe64d3fbf12a7d22e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4d5 expref: 8 pid: 9615 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746147723.679296:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147723.679304:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793864832:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 31us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.679308:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8244 00010000:00010000:1.0:1746147723.679574:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85400/0xe64d3fbf12a7d20b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4b2 expref: 8 pid: 17544 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.679596:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796421760:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147723.679611:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85000/0xe64d3fbf12a7d251 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.679617:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85000/0xe64d3fbf12a7d251 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.679621:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85000/0xe64d3fbf12a7d251 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:1.0:1746147723.679637:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147723.679751:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84200/0xe64d3fbf12a7d243 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4f1 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.679763:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85000/0xe64d3fbf12a7d251 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4f1 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.679768:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147723.679770:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147723.679772:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c85000, rc 0) 00000100:00100000:1.0:1746147723.679791:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32092:x1830967793864448:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 10188us (10266us total) trans 8589945965 rc 0/0 00000100:00100000:1.0:1746147723.679795:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11960 00000100:00100000:1.0:1746147723.683359:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.685709:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.685764:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793865216 00000100:00100000:1.0:1746147723.685769:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793865216 00000100:00100000:1.0:1746147723.685815:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11961 00000100:00100000:1.0:1746147723.685821:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32092:x1830967793865216:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147723.685838:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147723.685841:0:17544:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147723.685857:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85000/0xe64d3fbf12a7d251 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4f1 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.685869:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147723.685873:0:17544:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147723.685904:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d25f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb4f8 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.685979:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d266 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.685993:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d266 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.686000:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d266 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.686009:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d266 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.686014:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d266 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.686019:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d266 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.686024:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc78c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147723.686027:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d266 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.686032:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d266 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.686038:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147723.686040:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147723.686043:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d266 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.686047:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d266 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.686067:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d25f lrc: 1/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4f8 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.686078:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d25f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4f8 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.686085:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc79600, rc 0) 00000100:00100000:1.0:1746147723.686130:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+7:32092:x1830967793865216:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 309us (425us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147723.686136:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11961 00000100:00100000:0.0:1746147723.689829:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.689911:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793865472 00000100:00100000:1.0:1746147723.689919:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793865472 00002000:00100000:1.0:1746147723.689953:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1163264->1167359) req@ffff88009fe96300 x1830967793865472/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.689962:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96300 with x1830967793865472 ext(1163264->1167359) 00002000:00010000:1.0:1746147723.689967:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe96300 00000100:00100000:1.0:1746147723.689995:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7237 00000100:00100000:1.0:1746147723.690002:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967793865472:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147723.690154:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967793865472:12345-192.168.202.10@tcp:3:cat.0 Request processed in 152us (329us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147723.690161:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7237 00002000:00100000:1.0:1746147723.690166:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1163264->1167359) req@ffff88009fe96300 x1830967793865472/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/4536 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.690174:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96300 with x1830967793865472 ext(1163264->1167359) 00002000:00010000:1.0:1746147723.690177:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe96300 00000100:00100000:3.0:1746147723.691002:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967793864960:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7541us (7643us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147723.691011:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8245 00000100:00100000:0.0:1746147723.692273:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.692921:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793865728 00000100:00100000:1.0:1746147723.692928:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793865728 00000100:00100000:1.0:1746147723.692967:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4968 00000100:00100000:1.0:1746147723.692973:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6668850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+7:32092:x1830967793865728:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147723.693148:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6668850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+8:32092:x1830967793865728:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 174us (875us total) trans 8589945966 rc 0/0 00000100:00100000:1.0:1746147723.693154:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4968 00000100:00100000:0.0:1746147723.706147:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.706451:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.706479:0:14542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793866112 00000100:00100000:3.0:1746147723.706483:0:14542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793866112 00000100:00100000:3.0:1746147723.706503:0:14542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 218 00000100:00100000:3.0:1746147723.706508:0:14542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febf1b7c-e040-48da-83a3-5da159ba5e63+15:1959:x1830967793866112:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1746147723.706577:0:14542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febf1b7c-e040-48da-83a3-5da159ba5e63+15:1959:x1830967793866112:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 67us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147723.706583:0:14542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 218 00000100:00100000:0.0:1746147723.709354:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.709440:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793866368 00000100:00100000:1.0:1746147723.709448:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793866368 00000100:00100000:1.0:1746147723.709481:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11962 00000100:00100000:1.0:1746147723.709488:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32098:x1830967793866368:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147723.709505:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147723.709521:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d26d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb4ff expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.709612:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d274 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.709623:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d274 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.709631:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d274 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.709642:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667be00/0xe64d3fbf12a7d27b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.709646:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667be00/0xe64d3fbf12a7d27b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.709650:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667be00/0xe64d3fbf12a7d27b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.709754:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667b000/0xe64d3fbf12a7d282 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.709761:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667b000/0xe64d3fbf12a7d282 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.709766:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667b000/0xe64d3fbf12a7d282 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:1.0:1746147723.709774:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147723.709840:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d274 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.709845:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d274 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.709850:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d274 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.709854:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc78c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147723.709857:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d274 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.709862:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d274 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.709871:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147723.709873:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147723.709876:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d274 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.709880:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d274 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.711969:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667be00/0xe64d3fbf12a7d27b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.711981:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667be00/0xe64d3fbf12a7d27b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.711988:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667be00/0xe64d3fbf12a7d27b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.711993:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a667be00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147723.711996:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667be00/0xe64d3fbf12a7d27b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.712002:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667be00/0xe64d3fbf12a7d27b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.712013:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130b32400) 00010000:00010000:1.0:1746147723.712015:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147723.712018:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667be00/0xe64d3fbf12a7d27b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.712022:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667be00/0xe64d3fbf12a7d27b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.712092:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d26d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ff expref: 331 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.712102:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667b000/0xe64d3fbf12a7d282 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ff expref: 330 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.712109:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147723.712111:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147723.712113:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a667b000, rc 0) 00000100:00100000:1.0:1746147723.712173:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:32098:x1830967793866368:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2684us (2823us total) trans 8589945968 rc 0/0 00000100:00100000:1.0:1746147723.712181:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11962 00000100:00100000:1.0:1746147723.715772:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793866624 00000100:00100000:1.0:1746147723.715781:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793866624 00000100:00100000:1.0:1746147723.715814:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4970 00000100:00100000:1.0:1746147723.715821:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:32098:x1830967793866624:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:1.0:1746147723.716030:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+331:32098:x1830967793866624:12345-192.168.202.10@tcp:35:cat.0 Request processed in 207us (349us total) trans 8589945969 rc 0/0 00000100:00100000:1.0:1746147723.716036:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4970 00000100:00100000:0.0:1746147723.718744:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.719115:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793867008 00000100:00100000:1.0:1746147723.719122:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793867008 00000100:00100000:1.0:1746147723.719157:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11963 00000100:00100000:1.0:1746147723.719163:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+331:32096:x1830967793867008:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147723.719179:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147723.719193:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667be00/0xe64d3fbf12a7d290 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb50d expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.719268:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d297 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.719280:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667b000/0xe64d3fbf12a7d282 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ff expref: 332 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.719287:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d297 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.719314:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667b000/0xe64d3fbf12a7d282 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ff expref: 332 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.719324:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667b000/0xe64d3fbf12a7d282 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ff expref: 332 pid: 17544 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746147723.719334:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796422400:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147723.719368:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.719472:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793866880 00000100:00100000:0.0:1746147723.719475:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793866880 00000100:00100000:1.0:1746147723.719607:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64aec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147723.719620:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793867136 00000100:00100000:3.0:1746147723.719623:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793867136 00000100:00100000:0.0:1746147723.719662:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16288 00000100:00100000:0.0:1746147723.719667:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793866880:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147723.719675:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147723.719685:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e60200/0xe64d3fbf12a7d29e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb506 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147723.719713:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796422528:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147723.719751:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147723.719767:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16289 00000100:00100000:3.0:1746147723.719773:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793867136:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147723.719780:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147723.719788:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7cd200/0xe64d3fbf12a7d2a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb514 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147723.719813:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796422656:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147723.719849:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147723.721303:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796422400:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147723.721319:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d297 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:3.0:1746147723.722115:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793867264 00000100:00100000:3.0:1746147723.722119:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793867264 00010000:00010000:3.0:1746147723.722140:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667b000/0xe64d3fbf12a7d282 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ff expref: 333 pid: 17544 timeout: 902 lvb_type: 0 00000100:00100000:3.0:1746147723.722163:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8246 00000100:00100000:3.0:1746147723.722168:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:1960:x1830967793867264:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147723.722177:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147723.722182:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667b000/0xe64d3fbf12a7d282 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ff expref: 333 pid: 17544 timeout: 902 lvb_type: 0 00010000:00010000:3.0:1746147723.722190:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667b000/0xe64d3fbf12a7d282 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ff expref: 333 pid: 17544 timeout: 902 lvb_type: 0 00010000:00010000:3.0:1746147723.722203:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667b000/0xe64d3fbf12a7d282 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ff expref: 333 pid: 17544 timeout: 902 lvb_type: 0 00010000:00010000:3.0:1746147723.722227:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147723.722231:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d297 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147723.722238:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d297 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147723.722244:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d297 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147723.722257:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:0.0:1746147723.722328:0:6715:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime: 1746147723 -> 1746147724 00002000:00010000:0.0:1746147723.722331:0:6715:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime: 1746147722 -> 1746147724 00002000:00010000:0.0:1746147723.722332:0:6715:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime: 1746147723 -> 1746147724 00000100:00100000:0.0:1746147723.722345:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796422656:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147723.722361:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7cd200/0xe64d3fbf12a7d2a5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb514 expref: 26 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147723.722372:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7cd200/0xe64d3fbf12a7d2a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb514 expref: 26 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147723.722384:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7cd200, rc 0) 00010000:00010000:1.0:1746147723.722444:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d297 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147723.722450:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d297 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:1.0:1746147723.722465:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147723.722567:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667be00/0xe64d3fbf12a7d290 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb50d expref: 334 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.722580:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d297 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb50d expref: 333 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.722585:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147723.722587:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147723.722589:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc79600, rc 0) 00000100:00100000:3.0:1746147723.722630:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:1960:x1830967793867264:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 460us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147723.722636:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8246 00000100:00100000:0.0:1746147723.722829:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967793867136:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3055us (3459us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147723.722830:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+332:32096:x1830967793867008:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3667us (3910us total) trans 8589945970 rc 0/0 00000100:00100000:0.0:1746147723.722834:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16289 00000100:00100000:1.0:1746147723.722835:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11963 00000100:00100000:0.0:1746147723.731008:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.736102:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.737950:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793867520 00000100:00100000:3.0:1746147723.737959:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793867520 00002000:00100000:3.0:1746147723.737998:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1490944->2097151) req@ffff88009fe97480 x1830967793867520/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.738007:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe97480 with x1830967793867520 ext(1490944->2097151) 00010000:00010000:3.0:1746147723.738014:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7d212 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4b9 expref: 16 pid: 4591 timeout: 902 lvb_type: 0 00010000:00010000:3.0:1746147723.738026:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7d212 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4b9 expref: 16 pid: 4591 timeout: 902 lvb_type: 0 00002000:00010000:3.0:1746147723.738032:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe97480 00000100:00100000:3.0:1746147723.738074:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1436 00000100:00100000:3.0:1746147723.738082:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967793867520:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147723.751340:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967793867520:12345-192.168.202.10@tcp:4:cat.0 Request processed in 13249us (15235us total) trans 21474841556 rc 0/0 00000100:00100000:3.0:1746147723.751352:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1436 00002000:00100000:3.0:1746147723.751362:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1490944->2097151) req@ffff88009fe97480 x1830967793867520/t21474841556(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/448 e 0 to 0 dl 1746147734 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.751371:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe97480 with x1830967793867520 ext(1490944->2097151) 00010000:00010000:3.0:1746147723.751380:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7d212 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4b9 expref: 18 pid: 4591 timeout: 902 lvb_type: 0 00010000:00010000:3.0:1746147723.751394:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7d212 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4b9 expref: 18 pid: 4591 timeout: 902 lvb_type: 0 00002000:00010000:3.0:1746147723.751401:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe97480 00000100:00100000:0.0:1746147723.754334:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.756878:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793867776 00000100:00100000:3.0:1746147723.756895:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793867776 00000100:00100000:3.0:1746147723.756924:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16291 00000100:00100000:3.0:1746147723.756929:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32096:x1830967793867776:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147723.756943:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147723.756955:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb522 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.756974:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8200/0xe64d3fbf12a7d194 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb488 expref: 27 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.756982:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7d23c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4e3 expref: 7 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147723.756989:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c84600/0xe64d3fbf12a7d1ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ab expref: 16 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.756994:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147723.756995:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147723.756998:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 6/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2682880->3145727] (req 2682880->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 27 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.757016:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c84600/0xe64d3fbf12a7d1ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ab expref: 16 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.757024:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c84600/0xe64d3fbf12a7d1ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ab expref: 16 pid: 10613 timeout: 902 lvb_type: 0 00000100:00100000:3.0:1746147723.757037:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796423040:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147723.757377:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7d23c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4e3 expref: 7 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147723.757390:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7d23c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4e3 expref: 7 pid: 20619 timeout: 902 lvb_type: 1 00000100:00100000:3.0:1746147723.757398:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796423168:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147723.757424:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8200/0xe64d3fbf12a7d194 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb488 expref: 27 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.757431:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8200/0xe64d3fbf12a7d194 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb488 expref: 27 pid: 4591 timeout: 902 lvb_type: 0 00000100:00100000:3.0:1746147723.757438:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796423296:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147723.757468:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147723.759000:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.759075:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793868032 00000100:00100000:3.0:1746147723.759079:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793868032 00002000:00100000:3.0:1746147723.759105:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88012f514a80 x1830967793868032/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.759113:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514a80 with x1830967793868032 ext(1048576->2097151) 00002000:00010000:3.0:1746147723.759117:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f514a80 00000100:00100000:3.0:1746147723.759129:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7238 00000100:00100000:3.0:1746147723.759134:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967793868032:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147723.766706:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.767093:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796423040:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147723.767103:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7d23c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4e3 expref: 7 pid: 20619 timeout: 902 lvb_type: 1 00000100:00100000:3.0:1746147723.767936:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0436300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796423168:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147723.767950:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796423296:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147723.767972:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2682880->3145727] (req 2682880->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.767983:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c467a00, rc 0) 00000100:00100000:3.0:1746147723.768004:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32096:x1830967793867776:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 11075us (11323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147723.768011:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16291 00000100:00100000:0.0:1746147723.768342:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.769272:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.769688:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793868288 00000100:00100000:3.0:1746147723.769692:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793868288 00010000:00010000:3.0:1746147723.769708:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c84600/0xe64d3fbf12a7d1ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ab expref: 17 pid: 10613 timeout: 902 lvb_type: 0 00000100:00100000:3.0:1746147723.769743:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8250 00000100:00100000:3.0:1746147723.769749:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967793868288:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147723.769756:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147723.769766:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c84600/0xe64d3fbf12a7d1ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ab expref: 17 pid: 10613 timeout: 902 lvb_type: 0 00010000:00010000:3.0:1746147723.769775:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c84600/0xe64d3fbf12a7d1ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ab expref: 17 pid: 10613 timeout: 902 lvb_type: 0 00010000:00010000:3.0:1746147723.769788:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c84600/0xe64d3fbf12a7d1ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ab expref: 17 pid: 10613 timeout: 902 lvb_type: 0 00010000:00010000:3.0:1746147723.769798:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147723.769800:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147723.769805:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 27 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.769813:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 27 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.769836:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 27 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147723.769847:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796423424:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147723.769929:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147723.771842:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967793868032:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 12707us (12845us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147723.771850:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7238 00002000:00100000:3.0:1746147723.771858:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88012f514a80 x1830967793868032/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/440 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.771865:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514a80 with x1830967793868032 ext(1048576->2097151) 00002000:00010000:3.0:1746147723.771869:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f514a80 00000100:00100000:0.0:1746147723.772399:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.772461:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793868672 00000100:00100000:3.0:1746147723.772466:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793868672 00002000:00100000:3.0:1746147723.772488:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2682880->2686975) req@ffff88012da3c850 x1830967793868672/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.772499:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da3c850 with x1830967793868672 ext(2682880->2686975) 00002000:00010000:3.0:1746147723.772502:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012da3c850 00000100:00100000:3.0:1746147723.772627:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7239 00000100:00100000:3.0:1746147723.772633:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967793868672:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147723.772765:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967793868672:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 131us (367us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147723.772771:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7239 00002000:00100000:3.0:1746147723.772775:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2682880->2686975) req@ffff88012da3c850 x1830967793868672/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/4536 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.772781:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da3c850 with x1830967793868672 ext(2682880->2686975) 00002000:00010000:3.0:1746147723.772784:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012da3c850 00000100:00100000:0.0:1746147723.778207:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.778274:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793868800 00000100:00100000:3.0:1746147723.778281:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793868800 00000100:00100000:3.0:1746147723.778330:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16292 00000100:00100000:3.0:1746147723.778337:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:32098:x1830967793868800:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147723.778352:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147723.778366:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c466000/0xe64d3fbf12a7d2c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb529 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.778390:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7d24a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ea expref: 15 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.778397:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147723.778399:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147723.778402:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c466000/0xe64d3fbf12a7d2c1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb529 expref: 26 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.778426:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7d24a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ea expref: 15 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.778436:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7d24a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ea expref: 15 pid: 6715 timeout: 902 lvb_type: 0 00000100:00100000:3.0:1746147723.778445:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796423552:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147723.779338:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.779584:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793868928 00000100:00100000:0.0:1746147723.779589:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793868928 00000100:00100000:3.0:1746147723.779646:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147723.782617:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.783250:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796423552:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147723.783272:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c466000/0xe64d3fbf12a7d2c1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb529 expref: 28 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.783284:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c466000, rc 0) 00010000:00010000:1.0:1746147723.783552:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147723.787167:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:32098:x1830967793868800:12345-192.168.202.10@tcp:101:cat.0 Request processed in 8821us (8959us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147723.787177:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16292 00000100:00100000:1.0:1746147723.788829:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.788863:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.788947:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793869184 00000100:00100000:0.0:1746147723.788954:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793869184 00010000:00010000:0.0:1746147723.788982:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e61c00/0xe64d3fbf12a7d235 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4dc expref: 7 pid: 7050 timeout: 902 lvb_type: 1 00000100:00100000:0.0:1746147723.789003:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793869312 00000100:00100000:0.0:1746147723.789004:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793869312 00010000:00010000:0.0:1746147723.789011:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095151400/0xe64d3fbf12a7d171 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb473 expref: 28 pid: 4591 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746147723.789027:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8251 00000100:00100000:0.0:1746147723.789032:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793869184:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147723.789042:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147723.789059:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e61c00/0xe64d3fbf12a7d235 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4dc expref: 7 pid: 7050 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746147723.789067:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e61c00/0xe64d3fbf12a7d235 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4dc expref: 7 pid: 7050 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746147723.789084:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147723.789115:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793869184:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 84us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.789120:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8251 00000100:00100000:0.0:1746147723.789130:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8252 00000100:00100000:0.0:1746147723.789134:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967793869312:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147723.789138:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147723.789144:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095151400/0xe64d3fbf12a7d171 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb473 expref: 28 pid: 4591 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.789150:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095151400/0xe64d3fbf12a7d171 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb473 expref: 28 pid: 4591 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746147723.789159:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147723.789167:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967793869312:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 33us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.789171:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8252 00000100:00100000:3.0:1746147723.789387:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796423680:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147723.789396:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e61c00/0xe64d3fbf12a7d235 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4dc expref: 6 pid: 7050 timeout: 902 lvb_type: 1 00000100:00100000:3.0:1746147723.789409:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796423808:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147723.789417:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095151400/0xe64d3fbf12a7d171 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb473 expref: 27 pid: 4591 timeout: 902 lvb_type: 0 00000100:00100000:3.0:1746147723.789424:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796423936:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147723.789445:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7d2c8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->3194879] (req 3145728->3194879) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb530 expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.789454:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d2400, rc 0) 00000100:00100000:3.0:1746147723.789475:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32096:x1830967793868928:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 8353us (10138us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147723.789480:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16293 00000100:00100000:0.0:1746147723.792629:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.792691:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793869440 00000100:00100000:3.0:1746147723.792697:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793869440 00010000:00010000:3.0:1746147723.792717:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc79c00/0xe64d3fbf12a7d1be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb496 expref: 18 pid: 10613 timeout: 902 lvb_type: 1 00000100:00100000:3.0:1746147723.792758:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8253 00000100:00100000:3.0:1746147723.792765:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967793869440:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147723.792774:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147723.792788:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc79c00/0xe64d3fbf12a7d1be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb496 expref: 18 pid: 10613 timeout: 902 lvb_type: 1 00010000:00010000:3.0:1746147723.792798:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc79c00/0xe64d3fbf12a7d1be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb496 expref: 18 pid: 10613 timeout: 902 lvb_type: 1 00010000:00010000:3.0:1746147723.792815:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc79c00/0xe64d3fbf12a7d1be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb496 expref: 18 pid: 10613 timeout: 902 lvb_type: 1 00010000:00010000:3.0:1746147723.792833:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147723.792835:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147723.792840:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7d2c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb530 expref: 25 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.792847:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7d2c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb530 expref: 25 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.792871:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7d2c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb530 expref: 25 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147723.792881:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796424064:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147723.794056:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147723.795386:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796424064:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147723.795403:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147723.795514:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967793869440:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2748us (2884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147723.795523:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8253 00000100:00100000:0.0:1746147723.796278:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.797335:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.797450:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793869568 00000100:00100000:3.0:1746147723.797454:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793869568 00010000:00010000:3.0:1746147723.797471:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7d24a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ea expref: 17 pid: 6715 timeout: 902 lvb_type: 0 00000100:00100000:3.0:1746147723.797488:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8254 00000100:00100000:3.0:1746147723.797492:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967793869568:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147723.797500:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147723.797511:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7d24a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ea expref: 17 pid: 6715 timeout: 902 lvb_type: 0 00010000:00010000:3.0:1746147723.797520:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7d24a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ea expref: 17 pid: 6715 timeout: 902 lvb_type: 0 00010000:00010000:3.0:1746147723.797535:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7d24a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4ea expref: 17 pid: 6715 timeout: 902 lvb_type: 0 00010000:00010000:3.0:1746147723.797545:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147723.797546:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147723.797551:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c466000/0xe64d3fbf12a7d2c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb529 expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.797558:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c466000/0xe64d3fbf12a7d2c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb529 expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.797977:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008c466000/0xe64d3fbf12a7d2c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb529 expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147723.797987:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796424192:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147723.798415:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147723.801320:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796424192:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147723.801339:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147723.801388:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967793869568:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3893us (4052us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.801397:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8254 00000100:00100000:0.0:1746147723.802822:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.803047:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793870080 00000100:00100000:1.0:1746147723.803053:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793870080 00002000:00100000:1.0:1746147723.803083:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880091630a80 x1830967793870080/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.803091:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091630a80 with x1830967793870080 ext(1048576->2097151) 00002000:00010000:1.0:1746147723.803095:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091630a80 00000100:00100000:1.0:1746147723.803318:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7241 00000100:00100000:1.0:1746147723.803325:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967793870080:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147723.804095:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.808963:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793870464 00000100:00100000:3.0:1746147723.808971:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793870464 00000100:00100000:3.0:1746147723.809032:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793870592 00000100:00100000:3.0:1746147723.809036:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793870592 00000100:00100000:3.0:1746147723.809049:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793870848 00000100:00100000:3.0:1746147723.809052:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793870848 00000100:00100000:3.0:1746147723.809331:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16295 00000100:00100000:3.0:1746147723.809337:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967793870592:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147723.809344:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147723.809354:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c467200/0xe64d3fbf12a7d2f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb545 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.809365:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147723.809367:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147723.809373:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c467200/0xe64d3fbf12a7d2f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb545 expref: 18 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147723.809385:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c467200/0xe64d3fbf12a7d2f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb545 expref: 18 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147723.809394:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c467200, rc 0) 00000100:00100000:1.0:1746147723.809425:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16296 00000100:00100000:1.0:1746147723.809432:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967793870720:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147723.809437:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147723.809443:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915fca00/0xe64d3fbf12a7d300 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb54c expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147723.809474:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796424320:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147723.809521:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967793870592:12345-192.168.202.10@tcp:101:cat.0 Request processed in 184us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147723.809526:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16295 00000100:00100000:1.0:1746147723.810134:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64aec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147723.810212:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147723.810848:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.813067:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796424320:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147723.813092:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915fca00/0xe64d3fbf12a7d300 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb54c expref: 18 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147723.813104:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915fca00/0xe64d3fbf12a7d300 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb54c expref: 18 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147723.813117:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915fca00, rc 0) 00000100:00100000:1.0:1746147723.813155:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967793870720:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3723us (4191us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147723.813161:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16296 00000100:00100000:3.0:1746147723.813258:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796424448:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147723.813273:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d307 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb553 expref: 18 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147723.813281:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d307 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb553 expref: 18 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147723.813313:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55e8e00, rc 0) 00000100:00100000:3.0:1746147723.813332:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967793870848:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3882us (4307us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147723.813337:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16297 00000100:00100000:0.0:1746147723.828193:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.828226:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.828254:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.828419:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.828448:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793872000 00000100:00100000:0.0:1746147723.828451:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793872000 00002000:00100000:0.0:1746147723.828466:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3194880->4194303) req@ffff880091632680 x1830967793872000/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147723.828471:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091632680 with x1830967793872000 ext(3194880->4194303) 00002000:00010000:0.0:1746147723.828474:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091632680 00000100:00100000:0.0:1746147723.828484:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7243 00000100:00100000:0.0:1746147723.828489:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967793871488:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147723.829597:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7244 00000100:00100000:3.0:1746147723.829606:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967793871744:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147723.829690:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7245 00000100:00100000:1.0:1746147723.829697:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967793872000:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147723.831491:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793872256 00000100:00100000:0.0:1746147723.831498:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793872256 00002000:00100000:0.0:1746147723.831527:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3608575) req@ffff88009aee9c00 x1830967793872256/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 504/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147723.831536:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee9c00 with x1830967793872256 ext(2097152->3608575) 00002000:00010000:0.0:1746147723.831541:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aee9c00 00000100:00100000:0.0:1746147723.831564:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7246 00000100:00100000:0.0:1746147723.831571:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967793872256:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147723.834245:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.834268:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793872512 00000100:00100000:3.0:1746147723.834273:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793872512 00002000:00100000:3.0:1746147723.834302:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3608576->4194303) req@ffff8800a0436a00 x1830967793872512/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.834311:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0436a00 with x1830967793872512 ext(3608576->4194303) 00002000:00010000:3.0:1746147723.834315:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0436a00 00000100:00100000:3.0:1746147723.834341:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7247 00000100:00100000:3.0:1746147723.834348:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1958:x1830967793872512:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147723.846877:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967793871488:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18377us (18639us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147723.846899:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7243 00002000:00100000:1.0:1746147723.846911:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880091631f80 x1830967793871488/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/440 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.846921:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091631f80 with x1830967793871488 ext(1048576->2097151) 00002000:00010000:1.0:1746147723.846926:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091631f80 00000100:00100000:0.0:1746147723.847313:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.847414:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793872768 00000100:00100000:0.0:1746147723.847421:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793872768 00000100:00100000:0.0:1746147723.847459:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11965 00000100:00100000:0.0:1746147723.847466:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32106:x1830967793872768:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147723.847483:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147723.847498:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85000/0xe64d3fbf12a7d30e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb55a expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.847580:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d315 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847591:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d315 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847602:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d315 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847613:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85200/0xe64d3fbf12a7d31c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847618:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85200/0xe64d3fbf12a7d31c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847623:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85200/0xe64d3fbf12a7d31c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847713:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7d323 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847721:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7d323 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847736:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7d323 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147723.847745:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147723.847820:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d315 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847826:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d315 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847831:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d315 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847836:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c84a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147723.847838:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d315 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847844:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d315 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847853:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147723.847857:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147723.847860:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d315 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847868:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c84a00/0xe64d3fbf12a7d315 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847905:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85200/0xe64d3fbf12a7d31c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847911:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85200/0xe64d3fbf12a7d31c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847915:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85200/0xe64d3fbf12a7d31c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847919:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c85200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147723.847921:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85200/0xe64d3fbf12a7d31c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847926:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85200/0xe64d3fbf12a7d31c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847933:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06ee800) 00010000:00010000:0.0:1746147723.847935:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147723.847938:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85200/0xe64d3fbf12a7d31c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847942:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85200/0xe64d3fbf12a7d31c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147723.847978:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85000/0xe64d3fbf12a7d30e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb55a expref: 18 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.847990:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c85800/0xe64d3fbf12a7d323 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb55a expref: 17 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.848000:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147723.848002:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147723.848004:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c85800, rc 0) 00000100:00100000:0.0:1746147723.848031:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32106:x1830967793872768:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 564us (718us total) trans 8589945972 rc 0/0 00000100:00100000:0.0:1746147723.848037:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11965 00000100:00100000:0.0:1746147723.848401:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967793871232:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19979us (20214us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147723.848408:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7242 00002000:00100000:0.0:1746147723.848414:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880091631c00 x1830967793871232/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/440 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147723.848423:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091631c00 with x1830967793871232 ext(1048576->2097151) 00002000:00010000:0.0:1746147723.848426:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091631c00 00000100:00100000:3.0:1746147723.855452:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1958:x1830967793871744:12345-192.168.202.10@tcp:3:cat.0 Request processed in 25839us (27189us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147723.855464:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7244 00002000:00100000:3.0:1746147723.855473:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880091632300 x1830967793871744/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/440 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.855482:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091632300 with x1830967793871744 ext(2097152->3145727) 00002000:00010000:3.0:1746147723.855487:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091632300 00000100:00100000:1.0:1746147723.862056:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967793872000:12345-192.168.202.10@tcp:3:cat.0 Request processed in 32352us (33628us total) trans 0 rc 999424/999424 00000100:00100000:1.0:1746147723.862065:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7245 00002000:00100000:1.0:1746147723.862075:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (3194880->4194303) req@ffff880091632680 x1830967793872000/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/440 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 999424/999424 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147723.862088:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091632680 with x1830967793872000 ext(3194880->4194303) 00002000:00010000:1.0:1746147723.862093:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091632680 00000100:00100000:3.0:1746147723.863201:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1958:x1830967793872512:12345-192.168.202.10@tcp:3:cat.0 Request processed in 28850us (28959us total) trans 0 rc 585728/585728 00000100:00100000:3.0:1746147723.863208:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7247 00002000:00100000:3.0:1746147723.863214:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3608576->4194303) req@ffff8800a0436a00 x1830967793872512/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/440 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.863222:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0436a00 with x1830967793872512 ext(3608576->4194303) 00002000:00010000:3.0:1746147723.863225:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0436a00 00000100:00100000:0.0:1746147723.865340:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.865990:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.866060:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793872896 00000100:00100000:3.0:1746147723.866068:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793872896 00000100:00100000:3.0:1746147723.866101:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793873024 00000100:00100000:3.0:1746147723.866102:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793873024 00000100:00100000:3.0:1746147723.866115:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16298 00000100:00100000:3.0:1746147723.866120:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967793872896:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147723.866135:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147723.866149:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c467600/0xe64d3fbf12a7d331 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb561 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147723.866189:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796424576:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147723.866263:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147723.866354:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16299 00000100:00100000:3.0:1746147723.866359:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967793873024:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147723.866367:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147723.866377:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7cce00/0xe64d3fbf12a7d338 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb568 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147723.866405:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796424704:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147723.866426:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147723.869378:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.869543:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796424576:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147723.869570:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c467600/0xe64d3fbf12a7d331 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb561 expref: 18 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147723.869583:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c467600/0xe64d3fbf12a7d331 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb561 expref: 18 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147723.869594:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c467600, rc 0) 00000100:00100000:3.0:1746147723.869666:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967793872896:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3544us (4331us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147723.869673:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16298 00000100:00100000:0.0:1746147723.876109:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.878022:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.878096:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793873408 00000100:00100000:3.0:1746147723.878101:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793873408 00002000:00100000:3.0:1746147723.878132:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3194879) req@ffff880091633b80 x1830967793873408/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.878139:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091633b80 with x1830967793873408 ext(3145728->3194879) 00010000:00010000:3.0:1746147723.878145:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7d2c8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb530 expref: 26 pid: 9615 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147723.878155:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7d2c8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb530 expref: 26 pid: 9615 timeout: 903 lvb_type: 0 00002000:00010000:3.0:1746147723.878160:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091633b80 00000100:00100000:3.0:1746147723.878174:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1438 00000100:00100000:3.0:1746147723.878179:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967793873408:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147723.879093:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.883750:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967793873408:12345-192.168.202.10@tcp:4:cat.0 Request processed in 5561us (5722us total) trans 17179874325 rc 0/0 00000100:00100000:3.0:1746147723.883762:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1438 00002000:00100000:3.0:1746147723.883774:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3194879) req@ffff880091633b80 x1830967793873408/t17179874325(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/448 e 0 to 0 dl 1746147734 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.883784:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091633b80 with x1830967793873408 ext(3145728->3194879) 00010000:00010000:3.0:1746147723.883795:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7d2c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb530 expref: 30 pid: 9615 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147723.883811:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7d2c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb530 expref: 30 pid: 9615 timeout: 903 lvb_type: 0 00002000:00010000:3.0:1746147723.883818:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091633b80 00000100:00100000:0.0:1746147723.900572:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.901131:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.907080:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.907486:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793874176 00000100:00100000:3.0:1746147723.907492:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793874176 00002000:00100000:3.0:1746147723.907522:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88012e387480 x1830967793874176/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.907530:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e387480 with x1830967793874176 ext(2097152->3145727) 00002000:00010000:3.0:1746147723.907534:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e387480 00000100:00100000:3.0:1746147723.907550:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7248 00000100:00100000:3.0:1746147723.907557:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967793874176:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147723.916351:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.920013:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.924588:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147723.927022:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.927149:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793874816 00000100:00100000:0.0:1746147723.927154:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793874816 00000100:00100000:0.0:1746147723.927187:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16304 00000100:00100000:0.0:1746147723.927192:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32103:x1830967793874816:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147723.927201:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147723.927213:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c466800/0xe64d3fbf12a7d35b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb58b expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.927232:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.927237:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147723.927239:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147723.927241:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c466800/0xe64d3fbf12a7d35b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb58b expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.927255:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.927261:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 25 pid: 6715 timeout: 903 lvb_type: 0 00000100:00100000:0.0:1746147723.927268:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e387100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796425472:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147723.927517:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147723.932427:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.932458:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.932493:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.932515:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793875072 00000100:00100000:0.0:1746147723.932522:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793875072 00010000:00010000:0.0:1746147723.932552:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c467200/0xe64d3fbf12a7d2f9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb545 expref: 20 pid: 9615 timeout: 903 lvb_type: 1 00000100:00100000:0.0:1746147723.932572:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793875200 00000100:00100000:0.0:1746147723.932574:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793875200 00010000:00010000:0.0:1746147723.932580:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c466000/0xe64d3fbf12a7d2c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb529 expref: 28 pid: 6715 timeout: 903 lvb_type: 0 00000100:00100000:0.0:1746147723.932590:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8256 00000100:00100000:0.0:1746147723.932595:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793875072:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147723.932605:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147723.932625:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c467200/0xe64d3fbf12a7d2f9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb545 expref: 20 pid: 9615 timeout: 903 lvb_type: 1 00010000:00010000:0.0:1746147723.932634:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c467200/0xe64d3fbf12a7d2f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb545 expref: 20 pid: 9615 timeout: 903 lvb_type: 1 00010000:00010000:0.0:1746147723.932654:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147723.932669:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e387100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796425472:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147723.932683:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793875072:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 88us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147723.932688:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8256 00010000:00010000:1.0:1746147723.932689:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c466800/0xe64d3fbf12a7d35b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb58b expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147723.932698:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c466800, rc 0) 00000100:00100000:0.0:1746147723.932701:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8257 00000100:00100000:0.0:1746147723.932706:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967793875200:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147723.932711:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147723.932714:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32103:x1830967793874816:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5523us (5694us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147723.932717:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c466000/0xe64d3fbf12a7d2c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb529 expref: 28 pid: 6715 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746147723.932720:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16304 00010000:00010000:0.0:1746147723.932741:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c466000/0xe64d3fbf12a7d2c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb529 expref: 28 pid: 6715 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147723.932751:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147723.932753:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147723.932758:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb584 expref: 19 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.932765:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb584 expref: 19 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147723.932786:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb584 expref: 19 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147723.932797:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e385500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796425600:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147723.932841:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147723.932915:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793874944 00000100:00100000:3.0:1746147723.932921:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793874944 00002000:00100000:3.0:1746147723.932944:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2682880->3145727) req@ffff88012e386300 x1830967793874944/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.932957:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e386300 with x1830967793874944 ext(2682880->3145727) 00010000:00010000:3.0:1746147723.932961:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 26 pid: 6715 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147723.932970:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 26 pid: 6715 timeout: 903 lvb_type: 0 00002000:00010000:3.0:1746147723.932980:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e386300 00000100:00100000:3.0:1746147723.932993:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1440 00000100:00100000:3.0:1746147723.932998:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967793874944:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147723.936603:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e385500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796425600:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147723.936620:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147723.936642:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967793875200:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3935us (4148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147723.936649:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8257 00000100:00100000:0.0:1746147723.938945:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.940449:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967793874944:12345-192.168.202.10@tcp:4:cat.0 Request processed in 7448us (8026us total) trans 21474841557 rc 0/0 00000100:00100000:3.0:1746147723.940457:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1440 00002000:00100000:3.0:1746147723.940464:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2682880->3145727) req@ffff88012e386300 x1830967793874944/t21474841557(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:344/0 lens 488/448 e 0 to 0 dl 1746147734 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.940471:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e386300 with x1830967793874944 ext(2682880->3145727) 00010000:00010000:3.0:1746147723.940478:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 28 pid: 6715 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147723.940487:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 28 pid: 6715 timeout: 903 lvb_type: 0 00002000:00010000:3.0:1746147723.940493:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e386300 00000100:00100000:1.0:1746147723.942488:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.943769:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.947080:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.947379:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793875968 00000100:00100000:3.0:1746147723.947384:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793875968 00010000:00010000:3.0:1746147723.947408:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 28 pid: 6715 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147723.947428:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8260 00000100:00100000:3.0:1746147723.947434:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967793875968:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147723.947445:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147723.947463:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2682880->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 28 pid: 6715 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147723.947473:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2682880->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 28 pid: 6715 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147723.947493:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c467a00/0xe64d3fbf12a7d2ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2682880->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb522 expref: 28 pid: 6715 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147723.947507:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147723.947509:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147723.947514:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c466800/0xe64d3fbf12a7d35b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb58b expref: 17 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.947520:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c466800/0xe64d3fbf12a7d35b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb58b expref: 17 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147723.947545:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c466800/0xe64d3fbf12a7d35b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb58b expref: 17 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147723.947556:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796426112:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147723.947624:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147723.950238:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796426112:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147723.950255:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147723.950292:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967793875968:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2857us (3212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147723.950301:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8260 00000100:00100000:0.0:1746147723.950610:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.951055:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793876224 00000100:00100000:3.0:1746147723.951061:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793876224 00002000:00100000:3.0:1746147723.951091:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2678784->2682879) req@ffff88012e385500 x1830967793876224/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.951098:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e385500 with x1830967793876224 ext(2678784->2682879) 00002000:00010000:3.0:1746147723.951102:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e385500 00000100:00100000:3.0:1746147723.951116:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7251 00000100:00100000:3.0:1746147723.951121:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967793876224:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147723.951274:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967793876224:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 152us (665us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147723.951280:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7251 00002000:00100000:3.0:1746147723.951285:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2678784->2682879) req@ffff88012e385500 x1830967793876224/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/4536 e 0 to 0 dl 1746147734 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.951291:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e385500 with x1830967793876224 ext(2678784->2682879) 00002000:00010000:3.0:1746147723.951293:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e385500 00000100:00100000:0.0:1746147723.953093:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.956509:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.956550:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147723.956589:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147723.956657:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793876992 00000100:00100000:3.0:1746147723.956660:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793876992 00002000:00100000:3.0:1746147723.956674:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880093cd4700 x1830967793876992/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:344/0 lens 488/0 e 0 to 0 dl 1746147734 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147723.956686:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4700 with x1830967793876992 ext(3145728->4194303) 00002000:00010000:3.0:1746147723.956688:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd4700 00000100:00100000:3.0:1746147723.956862:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7252 00000100:00100000:3.0:1746147723.956868:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967793876736:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147723.957436:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7254 00000100:00100000:0.0:1746147723.957441:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967793877248:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147724.009355:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147724.010444:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147724.015281:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1746147724.016248:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147724.018595:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.018674:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793877888 00000100:00100000:3.0:1746147724.018680:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793877888 00000100:00100000:3.0:1746147724.018735:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4972 00000100:00100000:3.0:1746147724.018742:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+332:7670:x1830967793877888:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147724.018917:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:7670:x1830967793877888:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 175us (323us total) trans 8589945974 rc 0/0 00000100:00100000:3.0:1746147724.018923:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4972 00000100:00080000:0.0:1746147724.019135:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147724.021421:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.021654:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793878016 00000100:00100000:3.0:1746147724.021661:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793878016 00010000:00010000:3.0:1746147724.021691:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d297 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb50d expref: 333 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.021781:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8261 00000100:00100000:3.0:1746147724.021788:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:1959:x1830967793878016:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147724.025242:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147724.025255:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d297 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb50d expref: 333 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.025269:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d297 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb50d expref: 333 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.025293:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79600/0xe64d3fbf12a7d297 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb50d expref: 333 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.025309:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147724.025314:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094109800/0xe64d3fbf12a7d37e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147724.025322:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094109800/0xe64d3fbf12a7d37e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147724.025328:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094109800/0xe64d3fbf12a7d37e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147724.025361:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147724.025415:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+332:1959:x1830967793878016:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3627us (3999us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.025425:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8261 00010000:00010000:0.0:1746147724.025798:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094109800/0xe64d3fbf12a7d37e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025806:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094109800/0xe64d3fbf12a7d37e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147724.025846:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:0.0:1746147724.025850:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147724.025866:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094109800/0xe64d3fbf12a7d37e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025875:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094109800/0xe64d3fbf12a7d37e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025905:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8200/0xe64d3fbf12a7d370 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025910:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8200/0xe64d3fbf12a7d370 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025915:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8200/0xe64d3fbf12a7d370 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025921:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55e8200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147724.025924:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8200/0xe64d3fbf12a7d370 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025933:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8200/0xe64d3fbf12a7d370 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025941:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147724.025944:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147724.025947:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8200/0xe64d3fbf12a7d370 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025950:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8200/0xe64d3fbf12a7d370 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025963:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7d377 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025968:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7d377 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025972:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7d377 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025976:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55e9800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147724.025978:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7d377 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025982:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7d377 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025987:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a00f3300) 00010000:00010000:0.0:1746147724.025989:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147724.025991:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7d377 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.025996:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7d377 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.026025:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9200/0xe64d3fbf12a7d369 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb599 expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.026036:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094109800/0xe64d3fbf12a7d37e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb599 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.026042:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147724.026043:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147724.026045:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094109800, rc 0) 00000100:00100000:0.0:1746147724.026070:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+9:32110:x1830967793877632:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 10405us (10796us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147724.026077:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11966 00000100:00100000:0.0:1746147724.028370:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.030315:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.030334:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793878528 00000100:00100000:1.0:1746147724.030337:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793878528 00000100:00080000:0.0:1746147724.030424:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147724.030478:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4973 00000100:00100000:1.0:1746147724.030484:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32103:x1830967793878528:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:1.0:1746147724.031638:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32103:x1830967793878528:12345-192.168.202.10@tcp:35:cat.0 Request processed in 1152us (1321us total) trans 8589945975 rc 0/0 00000100:00100000:1.0:1746147724.031648:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4973 00000100:00100000:1.0:1746147724.031689:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.031826:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.031907:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793878656 00000100:00100000:0.0:1746147724.031912:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793878656 00000100:00100000:0.0:1746147724.031940:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793878784 00000100:00100000:0.0:1746147724.031942:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793878784 00000100:00100000:0.0:1746147724.031957:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16306 00000100:00100000:0.0:1746147724.031961:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+7:1958:x1830967793878656:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147724.031970:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147724.031980:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7d3a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb5a7 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.031995:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.031997:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.032003:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7d3a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5a7 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147724.032018:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7d3a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5a7 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147724.032026:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2f000, rc 0) 00000100:00100000:0.0:1746147724.032048:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967793878656:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 86us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147724.032053:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16306 00000100:00080000:1.0:1746147724.032488:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746147724.032491:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147724.037468:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.037498:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.038550:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793878912 00000100:00100000:1.0:1746147724.038559:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793878912 00000100:00100000:1.0:1746147724.038593:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16308 00000100:00100000:1.0:1746147724.038599:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967793878912:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147724.038614:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147724.038628:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5287a00/0xe64d3fbf12a7d3b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb5b5 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.038669:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796426496:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147724.038751:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b0a80 going to sleep for 11 seconds 00002000:00010000:1.0:1746147724.041867:0:22183:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime: 1746147724 -> 1746147725 00002000:00010000:1.0:1746147724.041869:0:22183:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147724 -> 1746147725 00002000:00010000:1.0:1746147724.041871:0:22183:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime: 1746147724 -> 1746147725 00000100:00100000:1.0:1746147724.041879:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796426496:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147724.041920:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5287a00/0xe64d3fbf12a7d3b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5b5 expref: 9 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147724.041927:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5287a00/0xe64d3fbf12a7d3b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5b5 expref: 9 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147724.041935:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5287a00, rc 0) 00000100:00100000:1.0:1746147724.042069:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+6:1958:x1830967793878912:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 3470us (4608us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147724.042075:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16308 00000100:00100000:0.0:1746147724.044271:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.050479:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.050549:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793879424 00000100:00100000:3.0:1746147724.050556:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793879424 00000100:00100000:0.0:1746147724.050567:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147724.050585:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9c00/0xe64d3fbf12a7d39a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5a0 expref: 334 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.050605:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793879552 00000100:00100000:3.0:1746147724.050607:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793879552 00010000:00010000:3.0:1746147724.050616:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094109800/0xe64d3fbf12a7d37e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb599 expref: 11 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:0.0:1746147724.050649:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8262 00000100:00100000:0.0:1746147724.050659:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:1958:x1830967793879424:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147724.050671:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147724.050677:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9c00/0xe64d3fbf12a7d39a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5a0 expref: 334 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.050686:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9c00/0xe64d3fbf12a7d39a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5a0 expref: 334 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.050704:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9c00/0xe64d3fbf12a7d39a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5a0 expref: 334 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.050716:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8263 00010000:00010000:0.0:1746147724.050720:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00000100:00100000:3.0:1746147724.050722:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967793879552:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147724.050734:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d3cb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147724.050738:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147724.050742:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094109800/0xe64d3fbf12a7d37e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb599 expref: 11 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.050742:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d3cb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.050747:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147724.050751:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094109800/0xe64d3fbf12a7d37e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb599 expref: 11 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.050763:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094109800/0xe64d3fbf12a7d37e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb599 expref: 11 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:0.0:1746147724.050781:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:1958:x1830967793879424:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 124us (310us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147724.050785:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00000100:00100000:0.0:1746147724.050787:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8262 00010000:00010000:3.0:1746147724.050788:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d3cb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147724.050795:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d3cb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147724.050800:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d3cb lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147724.050814:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147724.050823:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d3cb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.050828:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d3cb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:3.0:1746147724.050831:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967793879552:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 109us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.050836:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8263 00000004:00200000:0.0:1746147724.050843:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147724.050989:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5516c00/0xe64d3fbf12a7d3c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5c3 expref: 11 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.051003:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d3cb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5c3 expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.051008:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147724.051010:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147724.051012:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5516000, rc 0) 00000100:00100000:0.0:1746147724.051041:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+10:32110:x1830967793879296:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 6628us (6774us total) trans 8589945977 rc 0/0 00000100:00100000:0.0:1746147724.051047:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11968 00000100:00100000:0.0:1746147724.059488:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.059917:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.060018:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793880064 00000100:00100000:3.0:1746147724.060022:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793880064 00000100:00100000:3.0:1746147724.060050:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11970 00000100:00100000:3.0:1746147724.060055:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+10:32110:x1830967793880064:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147724.060064:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.060067:0:14546:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147724.060079:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d3cb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5c3 expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.060092:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147724.060095:0:14546:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147724.060101:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7d3fc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb5d1 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.060133:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d403 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.060140:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d403 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.060146:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d403 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.060153:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d403 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.060158:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d403 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.060162:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d403 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.060166:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a66abe00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147724.060342:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d403 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.060349:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d403 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.060359:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147724.060361:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147724.060363:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d403 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.060367:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d403 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00000100:00100000:2.0:1746147724.060375:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11969 00010000:00010000:3.0:1746147724.060387:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7d3fc lrc: 1/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5d1 expref: 10 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.060393:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7d3fc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5d1 expref: 10 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.060399:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a66ab400, rc 0) 00000100:00100000:3.0:1746147724.060432:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+9:32110:x1830967793880064:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 376us (515us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147724.060438:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11970 00000100:00100000:0.0:1746147724.063797:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.064230:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793880320 00000100:00100000:1.0:1746147724.064239:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793880320 00000100:00100000:1.0:1746147724.064273:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4974 00000100:00100000:1.0:1746147724.064280:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6669c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:32116:x1830967793880320:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:1.0:1746147724.064801:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6669c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+336:32116:x1830967793880320:12345-192.168.202.10@tcp:35:cat.0 Request processed in 520us (1011us total) trans 8589945979 rc 0/0 00000100:00100000:1.0:1746147724.064808:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4974 00000100:00100000:0.0:1746147724.065090:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.065322:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793880576 00000100:00100000:1.0:1746147724.065326:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793880576 00000100:00100000:1.0:1746147724.065356:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4975 00000100:00100000:1.0:1746147724.065362:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+9:32110:x1830967793880576:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147724.065442:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+10:32110:x1830967793880576:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 80us (353us total) trans 8589945980 rc 0/0 00000100:00100000:1.0:1746147724.065448:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4975 00000100:00100000:2.0:1746147724.076375:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.076407:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.076426:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793880704 00000100:00100000:2.0:1746147724.076432:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793880704 00000100:00100000:2.0:1746147724.076463:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793880832 00000100:00100000:2.0:1746147724.076465:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793880832 00000100:00100000:2.0:1746147724.076477:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16310 00000100:00100000:2.0:1746147724.076483:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967793880704:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147724.076497:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.076512:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801361d2200/0xe64d3fbf12a7d40a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb5d8 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147724.076556:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeeaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796426880:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147724.076633:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16311 00000100:00100000:2.0:1746147724.076639:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967793880832:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147724.076645:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.076651:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d188000/0xe64d3fbf12a7d411 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb5df expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147724.076670:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796427008:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147724.076700:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.076736:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793880960 00000100:00100000:0.0:1746147724.076741:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793880960 00000100:00100000:0.0:1746147724.076763:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16312 00000100:00100000:2.0:1746147724.076766:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.076768:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967793880960:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147724.076775:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147724.076781:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793881088 00000100:00100000:2.0:1746147724.076784:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793881088 00010000:00010000:0.0:1746147724.076785:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134b2fe00/0xe64d3fbf12a7d418 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb5e6 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.076797:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.076799:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147724.076800:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16313 00000100:00100000:2.0:1746147724.076805:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32112:x1830967793881088:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147724.076806:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134b2fe00/0xe64d3fbf12a7d418 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5e6 expref: 29 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.076813:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147724.076818:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134b2fe00/0xe64d3fbf12a7d418 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5e6 expref: 29 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.076822:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb5ed expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.076826:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2fe00, rc 0) 00010000:00010000:2.0:1746147724.076835:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7d2b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb51b expref: 30 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.076843:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7d3a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5a7 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147724.076846:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967793880960:12345-192.168.202.10@tcp:101:cat.0 Request processed in 79us (146us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147724.076850:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d2f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb53e expref: 17 pid: 4591 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147724.076852:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16312 00010000:00010000:2.0:1746147724.076855:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.076856:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.076859:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 6/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1892352->2097151] (req 1892352->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 30 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.076875:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d2f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb53e expref: 17 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.080407:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d2f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb53e expref: 17 pid: 4591 timeout: 903 lvb_type: 1 00000100:00100000:2.0:1746147724.080429:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeeb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796427136:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.082470:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7d3a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5a7 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.082490:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7d3a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5a7 expref: 8 pid: 8184 timeout: 903 lvb_type: 1 00000100:00100000:2.0:1746147724.082503:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796427264:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.082589:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7d2b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb51b expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.082597:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7d2b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb51b expref: 29 pid: 6715 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.082604:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796427392:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147724.082621:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147724.082655:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.082715:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147724.093443:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeeaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796426880:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147724.093444:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147724.093474:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801361d2200/0xe64d3fbf12a7d40a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5d8 expref: 29 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.093487:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801361d2200/0xe64d3fbf12a7d40a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5d8 expref: 29 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.093509:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801361d2200, rc 0) 00000100:00100000:0.0:1746147724.093538:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.093547:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967793880704:12345-192.168.202.10@tcp:101:cat.0 Request processed in 17064us (17179us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147724.093553:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16310 00000100:00100000:0.0:1746147724.093557:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793881344 00000100:00100000:0.0:1746147724.093562:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793881344 00000100:00100000:2.0:1746147724.093587:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793881216 00000100:00100000:2.0:1746147724.093589:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793881216 00010000:00010000:0.0:1746147724.093592:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d2f2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb53e expref: 18 pid: 4591 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.093598:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7d3a8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5a7 expref: 9 pid: 8184 timeout: 903 lvb_type: 1 00000100:00100000:0.0:1746147724.093609:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8264 00000100:00100000:0.0:1746147724.093614:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967793881344:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147724.093687:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeeb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796427136:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.093696:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796427264:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.093702:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796427392:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.093723:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1892352->2097151] (req 1892352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.093748:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009469aa00, rc 0) 00000100:00100000:3.0:1746147724.093766:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32112:x1830967793881088:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 16960us (17000us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.093772:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16313 00010000:00010000:0.0:1746147724.093792:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147724.093806:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d2f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb53e expref: 18 pid: 4591 timeout: 903 lvb_type: 1 00000100:00100000:2.0:1746147724.093977:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8265 00010000:00010000:0.0:1746147724.093983:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d2f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb53e expref: 18 pid: 4591 timeout: 903 lvb_type: 1 00000100:00100000:2.0:1746147724.093984:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967793881216:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.093992:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147724.093999:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d2f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb53e expref: 18 pid: 4591 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.094000:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7d3a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5a7 expref: 9 pid: 8184 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.094008:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7d3a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5a7 expref: 9 pid: 8184 timeout: 903 lvb_type: 1 00010000:00010000:0.0:1746147724.094014:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147724.094018:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7d3a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5a7 expref: 9 pid: 8184 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.094026:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147724.094028:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967793881344:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 414us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147724.094033:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8264 00000100:00100000:2.0:1746147724.094035:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967793881216:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 53us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.094040:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8265 00000100:00080000:0.0:1746147724.094072:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147724.094103:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796427008:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147724.094119:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d188000/0xe64d3fbf12a7d411 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5df expref: 27 pid: 10613 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147724.094127:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147724.094127:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d188000/0xe64d3fbf12a7d411 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5df expref: 27 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147724.094139:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d188000, rc 0) 00000100:00100000:0.0:1746147724.094154:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967793880832:12345-192.168.202.10@tcp:101:cat.0 Request processed in 17515us (17746us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147724.094158:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16311 00000100:00100000:0.0:1746147724.094171:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793881472 00000100:00100000:0.0:1746147724.094173:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793881472 00010000:00010000:1.0:1746147724.095569:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7d2b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb51b expref: 29 pid: 6715 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746147724.095602:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8266 00000100:00100000:1.0:1746147724.095609:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967793881472:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.095617:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.095632:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7d2b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb51b expref: 29 pid: 6715 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.095646:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7d2b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb51b expref: 29 pid: 6715 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.095662:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7d2b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb51b expref: 29 pid: 6715 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.095684:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.095686:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.095692:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 28 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.095699:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 28 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.095734:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 28 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.095745:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796427520:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147724.095809:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41639c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.096826:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.096976:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793881728 00000100:00100000:3.0:1746147724.096981:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793881728 00000100:00100000:3.0:1746147724.097008:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11971 00000100:00100000:3.0:1746147724.097014:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32119:x1830967793881728:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147724.097030:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.097042:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab800/0xe64d3fbf12a7d426 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb5f4 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.097126:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aa800/0xe64d3fbf12a7d42d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097136:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aa800/0xe64d3fbf12a7d42d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097144:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aa800/0xe64d3fbf12a7d42d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097154:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aaa00/0xe64d3fbf12a7d434 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097160:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aaa00/0xe64d3fbf12a7d434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097165:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aaa00/0xe64d3fbf12a7d434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097255:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7d43b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097263:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7d43b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097269:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7d43b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:3.0:1746147724.097277:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147724.097345:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aa800/0xe64d3fbf12a7d42d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097351:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aa800/0xe64d3fbf12a7d42d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097356:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aa800/0xe64d3fbf12a7d42d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097361:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a66aa800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147724.097364:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aa800/0xe64d3fbf12a7d42d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097369:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aa800/0xe64d3fbf12a7d42d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097376:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147724.097378:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147724.097381:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aa800/0xe64d3fbf12a7d42d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097385:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aa800/0xe64d3fbf12a7d42d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097407:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aaa00/0xe64d3fbf12a7d434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097411:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aaa00/0xe64d3fbf12a7d434 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097419:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aaa00/0xe64d3fbf12a7d434 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097423:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a66aaa00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147724.097426:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aaa00/0xe64d3fbf12a7d434 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097430:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aaa00/0xe64d3fbf12a7d434 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097437:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a02f4400) 00010000:00010000:3.0:1746147724.097442:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147724.097444:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aaa00/0xe64d3fbf12a7d434 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097449:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66aaa00/0xe64d3fbf12a7d434 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.097479:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab800/0xe64d3fbf12a7d426 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5f4 expref: 21 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.097487:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7d43b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5f4 expref: 20 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.097493:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147724.097494:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147724.097496:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a66ab400, rc 0) 00000100:00100000:3.0:1746147724.097525:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32119:x1830967793881728:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 511us (702us total) trans 8589945981 rc 0/0 00000100:00100000:3.0:1746147724.097531:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11971 00000100:00100000:0.0:1746147724.104763:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.104919:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796427520:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147724.104939:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.104977:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967793881472:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 9369us (10849us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.104987:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8266 00000100:00100000:0.0:1746147724.105291:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.105324:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793881984 00000100:00100000:2.0:1746147724.105329:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793881984 00002000:00100000:2.0:1746147724.105360:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x455:0x0] (1892352->1896447) req@ffff8800a2138a80 x1830967793881984/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.105370:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2138a80 with x1830967793881984 ext(1892352->1896447) 00002000:00010000:2.0:1746147724.105374:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2138a80 00000100:00100000:2.0:1746147724.105401:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7256 00000100:00100000:2.0:1746147724.105407:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967793881984:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147724.105530:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967793881984:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 122us (774us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147724.105535:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7256 00002000:00100000:2.0:1746147724.105540:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x455:0x0] (1892352->1896447) req@ffff8800a2138a80 x1830967793881984/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/4536 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.105547:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2138a80 with x1830967793881984 ext(1892352->1896447) 00002000:00010000:2.0:1746147724.105549:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2138a80 00000100:00100000:3.0:1746147724.105812:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793882240 00000100:00100000:3.0:1746147724.105817:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793882240 00002000:00100000:3.0:1746147724.105835:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a213aa00 x1830967793882240/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 504/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.105841:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a213aa00 with x1830967793882240 ext(1048576->2097151) 00002000:00010000:3.0:1746147724.105844:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a213aa00 00000100:00100000:3.0:1746147724.105866:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7257 00000100:00100000:3.0:1746147724.105871:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967793882240:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147724.124871:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967793882240:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18988us (19568us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746147724.124912:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7257 00002000:00100000:3.0:1746147724.124926:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a213aa00 x1830967793882240/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 504/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.124935:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a213aa00 with x1830967793882240 ext(1048576->2097151) 00002000:00010000:3.0:1746147724.124941:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a213aa00 00000100:00100000:0.0:1746147724.133918:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.133965:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.133993:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793882368 00000100:00100000:2.0:1746147724.134000:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793882368 00000100:00100000:3.0:1746147724.134016:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793882496 00000100:00100000:3.0:1746147724.134019:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793882496 00000100:00100000:2.0:1746147724.134037:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16314 00000100:00100000:2.0:1746147724.134044:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:32112:x1830967793882368:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147724.134059:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.134081:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb5fb expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.134107:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d354 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb584 expref: 17 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.134114:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147724.134115:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147724.134118:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->1286143] (req 1048576->1286143) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 28 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.134147:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb584 expref: 17 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.134157:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb584 expref: 17 pid: 4591 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.134167:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796427648:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147724.134237:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147724.134515:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16315 00000100:00100000:3.0:1746147724.134522:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:32116:x1830967793882496:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147724.134529:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.134535:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d450 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb602 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.134546:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147724.134550:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1286143] (req 1048576->1286143) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.134560:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147724.134563:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d450 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb602 expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.134581:0:7050:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1286143] (req 1048576->1286143) gid 0 flags: 0x60000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.134591:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d450 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb602 expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.134599:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a66abe00, rc 0) 00000100:00100000:3.0:1746147724.134617:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32116:x1830967793882496:12345-192.168.202.10@tcp:101:cat.0 Request processed in 97us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.134623:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16315 00000100:00100000:2.0:1746147724.135695:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796427648:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.135737:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1286143] (req 1048576->1286143) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 28 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.135747:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090aba200, rc 0) 00000100:00100000:2.0:1746147724.136280:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:32112:x1830967793882368:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2234us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.136286:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16314 00000100:00100000:0.0:1746147724.136477:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.136614:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793882624 00000100:00100000:3.0:1746147724.136619:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793882624 00002000:00100000:3.0:1746147724.136646:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (2084864->2097151) req@ffff8800a213a300 x1830967793882624/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 12776/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.136654:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a213a300 with x1830967793882624 ext(2084864->2097151) 00010000:00010000:3.0:1746147724.136659:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb584 expref: 18 pid: 4591 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.136671:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb584 expref: 18 pid: 4591 timeout: 903 lvb_type: 0 00002000:00010000:3.0:1746147724.136682:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a213a300 00000100:00100000:3.0:1746147724.136706:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1441 00000100:00100000:3.0:1746147724.136712:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967793882624:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147724.137104:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793882624:12345-192.168.202.10@tcp:4:cat.0 Request processed in 391us (627us total) trans 17179874326 rc 0/0 00000100:00100000:3.0:1746147724.137110:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1441 00002000:00100000:3.0:1746147724.137122:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (2084864->2097151) req@ffff8800a213a300 x1830967793882624/t17179874326(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 12776/448 e 0 to 0 dl 1746147735 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.137130:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a213a300 with x1830967793882624 ext(2084864->2097151) 00010000:00010000:3.0:1746147724.137135:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb584 expref: 20 pid: 4591 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.137144:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb584 expref: 20 pid: 4591 timeout: 903 lvb_type: 0 00002000:00010000:3.0:1746147724.137150:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a213a300 00000100:00100000:0.0:1746147724.139362:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.140335:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793882752 00000100:00100000:1.0:1746147724.140343:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793882752 00010000:00010000:1.0:1746147724.140371:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb584 expref: 20 pid: 4591 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746147724.141387:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8267 00000100:00100000:1.0:1746147724.141396:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2139500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793882752:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.141409:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.141429:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb584 expref: 20 pid: 4591 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.141442:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb584 expref: 20 pid: 4591 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.141464:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d354 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb584 expref: 20 pid: 4591 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.141488:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.141490:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.141496:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 27 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.141503:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 27 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.141532:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 27 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.141542:0:7096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 27 pid: 10613 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746147724.141554:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796427904:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147724.141634:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41639c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147724.145941:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796427904:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147724.145971:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.146019:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2139500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967793882752:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4623us (6661us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.146029:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8267 00000100:00100000:0.0:1746147724.148858:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.149062:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793883008 00000100:00100000:2.0:1746147724.149072:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793883008 00002000:00100000:2.0:1746147724.149110:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1282048->1286143) req@ffff8800a213ad80 x1830967793883008/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.149118:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a213ad80 with x1830967793883008 ext(1282048->1286143) 00010000:00010000:2.0:1746147724.149125:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 28 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.149141:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 28 pid: 10613 timeout: 903 lvb_type: 0 00002000:00010000:2.0:1746147724.149147:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a213ad80 00000100:00100000:2.0:1746147724.149301:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1442 00000100:00100000:2.0:1746147724.149310:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967793883008:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147724.149464:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967793883008:12345-192.168.202.10@tcp:3:cat.0 Request processed in 155us (610us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147724.149471:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1442 00002000:00100000:2.0:1746147724.149476:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1282048->1286143) req@ffff8800a213ad80 x1830967793883008/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/4536 e 0 to 0 dl 1746147735 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.149482:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a213ad80 with x1830967793883008 ext(1282048->1286143) 00010000:00010000:2.0:1746147724.149487:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 28 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.149495:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 28 pid: 10613 timeout: 903 lvb_type: 0 00002000:00010000:2.0:1746147724.149501:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a213ad80 00000100:00100000:0.0:1746147724.152834:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.155102:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.155221:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793883264 00000100:00100000:3.0:1746147724.155230:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793883264 00002000:00100000:3.0:1746147724.155267:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1286143) req@ffff8800a2138000 x1830967793883264/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.155275:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2138000 with x1830967793883264 ext(1048576->1286143) 00000100:00100000:2.0:1746147724.155278:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793883520 00010000:00010000:3.0:1746147724.155282:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 28 pid: 10613 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.155284:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793883520 00010000:00010000:3.0:1746147724.155300:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 28 pid: 10613 timeout: 903 lvb_type: 0 00002000:00010000:3.0:1746147724.155306:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a2138000 00000100:00100000:3.0:1746147724.155323:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1443 00000100:00100000:2.0:1746147724.155324:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4976 00000100:00100000:3.0:1746147724.155330:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1958:x1830967793883264:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147724.155332:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+336:32112:x1830967793883520:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:2.0:1746147724.156455:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+337:32112:x1830967793883520:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 1122us (1356us total) trans 8589945982 rc 0/0 00000100:00100000:2.0:1746147724.156463:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4976 00000100:00100000:3.0:1746147724.162452:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967793883264:12345-192.168.202.10@tcp:4:cat.0 Request processed in 7113us (9614us total) trans 17179874327 rc 0/0 00000100:00100000:3.0:1746147724.162463:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1443 00002000:00100000:3.0:1746147724.162475:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1286143) req@ffff8800a2138000 x1830967793883264/t17179874327(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/448 e 0 to 0 dl 1746147735 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.162483:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2138000 with x1830967793883264 ext(1048576->1286143) 00010000:00010000:3.0:1746147724.162492:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 30 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.162507:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 30 pid: 10613 timeout: 903 lvb_type: 0 00002000:00010000:3.0:1746147724.162514:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a2138000 00000100:00100000:0.0:1746147724.169010:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.169096:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793883648 00000100:00100000:1.0:1746147724.169104:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793883648 00010000:00010000:1.0:1746147724.169134:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 30 pid: 10613 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746147724.169170:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8268 00000100:00100000:1.0:1746147724.169176:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2139f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967793883648:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.169189:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.169207:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 30 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.169218:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 30 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.169237:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090aba200/0xe64d3fbf12a7d449 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5fb expref: 30 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.169258:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.169260:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.169266:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d450 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb602 expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.169273:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d450 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb602 expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.169299:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d450 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb602 expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.169310:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796428032:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147724.169380:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41639c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147724.174941:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796428032:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147724.174968:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.175018:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2139f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967793883648:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5839us (6013us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.175028:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8268 00000100:00100000:0.0:1746147724.181077:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.181796:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.187682:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793884160 00000100:00100000:1.0:1746147724.187693:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793884160 00000100:00100000:1.0:1746147724.187754:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11972 00000100:00100000:1.0:1746147724.187760:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32123:x1830967793884160:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147724.187782:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147724.187796:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287a00/0xe64d3fbf12a7d457 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb609 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.187880:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7d45e lrc: 3/1,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147724.187905:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7d45e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147724.187913:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7d45e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:1.0:1746147724.187922:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147724.188017:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287a00/0xe64d3fbf12a7d457 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb609 expref: 23 pid: 17544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147724.188330:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793883904 00000100:00100000:3.0:1746147724.188335:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793883904 00002000:00100000:3.0:1746147724.188360:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a2139c00 x1830967793883904/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.188369:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2139c00 with x1830967793883904 ext(1048576->2097151) 00002000:00010000:3.0:1746147724.188373:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2139c00 00000100:00100000:3.0:1746147724.188387:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7258 00000100:00100000:3.0:1746147724.188391:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967793883904:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:1.0:1746147724.188983:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7d45e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb609 expref: 22 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.188992:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147724.188994:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746147724.188998:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5287e00, rc 0) 00000100:00100000:1.0:1746147724.189058:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32123:x1830967793884160:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1295us (7262us total) trans 8589945983 rc 0/0 00000100:00100000:1.0:1746147724.189064:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11972 00000100:00100000:0.0:1746147724.197795:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.198917:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793884288 00000100:00100000:2.0:1746147724.198926:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793884288 00000100:00100000:0.0:1746147724.198933:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.198957:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793884416 00000100:00100000:2.0:1746147724.198959:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793884416 00000100:00100000:2.0:1746147724.198973:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16316 00000100:00100000:2.0:1746147724.198980:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967793884288:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147724.198995:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.199010:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7d46c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb610 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147724.199053:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16317 00000100:00100000:2.0:1746147724.199056:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796428160:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147724.199059:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967793884416:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147724.199066:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.199076:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094109800/0xe64d3fbf12a7d473 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb617 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.199086:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.199088:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.199095:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094109800/0xe64d3fbf12a7d473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb617 expref: 20 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.199106:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094109800/0xe64d3fbf12a7d473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb617 expref: 20 pid: 7050 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147724.199109:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147724.199115:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094109800, rc 0) 00000100:00100000:3.0:1746147724.199136:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793884416:12345-192.168.202.10@tcp:101:cat.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.199141:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16317 00000100:00100000:3.0:1746147724.199391:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967793883904:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10997us (18323us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147724.199400:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7258 00002000:00100000:3.0:1746147724.199407:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a2139c00 x1830967793883904/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.199421:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2139c00 with x1830967793883904 ext(1048576->2097151) 00002000:00010000:3.0:1746147724.199424:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2139c00 00000100:00100000:0.0:1746147724.206739:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.206836:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793884544 00000100:00100000:1.0:1746147724.206844:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793884544 00000100:00100000:1.0:1746147724.206914:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16318 00000100:00100000:1.0:1746147724.206921:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32116:x1830967793884544:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147724.206936:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147724.206951:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7d47a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb61e expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.206979:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7d362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2682879) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb592 expref: 19 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.206986:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147724.206987:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147724.206991:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7d47a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb61e expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.207015:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7d362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2682879) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb592 expref: 19 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.207025:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7d362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2682879) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb592 expref: 19 pid: 4591 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746147724.207034:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796428288:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147724.207105:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41639c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147724.209112:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796428288:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147724.209136:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7d47a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb61e expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.209149:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5286c00, rc 0) 00000100:00100000:1.0:1746147724.209191:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32116:x1830967793884544:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2270us (2469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.209198:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16318 00002000:00010000:2.0:1746147724.209813:0:10613:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime: 1746147724 -> 1746147725 00002000:00010000:2.0:1746147724.209818:0:10613:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime: 1746147724 -> 1746147725 00002000:00010000:2.0:1746147724.209820:0:10613:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime: 1746147724 -> 1746147725 00000100:00100000:2.0:1746147724.209841:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796428160:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147724.209866:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7d46c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb610 expref: 18 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.209878:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7d46c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb610 expref: 18 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.209960:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e4200, rc 0) 00000100:00100000:2.0:1746147724.210020:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967793884288:12345-192.168.202.10@tcp:101:cat.0 Request processed in 11037us (12231us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147724.210027:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16316 00000100:00100000:2.0:1746147724.210586:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.210614:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793884672 00000100:00100000:3.0:1746147724.210620:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793884672 00002000:00100000:3.0:1746147724.210743:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->2682879) req@ffff88009aee8380 x1830967793884672/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.210751:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee8380 with x1830967793884672 ext(2097152->2682879) 00010000:00010000:3.0:1746147724.210757:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7d362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2682879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb592 expref: 20 pid: 4591 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.210767:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7d362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2682879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb592 expref: 20 pid: 4591 timeout: 903 lvb_type: 0 00002000:00010000:3.0:1746147724.210773:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aee8380 00000100:00100000:3.0:1746147724.210801:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1444 00000100:00100000:3.0:1746147724.210807:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793884672:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147724.219753:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.220516:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793884800 00000100:00100000:3.0:1746147724.220525:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793884800 00000100:00100000:3.0:1746147724.220597:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16319 00000100:00100000:3.0:1746147724.220607:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32123:x1830967793884800:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147724.220625:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.220641:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d702400/0xe64d3fbf12a7d481 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb625 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.220665:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 27 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.220672:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147724.220674:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147724.220676:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d702400/0xe64d3fbf12a7d481 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb625 expref: 18 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.220701:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 27 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.220710:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 27 pid: 7050 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.220720:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796428416:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.222398:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147724.227489:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967793884672:12345-192.168.202.10@tcp:4:cat.0 Request processed in 16673us (16897us total) trans 17179874328 rc 0/0 00000100:00100000:3.0:1746147724.227501:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1444 00002000:00100000:3.0:1746147724.227512:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->2682879) req@ffff88009aee8380 x1830967793884672/t17179874328(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/448 e 0 to 0 dl 1746147735 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.227521:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee8380 with x1830967793884672 ext(2097152->2682879) 00010000:00010000:3.0:1746147724.227530:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7d362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2682879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb592 expref: 22 pid: 4591 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.227543:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7d362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2682879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb592 expref: 22 pid: 4591 timeout: 903 lvb_type: 0 00002000:00010000:3.0:1746147724.227555:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aee8380 00000100:00100000:0.0:1746147724.229632:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.229691:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793884928 00000100:00100000:2.0:1746147724.229698:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793884928 00002000:00100000:2.0:1746147724.229736:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1892352->2097151) req@ffff88009fe39180 x1830967793884928/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.229745:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39180 with x1830967793884928 ext(1892352->2097151) 00010000:00010000:2.0:1746147724.229751:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 28 pid: 7050 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.229762:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 28 pid: 7050 timeout: 903 lvb_type: 0 00002000:00010000:2.0:1746147724.229768:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe39180 00000100:00100000:2.0:1746147724.229800:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1445 00000100:00100000:2.0:1746147724.229807:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1958:x1830967793884928:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147724.232876:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796428416:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.232926:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d702400/0xe64d3fbf12a7d481 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb625 expref: 18 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.232940:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d702400, rc 0) 00000100:00100000:3.0:1746147724.236219:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32123:x1830967793884800:12345-192.168.202.10@tcp:101:cat.0 Request processed in 15605us (16467us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.236229:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16319 00000100:00100000:2.0:1746147724.236410:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967793884928:12345-192.168.202.10@tcp:4:cat.0 Request processed in 6601us (6781us total) trans 21474841558 rc 0/0 00000100:00100000:2.0:1746147724.236419:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1445 00002000:00100000:2.0:1746147724.236429:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1892352->2097151) req@ffff88009fe39180 x1830967793884928/t21474841558(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/448 e 0 to 0 dl 1746147735 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.236437:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39180 with x1830967793884928 ext(1892352->2097151) 00010000:00010000:2.0:1746147724.236445:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.236476:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00002000:00010000:2.0:1746147724.236482:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe39180 00000100:00100000:0.0:1746147724.237357:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.237402:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793885056 00000100:00100000:0.0:1746147724.237409:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793885056 00010000:00010000:0.0:1746147724.237435:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7d362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2682879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb592 expref: 22 pid: 4591 timeout: 903 lvb_type: 0 00000100:00100000:0.0:1746147724.237871:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8269 00000100:00100000:0.0:1746147724.237881:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967793885056:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147724.238478:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147724.238500:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7d362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2682879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb592 expref: 22 pid: 4591 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.238513:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7d362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2682879) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb592 expref: 22 pid: 4591 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.238533:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7d362 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2682879) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb592 expref: 22 pid: 4591 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.238570:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.238572:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.238579:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7d47a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb61e expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.238587:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7d47a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb61e expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.238618:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7d47a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb61e expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147724.238630:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796428544:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147724.238714:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147724.245627:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796428544:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147724.245644:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.245686:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967793885056:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7807us (8332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.245694:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8269 00000100:00100000:2.0:1746147724.246828:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.248014:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793885184 00000100:00100000:1.0:1746147724.248020:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793885184 00010000:00010000:1.0:1746147724.248050:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746147724.248109:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8270 00000100:00100000:1.0:1746147724.248116:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967793885184:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.248128:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.248147:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.248158:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.248176:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009469aa00/0xe64d3fbf12a7d41f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ed expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.248396:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.248399:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.248407:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d702400/0xe64d3fbf12a7d481 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb625 expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.248415:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d702400/0xe64d3fbf12a7d481 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb625 expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.248443:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d702400/0xe64d3fbf12a7d481 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb625 expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.248454:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796428672:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147724.249979:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41639c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147724.250004:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796428672:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147724.250018:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.250057:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967793885184:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1941us (3231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.250066:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8270 00000100:00100000:2.0:1746147724.251773:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.251795:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.251812:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.251840:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.251859:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793885696 00000100:00100000:2.0:1746147724.251865:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793885696 00000100:00100000:0.0:1746147724.252075:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793885568 00000100:00100000:0.0:1746147724.252079:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793885568 00000100:00100000:3.0:1746147724.252850:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793885952 00000100:00100000:3.0:1746147724.252854:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793885952 00002000:00100000:2.0:1746147724.252862:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009aeead80 x1830967793885696/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.252871:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeead80 with x1830967793885696 ext(3145728->4194303) 00002000:00010000:2.0:1746147724.252879:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aeead80 00000100:00100000:2.0:1746147724.252905:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793886080 00000100:00100000:2.0:1746147724.252908:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793886080 00000100:00100000:1.0:1746147724.252909:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7259 00000100:00100000:1.0:1746147724.252917:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967793885696:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:0.0:1746147724.252950:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009aee9880 x1830967793885568/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.252956:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee9880 with x1830967793885568 ext(2097152->3145727) 00002000:00010000:0.0:1746147724.252958:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aee9880 00000100:00100000:0.0:1746147724.252969:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7260 00000100:00100000:0.0:1746147724.252973:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967793885568:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:3.0:1746147724.253051:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009aeebb80 x1830967793885952/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.253053:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009aeeb800 x1830967793886080/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.253058:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeebb80 with x1830967793885952 ext(2097152->3145727) 00002000:00100000:2.0:1746147724.253060:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeeb800 with x1830967793886080 ext(3145728->4194303) 00002000:00010000:3.0:1746147724.253062:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeebb80 00002000:00010000:2.0:1746147724.253062:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeeb800 00000100:00100000:3.0:1746147724.255183:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7261 00000100:00100000:3.0:1746147724.255194:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1957:x1830967793886080:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147724.255336:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7262 00000100:00100000:2.0:1746147724.255344:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1957:x1830967793885952:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147724.266161:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.267536:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.267593:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793886464 00000100:00100000:1.0:1746147724.267601:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793886464 00002000:00100000:1.0:1746147724.267637:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009fe3aa00 x1830967793886464/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.267645:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe3aa00 with x1830967793886464 ext(1048576->2097151) 00002000:00010000:1.0:1746147724.267650:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe3aa00 00000100:00100000:1.0:1746147724.267669:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7263 00000100:00100000:1.0:1746147724.267674:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967793886464:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147724.269366:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793886720 00000100:00100000:2.0:1746147724.269374:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793886720 00002000:00100000:2.0:1746147724.269402:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009fe3b480 x1830967793886720/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.269410:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe3b480 with x1830967793886720 ext(1048576->2097151) 00002000:00010000:2.0:1746147724.269414:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe3b480 00000100:00100000:2.0:1746147724.269432:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7264 00000100:00100000:2.0:1746147724.269437:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967793886720:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147724.270424:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1957:x1830967793885568:12345-192.168.202.10@tcp:3:cat.0 Request processed in 17448us (18625us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147724.270434:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7260 00002000:00100000:1.0:1746147724.270440:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009aee9880 x1830967793885568/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.270447:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee9880 with x1830967793885568 ext(2097152->3145727) 00002000:00010000:1.0:1746147724.270450:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aee9880 00000100:00100000:3.0:1746147724.276163:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1957:x1830967793886080:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20961us (24312us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147724.276175:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7261 00002000:00100000:3.0:1746147724.276185:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009aeeb800 x1830967793886080/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.276193:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeeb800 with x1830967793886080 ext(3145728->4194303) 00002000:00010000:3.0:1746147724.276199:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeeb800 00000100:00100000:1.0:1746147724.282422:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967793885696:12345-192.168.202.10@tcp:3:cat.0 Request processed in 29496us (30645us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147724.282433:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7259 00002000:00100000:1.0:1746147724.282443:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009aeead80 x1830967793885696/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.282451:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeead80 with x1830967793885696 ext(3145728->4194303) 00002000:00010000:1.0:1746147724.282455:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aeead80 00000100:00100000:2.0:1746147724.285304:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967793885952:12345-192.168.202.10@tcp:3:cat.0 Request processed in 29951us (33481us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147724.285315:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7262 00002000:00100000:2.0:1746147724.285325:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009aeebb80 x1830967793885952/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.285332:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeebb80 with x1830967793885952 ext(2097152->3145727) 00002000:00010000:2.0:1746147724.285337:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeebb80 00000100:00100000:1.0:1746147724.289774:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967793886464:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22091us (23612us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147724.289785:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7263 00002000:00100000:1.0:1746147724.289795:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009fe3aa00 x1830967793886464/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.289804:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe3aa00 with x1830967793886464 ext(1048576->2097151) 00002000:00010000:1.0:1746147724.289808:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe3aa00 00000100:00100000:2.0:1746147724.293238:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967793886720:12345-192.168.202.10@tcp:3:cat.0 Request processed in 23792us (25697us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147724.293248:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7264 00002000:00100000:2.0:1746147724.293258:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009fe3b480 x1830967793886720/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.293267:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe3b480 with x1830967793886720 ext(1048576->2097151) 00002000:00010000:2.0:1746147724.293272:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe3b480 00000100:00100000:0.0:1746147724.299746:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.299801:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793886848 00000100:00100000:3.0:1746147724.299809:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793886848 00000100:00100000:0.0:1746147724.299831:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.300027:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793886976 00000100:00100000:3.0:1746147724.300030:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793886976 00000100:00100000:3.0:1746147724.300051:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16320 00000100:00100000:3.0:1746147724.300058:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32119:x1830967793886848:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147724.300075:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147724.300080:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16321 00000100:00100000:1.0:1746147724.300086:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967793886976:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147724.300089:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb62c expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.300092:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147724.300097:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5287a00/0xe64d3fbf12a7d48f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb633 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.300111:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d702400/0xe64d3fbf12a7d481 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb625 expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.300121:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.300123:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.300126:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1638400->2097151] (req 1638400->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.300152:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.300162:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5287a00/0xe64d3fbf12a7d48f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb633 expref: 30 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.300169:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d702400/0xe64d3fbf12a7d481 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb625 expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.300184:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d702400/0xe64d3fbf12a7d481 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb625 expref: 19 pid: 10613 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.300195:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796428800:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147724.300224:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5287a00/0xe64d3fbf12a7d48f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb633 expref: 30 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147724.300239:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5287a00, rc 0) 00000100:00100000:1.0:1746147724.300258:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967793886976:12345-192.168.202.10@tcp:101:cat.0 Request processed in 172us (426us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147724.300262:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147724.300263:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16321 00000100:00100000:2.0:1746147724.306371:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.306403:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.306415:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793887360 00000100:00100000:2.0:1746147724.306418:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793887616 00000100:00100000:2.0:1746147724.306422:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793887616 00000100:00100000:1.0:1746147724.306422:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793887360 00010000:00010000:1.0:1746147724.306448:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d702400/0xe64d3fbf12a7d481 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb625 expref: 20 pid: 10613 timeout: 903 lvb_type: 0 00002000:00100000:2.0:1746147724.306453:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009505f100 x1830967793887616/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.306460:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505f100 with x1830967793887616 ext(4194304->5017599) 00002000:00010000:2.0:1746147724.306464:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009505f100 00000100:00100000:2.0:1746147724.306475:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7265 00000100:00100000:1.0:1746147724.306475:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8271 00000100:00100000:2.0:1746147724.306480:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967793887616:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147724.306480:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793887360:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.306490:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.306507:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d702400/0xe64d3fbf12a7d481 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb625 expref: 20 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.306517:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d702400/0xe64d3fbf12a7d481 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb625 expref: 20 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.306540:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.306541:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.306547:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 20 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.306554:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 20 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.306576:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 20 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.306585:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796428928:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147724.306705:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41639c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147724.306719:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d702400/0xe64d3fbf12a7d481 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb625 expref: 20 pid: 10613 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.306746:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796428800:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147724.306749:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147724.306763:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.306770:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8800, rc 0) 00000100:00100000:3.0:1746147724.306790:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:32119:x1830967793886848:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 6732us (7050us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.306796:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16320 00000100:00100000:0.0:1746147724.306836:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793887232 00000100:00100000:0.0:1746147724.306839:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793887232 00000100:00100000:0.0:1746147724.306861:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11973 00000100:00100000:0.0:1746147724.306866:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+337:32125:x1830967793887232:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147724.306878:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147724.306907:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7d496 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb63a expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.306981:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d49d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.306990:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d49d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.306997:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d49d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.307006:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7d4a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.307011:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7d4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.307015:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7d4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.307858:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7d4ab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.307867:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7d4ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.307874:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7d4ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147724.307881:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:2.0:1746147724.307993:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147724.311105:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d49d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.311113:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d49d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.311119:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d49d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.311123:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931cf800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147724.311126:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d49d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.311130:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d49d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.311143:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147724.311145:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147724.311148:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d49d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.311152:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d49d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.311176:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7d4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.311180:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7d4a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.311183:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7d4a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.311186:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931cfe00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147724.311188:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7d4a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.311191:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7d4a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.311196:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06eeb00) 00010000:00010000:0.0:1746147724.311197:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147724.311199:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7d4a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.311202:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7d4a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.311247:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7d496 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb63a expref: 340 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.311259:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7d4ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb63a expref: 339 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.311264:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147724.311266:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147724.311268:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931cf600, rc 0) 00000100:00100000:0.0:1746147724.311340:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:32125:x1830967793887232:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4473us (5007us total) trans 8589945984 rc 0/0 00000100:00100000:0.0:1746147724.311347:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11973 00000100:00100000:3.0:1746147724.312227:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793887744 00000100:00100000:3.0:1746147724.312235:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793887744 00000100:00100000:3.0:1746147724.312275:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16322 00000100:00100000:3.0:1746147724.312281:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32123:x1830967793887744:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147724.312293:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.312305:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7d4b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb641 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.312324:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.312325:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.312332:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7d4b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb641 expref: 22 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.312342:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7d4b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb641 expref: 22 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.312350:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e4200, rc 0) 00000100:00100000:3.0:1746147724.312373:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32123:x1830967793887744:12345-192.168.202.10@tcp:101:cat.0 Request processed in 93us (4380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.312378:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16322 00000100:00100000:1.0:1746147724.312490:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796428928:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147724.312506:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.312528:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967793887360:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6047us (6164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.312535:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8271 00000100:00100000:2.0:1746147724.312740:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.313272:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793888000 00000100:00100000:1.0:1746147724.313277:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793888000 00002000:00100000:1.0:1746147724.313299:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1638400->1642495) req@ffff88009505d180 x1830967793888000/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.313307:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505d180 with x1830967793888000 ext(1638400->1642495) 00002000:00010000:1.0:1746147724.313310:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009505d180 00000100:00100000:1.0:1746147724.313441:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7266 00000100:00100000:1.0:1746147724.313448:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967793888000:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147724.313567:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967793888000:12345-192.168.202.10@tcp:3:cat.0 Request processed in 119us (828us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147724.313573:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7266 00002000:00100000:1.0:1746147724.313577:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1638400->1642495) req@ffff88009505d180 x1830967793888000/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/4536 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.313584:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505d180 with x1830967793888000 ext(1638400->1642495) 00002000:00010000:1.0:1746147724.313586:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009505d180 00000100:00100000:3.0:1746147724.314653:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967793887616:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8170us (8247us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746147724.314660:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7265 00002000:00100000:3.0:1746147724.314666:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009505f100 x1830967793887616/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.314673:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505f100 with x1830967793887616 ext(4194304->5017599) 00002000:00010000:3.0:1746147724.314677:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009505f100 00000100:00100000:0.0:1746147724.322253:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.322337:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.323495:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793888256 00000100:00100000:3.0:1746147724.323504:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793888256 00000100:00100000:2.0:1746147724.323513:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793888512 00000100:00100000:2.0:1746147724.323516:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793888512 00002000:00100000:2.0:1746147724.323539:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fe39880 x1830967793888512/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.323540:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009fe38a80 x1830967793888256/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.323549:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe38a80 with x1830967793888256 ext(2097152->3145727) 00002000:00100000:2.0:1746147724.323549:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39880 with x1830967793888512 ext(3145728->4194303) 00002000:00010000:3.0:1746147724.323553:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe38a80 00002000:00010000:2.0:1746147724.323553:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe39880 00000100:00100000:3.0:1746147724.323570:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7267 00000100:00100000:2.0:1746147724.323573:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7268 00000100:00100000:3.0:1746147724.323575:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967793888256:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147724.323577:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967793888512:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147724.326367:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.326407:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793888640 00000100:00100000:0.0:1746147724.326413:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793888640 00000100:00100000:0.0:1746147724.326450:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16323 00000100:00100000:0.0:1746147724.326456:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967793888640:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147724.326470:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147724.326484:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931cf000/0xe64d3fbf12a7d4c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb648 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147724.326526:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe38380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796429056:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147724.326582:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.337877:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.339389:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793888768 00000100:00100000:2.0:1746147724.339400:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793888768 00000100:00100000:2.0:1746147724.339933:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16324 00000100:00100000:2.0:1746147724.339944:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32119:x1830967793888768:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147724.339964:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.339982:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb64f expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.340016:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d450 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb602 expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.340024:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094109800/0xe64d3fbf12a7d473 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb617 expref: 27 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.340030:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.340031:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.340035:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1511423] (req 1048576->1511423) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 27 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.340070:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094109800/0xe64d3fbf12a7d473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb617 expref: 27 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.340082:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094109800/0xe64d3fbf12a7d473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb617 expref: 27 pid: 7050 timeout: 903 lvb_type: 1 00000100:00100000:2.0:1746147724.340095:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796429184:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.340199:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d450 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb602 expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.340207:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d450 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb602 expref: 29 pid: 7050 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.340214:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796429312:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147724.340234:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147724.340340:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe38380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796429056:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147724.340361:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931cf000/0xe64d3fbf12a7d4c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb648 expref: 30 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.340369:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931cf000/0xe64d3fbf12a7d4c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb648 expref: 30 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.340381:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931cf000, rc 0) 00000100:00100000:2.0:1746147724.340405:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967793888640:12345-192.168.202.10@tcp:101:cat.0 Request processed in 13949us (14044us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147724.340411:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16323 00000100:00100000:2.0:1746147724.344959:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793888512:12345-192.168.202.10@tcp:3:cat.0 Request processed in 21372us (22615us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147724.344969:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7268 00002000:00100000:2.0:1746147724.344979:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fe39880 x1830967793888512/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.344987:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39880 with x1830967793888512 ext(3145728->4194303) 00002000:00010000:2.0:1746147724.344992:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe39880 00000100:00100000:3.0:1746147724.346395:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793888256:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22816us (24148us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147724.346405:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7267 00002000:00100000:3.0:1746147724.346411:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009fe38a80 x1830967793888256/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.346418:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe38a80 with x1830967793888256 ext(2097152->3145727) 00002000:00010000:3.0:1746147724.346422:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe38a80 00000100:00100000:0.0:1746147724.348226:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.348624:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796429184:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.348635:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796429312:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.348660:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1511423] (req 1048576->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.348669:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793888896 00010000:00010000:3.0:1746147724.348673:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dae9e00, rc 0) 00000100:00100000:1.0:1746147724.348674:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793888896 00000100:00100000:3.0:1746147724.348705:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:32119:x1830967793888768:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 8764us (10838us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.348711:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16324 00000100:00100000:3.0:1746147724.348735:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16325 00000100:00100000:3.0:1746147724.348741:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967793888896:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147724.348753:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.348765:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4000/0xe64d3fbf12a7d4ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb656 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147724.348802:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796429440:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147724.348839:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.353222:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.353717:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793889152 00000100:00100000:1.0:1746147724.353733:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793889152 00010000:00010000:1.0:1746147724.353769:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d450 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb602 expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746147724.354142:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8272 00000100:00100000:1.0:1746147724.354150:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967793889152:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.354166:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.354189:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d450 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb602 expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.354199:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d450 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb602 expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.354220:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7d450 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb602 expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.354256:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.354298:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967793889152:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 149us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.354305:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8272 00000100:00100000:3.0:1746147724.354587:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796429440:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147724.354617:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4000/0xe64d3fbf12a7d4ce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb656 expref: 30 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.354628:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4000/0xe64d3fbf12a7d4ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb656 expref: 30 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.354648:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e4000, rc 0) 00000100:00100000:3.0:1746147724.354678:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967793888896:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5936us (6455us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147724.354684:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16325 00000100:00100000:0.0:1746147724.355660:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.355759:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793889024 00000100:00100000:2.0:1746147724.355764:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793889024 00010000:00010000:2.0:1746147724.355784:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094109800/0xe64d3fbf12a7d473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb617 expref: 23 pid: 7050 timeout: 903 lvb_type: 1 00000100:00100000:2.0:1746147724.356277:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8273 00000100:00100000:2.0:1746147724.356285:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967793889024:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.356296:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147724.356311:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094109800/0xe64d3fbf12a7d473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb617 expref: 23 pid: 7050 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.356320:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094109800/0xe64d3fbf12a7d473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb617 expref: 23 pid: 7050 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.356334:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094109800/0xe64d3fbf12a7d473 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb617 expref: 23 pid: 7050 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.356360:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.356361:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.356367:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 22 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.356374:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 22 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.356402:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 22 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147724.356413:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796429568:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147724.356479:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.366187:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.367989:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793889280 00000100:00100000:3.0:1746147724.367998:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793889280 00000100:00100000:3.0:1746147724.368055:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16326 00000100:00100000:3.0:1746147724.368062:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967793889280:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147724.368078:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.368093:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d4d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb65d expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147724.368141:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796429696:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147724.368210:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147724.373440:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796429696:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147724.373470:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d4d5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb65d expref: 24 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.373481:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d4d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb65d expref: 24 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.373503:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e5000, rc 0) 00000100:00100000:3.0:1746147724.373540:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967793889280:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5478us (7359us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147724.373549:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16326 00000100:00100000:2.0:1746147724.376972:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796429568:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147724.376992:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147724.377039:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967793889024:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 20754us (21379us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.377051:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8273 00000100:00100000:0.0:1746147724.385581:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.385669:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.385797:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793889792 00000100:00100000:2.0:1746147724.385806:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793889792 00002000:00100000:2.0:1746147724.385851:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009fe39f80 x1830967793889792/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.385861:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39f80 with x1830967793889792 ext(4194304->5017599) 00002000:00010000:2.0:1746147724.385866:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe39f80 00000100:00100000:2.0:1746147724.385923:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793889536 00000100:00100000:2.0:1746147724.385925:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793889536 00002000:00100000:2.0:1746147724.385937:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x457:0x0] (1507328->1511423) req@ffff88009fe94700 x1830967793889536/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147724.385937:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7269 00002000:00100000:2.0:1746147724.385943:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe94700 with x1830967793889536 ext(1507328->1511423) 00002000:00010000:2.0:1746147724.385946:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe94700 00000100:00100000:1.0:1746147724.385946:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967793889792:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147724.385956:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7270 00000100:00100000:2.0:1746147724.385959:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967793889536:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147724.386076:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967793889536:12345-192.168.202.10@tcp:3:cat.0 Request processed in 115us (410us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147724.386082:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7270 00002000:00100000:2.0:1746147724.386086:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x457:0x0] (1507328->1511423) req@ffff88009fe94700 x1830967793889536/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/4536 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.386092:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe94700 with x1830967793889536 ext(1507328->1511423) 00002000:00010000:2.0:1746147724.386095:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe94700 00000100:00100000:0.0:1746147724.392398:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.392521:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793890048 00000100:00100000:2.0:1746147724.392531:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793890048 00000100:00100000:2.0:1746147724.392609:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4977 00000100:00100000:2.0:1746147724.392620:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32119:x1830967793890048:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:2.0:1746147724.393111:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:32119:x1830967793890048:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 491us (721us total) trans 8589945985 rc 0/0 00000100:00100000:2.0:1746147724.393118:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4977 00000100:00100000:1.0:1746147724.396477:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967793889792:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10524us (10898us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147724.396488:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7269 00002000:00100000:1.0:1746147724.396497:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009fe39f80 x1830967793889792/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.396505:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39f80 with x1830967793889792 ext(4194304->5017599) 00002000:00010000:1.0:1746147724.396510:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe39f80 00000100:00100000:0.0:1746147724.437347:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.438540:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793890176 00000100:00100000:3.0:1746147724.438549:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793890176 00000100:00100000:3.0:1746147724.438597:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16327 00000100:00100000:3.0:1746147724.438604:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32125:x1830967793890176:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147724.438619:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.438636:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb664 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.438661:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.438668:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147724.438670:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147724.438673:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1662976->2097151] (req 1662976->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 30 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.438694:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.438702:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 17 pid: 10613 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.438711:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796429824:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.438786:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147724.441955:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796429824:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.441981:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1662976->2097151] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 30 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.441995:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e5a00, rc 0) 00000100:00100000:3.0:1746147724.443461:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32125:x1830967793890176:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4852us (6115us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.443470:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16327 00000100:00100000:0.0:1746147724.444239:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.444677:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793890304 00000100:00100000:1.0:1746147724.444683:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793890304 00002000:00100000:1.0:1746147724.444716:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1638400->2097151) req@ffff88009fe96300 x1830967793890304/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.444736:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96300 with x1830967793890304 ext(1638400->2097151) 00010000:00010000:1.0:1746147724.444743:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 18 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.444755:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 18 pid: 10613 timeout: 903 lvb_type: 0 00002000:00010000:1.0:1746147724.444766:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe96300 00000100:00100000:1.0:1746147724.444781:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1446 00000100:00100000:1.0:1746147724.444787:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967793890304:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147724.451745:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793890304:12345-192.168.202.10@tcp:4:cat.0 Request processed in 6950us (7499us total) trans 21474841559 rc 0/0 00000100:00100000:1.0:1746147724.451757:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1446 00002000:00100000:1.0:1746147724.451766:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1638400->2097151) req@ffff88009fe96300 x1830967793890304/t21474841559(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/448 e 0 to 0 dl 1746147735 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.451775:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96300 with x1830967793890304 ext(1638400->2097151) 00010000:00010000:1.0:1746147724.451783:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 20 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.451796:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 20 pid: 10613 timeout: 903 lvb_type: 0 00002000:00010000:1.0:1746147724.451803:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe96300 00000100:00100000:0.0:1746147724.457545:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.458359:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793890432 00000100:00100000:2.0:1746147724.458368:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793890432 00010000:00010000:2.0:1746147724.458400:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 20 pid: 10613 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.458423:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8274 00000100:00100000:2.0:1746147724.458428:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793890432:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.458442:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147724.458461:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 20 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.458472:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 20 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.458490:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7d488 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb62c expref: 20 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.458518:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.458520:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.458527:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.458540:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.458565:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147724.458574:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796429952:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147724.458635:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147724.461857:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796429952:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147724.461876:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147724.463657:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967793890432:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5220us (6111us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.463668:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8274 00000100:00100000:2.0:1746147724.464149:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.464536:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793890688 00000100:00100000:0.0:1746147724.464544:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793890688 00002000:00100000:0.0:1746147724.464575:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1662976->1667071) req@ffff88009505ce00 x1830967793890688/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.464583:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505ce00 with x1830967793890688 ext(1662976->1667071) 00002000:00010000:0.0:1746147724.464588:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009505ce00 00000100:00100000:0.0:1746147724.464612:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7271 00000100:00100000:0.0:1746147724.464617:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967793890688:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147724.464767:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967793890688:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 148us (618us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147724.464772:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7271 00002000:00100000:0.0:1746147724.464776:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1662976->1667071) req@ffff88009505ce00 x1830967793890688/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/4536 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.464783:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505ce00 with x1830967793890688 ext(1662976->1667071) 00002000:00010000:0.0:1746147724.464785:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009505ce00 00000100:00100000:0.0:1746147724.470818:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.470877:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793890816 00000100:00100000:3.0:1746147724.470912:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793890816 00000100:00100000:2.0:1746147724.471004:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16328 00000100:00100000:2.0:1746147724.471013:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32125:x1830967793890816:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147724.471027:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.471042:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb66b expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.471063:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.471068:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147724.471069:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147724.471072:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->1425407] (req 1048576->1425407) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 30 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.471091:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.471098:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 21 pid: 10613 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.471106:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796430080:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147724.471178:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147724.472746:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796430080:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.472767:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->1425407] (req 1048576->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 30 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.472778:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff9c00, rc 0) 00000100:00100000:2.0:1746147724.472804:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32125:x1830967793890816:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1792us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.472810:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16328 00000100:00100000:0.0:1746147724.473753:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.473837:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793890944 00000100:00100000:2.0:1746147724.473842:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793890944 00002000:00100000:2.0:1746147724.473871:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1511423) req@ffff88009fe95880 x1830967793890944/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.473879:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe95880 with x1830967793890944 ext(1048576->1511423) 00010000:00010000:2.0:1746147724.473911:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 22 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.473921:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 22 pid: 10613 timeout: 903 lvb_type: 0 00002000:00010000:2.0:1746147724.473927:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe95880 00000100:00100000:2.0:1746147724.473945:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1447 00000100:00100000:2.0:1746147724.473950:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967793890944:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147724.480201:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793890944:12345-192.168.202.10@tcp:4:cat.0 Request processed in 6240us (6439us total) trans 17179874329 rc 0/0 00000100:00100000:2.0:1746147724.480212:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1447 00002000:00100000:2.0:1746147724.480221:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1511423) req@ffff88009fe95880 x1830967793890944/t17179874329(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/448 e 0 to 0 dl 1746147735 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.480230:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe95880 with x1830967793890944 ext(1048576->1511423) 00010000:00010000:2.0:1746147724.480238:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 24 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.480253:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 24 pid: 10613 timeout: 903 lvb_type: 0 00002000:00010000:2.0:1746147724.480259:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe95880 00000100:00100000:0.0:1746147724.482396:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.482484:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793891072 00000100:00100000:2.0:1746147724.482491:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793891072 00000100:00100000:2.0:1746147724.482540:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11974 00000100:00100000:2.0:1746147724.482547:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+10:32129:x1830967793891072:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147724.482569:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.482585:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7d4ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb672 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.482633:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7d4f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.482643:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7d4f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.482652:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7d4f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.482662:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d4f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.482667:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.482672:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.482781:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7d4ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.482789:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7d4ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.482794:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7d4ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147724.482820:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147724.482823:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147724.482837:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7d4ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.482846:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7d4ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.482852:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7d4f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.482858:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7d4f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.482863:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7d4f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.482868:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fff9400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147724.482871:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7d4f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.482878:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7d4f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.483157:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147724.483160:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147724.483163:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7d4f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.483168:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7d4f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.483573:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.483579:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d4f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.483583:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d4f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.483588:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fff8600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147724.483590:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d4f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.483595:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d4f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147724.483597:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147724.483601:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a00f3300) 00010000:00010000:2.0:1746147724.483603:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147724.483605:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d4f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.483610:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d4f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147724.483625:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793891200 00000100:00100000:0.0:1746147724.483630:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793891200 00010000:00010000:2.0:1746147724.483635:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7d4ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb672 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.483645:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7d4ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb672 expref: 11 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.483649:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 24 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.483651:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147724.483652:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147724.483654:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8e00, rc 0) 00000100:00100000:0.0:1746147724.483680:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8275 00000100:00100000:0.0:1746147724.483685:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793891200:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147724.483689:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+11:32129:x1830967793891072:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 1143us (1300us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147724.483693:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147724.483695:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11974 00010000:00010000:0.0:1746147724.483707:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 24 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.483717:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 24 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.483741:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d4c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb64f expref: 24 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.483759:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.483760:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.483766:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.483774:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.483799:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147724.483874:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796430208:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147724.483958:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.486915:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.486946:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.487009:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.487044:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793891328 00000100:00100000:0.0:1746147724.487050:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793891328 00000100:00100000:0.0:1746147724.487082:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793891456 00000100:00100000:0.0:1746147724.487084:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793891456 00000100:00100000:0.0:1746147724.487097:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793891584 00000100:00100000:0.0:1746147724.487098:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793891584 00000100:00100000:0.0:1746147724.487109:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16329 00000100:00100000:0.0:1746147724.487116:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967793891328:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147724.487130:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147724.487146:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7d506 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb679 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147724.487185:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796430336:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147724.487246:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.487259:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16330 00000100:00100000:0.0:1746147724.487264:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967793891456:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147724.487270:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147724.487279:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d50d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb680 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147724.487305:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796430464:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147724.487322:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.487339:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16331 00000100:00100000:0.0:1746147724.487344:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967793891584:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147724.487349:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147724.487355:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0c00/0xe64d3fbf12a7d514 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb687 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.487364:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.487366:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.487373:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0c00/0xe64d3fbf12a7d514 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb687 expref: 9 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147724.487385:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0c00/0xe64d3fbf12a7d514 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb687 expref: 9 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147724.487393:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2b0c00, rc 0) 00000100:00100000:0.0:1746147724.487410:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967793891584:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 66us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147724.487415:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16331 00000100:00100000:2.0:1746147724.487961:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796430208:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147724.487975:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147724.487997:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967793891200:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4313us (4401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.488004:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8275 00000100:00100000:1.0:1746147724.489003:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796430336:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147724.489004:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796430464:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147724.489020:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d50d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb680 expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147724.489020:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7d506 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb679 expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.489030:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d50d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb680 expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147724.489030:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7d506 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb679 expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.489038:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a221e000, rc 0) 00010000:00010000:1.0:1746147724.489044:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a221ec00, rc 0) 00000100:00100000:2.0:1746147724.489056:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967793891456:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 1791us (2109us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147724.489057:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967793891328:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 1942us (2182us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147724.489061:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16330 00000100:00100000:1.0:1746147724.489072:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16329 00000100:00100000:0.0:1746147724.492154:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.492787:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793891840 00000100:00100000:2.0:1746147724.492794:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793891840 00000100:00100000:2.0:1746147724.493058:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11975 00000100:00100000:2.0:1746147724.493066:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+11:32129:x1830967793891840:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147724.493082:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.493096:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d51b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb68e expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.493174:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7d522 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.493186:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7d43b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5f4 expref: 22 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.493196:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7d4ab lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb63a expref: 338 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.493201:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7d4ff lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb672 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.493207:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7d522 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147724.493767:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147724.494075:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7d4ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb672 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.494085:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7d4ff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb672 expref: 12 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.494096:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796430592:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.494790:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7d4ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb63a expref: 338 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.494799:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7d4ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb63a expref: 338 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.494811:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796430720:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.494836:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793892096 00000100:00100000:3.0:1746147724.494840:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793892096 00010000:00010000:2.0:1746147724.494842:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7d43b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5f4 expref: 22 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.494850:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7d43b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5f4 expref: 22 pid: 14546 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.494857:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796430848:192.168.202.10@tcp:104: 00002000:00100000:3.0:1746147724.494864:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1421312->1425407) req@ffff8800956b5500 x1830967793892096/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147724.494871:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e9c0 going to sleep for 11 seconds 00002000:00100000:3.0:1746147724.494872:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b5500 with x1830967793892096 ext(1421312->1425407) 00002000:00010000:3.0:1746147724.494875:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b5500 00000100:00100000:3.0:1746147724.494901:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7272 00000100:00100000:3.0:1746147724.494907:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967793892096:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147724.495019:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967793892096:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 111us (1252us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147724.495025:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7272 00002000:00100000:3.0:1746147724.495030:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1421312->1425407) req@ffff8800956b5500 x1830967793892096/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/4536 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.495037:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b5500 with x1830967793892096 ext(1421312->1425407) 00002000:00010000:3.0:1746147724.495039:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b5500 00000100:00100000:0.0:1746147724.496825:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.496854:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.496876:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793892352 00000100:00100000:3.0:1746147724.496899:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793892352 00000100:00100000:0.0:1746147724.496904:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147724.496920:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7d43b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5f4 expref: 23 pid: 14546 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.496942:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793892480 00000100:00100000:3.0:1746147724.496944:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793892480 00010000:00010000:3.0:1746147724.496954:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7d4ab lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb63a expref: 339 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.496976:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793892224 00000100:00100000:3.0:1746147724.496979:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793892224 00010000:00010000:3.0:1746147724.496988:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7d4ff lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb672 expref: 13 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.497005:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8276 00000100:00100000:3.0:1746147724.497011:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967793892352:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147724.497021:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147724.497027:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7d43b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5f4 expref: 23 pid: 14546 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.497034:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7d43b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5f4 expref: 23 pid: 14546 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.497034:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8277 00000100:00100000:2.0:1746147724.497040:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:1957:x1830967793892480:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.497046:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147724.497049:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7d4ab lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb63a expref: 339 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.497051:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147724.497055:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7d522 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00000100:00100000:1.0:1746147724.497097:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8278 00000100:00100000:1.0:1746147724.497103:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967793892224:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.497109:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.497113:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7d4ff lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb672 expref: 13 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.497279:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7d522 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147724.497285:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147724.497288:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7d4ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb63a expref: 339 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.497299:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147724.497302:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7d522 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.497306:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7d522 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.497310:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147724.497313:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967793892352:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 303us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.497319:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8276 00000100:00100000:2.0:1746147724.497321:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:1957:x1830967793892480:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 282us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.497326:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8277 00000100:00100000:2.0:1746147724.497350:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796430592:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.497359:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7d4ab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb63a expref: 338 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.497374:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796430720:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147724.497399:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7d4ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb672 expref: 13 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.497411:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7d4ff lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb672 expref: 13 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.497431:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147724.497434:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7d522 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147724.497439:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7d522 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147724.497445:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7d522 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147724.497458:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147724.497876:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147724.498010:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7d43b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5f4 expref: 22 pid: 14546 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.498021:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796430848:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.498039:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7d522 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.498047:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7d522 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.498051:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7d522 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147724.498067:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147724.498182:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d51b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb68e expref: 14 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.498193:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7d522 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb68e expref: 13 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.498199:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147724.498201:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147724.498203:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff9e00, rc 0) 00000100:00100000:2.0:1746147724.498234:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+13:32129:x1830967793891840:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 5169us (6086us total) trans 8589945986 rc 0/0 00000100:00100000:2.0:1746147724.498240:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11975 00000100:00100000:2.0:1746147724.498268:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793892736 00000100:00100000:2.0:1746147724.498271:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793892736 00000100:00100000:2.0:1746147724.498288:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4978 00000100:00100000:2.0:1746147724.498293:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+338:32125:x1830967793892736:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:1.0:1746147724.498351:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967793892224:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1248us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.498357:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8278 00000100:00100000:2.0:1746147724.498372:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:32125:x1830967793892736:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 79us (497us total) trans 8589945987 rc 0/0 00000100:00100000:2.0:1746147724.498377:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4978 00000100:00100000:0.0:1746147724.500749:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.500854:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793892992 00000100:00100000:2.0:1746147724.500859:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793892992 00000100:00100000:2.0:1746147724.500931:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11976 00000100:00100000:2.0:1746147724.500938:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+12:32129:x1830967793892992:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147724.500953:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.500955:0:17544:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147724.500977:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7d522 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb68e expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.500988:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147724.500992:0:17544:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147724.501000:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213c00/0xe64d3fbf12a7d530 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb695 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.501065:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213e00/0xe64d3fbf12a7d537 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.501075:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213e00/0xe64d3fbf12a7d537 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.501082:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213e00/0xe64d3fbf12a7d537 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147724.501093:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147724.501162:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213c00/0xe64d3fbf12a7d530 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb695 expref: 14 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.501171:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213e00/0xe64d3fbf12a7d537 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb695 expref: 13 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.501177:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147724.501179:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147724.501180:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9213e00, rc 0) 00000100:00100000:2.0:1746147724.501210:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+13:32129:x1830967793892992:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 273us (466us total) trans 8589945988 rc 0/0 00000100:00100000:2.0:1746147724.501215:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11976 00000100:00100000:0.0:1746147724.502399:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.502739:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793893120 00000100:00100000:3.0:1746147724.502744:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793893120 00000100:00100000:3.0:1746147724.502811:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11977 00000100:00100000:3.0:1746147724.502818:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+13:32129:x1830967793893120:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147724.502830:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.502840:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7d545 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb69c expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.502874:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7d545 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb69c expref: 14 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.502912:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7d545 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb69c expref: 14 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.502962:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147724.502965:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147724.502967:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e5e00, rc 0) 00000100:00100000:3.0:1746147724.503008:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+14:32129:x1830967793893120:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 190us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.503013:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11977 00000100:00100000:0.0:1746147724.506136:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.506165:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.506194:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793893248 00000100:00100000:0.0:1746147724.506196:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.506200:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793893248 00000100:00100000:0.0:1746147724.506219:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.506237:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793893376 00000100:00100000:1.0:1746147724.506240:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793893376 00000100:00100000:1.0:1746147724.506406:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793893504 00000100:00100000:3.0:1746147724.506407:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793893632 00000100:00100000:1.0:1746147724.506409:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793893504 00000100:00100000:3.0:1746147724.506410:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793893632 00000100:00100000:1.0:1746147724.506424:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16332 00000100:00100000:3.0:1746147724.506429:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16333 00000100:00100000:1.0:1746147724.506431:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793893248:12345-192.168.202.10@tcp:1:mirror_io.0 00000100:00100000:3.0:1746147724.506433:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793893376:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147724.506461:0:7050:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d553 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.506461:0:9615:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d54c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.506475:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e60000/0xe64d3fbf12a7d075 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3d9 expref: 29 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147724.506475:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e61800/0xe64d3fbf12a7d044 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3a8 expref: 29 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.506482:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7d219 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c7 expref: 9 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147724.506482:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e60400/0xe64d3fbf12a7d220 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c0 expref: 8 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147724.506488:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7d116 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb434 expref: 22 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.506489:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7d11d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb43b expref: 18 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.506493:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.506493:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.506495:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.506495:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.506497:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d553 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.506497:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d54c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.506520:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7d11d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb43b expref: 18 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147724.506527:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7d116 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb434 expref: 22 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.506528:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7d11d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb43b expref: 18 pid: 6715 timeout: 903 lvb_type: 1 00010000:00010000:1.0:1746147724.506535:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7d116 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb434 expref: 22 pid: 6715 timeout: 903 lvb_type: 1 00000100:00100000:3.0:1746147724.506539:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796430976:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147724.506543:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796431104:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.506587:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16334 00000100:00100000:3.0:1746147724.506592:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793893504:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147724.506596:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e60400/0xe64d3fbf12a7d220 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c0 expref: 8 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.506605:0:8184:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d55a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.506617:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.506623:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147724.506624:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147724.506625:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d55a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147724.506922:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16335 00010000:00010000:3.0:1746147724.506928:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147724.506930:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793893632:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147724.506936:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 29 pid: 10613 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.506944:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796431360:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.506948:0:10613:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d561 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.506962:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147724.506963:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746147724.506967:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147724.506969:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147724.506970:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d561 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.506981:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7d219 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c7 expref: 9 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.506986:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.506987:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7d219 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c7 expref: 9 pid: 4591 timeout: 903 lvb_type: 1 00000100:00100000:3.0:1746147724.506994:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796431488:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.506995:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 29 pid: 7050 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.507003:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796431616:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.507012:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e60000/0xe64d3fbf12a7d075 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3d9 expref: 29 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.507023:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e60000/0xe64d3fbf12a7d075 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3d9 expref: 29 pid: 7050 timeout: 903 lvb_type: 1 00000100:00100000:2.0:1746147724.507023:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147724.507030:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796431744:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.507048:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147724.507058:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e60400/0xe64d3fbf12a7d220 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c0 expref: 8 pid: 6715 timeout: 903 lvb_type: 1 00000100:00100000:1.0:1746147724.507067:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796431232:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.507073:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.507091:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793893760 00010000:00010000:1.0:1746147724.507092:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e61800/0xe64d3fbf12a7d044 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3a8 expref: 29 pid: 4591 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147724.507094:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793893760 00010000:00010000:1.0:1746147724.507100:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e61800/0xe64d3fbf12a7d044 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3a8 expref: 29 pid: 4591 timeout: 903 lvb_type: 1 00000100:00100000:1.0:1746147724.507107:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796431872:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.507109:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16336 00000100:00100000:2.0:1746147724.507111:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.507113:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793893760:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147724.507126:0:22183:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136404600/0xe64d3fbf12a7d568 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.507128:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4163b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147724.507137:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7d47a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb61e expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.507139:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793893888 00000100:00100000:1.0:1746147724.507141:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793893888 00010000:00010000:3.0:1746147724.507143:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0c00/0xe64d3fbf12a7d514 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb687 expref: 9 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.507149:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7d4b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb641 expref: 22 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.507154:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.507156:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.507158:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136404600/0xe64d3fbf12a7d568 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.507163:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16337 00000100:00100000:1.0:1746147724.507166:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793893888:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147724.507171:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7d4b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb641 expref: 22 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.507177:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7d4b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb641 expref: 22 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.507179:0:6715:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095699400/0xe64d3fbf12a7d56f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147724.507184:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796432000:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147724.507187:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c466800/0xe64d3fbf12a7d35b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb58b expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.507193:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134b2fe00/0xe64d3fbf12a7d418 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5e6 expref: 29 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147724.507200:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d3bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5bc expref: 10 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147724.507204:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.507205:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.507207:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095699400/0xe64d3fbf12a7d56f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.507216:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0c00/0xe64d3fbf12a7d514 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb687 expref: 9 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147724.507217:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d3bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5bc expref: 10 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.507223:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0c00/0xe64d3fbf12a7d514 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb687 expref: 9 pid: 22183 timeout: 903 lvb_type: 1 00010000:00010000:1.0:1746147724.507224:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d3bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5bc expref: 10 pid: 10613 timeout: 903 lvb_type: 1 00000100:00100000:3.0:1746147724.507230:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796432128:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147724.507230:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796432256:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.507248:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7d47a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb61e expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.507248:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134b2fe00/0xe64d3fbf12a7d418 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5e6 expref: 29 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.507254:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7d47a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb61e expref: 29 pid: 4591 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.507254:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134b2fe00/0xe64d3fbf12a7d418 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5e6 expref: 29 pid: 8184 timeout: 903 lvb_type: 1 00000100:00100000:3.0:1746147724.507261:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796432512:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147724.507266:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796432384:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.507272:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746147724.507287:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c466800/0xe64d3fbf12a7d35b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb58b expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.507294:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c466800/0xe64d3fbf12a7d35b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb58b expref: 18 pid: 8184 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746147724.507300:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796432640:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147724.507314:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4163900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147724.513169:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796431488:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147724.513169:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796431104:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.513274:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796432000:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.513294:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796431360:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.513315:0:8184:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d55a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147724.514558:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796431616:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147724.514573:0:10613:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d561 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147724.514660:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.514676:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796431232:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147724.514679:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.514684:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796431872:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147724.514694:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147724.514704:0:9615:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d54c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.514736:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796432256:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147724.514753:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793894400 00000100:00100000:1.0:1746147724.514758:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793894400 00000100:00100000:3.0:1746147724.514762:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796430976:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.514770:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796431744:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.514787:0:7050:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d553 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746147724.514789:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1425407) req@ffff88009505ed80 x1830967793894400/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.514797:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505ed80 with x1830967793894400 ext(1048576->1425407) 00010000:00010000:1.0:1746147724.514803:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.514813:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793894016 00010000:00010000:1.0:1746147724.514813:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.514815:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793894016 00002000:00010000:1.0:1746147724.514819:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009505ed80 00010000:00010000:3.0:1746147724.514832:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7d116 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb434 expref: 23 pid: 6715 timeout: 903 lvb_type: 1 00000100:00100000:1.0:1746147724.514837:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1448 00000100:00100000:1.0:1746147724.514842:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967793894400:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:3.0:1746147724.514846:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793894144 00000100:00100000:3.0:1746147724.514847:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793894144 00010000:00010000:3.0:1746147724.514855:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7d219 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c7 expref: 11 pid: 4591 timeout: 903 lvb_type: 1 00000100:00100000:3.0:1746147724.514875:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8279 00000100:00100000:3.0:1746147724.514879:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967793894016:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147724.514902:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147724.514918:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7d116 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb434 expref: 23 pid: 6715 timeout: 903 lvb_type: 1 00010000:00010000:3.0:1746147724.514927:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7d116 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb434 expref: 23 pid: 6715 timeout: 903 lvb_type: 1 00010000:00010000:3.0:1746147724.514944:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7d116 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb434 expref: 23 pid: 6715 timeout: 903 lvb_type: 1 00000100:00100000:2.0:1746147724.516524:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8280 00000100:00100000:2.0:1746147724.516533:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967793894144:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.516543:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147724.516560:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7d219 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c7 expref: 11 pid: 4591 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.516567:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7d219 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c7 expref: 11 pid: 4591 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.516582:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7d219 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c7 expref: 11 pid: 4591 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.516596:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147724.516624:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967793894144:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 94us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.516630:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8280 00000100:00100000:2.0:1746147724.516805:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0436680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796432128:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147724.516814:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796432512:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.516830:0:22183:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136404600/0xe64d3fbf12a7d568 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.517034:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147724.517054:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967793894016:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2174us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.517059:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8279 00000100:00100000:1.0:1746147724.519578:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796432384:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147724.519594:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796432640:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147724.519620:0:6715:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095699400/0xe64d3fbf12a7d56f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147724.520246:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.520283:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.520369:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793895424 00000100:00100000:1.0:1746147724.520375:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793895424 00010000:00010000:1.0:1746147724.520399:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c466800/0xe64d3fbf12a7d35b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb58b expref: 19 pid: 8184 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.520408:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793895168 00000100:00100000:3.0:1746147724.520412:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793895168 00000100:00100000:1.0:1746147724.520420:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8281 00010000:00010000:3.0:1746147724.520427:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7d11d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb43b expref: 20 pid: 6715 timeout: 903 lvb_type: 1 00000100:00100000:1.0:1746147724.520427:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1958:x1830967793895424:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.520437:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147724.520444:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8282 00000100:00100000:3.0:1746147724.520449:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1958:x1830967793895168:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147724.520456:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.520456:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c466800/0xe64d3fbf12a7d35b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb58b expref: 20 pid: 8184 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.520464:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7d11d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb43b expref: 20 pid: 6715 timeout: 903 lvb_type: 1 00010000:00010000:1.0:1746147724.520466:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c466800/0xe64d3fbf12a7d35b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb58b expref: 20 pid: 8184 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.520473:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7d11d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb43b expref: 20 pid: 6715 timeout: 903 lvb_type: 1 00010000:00010000:3.0:1746147724.520485:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7d11d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb43b expref: 20 pid: 6715 timeout: 903 lvb_type: 1 00010000:00010000:1.0:1746147724.520485:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c466800/0xe64d3fbf12a7d35b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb58b expref: 20 pid: 8184 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.520496:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147724.520499:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.520694:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967793895424:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 266us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.520701:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8281 00000100:00100000:3.0:1746147724.520792:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967793895168:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 341us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.520797:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8282 00000100:00100000:0.0:1746147724.521495:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.521522:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.521544:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.521572:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.521585:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.521596:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.521615:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.521666:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793894656 00000100:00100000:2.0:1746147724.521670:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793894656 00010000:00010000:2.0:1746147724.521686:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e60400/0xe64d3fbf12a7d220 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c0 expref: 10 pid: 6715 timeout: 903 lvb_type: 1 00000100:00100000:2.0:1746147724.521698:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793894912 00000100:00100000:2.0:1746147724.521700:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793894912 00010000:00010000:2.0:1746147724.521709:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d3bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5bc expref: 10 pid: 10613 timeout: 903 lvb_type: 1 00000100:00100000:2.0:1746147724.521716:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793895296 00000100:00100000:2.0:1746147724.521718:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793895296 00010000:00010000:2.0:1746147724.521739:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7d4b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb641 expref: 22 pid: 10613 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.521751:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793894528 00000100:00100000:2.0:1746147724.521753:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793894528 00010000:00010000:2.0:1746147724.521763:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e60000/0xe64d3fbf12a7d075 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3d9 expref: 30 pid: 7050 timeout: 903 lvb_type: 1 00000100:00100000:2.0:1746147724.521770:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793894784 00000100:00100000:2.0:1746147724.521772:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793894784 00010000:00010000:2.0:1746147724.521779:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e61800/0xe64d3fbf12a7d044 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3a8 expref: 32 pid: 4591 timeout: 903 lvb_type: 1 00000100:00100000:2.0:1746147724.521785:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793895040 00000100:00100000:2.0:1746147724.521787:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793895040 00010000:00010000:2.0:1746147724.521793:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0c00/0xe64d3fbf12a7d514 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb687 expref: 11 pid: 22183 timeout: 903 lvb_type: 1 00000100:00100000:2.0:1746147724.521801:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8283 00000100:00100000:2.0:1746147724.521805:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967793894656:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.521813:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147724.521819:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8284 00010000:00010000:2.0:1746147724.521826:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e60400/0xe64d3fbf12a7d220 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c0 expref: 11 pid: 6715 timeout: 903 lvb_type: 1 00000100:00100000:1.0:1746147724.521827:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793894912:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.521833:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e60400/0xe64d3fbf12a7d220 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c0 expref: 11 pid: 6715 timeout: 903 lvb_type: 1 00010000:00010000:1.0:1746147724.521834:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.521844:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d3bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5bc expref: 10 pid: 10613 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.521851:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e60400/0xe64d3fbf12a7d220 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb4c0 expref: 11 pid: 6715 timeout: 903 lvb_type: 1 00010000:00010000:1.0:1746147724.521853:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d3bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5bc expref: 10 pid: 10613 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.521861:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147724.521864:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d3bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5bc expref: 10 pid: 10613 timeout: 903 lvb_type: 1 00010000:00010000:1.0:1746147724.521872:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147724.521880:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793894656:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 74us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.521900:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8283 00000100:00100000:1.0:1746147724.521911:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793894912:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 85us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.521912:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8285 00000100:00100000:1.0:1746147724.521917:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8284 00000100:00100000:2.0:1746147724.521918:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967793895296:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.521926:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147724.521929:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8286 00000100:00100000:1.0:1746147724.521934:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967793894528:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.521935:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7d4b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb641 expref: 22 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.521940:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147724.521942:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7d4b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb641 expref: 22 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.521948:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e60000/0xe64d3fbf12a7d075 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3d9 expref: 30 pid: 7050 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.521954:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7d4b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb641 expref: 22 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.521955:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e60000/0xe64d3fbf12a7d075 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3d9 expref: 30 pid: 7050 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.521963:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147724.521966:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e60000/0xe64d3fbf12a7d075 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3d9 expref: 30 pid: 7050 timeout: 903 lvb_type: 1 00010000:00010000:1.0:1746147724.521974:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147724.521976:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967793895296:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 59us (403us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147724.521976:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147724.521980:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8285 00010000:00010000:1.0:1746147724.521980:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d553 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.521987:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d553 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147724.522002:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8287 00010000:00010000:1.0:1746147724.522005:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147724.522007:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793894784:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.522011:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147724.522018:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e61800/0xe64d3fbf12a7d044 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3a8 expref: 32 pid: 4591 timeout: 903 lvb_type: 1 00000100:00100000:1.0:1746147724.522022:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967793894528:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 87us (435us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147724.522025:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e61800/0xe64d3fbf12a7d044 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3a8 expref: 32 pid: 4591 timeout: 903 lvb_type: 1 00000100:00100000:1.0:1746147724.522027:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8286 00010000:00010000:2.0:1746147724.522034:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e61800/0xe64d3fbf12a7d044 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb3a8 expref: 32 pid: 4591 timeout: 903 lvb_type: 1 00000100:00100000:1.0:1746147724.522038:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8288 00000100:00100000:1.0:1746147724.522042:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793895040:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.522047:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.522048:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.522048:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147724.522051:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d54c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.522056:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d54c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.522056:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0c00/0xe64d3fbf12a7d514 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb687 expref: 9 pid: 22183 timeout: 903 lvb_type: 1 00010000:00010000:1.0:1746147724.522068:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0c00/0xe64d3fbf12a7d514 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb687 expref: 9 pid: 22183 timeout: 903 lvb_type: 1 00010000:00010000:2.0:1746147724.522069:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147724.522078:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0c00/0xe64d3fbf12a7d514 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb687 expref: 9 pid: 22183 timeout: 903 lvb_type: 1 00000100:00100000:2.0:1746147724.522081:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967793894784:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 74us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.522085:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8287 00010000:00010000:1.0:1746147724.522085:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.522100:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793895040:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 57us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.522101:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793894272 00000100:00100000:2.0:1746147724.522104:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793894272 00000100:00100000:1.0:1746147724.522104:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8288 00010000:00010000:1.0:1746147724.522120:0:9615:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d54c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147724.522121:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x455:0x0] (1662976->2097151) req@ffff8800956b6d80 x1830967793894272/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746147724.522127:0:9615:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d54c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147724.522128:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b6d80 with x1830967793894272 ext(1662976->2097151) 00010000:00010000:2.0:1746147724.522134:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 29 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.522142:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 29 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.522143:0:9615:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d54c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147724.522147:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800956b6d80 00010000:00010000:1.0:1746147724.522150:0:9615:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d54c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.522156:0:9615:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d54c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147724.522158:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1449 00000100:00100000:2.0:1746147724.522162:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967793894272:12345-192.168.202.10@tcp:4:multiop.0 00010000:00010000:1.0:1746147724.522162:0:9615:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd14400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147724.522166:0:9615:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d54c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.522172:0:9615:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d54c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.522181:0:9615:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d54c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.522186:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d54c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.522222:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793893248:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 15791us (16090us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.522228:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16332 00010000:00010000:0.0:1746147724.524326:0:7050:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d553 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.524339:0:7050:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d553 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.524359:0:7050:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d553 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.524365:0:7050:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d553 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.524371:0:7050:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d553 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.524376:0:7050:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02e4c00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147724.524379:0:7050:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d553 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.524385:0:7050:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d553 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.524396:0:7050:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d553 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.524402:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d553 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147724.524472:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793893376:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 18035us (18303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147724.524479:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16333 00000100:00100000:3.0:1746147724.524568:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.524639:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793895552 00000100:00100000:3.0:1746147724.524643:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793895552 00010000:00010000:3.0:1746147724.524660:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7d47a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb61e expref: 31 pid: 4591 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.524679:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8289 00000100:00100000:3.0:1746147724.524684:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967793895552:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147724.524691:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147724.524701:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7d47a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb61e expref: 31 pid: 4591 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.524708:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7d47a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb61e expref: 31 pid: 4591 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.524719:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7d47a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb61e expref: 31 pid: 4591 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.524739:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.524741:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.524744:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136404600/0xe64d3fbf12a7d568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.524754:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136404600/0xe64d3fbf12a7d568 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.524776:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147724.524793:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967793895552:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 109us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.524798:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8289 00010000:00010000:2.0:1746147724.524853:0:22183:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136404600/0xe64d3fbf12a7d568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.524860:0:22183:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136404600/0xe64d3fbf12a7d568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.524873:0:22183:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136404600/0xe64d3fbf12a7d568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.524879:0:22183:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136404600/0xe64d3fbf12a7d568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.524909:0:22183:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136404600/0xe64d3fbf12a7d568 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.524914:0:22183:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136404600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147724.524916:0:22183:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136404600/0xe64d3fbf12a7d568 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.524921:0:22183:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136404600/0xe64d3fbf12a7d568 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.524931:0:22183:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136404600/0xe64d3fbf12a7d568 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.524935:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136404600/0xe64d3fbf12a7d568 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147724.524971:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967793893760:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 17857us (17896us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.524977:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16336 00000100:00100000:2.0:1746147724.528233:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.528716:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793895680 00000100:00100000:3.0:1746147724.528731:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793895680 00010000:00010000:3.0:1746147724.528756:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134b2fe00/0xe64d3fbf12a7d418 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5e6 expref: 31 pid: 8184 timeout: 903 lvb_type: 1 00000100:00100000:3.0:1746147724.528779:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8290 00000100:00100000:3.0:1746147724.528785:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1957:x1830967793895680:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147724.528795:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147724.528812:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134b2fe00/0xe64d3fbf12a7d418 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5e6 expref: 31 pid: 8184 timeout: 903 lvb_type: 1 00010000:00010000:3.0:1746147724.528821:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134b2fe00/0xe64d3fbf12a7d418 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5e6 expref: 31 pid: 8184 timeout: 903 lvb_type: 1 00010000:00010000:3.0:1746147724.528840:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134b2fe00/0xe64d3fbf12a7d418 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5e6 expref: 31 pid: 8184 timeout: 903 lvb_type: 1 00010000:00010000:3.0:1746147724.528852:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.528853:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.528857:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095699400/0xe64d3fbf12a7d56f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.528869:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095699400/0xe64d3fbf12a7d56f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.528907:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147724.528938:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967793895680:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 153us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.528945:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8290 00010000:00010000:0.0:1746147724.529020:0:6715:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095699400/0xe64d3fbf12a7d56f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.529027:0:6715:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095699400/0xe64d3fbf12a7d56f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.529045:0:6715:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095699400/0xe64d3fbf12a7d56f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.529052:0:6715:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095699400/0xe64d3fbf12a7d56f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.529059:0:6715:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095699400/0xe64d3fbf12a7d56f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.529064:0:6715:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095699400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147724.529067:0:6715:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095699400/0xe64d3fbf12a7d56f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.529073:0:6715:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095699400/0xe64d3fbf12a7d56f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.529083:0:6715:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095699400/0xe64d3fbf12a7d56f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.529088:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095699400/0xe64d3fbf12a7d56f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147724.529149:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967793893888:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 21980us (22037us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147724.529156:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16337 00000100:00100000:1.0:1746147724.530053:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967793894400:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 15209us (15371us total) trans 17179874330 rc 0/0 00000100:00100000:1.0:1746147724.530063:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1448 00002000:00100000:1.0:1746147724.530070:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1425407) req@ffff88009505ed80 x1830967793894400/t17179874330(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/448 e 0 to 0 dl 1746147735 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.530077:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505ed80 with x1830967793894400 ext(1048576->1425407) 00010000:00010000:1.0:1746147724.530083:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.530092:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00002000:00010000:1.0:1746147724.530103:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009505ed80 00000100:00100000:2.0:1746147724.534516:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967793894272:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 12345us (13013us total) trans 21474841560 rc 0/0 00000100:00100000:2.0:1746147724.534526:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1449 00002000:00100000:2.0:1746147724.534536:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x455:0x0] (1662976->2097151) req@ffff8800956b6d80 x1830967793894272/t21474841560(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/448 e 0 to 0 dl 1746147735 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.534545:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b6d80 with x1830967793894272 ext(1662976->2097151) 00010000:00010000:2.0:1746147724.534552:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 30 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.534563:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 30 pid: 10613 timeout: 903 lvb_type: 0 00002000:00010000:2.0:1746147724.534569:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800956b6d80 00000100:00100000:0.0:1746147724.535701:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.535800:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793895808 00000100:00100000:3.0:1746147724.535805:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793895808 00010000:00010000:3.0:1746147724.535828:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.535846:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8291 00000100:00100000:3.0:1746147724.535852:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967793895808:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147724.535862:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147724.535878:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.535912:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.535930:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d4e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb66b expref: 30 pid: 7050 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.535943:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.535945:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.535948:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d561 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.535956:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d561 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.535977:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147724.536002:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967793895808:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 149us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.536007:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8291 00010000:00010000:1.0:1746147724.540848:0:10613:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d561 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.540863:0:10613:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d561 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.540904:0:10613:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d561 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.540910:0:10613:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d561 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.540916:0:10613:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d561 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.540921:0:10613:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a9213a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147724.540924:0:10613:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d561 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.540931:0:10613:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d561 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.540946:0:10613:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d561 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147724.540954:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147724.540955:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d561 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147724.540988:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793895936 00000100:00100000:0.0:1746147724.540994:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793895936 00000100:00100000:1.0:1746147724.541015:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+5:1960:x1830967793893632:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 34086us (34794us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147724.541016:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 30 pid: 10613 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746147724.541023:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16335 00000100:00100000:0.0:1746147724.541036:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8292 00000100:00100000:0.0:1746147724.541042:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6671850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967793895936:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147724.541052:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147724.541065:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 30 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.541073:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 30 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.541088:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d4dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb664 expref: 30 pid: 10613 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.541099:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.541100:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.541104:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d55a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.541111:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d55a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.541138:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147724.541154:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6671850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967793895936:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 112us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147724.541160:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8292 00010000:00010000:3.0:1746147724.541321:0:8184:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d55a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.541329:0:8184:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d55a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.541342:0:8184:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d55a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.541347:0:8184:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d55a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.541353:0:8184:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d55a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.541357:0:8184:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02e5800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147724.541359:0:8184:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d55a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.541369:0:8184:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d55a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.541378:0:8184:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d55a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.541384:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d55a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147724.541422:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967793893504:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 34829us (35225us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.541427:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16334 00000100:00100000:0.0:1746147724.544086:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.546368:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793896192 00000100:00100000:3.0:1746147724.546379:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793896192 00000100:00100000:3.0:1746147724.546441:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11978 00000100:00100000:3.0:1746147724.546449:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+14:32129:x1830967793896192:12345-192.168.202.10@tcp:36:mirror_io.0 00010000:00010000:3.0:1746147724.546492:0:14546:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147724.546516:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7d545 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb69c expref: 14 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.546531:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147724.546535:0:14546:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147724.546561:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.546572:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7d0f3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb411 expref: 338 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.546579:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7d0fa lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb418 expref: 21 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.546585:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7d45e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb609 expref: 21 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.546591:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8600/0xe64d3fbf12a7d1b0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb48f expref: 21 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.546596:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d3ee lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ca expref: 338 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.546601:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.546628:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d3ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ca expref: 338 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.546638:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d3ee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ca expref: 338 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.546649:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796432768:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.546749:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8600/0xe64d3fbf12a7d1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb48f expref: 21 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.546757:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8600/0xe64d3fbf12a7d1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb48f expref: 21 pid: 5744 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.546768:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796432896:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.546792:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7d45e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb609 expref: 21 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.546799:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7d45e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb609 expref: 21 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.546804:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796433024:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.546820:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7d0fa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb418 expref: 21 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.546826:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7d0fa lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb418 expref: 21 pid: 14546 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.546832:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796433152:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.546849:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7d0f3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb411 expref: 338 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.546855:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7d0f3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb411 expref: 338 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.546861:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796433280:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.546873:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147724.551287:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796432896:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147724.551876:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.552052:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796433024:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.552061:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796433152:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.552067:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796433280:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147724.552185:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.552212:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.552235:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.552400:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793896320 00000100:00100000:3.0:1746147724.552405:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793896320 00010000:00010000:3.0:1746147724.552436:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8600/0xe64d3fbf12a7d1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb48f expref: 22 pid: 5744 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.552458:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793896704 00000100:00100000:3.0:1746147724.552460:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793896704 00000100:00100000:1.0:1746147724.552461:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793896832 00000100:00100000:1.0:1746147724.552465:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793896832 00010000:00010000:3.0:1746147724.552467:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7d0fa lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb418 expref: 23 pid: 14546 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.552481:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7d0f3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb411 expref: 339 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746147724.552530:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8293 00000100:00100000:1.0:1746147724.552537:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967793896320:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147724.552538:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793896576 00000100:00100000:2.0:1746147724.552542:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793896576 00010000:00010000:1.0:1746147724.552548:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.552554:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8600/0xe64d3fbf12a7d1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb48f expref: 24 pid: 5744 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.552563:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4979 00010000:00010000:1.0:1746147724.552564:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8600/0xe64d3fbf12a7d1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb48f expref: 24 pid: 5744 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.552568:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:23727:x1830967793896576:12345-192.168.202.10@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1746147724.552583:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8600/0xe64d3fbf12a7d1b0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb48f expref: 24 pid: 5744 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.552596:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147724.552601:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147724.552612:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.552647:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967793896320:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 110us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.552653:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8293 00000100:00100000:1.0:1746147724.552671:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8294 00000100:00100000:1.0:1746147724.552676:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967793896704:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.552682:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.552686:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7d0fa lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb418 expref: 23 pid: 14546 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.552694:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7d0fa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb418 expref: 23 pid: 14546 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.552703:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7d0fa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb418 expref: 23 pid: 14546 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.552711:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147724.552714:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147724.552719:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147724.552742:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:23727:x1830967793896576:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 172us (866us total) trans 8589945989 rc 0/0 00000100:00100000:1.0:1746147724.552746:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967793896704:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 69us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.552747:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4979 00000100:00100000:1.0:1746147724.552751:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8294 00000100:00100000:1.0:1746147724.552762:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8295 00000100:00100000:1.0:1746147724.552767:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:1960:x1830967793896832:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.552775:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.552778:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7d0f3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb411 expref: 339 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.552786:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7d0f3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb411 expref: 339 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.552796:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009527ba00/0xe64d3fbf12a7d0f3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb411 expref: 339 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.552804:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147724.552807:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147724.552812:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147724.552818:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796432768:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147724.552824:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+338:1960:x1830967793896832:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 57us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.552829:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8295 00010000:00010000:3.0:1746147724.552840:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147724.554248:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.554302:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.554717:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793896960 00000100:00100000:1.0:1746147724.554730:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793896960 00010000:00010000:1.0:1746147724.554750:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d3ee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ca expref: 338 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746147724.554766:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793897088 00000100:00100000:1.0:1746147724.554768:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793897088 00010000:00010000:1.0:1746147724.554774:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7d45e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb609 expref: 21 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746147724.554797:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8296 00000100:00100000:1.0:1746147724.554803:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+338:1960:x1830967793896960:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.554813:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.554818:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d3ee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ca expref: 338 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.554826:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d3ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ca expref: 338 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.554839:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d3ee lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb5ca expref: 338 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.554849:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147724.554853:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147724.554859:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.554881:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+337:1960:x1830967793896960:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 78us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.554906:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8296 00000100:00100000:1.0:1746147724.554918:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8297 00000100:00100000:1.0:1746147724.554923:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967793897088:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.554929:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.554933:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7d45e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb609 expref: 21 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.554941:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7d45e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb609 expref: 21 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.554955:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7d45e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb609 expref: 21 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.554963:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147724.554965:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147724.554970:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147724.554976:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147724.554990:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.555002:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793897088:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 79us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.555007:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8297 00010000:00010000:3.0:1746147724.555374:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147724.555381:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000040:00080000:3.0:1746147724.555939:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3631, 88 off303896 00000004:00080000:3.0:1746147724.555946:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803730060482ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147724.555995:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3644, 88 off304688 00000004:00080000:3.0:1746147724.556000:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803730114973ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147724.556010:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3645, 88 off304776 00000004:00080000:3.0:1746147724.556013:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803730128076ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147724.556019:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3632, 88 off303984 00000004:00080000:3.0:1746147724.556022:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803730137770ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147724.556028:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3633, 88 off304072 00000004:00080000:3.0:1746147724.556030:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803730145515ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147724.556035:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3646, 88 off304864 00000004:00080000:3.0:1746147724.556038:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803730153150ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147724.556043:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3647, 88 off304952 00000004:00080000:3.0:1746147724.556046:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803730160892ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147724.556051:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3648, 88 off305040 00000004:00080000:3.0:1746147724.556053:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803730168551ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147724.556058:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3634, 88 off304160 00000004:00080000:3.0:1746147724.556061:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803730176176ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147724.556065:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3649, 88 off305128 00000004:00080000:3.0:1746147724.556067:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803730182811ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147724.556072:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3635, 88 off304248 00000004:00080000:3.0:1746147724.556074:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803730189996ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147724.556079:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3650, 88 off305216 00000004:00080000:3.0:1746147724.556081:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803730196745ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147724.556086:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3636, 88 off304336 00000004:00080000:3.0:1746147724.556088:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803730203910ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147724.556094:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3637, 88 off304424 00000004:00080000:3.0:1746147724.556096:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803730211208ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147724.556101:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3638, 88 off304512 00000004:00080000:3.0:1746147724.556103:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803730218606ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147724.556109:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3639, 88 off304600 00000004:00080000:3.0:1746147724.556111:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803730226881ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147724.556117:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3651, 88 off305304 00000004:00080000:3.0:1746147724.556120:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803730235333ns, next at 756024029964ns, rc = 0 00000001:00080000:0.0:1746147724.582769:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945984 is committed 00000001:00080000:0.0:1746147724.582780:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945977 is committed 00000001:00080000:0.0:1746147724.582786:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945972 is committed 00000001:00080000:0.0:1746147724.582793:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945983 is committed 00000001:00080000:0.0:1746147724.582796:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945980 is committed 00000001:00080000:0.0:1746147724.582814:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945989 is committed 00000001:00080000:0.0:1746147724.582817:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945988 is committed 00000001:00080000:0.0:1746147724.582820:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945987 is committed 00000001:00080000:0.0:1746147724.582845:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945990 is committed 00000004:00080000:0.0:1746147724.582848:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2719 committed 00000004:00080000:0.0:1746147724.582854:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2707 committed 00000004:00080000:0.0:1746147724.582859:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2706 committed 00000004:00080000:0.0:1746147724.582861:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2705 committed 00000004:00080000:0.0:1746147724.582862:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2704 committed 00000004:00080000:0.0:1746147724.582863:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2718 committed 00000004:00080000:0.0:1746147724.582865:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2703 committed 00000004:00080000:0.0:1746147724.582866:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2717 committed 00000004:00080000:0.0:1746147724.582867:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2702 committed 00000004:00080000:0.0:1746147724.582868:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2716 committed 00000004:00080000:0.0:1746147724.582869:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2715 committed 00000004:00080000:0.0:1746147724.582871:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2714 committed 00000004:00080000:0.0:1746147724.582873:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2701 committed 00000004:00080000:0.0:1746147724.582874:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2700 committed 00000004:00080000:0.0:1746147724.582875:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2713 committed 00000004:00080000:0.0:1746147724.582876:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2712 committed 00000004:00080000:0.0:1746147724.582877:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2699 committed 00000100:00100000:0.0:1746147724.582991:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796433408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.583043:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147724.583078:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796433920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.583092:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147724.583108:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147724.583112:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796433536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.583124:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147724.583135:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796434048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.583144:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147724.583164:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796433408 00000100:00100000:0.0:1746147724.583170:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796433408 00000100:00100000:0.0:1746147724.583196:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796433920 00000100:00100000:0.0:1746147724.583198:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796433920 00000100:00100000:0.0:1746147724.583208:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796433536 00000100:00100000:0.0:1746147724.583209:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796433536 00000100:00100000:0.0:1746147724.583218:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796434048 00000100:00100000:0.0:1746147724.583219:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796434048 00000100:00100000:0.0:1746147724.583229:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16338 00000100:00100000:0.0:1746147724.583235:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3301:x1830967796433408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.583404:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3301:x1830967796433408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (360us total) trans 17179874331 rc 0/0 00000100:00100000:0.0:1746147724.583410:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16338 00000100:00100000:0.0:1746147724.583425:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16339 00000100:00100000:0.0:1746147724.583429:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3301:x1830967796433920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.583503:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3301:x1830967796433920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (409us total) trans 17179874332 rc 0/0 00000100:00100000:0.0:1746147724.583509:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16339 00000100:00100000:0.0:1746147724.583518:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16340 00000100:00100000:0.0:1746147724.583521:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3301:x1830967796433536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.583609:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3301:x1830967796433536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (483us total) trans 17179874333 rc 0/0 00000100:00100000:0.0:1746147724.583614:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16340 00000100:00100000:0.0:1746147724.583623:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16341 00000100:00100000:0.0:1746147724.583627:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3301:x1830967796434048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.583690:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3301:x1830967796434048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (544us total) trans 17179874334 rc 0/0 00000100:00100000:0.0:1746147724.583694:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16341 00000004:00080000:0.0:1746147724.583739:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b6300/2, rc 0, transno 17179874333 00000100:00100000:0.0:1746147724.583747:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796433536:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147724.583754:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d7b80/2, rc 0, transno 17179874334 00000100:00100000:0.0:1746147724.583757:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796434048:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147724.583761:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b4380/2, rc 0, transno 17179874331 00000100:00100000:0.0:1746147724.583763:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796433408:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147724.583768:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d5500/2, rc 0, transno 17179874332 00000100:00100000:0.0:1746147724.583770:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796433920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.583794:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796434432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.583811:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147724.583826:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796434432 00000100:00100000:0.0:1746147724.583829:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796434432 00000100:00100000:0.0:1746147724.583841:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16342 00000100:00100000:0.0:1746147724.583845:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3301:x1830967796434432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.583941:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3301:x1830967796434432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (128us total) trans 17179874335 rc 0/0 00000100:00100000:0.0:1746147724.583946:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16342 00000004:00080000:0.0:1746147724.583964:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d6680/2, rc 0, transno 17179874335 00000100:00100000:0.0:1746147724.583967:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796434432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147724.584139:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796433792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147724.584160:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.584190:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796434304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147724.584204:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.584214:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796434816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.584227:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.584237:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796435328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.584248:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.584258:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746147724.584262:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796433664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147724.584273:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.584282:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796434176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147724.584292:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.584300:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796434688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.584309:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.584317:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796435200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.584325:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.584340:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796433792 00000100:00100000:1.0:1746147724.584342:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796433792 00000100:00100000:1.0:1746147724.584355:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796434304 00000100:00100000:1.0:1746147724.584356:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796434304 00000100:00100000:1.0:1746147724.584362:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796434816 00000100:00100000:1.0:1746147724.584363:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796434816 00000100:00100000:1.0:1746147724.584369:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796435328 00000100:00100000:1.0:1746147724.584370:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796435328 00000100:00100000:1.0:1746147724.584375:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796433664 00000100:00100000:1.0:1746147724.584376:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796433664 00000100:00100000:1.0:1746147724.584381:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796434176 00000100:00100000:1.0:1746147724.584382:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796434176 00000100:00100000:1.0:1746147724.584386:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796434688 00000100:00100000:1.0:1746147724.584387:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796434688 00000100:00100000:1.0:1746147724.584393:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796435200 00000100:00100000:1.0:1746147724.584394:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796435200 00000100:00100000:1.0:1746147724.584399:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16343 00000100:00100000:1.0:1746147724.584403:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3304:x1830967796433792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147724.584475:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3304:x1830967796433792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (315us total) trans 17179874336 rc 0/0 00000100:00100000:1.0:1746147724.584480:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16343 00000100:00100000:1.0:1746147724.584489:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16344 00000100:00100000:1.0:1746147724.584493:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3304:x1830967796434304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147724.584564:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3304:x1830967796434304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (359us total) trans 17179874337 rc 0/0 00000100:00100000:1.0:1746147724.584569:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16344 00000100:00100000:1.0:1746147724.584576:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16345 00000100:00100000:1.0:1746147724.584579:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3304:x1830967796434816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.584675:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3304:x1830967796434816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (446us total) trans 21474841561 rc 0/0 00000100:00100000:1.0:1746147724.584680:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16345 00000100:00100000:1.0:1746147724.584688:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16346 00000100:00100000:1.0:1746147724.584692:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3304:x1830967796435328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.584769:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3304:x1830967796435328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (520us total) trans 21474841562 rc 0/0 00000100:00100000:1.0:1746147724.584774:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16346 00000100:00100000:1.0:1746147724.584782:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16347 00000100:00100000:1.0:1746147724.584786:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3304:x1830967796433664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147724.584854:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3304:x1830967796433664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (580us total) trans 17179874338 rc 0/0 00000100:00100000:1.0:1746147724.584859:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16347 00000100:00100000:1.0:1746147724.584868:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16348 00000100:00100000:1.0:1746147724.584871:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3304:x1830967796434176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147724.584960:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3304:x1830967796434176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (666us total) trans 17179874339 rc 0/0 00000100:00100000:1.0:1746147724.584965:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16348 00000100:00100000:1.0:1746147724.584974:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16349 00000100:00100000:1.0:1746147724.584977:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3304:x1830967796434688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.585047:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3304:x1830967796434688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (736us total) trans 21474841563 rc 0/0 00000100:00100000:1.0:1746147724.585051:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16349 00000100:00100000:1.0:1746147724.585059:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16350 00000100:00100000:1.0:1746147724.585063:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3304:x1830967796435200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.585124:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3304:x1830967796435200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (798us total) trans 21474841564 rc 0/0 00000100:00100000:1.0:1746147724.585129:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16350 00000004:00080000:1.0:1746147724.585157:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b4a80/2, rc 0, transno 17179874338 00000100:00100000:1.0:1746147724.585160:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796433664:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147724.585165:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d7100/2, rc 0, transno 17179874339 00000100:00100000:1.0:1746147724.585168:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796434176:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147724.585174:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f517b80/2, rc 0, transno 21474841563 00000100:00100000:1.0:1746147724.585178:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796434688:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147724.585182:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f516300/2, rc 0, transno 21474841564 00000100:00100000:1.0:1746147724.585184:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796435200:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147724.585190:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b4e00/2, rc 0, transno 17179874336 00000100:00100000:1.0:1746147724.585192:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796433792:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147724.585197:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d4700/2, rc 0, transno 17179874337 00000100:00100000:1.0:1746147724.585199:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796434304:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147724.585204:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f514000/2, rc 0, transno 21474841561 00000100:00100000:1.0:1746147724.585206:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796434816:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147724.585211:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f514380/2, rc 0, transno 21474841562 00000100:00100000:1.0:1746147724.585213:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796435328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.585224:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796434944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.585239:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.585263:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796435456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.585275:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.585284:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746147724.585288:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796434560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.585298:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.585306:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796435072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.585316:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.585328:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796434944 00000100:00100000:1.0:1746147724.585330:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796434944 00000100:00100000:1.0:1746147724.585343:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796435456 00000100:00100000:1.0:1746147724.585344:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796435456 00000100:00100000:1.0:1746147724.585351:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796434560 00000100:00100000:1.0:1746147724.585352:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796434560 00000100:00100000:1.0:1746147724.585356:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796435072 00000100:00100000:1.0:1746147724.585358:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796435072 00000100:00100000:1.0:1746147724.585364:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16351 00000100:00100000:1.0:1746147724.585368:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3301:x1830967796434944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.585443:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3301:x1830967796434944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (203us total) trans 21474841565 rc 0/0 00000100:00100000:1.0:1746147724.585448:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16351 00000100:00100000:1.0:1746147724.585456:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16352 00000100:00100000:1.0:1746147724.585460:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3301:x1830967796435456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.585524:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3301:x1830967796435456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (248us total) trans 21474841566 rc 0/0 00000100:00100000:1.0:1746147724.585529:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16352 00000100:00100000:1.0:1746147724.585537:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16353 00000100:00100000:1.0:1746147724.585540:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3301:x1830967796434560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.585607:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3301:x1830967796434560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (307us total) trans 21474841567 rc 0/0 00000100:00100000:1.0:1746147724.585612:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16353 00000100:00100000:1.0:1746147724.585620:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16354 00000100:00100000:1.0:1746147724.585623:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3301:x1830967796435072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147724.585685:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:1.0:1746147724.585688:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147724.585690:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147724.585692:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147724.585694:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:1.0:1746147724.585710:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3301:x1830967796435072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (393us total) trans 21474841568 rc 0/0 00000100:00100000:1.0:1746147724.585715:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16354 00000004:00080000:1.0:1746147724.585750:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f515c00/2, rc 0, transno 21474841567 00000100:00100000:1.0:1746147724.585753:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796434560:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147724.585758:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f517800/2, rc 0, transno 21474841568 00000100:00100000:1.0:1746147724.585761:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796435072:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147724.585766:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f516680/2, rc 0, transno 21474841565 00000100:00100000:1.0:1746147724.585768:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796434944:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147724.585773:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f517480/2, rc 0, transno 21474841566 00000100:00100000:1.0:1746147724.585776:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796435456:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746147724.585989:0:14546:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800956b5f80 reply state ffff8800a04c8400 transno 8589945990 ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:3.0:1746147724.585997:0:14546:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746147724.586061:0:14546:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147724.586084:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+8:32129:x1830967793896192:12345-192.168.202.10@tcp:36:mirror_io.0 Request processed in 39634us (42002us total) trans 8589945990 rc 0/0 00000100:00100000:3.0:1746147724.586090:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11978 00010000:00010000:2.0:1746147724.586142:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.586149:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.586154:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.586159:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136404e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147724.586162:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.586168:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.586179:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147724.586182:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147724.586185:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.586190:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136404e00/0xe64d3fbf12a7d576 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147724.588382:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.588645:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793897216 00000100:00100000:3.0:1746147724.588651:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793897216 00000100:00100000:3.0:1746147724.588872:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11979 00000100:00100000:3.0:1746147724.588880:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+7:32129:x1830967793897216:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147724.588920:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.588934:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7d57d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb6a3 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.588980:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7d57d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6a3 expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.588990:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7d57d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6a3 expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.589003:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147724.589005:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147724.589007:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fc4c00, rc 0) 00000100:00100000:3.0:1746147724.589044:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+8:32129:x1830967793897216:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 165us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.589049:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11979 00000100:00100000:0.0:1746147724.598217:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.598380:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793897344 00000100:00100000:3.0:1746147724.598388:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793897344 00000100:00100000:3.0:1746147724.598433:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 906 00000100:00100000:3.0:1746147724.598440:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+8:32129:x1830967793897344:12345-192.168.202.10@tcp:103:mirror_io.0 00010000:00010000:3.0:1746147724.598456:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147724.598478:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213e00/0xe64d3fbf12a7d537 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb695 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.598492:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147724.598496:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147724.598533:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+7:32129:x1830967793897344:12345-192.168.202.10@tcp:103:mirror_io.0 Request processed in 93us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.598539:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 906 00000100:00100000:0.0:1746147724.602044:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.603036:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793897600 00000100:00100000:2.0:1746147724.603044:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793897600 00000100:00100000:2.0:1746147724.603099:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4980 00000100:00100000:2.0:1746147724.603106:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6668450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+7:32129:x1830967793897600:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147724.603530:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6668450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+8:32129:x1830967793897600:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 424us (1492us total) trans 8589945991 rc 0/0 00000100:00100000:2.0:1746147724.603537:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4980 00000100:00100000:0.0:1746147724.610961:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.611045:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.611259:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793897856 00000100:00100000:3.0:1746147724.611267:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793897856 00000100:00100000:3.0:1746147724.611301:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4981 00000100:00100000:3.0:1746147724.611308:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+8:32129:x1830967793897856:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147724.611502:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+9:32129:x1830967793897856:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 192us (546us total) trans 8589945992 rc 0/0 00000100:00100000:3.0:1746147724.611508:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4981 00000100:00100000:0.0:1746147724.611842:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793898112 00000100:00100000:0.0:1746147724.611846:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793898112 00000100:00100000:0.0:1746147724.611879:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11980 00000100:00100000:0.0:1746147724.611905:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:32133:x1830967793898112:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147724.611916:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147724.611930:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094080400/0xe64d3fbf12a7d584 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb6aa expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.611997:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094080600/0xe64d3fbf12a7d58b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612007:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094080600/0xe64d3fbf12a7d58b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612017:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094080600/0xe64d3fbf12a7d58b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612028:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094080e00/0xe64d3fbf12a7d592 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612033:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094080e00/0xe64d3fbf12a7d592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612037:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094080e00/0xe64d3fbf12a7d592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612114:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094081a00/0xe64d3fbf12a7d599 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612121:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094081a00/0xe64d3fbf12a7d599 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612126:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094081a00/0xe64d3fbf12a7d599 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:0.0:1746147724.612133:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147724.612375:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094080600/0xe64d3fbf12a7d58b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612381:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094080600/0xe64d3fbf12a7d58b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612385:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094080600/0xe64d3fbf12a7d58b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612390:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094080600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147724.612393:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094080600/0xe64d3fbf12a7d58b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612399:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094080600/0xe64d3fbf12a7d58b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612407:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147724.612409:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147724.612412:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094080600/0xe64d3fbf12a7d58b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612416:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094080600/0xe64d3fbf12a7d58b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612439:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094080e00/0xe64d3fbf12a7d592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612444:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094080e00/0xe64d3fbf12a7d592 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612448:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094080e00/0xe64d3fbf12a7d592 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612452:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094080e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147724.612454:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094080e00/0xe64d3fbf12a7d592 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612458:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094080e00/0xe64d3fbf12a7d592 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612464:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06eeb00) 00010000:00010000:0.0:1746147724.612466:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147724.612468:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094080e00/0xe64d3fbf12a7d592 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612475:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094080e00/0xe64d3fbf12a7d592 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147724.612504:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094080400/0xe64d3fbf12a7d584 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6aa expref: 325 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.612514:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094081a00/0xe64d3fbf12a7d599 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6aa expref: 324 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.612520:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147724.612521:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147724.612523:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094081a00, rc 0) 00000100:00100000:0.0:1746147724.612555:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32133:x1830967793898112:12345-192.168.202.10@tcp:101:cat.0 Request processed in 670us (1508us total) trans 8589945993 rc 0/0 00000100:00100000:0.0:1746147724.612561:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11980 00000100:00100000:0.0:1746147724.618874:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.618919:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793898368 00000100:00100000:1.0:1746147724.618927:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793898368 00000100:00100000:1.0:1746147724.618977:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4982 00000100:00100000:1.0:1746147724.618984:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32133:x1830967793898368:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:1.0:1746147724.619181:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32133:x1830967793898368:12345-192.168.202.10@tcp:35:cat.0 Request processed in 196us (315us total) trans 8589945994 rc 0/0 00000100:00100000:1.0:1746147724.619187:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4982 00000100:00100000:0.0:1746147724.622134:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.622167:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.622197:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.622208:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.622219:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.622256:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.622460:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793898624 00000100:00100000:2.0:1746147724.622468:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793898624 00000100:00100000:2.0:1746147724.622499:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793898880 00000100:00100000:2.0:1746147724.622501:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793898880 00000100:00100000:2.0:1746147724.622512:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793898496 00000100:00100000:2.0:1746147724.622513:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793898496 00000100:00100000:2.0:1746147724.622521:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793899136 00000100:00100000:2.0:1746147724.622522:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793899136 00000100:00100000:2.0:1746147724.622532:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793898752 00000100:00100000:2.0:1746147724.622533:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793898752 00000100:00100000:2.0:1746147724.622541:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793899008 00000100:00100000:2.0:1746147724.622543:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793899008 00000100:00100000:2.0:1746147724.622555:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16355 00000100:00100000:2.0:1746147724.622561:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967793898624:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147724.622575:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.622591:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9213c00/0xe64d3fbf12a7d5a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb6b8 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147724.622612:0:21480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x6814198b, atime: 0x6814198b, ctime: 0x6814198b, blocks: 0x81f 00010000:00010000:2.0:1746147724.622627:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.622628:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.622635:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9213c00/0xe64d3fbf12a7d5a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b8 expref: 32 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.622647:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a9213c00/0xe64d3fbf12a7d5a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b8 expref: 32 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.622656:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9213c00, rc 0) 00000100:00100000:2.0:1746147724.622690:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793898624:12345-192.168.202.10@tcp:101:cat.0 Request processed in 129us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.622695:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16355 00000100:00100000:2.0:1746147724.622708:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16356 00000100:00100000:2.0:1746147724.622713:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967793898880:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147724.622719:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.622738:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d5ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb6c6 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147724.622751:0:21480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x6814198d, atime: 0x6814198d, ctime: 0x6814198d, blocks: 0x821 00010000:00010000:2.0:1746147724.622758:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.622759:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.622762:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d5ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6c6 expref: 32 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.622770:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d5ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6c6 expref: 32 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.622776:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9213a00, rc 0) 00000100:00100000:2.0:1746147724.622790:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793898880:12345-192.168.202.10@tcp:101:cat.0 Request processed in 77us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.622794:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16356 00000100:00100000:2.0:1746147724.622803:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16357 00000100:00100000:2.0:1746147724.622808:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967793898496:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147724.622812:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.622818:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7d5b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb6b1 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147724.622827:0:21480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x6814198b, atime: 0x6814198b, ctime: 0x6814198b, blocks: 0x79f 00010000:00010000:2.0:1746147724.622835:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.622836:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.622839:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7d5b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b1 expref: 32 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.622846:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7d5b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b1 expref: 32 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.622852:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8000, rc 0) 00000100:00100000:2.0:1746147724.622864:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793898496:12345-192.168.202.10@tcp:101:cat.0 Request processed in 57us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.622869:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16357 00000100:00100000:2.0:1746147724.622876:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16358 00000100:00100000:2.0:1746147724.622879:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967793899136:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147724.622913:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.622920:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d5bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb6d4 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147724.622930:0:21480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x456:0x0] initial LVB size: 4194304, mtime: 0x6814198c, atime: 0x6814198c, ctime: 0x6814198c, blocks: 0x102b 00010000:00010000:2.0:1746147724.622936:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.622937:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.622940:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d5bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6d4 expref: 32 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.622948:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d5bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6d4 expref: 32 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.622959:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8200, rc 0) 00000100:00100000:2.0:1746147724.622973:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793899136:12345-192.168.202.10@tcp:101:cat.0 Request processed in 93us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.622977:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16358 00000100:00100000:2.0:1746147724.622985:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16359 00000100:00100000:2.0:1746147724.622989:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967793898752:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147724.622994:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.623000:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d5c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb6bf expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147724.623009:0:21480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x6814198d, atime: 0x6814198d, ctime: 0x6814198d, blocks: 0x821 00010000:00010000:2.0:1746147724.623014:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.623015:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.623019:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d5c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6bf expref: 32 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.623026:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d5c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6bf expref: 32 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.623032:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8600, rc 0) 00000100:00100000:2.0:1746147724.623044:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793898752:12345-192.168.202.10@tcp:101:cat.0 Request processed in 55us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.623048:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16359 00000100:00100000:2.0:1746147724.623056:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16360 00000100:00100000:2.0:1746147724.623060:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967793899008:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147724.623065:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.623070:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d5ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb6cd expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147724.623079:0:21480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x458:0x0] initial LVB size: 5013696, mtime: 0x6814198d, atime: 0x6814198d, ctime: 0x6814198d, blocks: 0x1691 00010000:00010000:2.0:1746147724.623086:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.623087:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.623090:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d5ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6cd expref: 32 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.623098:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d5ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6cd expref: 32 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.623103:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff9c00, rc 0) 00000100:00100000:2.0:1746147724.623115:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793899008:12345-192.168.202.10@tcp:101:cat.0 Request processed in 55us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.623120:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16360 00000100:00100000:0.0:1746147724.640417:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.640513:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793899392 00000100:00100000:2.0:1746147724.640521:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793899392 00000100:00100000:2.0:1746147724.640561:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11981 00000100:00100000:2.0:1746147724.640568:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+6:32135:x1830967793899392:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147724.640589:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.640607:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213e00/0xe64d3fbf12a7d5d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb6db expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.640700:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d5d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.640713:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d5d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.640752:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d5d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.640767:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d5df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.640772:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d5df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.640778:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d5df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.640867:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278600/0xe64d3fbf12a7d5e6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.640874:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278600/0xe64d3fbf12a7d5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.640880:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278600/0xe64d3fbf12a7d5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147724.640909:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147724.640976:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d5d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.640982:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d5d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.640988:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d5d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.640996:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd14400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147724.640998:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d5d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.641004:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d5d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.641013:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147724.641015:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147724.641018:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d5d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.641023:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd14400/0xe64d3fbf12a7d5d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.641051:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d5df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.641055:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d5df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.641059:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d5df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.641063:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0278e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147724.641065:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d5df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.641069:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d5df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.641074:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88013632f300) 00010000:00010000:2.0:1746147724.641076:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147724.641082:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d5df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.641086:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d5df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147724.641121:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213e00/0xe64d3fbf12a7d5d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6db expref: 9 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.641132:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278600/0xe64d3fbf12a7d5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6db expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.641137:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147724.641139:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147724.641141:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0278600, rc 0) 00000100:00100000:2.0:1746147724.641180:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32135:x1830967793899392:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 612us (769us total) trans 8589945995 rc 0/0 00000100:00100000:2.0:1746147724.641185:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11981 00000100:00100000:0.0:1746147724.658167:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.658272:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793899648 00000100:00100000:2.0:1746147724.658280:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793899648 00000100:00100000:2.0:1746147724.658318:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11982 00000100:00100000:2.0:1746147724.658329:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32138:x1830967793899648:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147724.658348:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.658363:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279200/0xe64d3fbf12a7d5f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb6e2 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.658453:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.658465:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094081a00/0xe64d3fbf12a7d599 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6aa expref: 326 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.658473:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278600/0xe64d3fbf12a7d5e6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6db expref: 7 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.658479:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 5/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.658506:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278600/0xe64d3fbf12a7d5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6db expref: 7 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.658517:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278600/0xe64d3fbf12a7d5e6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6db expref: 7 pid: 14546 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.658528:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796435584:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.658626:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094081a00/0xe64d3fbf12a7d599 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6aa expref: 326 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.658633:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094081a00/0xe64d3fbf12a7d599 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6aa expref: 326 pid: 14546 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.658640:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796435712:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147724.658659:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.660051:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.660085:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.660110:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.660123:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.660171:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.660199:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793899904 00000100:00100000:0.0:1746147724.660204:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793899904 00002000:00100000:0.0:1746147724.660233:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009ce61f80 x1830967793899904/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.660241:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61f80 with x1830967793899904 ext(0->1048575) 00002000:00010000:0.0:1746147724.660245:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce61f80 00000100:00100000:0.0:1746147724.660258:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793900160 00000100:00100000:0.0:1746147724.660260:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793900160 00002000:00100000:0.0:1746147724.660270:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009ce60e00 x1830967793900160/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.660276:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60e00 with x1830967793900160 ext(1048576->2097151) 00002000:00010000:0.0:1746147724.660279:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60e00 00000100:00100000:0.0:1746147724.660286:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793900672 00000100:00100000:0.0:1746147724.660288:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793900672 00002000:00100000:0.0:1746147724.660295:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009ce62300 x1830967793900672/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.660301:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce62300 with x1830967793900672 ext(1048576->2097151) 00002000:00010000:0.0:1746147724.660303:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce62300 00000100:00100000:0.0:1746147724.660310:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793900928 00000100:00100000:0.0:1746147724.660312:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793900928 00002000:00100000:0.0:1746147724.660319:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009ce60700 x1830967793900928/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.660325:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60700 with x1830967793900928 ext(1048576->2097151) 00002000:00010000:0.0:1746147724.660327:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce60700 00000100:00100000:0.0:1746147724.660337:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7273 00000100:00100000:0.0:1746147724.660342:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967793899904:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147724.660536:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7274 00000100:00100000:1.0:1746147724.660543:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967793900160:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147724.662344:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793900416 00000100:00100000:1.0:1746147724.662351:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793900416 00000100:00100000:1.0:1746147724.662382:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11983 00000100:00100000:1.0:1746147724.662388:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32141:x1830967793900416:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147724.662402:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147724.662418:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb6e9 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.662485:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d609 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147724.662495:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d609 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147724.662503:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d609 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:1.0:1746147724.662515:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147724.662606:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7d602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e9 expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.662625:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d609 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e9 expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.662632:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147724.662634:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746147724.662637:0:5744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147724.662642:0:5744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147724.662648:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55e8400, rc 0) 00000100:00100000:1.0:1746147724.662675:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32141:x1830967793900416:12345-192.168.202.10@tcp:101:cat.0 Request processed in 286us (2625us total) trans 8589945996 rc 0/0 00000100:00100000:1.0:1746147724.662681:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11983 00000100:00100000:3.0:1746147724.662792:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7275 00000100:00100000:3.0:1746147724.662801:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793900672:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147724.663804:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7276 00000100:00100000:3.0:1746147724.663811:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967793900928:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147724.670441:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796435584:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147724.670455:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796435712:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.670476:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147724.674992:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.679664:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793901184 00000100:00100000:2.0:1746147724.679679:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793901184 00010000:00010000:2.0:1746147724.679734:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278600/0xe64d3fbf12a7d5e6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6db expref: 10 pid: 14546 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.679792:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8298 00000100:00100000:2.0:1746147724.679802:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6670050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967793901184:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.679819:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147724.679826:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278600/0xe64d3fbf12a7d5e6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6db expref: 10 pid: 14546 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.679836:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278600/0xe64d3fbf12a7d5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6db expref: 10 pid: 14546 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.679858:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0278600/0xe64d3fbf12a7d5e6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6db expref: 10 pid: 14546 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.679916:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147724.679923:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.679930:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.679935:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147724.679993:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6670050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793901184:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 191us (5009us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.680008:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8298 00000100:00100000:1.0:1746147724.683747:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.683827:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.683848:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793901312 00000100:00100000:1.0:1746147724.683854:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793901312 00000100:00100000:1.0:1746147724.683904:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11984 00000100:00100000:1.0:1746147724.683911:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32141:x1830967793901312:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147724.683930:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147724.683946:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7d617 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb6f0 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.684029:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147724.684041:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147724.684046:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147724.684061:0:5744:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147724.684070:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147724.684230:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793901056 00000100:00100000:2.0:1746147724.684235:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793901056 00010000:00010000:2.0:1746147724.684257:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094081a00/0xe64d3fbf12a7d599 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6aa expref: 327 pid: 14546 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.684281:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8299 00000100:00100000:2.0:1746147724.684288:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:1959:x1830967793901056:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.684297:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147724.684303:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094081a00/0xe64d3fbf12a7d599 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6aa expref: 327 pid: 14546 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.684313:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094081a00/0xe64d3fbf12a7d599 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6aa expref: 327 pid: 14546 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.684330:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094081a00/0xe64d3fbf12a7d599 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6aa expref: 327 pid: 14546 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.684342:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147724.684346:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.684352:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.684358:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.684363:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147724.684368:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147724.684373:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147724.684390:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147724.684428:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:1959:x1830967793901056:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 139us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.684435:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8299 00010000:00010000:2.0:1746147724.684461:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.684468:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147724.684484:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147724.684614:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279200/0xe64d3fbf12a7d5f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e2 expref: 327 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.684632:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e2 expref: 326 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.684639:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e2 expref: 326 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:2.0:1746147724.684645:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0279000, rc 0) 00000100:00100000:2.0:1746147724.684677:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32138:x1830967793899648:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 26351us (26516us total) trans 8589945997 rc 0/0 00000100:00100000:2.0:1746147724.684683:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11982 00000100:00100000:0.0:1746147724.686234:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793900160:12345-192.168.202.10@tcp:3:cat.0 Request processed in 25685us (26116us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147724.686245:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7274 00002000:00100000:0.0:1746147724.686255:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009ce60e00 x1830967793900160/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.686263:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60e00 with x1830967793900160 ext(1048576->2097151) 00002000:00010000:0.0:1746147724.686268:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60e00 00000100:00100000:0.0:1746147724.699093:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793900928:12345-192.168.202.10@tcp:3:cat.0 Request processed in 35273us (38912us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147724.699105:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7276 00002000:00100000:0.0:1746147724.699116:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009ce60700 x1830967793900928/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.699125:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60700 with x1830967793900928 ext(1048576->2097151) 00002000:00010000:0.0:1746147724.699130:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce60700 00000100:00100000:0.0:1746147724.699505:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793900672:12345-192.168.202.10@tcp:3:cat.0 Request processed in 36705us (39380us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147724.699511:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7275 00002000:00100000:0.0:1746147724.699516:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009ce62300 x1830967793900672/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.699524:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce62300 with x1830967793900672 ext(1048576->2097151) 00002000:00010000:0.0:1746147724.699527:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce62300 00000100:00100000:0.0:1746147724.714545:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.714734:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793901440 00000100:00100000:3.0:1746147724.714742:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793901440 00010000:00010000:3.0:1746147724.714773:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e2 expref: 326 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.714798:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8300 00000100:00100000:3.0:1746147724.714805:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:1960:x1830967793901440:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147724.714816:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147724.714821:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e2 expref: 326 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.714831:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e2 expref: 326 pid: 17544 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.714849:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0279000/0xe64d3fbf12a7d5fb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e2 expref: 326 pid: 17544 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.715328:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793899904:12345-192.168.202.10@tcp:3:cat.0 Request processed in 54982us (55239us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147724.715339:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7273 00002000:00100000:2.0:1746147724.715350:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009ce61f80 x1830967793899904/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.715358:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61f80 with x1830967793899904 ext(0->1048575) 00002000:00010000:2.0:1746147724.715362:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce61f80 00010000:00010000:3.0:1746147724.715394:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147724.715400:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147724.715408:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147724.715482:0:7096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147724.715500:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147724.715518:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:1960:x1830967793901440:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 713us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.715523:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8300 00010000:00010000:1.0:1746147724.715583:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147724.715590:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:1.0:1746147724.715624:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:1.0:1746147724.715629:0:5744:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147724.715639:0:5744:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147724.715665:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7d617 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f0 expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.715692:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f0 expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.715702:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147724.715704:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147724.715706:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55e9000, rc 0) 00000100:00100000:1.0:1746147724.715733:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32141:x1830967793901312:12345-192.168.202.10@tcp:101:cat.0 Request processed in 31823us (31906us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.715738:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11984 00000100:00100000:0.0:1746147724.722456:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.722494:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.722522:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.722551:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.722564:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.722576:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.722626:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793901568 00000100:00100000:3.0:1746147724.722634:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793901568 00000100:00100000:0.0:1746147724.722646:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.722665:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793901824 00000100:00100000:3.0:1746147724.722667:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793901824 00000100:00100000:0.0:1746147724.722674:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793902336 00000100:00100000:3.0:1746147724.722676:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793902080 00000100:00100000:0.0:1746147724.722677:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793902336 00000100:00100000:3.0:1746147724.722678:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793902080 00000100:00100000:3.0:1746147724.722686:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793901696 00000100:00100000:3.0:1746147724.722687:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793901696 00000100:00100000:3.0:1746147724.722695:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793901952 00000100:00100000:3.0:1746147724.722697:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793901952 00000100:00100000:3.0:1746147724.722704:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793902208 00000100:00100000:0.0:1746147724.722704:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11985 00000100:00100000:3.0:1746147724.722705:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793902208 00000100:00100000:0.0:1746147724.722710:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32133:x1830967793902336:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147724.722716:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16361 00000100:00100000:3.0:1746147724.722732:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967793901568:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147724.722741:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147724.722741:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.722754:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d62c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb6f7 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.722754:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094080600/0xe64d3fbf12a7d633 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb721 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.722771:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.722773:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.722780:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d62c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f7 expref: 24 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.722791:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d62c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f7 expref: 24 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147724.722798:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094080600/0xe64d3fbf12a7d633 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb721 expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.722799:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e4c00, rc 0) 00010000:00010000:0.0:1746147724.722807:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094080600/0xe64d3fbf12a7d633 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb721 expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.722820:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00000100:00100000:2.0:1746147724.722823:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16362 00010000:00010000:0.0:1746147724.722823:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147724.722826:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094080600, rc 0) 00000100:00100000:2.0:1746147724.722829:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967793901824:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147724.722834:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793901568:12345-192.168.202.10@tcp:101:cat.0 Request processed in 113us (385us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147724.722836:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147724.722839:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16361 00010000:00010000:2.0:1746147724.722845:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d63a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb705 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147724.722847:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32133:x1830967793902336:12345-192.168.202.10@tcp:101:cat.0 Request processed in 137us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.722852:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16363 00000100:00100000:0.0:1746147724.722853:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11985 00010000:00010000:2.0:1746147724.722855:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147724.722857:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967793902080:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147724.722857:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.722861:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.722861:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d63a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb705 expref: 20 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.722867:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7d641 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb713 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.722869:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d63a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb705 expref: 20 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.722874:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.722875:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.722875:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0278e00, rc 0) 00010000:00010000:3.0:1746147724.722879:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7d641 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb713 expref: 24 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.722903:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7d641 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb713 expref: 24 pid: 22183 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147724.722907:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793901824:12345-192.168.202.10@tcp:101:cat.0 Request processed in 78us (413us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147724.722909:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e5200, rc 0) 00000100:00100000:2.0:1746147724.722912:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16362 00000100:00100000:3.0:1746147724.722922:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793902080:12345-192.168.202.10@tcp:101:cat.0 Request processed in 66us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.722923:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16364 00000100:00100000:3.0:1746147724.722927:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16363 00000100:00100000:2.0:1746147724.722928:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967793901696:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147724.722934:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16365 00010000:00010000:2.0:1746147724.722934:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147724.722938:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967793901952:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147724.722940:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0278c00/0xe64d3fbf12a7d648 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb6fe expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.722942:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.722946:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5c00/0xe64d3fbf12a7d64f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb70c expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.722948:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.722949:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.722953:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.722953:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0278c00/0xe64d3fbf12a7d648 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6fe expref: 20 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.722955:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.722958:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5c00/0xe64d3fbf12a7d64f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb70c expref: 24 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.722961:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0278c00/0xe64d3fbf12a7d648 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6fe expref: 20 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.722968:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5c00/0xe64d3fbf12a7d64f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb70c expref: 24 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.722973:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0278c00, rc 0) 00010000:00010000:3.0:1746147724.722974:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e5c00, rc 0) 00000100:00100000:0.0:1746147724.722985:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16366 00000100:00100000:2.0:1746147724.722991:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793901696:12345-192.168.202.10@tcp:101:cat.0 Request processed in 63us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.723073:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793901952:12345-192.168.202.10@tcp:101:cat.0 Request processed in 134us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.723205:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16364 00000100:00100000:0.0:1746147724.723207:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793902208:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147724.723213:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16365 00010000:00010000:0.0:1746147724.723216:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147724.723223:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094081600/0xe64d3fbf12a7d656 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb71a expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.723232:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.723233:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.723237:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094081600/0xe64d3fbf12a7d656 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb71a expref: 20 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147724.723246:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094081600/0xe64d3fbf12a7d656 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb71a expref: 20 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147724.723253:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094081600, rc 0) 00000100:00100000:0.0:1746147724.723267:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793902208:12345-192.168.202.10@tcp:101:cat.0 Request processed in 62us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147724.723272:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16366 00000100:00100000:0.0:1746147724.734501:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.734543:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.734573:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.734605:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.734625:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793902720 00000100:00100000:1.0:1746147724.734626:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793902848 00000100:00100000:0.0:1746147724.734631:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793902720 00000100:00100000:1.0:1746147724.734633:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793902848 00002000:00100000:1.0:1746147724.734673:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a5e37b80 x1830967793902848/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.734683:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e37b80 with x1830967793902848 ext(1048576->2097151) 00002000:00010000:1.0:1746147724.734688:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e37b80 00000100:00100000:1.0:1746147724.734710:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793903104 00000100:00100000:1.0:1746147724.734714:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793903104 00000100:00100000:2.0:1746147724.734908:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793903360 00000100:00100000:2.0:1746147724.734912:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793903360 00002000:00100000:0.0:1746147724.735407:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a5e37100 x1830967793902720/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.735415:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e37100 with x1830967793902720 ext(0->1048575) 00002000:00010000:0.0:1746147724.735419:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e37100 00000100:00100000:0.0:1746147724.735438:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7277 00000100:00100000:0.0:1746147724.735446:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967793902848:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:1.0:1746147724.735447:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a5e35c00 x1830967793903104/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.735453:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e35c00 with x1830967793903104 ext(1048576->2097151) 00002000:00010000:1.0:1746147724.735456:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e35c00 00000100:00100000:1.0:1746147724.735470:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7278 00000100:00100000:1.0:1746147724.735477:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967793902720:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147724.735801:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7279 00000100:00100000:3.0:1746147724.735809:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967793903104:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:2.0:1746147724.736737:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a5e37800 x1830967793903360/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.736746:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e37800 with x1830967793903360 ext(1048576->2097151) 00002000:00010000:2.0:1746147724.736749:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e37800 00000100:00100000:2.0:1746147724.736762:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7280 00000100:00100000:2.0:1746147724.736768:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967793903360:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147724.745430:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.745469:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.745493:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.745521:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793903616 00000100:00100000:1.0:1746147724.745532:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793903616 00002000:00100000:1.0:1746147724.745574:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a5e36680 x1830967793903616/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.745589:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e36680 with x1830967793903616 ext(2097152->3145727) 00002000:00010000:1.0:1746147724.745594:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e36680 00000100:00100000:1.0:1746147724.745615:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793903744 00000100:00100000:1.0:1746147724.745619:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793903744 00002000:00100000:1.0:1746147724.745634:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a5e35180 x1830967793903744/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.745640:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e35180 with x1830967793903744 ext(3145728->4194303) 00002000:00010000:1.0:1746147724.745643:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e35180 00000100:00100000:1.0:1746147724.745658:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793904128 00000100:00100000:1.0:1746147724.745661:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793904128 00002000:00100000:1.0:1746147724.745676:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a5e34a80 x1830967793904128/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.745682:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e34a80 with x1830967793904128 ext(2097152->3145727) 00002000:00010000:1.0:1746147724.745685:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e34a80 00000100:00100000:1.0:1746147724.745703:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7281 00000100:00100000:1.0:1746147724.745711:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967793903616:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147724.746151:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7282 00000100:00100000:3.0:1746147724.746160:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967793903744:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147724.747245:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7283 00000100:00100000:2.0:1746147724.747254:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793904128:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147724.747305:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.750557:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793904256 00000100:00100000:2.0:1746147724.750568:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793904256 00002000:00100000:2.0:1746147724.750600:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a5e34380 x1830967793904256/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.750609:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e34380 with x1830967793904256 ext(3145728->4194303) 00002000:00010000:2.0:1746147724.750614:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e34380 00000100:00100000:2.0:1746147724.750631:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7284 00000100:00100000:2.0:1746147724.750638:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793904256:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147724.754590:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967793903104:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18771us (20005us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147724.754600:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7279 00002000:00100000:2.0:1746147724.754610:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a5e35c00 x1830967793903104/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.754618:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e35c00 with x1830967793903104 ext(1048576->2097151) 00002000:00010000:2.0:1746147724.754623:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e35c00 00000100:00100000:0.0:1746147724.757700:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967793903360:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20923us (23085us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147724.757712:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7280 00002000:00100000:0.0:1746147724.757734:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a5e37800 x1830967793903360/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.757743:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e37800 with x1830967793903360 ext(1048576->2097151) 00002000:00010000:0.0:1746147724.757749:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e37800 00000100:00100000:0.0:1746147724.760221:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.760318:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793904640 00000100:00100000:2.0:1746147724.760326:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793904640 00000100:00100000:2.0:1746147724.760373:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11986 00000100:00100000:2.0:1746147724.760379:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32138:x1830967793904640:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147724.760395:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.760398:0:17544:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147724.760420:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094080600/0xe64d3fbf12a7d633 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb721 expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.760448:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147724.760452:0:17544:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147724.760461:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5635400/0xe64d3fbf12a7d65d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb728 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.760507:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.760517:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7d57d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6a3 expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.760524:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d609 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e9 expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.760529:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f0 expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.760534:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.760558:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f0 expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.760568:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f0 expref: 9 pid: 5744 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.760578:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796435840:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.761039:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d609 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e9 expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.761046:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d609 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e9 expref: 9 pid: 5744 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.761053:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796435968:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.761094:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7d57d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6a3 expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.761101:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7d57d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6a3 expref: 8 pid: 14546 timeout: 903 lvb_type: 0 00000100:00100000:2.0:1746147724.761108:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796436096:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147724.761127:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.763509:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967793902848:12345-192.168.202.10@tcp:3:cat.0 Request processed in 28056us (28959us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147724.763521:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7277 00002000:00100000:0.0:1746147724.763530:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a5e37b80 x1830967793902848/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.763538:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e37b80 with x1830967793902848 ext(1048576->2097151) 00002000:00010000:0.0:1746147724.763543:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e37b80 00000100:00100000:0.0:1746147724.768336:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.768968:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796435840:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147724.768977:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796435968:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147724.768984:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796436096:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.769009:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147724.769084:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.770412:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793904768 00000100:00100000:3.0:1746147724.770421:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793904768 00010000:00010000:3.0:1746147724.770453:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f0 expref: 10 pid: 5744 timeout: 903 lvb_type: 0 00000100:00100000:0.0:1746147724.770460:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.770490:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793904896 00000100:00100000:3.0:1746147724.770492:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793904896 00010000:00010000:3.0:1746147724.770503:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d609 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e9 expref: 11 pid: 5744 timeout: 903 lvb_type: 0 00000100:00100000:0.0:1746147724.770504:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793905024 00000100:00100000:0.0:1746147724.770507:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793905024 00010000:00010000:0.0:1746147724.770522:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7d57d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6a3 expref: 9 pid: 14546 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746147724.770523:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8301 00000100:00100000:3.0:1746147724.770530:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793904768:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147724.770538:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8302 00010000:00010000:3.0:1746147724.770543:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147724.770543:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793904896:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147724.770549:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f0 expref: 11 pid: 5744 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.770551:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147724.770554:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d609 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e9 expref: 11 pid: 5744 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.770559:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f0 expref: 11 pid: 5744 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746147724.770606:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8303 00000100:00100000:1.0:1746147724.770613:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793905024:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.770619:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.770623:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7d57d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6a3 expref: 9 pid: 14546 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.770870:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d609 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e9 expref: 11 pid: 5744 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.770905:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9000/0xe64d3fbf12a7d61e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f0 expref: 11 pid: 5744 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.770922:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7d57d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6a3 expref: 9 pid: 14546 timeout: 903 lvb_type: 0 00010000:00010000:3.0:1746147724.770932:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147724.770940:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147724.770947:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147724.770952:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147724.770971:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7d57d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6a3 expref: 9 pid: 14546 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746147724.770995:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00000100:00100000:3.0:1746147724.770996:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967793904768:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 465us (2665us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147724.770999:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:3.0:1746147724.771002:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8301 00010000:00010000:1.0:1746147724.771004:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147724.771008:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.771027:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793905024:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 414us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.771032:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8303 00010000:00010000:0.0:1746147724.771134:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7d609 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6e9 expref: 9 pid: 5744 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746147724.771147:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147724.771150:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.771156:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.771161:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.771185:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147724.771210:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1959:x1830967793904896:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 667us (2126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147724.771216:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8302 00010000:00010000:2.0:1746147724.771381:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147724.771388:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000040:00080000:2.0:1746147724.772846:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3640, 88 off304688 00000004:00080000:2.0:1746147724.772855:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803946969850ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147724.772917:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3652, 88 off305392 00000004:00080000:2.0:1746147724.772921:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803947036630ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147724.772934:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3653, 88 off305480 00000004:00080000:2.0:1746147724.772937:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803947052505ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147724.772945:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3641, 88 off304776 00000004:00080000:2.0:1746147724.772947:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803947062425ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147724.772956:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3642, 88 off304864 00000004:00080000:2.0:1746147724.772959:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803947074546ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147724.772978:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3654, 88 off305568 00000004:00080000:2.0:1746147724.772981:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803947096664ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147724.772990:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3655, 88 off305656 00000004:00080000:2.0:1746147724.772992:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803947107974ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147724.773321:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3656, 88 off305744 00000004:00080000:2.0:1746147724.773378:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803947493551ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147724.773399:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3643, 88 off304952 00000004:00080000:2.0:1746147724.773402:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803947517781ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147724.773469:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3657, 88 off305832 00000004:00080000:2.0:1746147724.773473:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803947588826ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147724.773485:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3644, 88 off305040 00000004:00080000:2.0:1746147724.773488:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803947603904ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147724.773541:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3658, 88 off305920 00000004:00080000:2.0:1746147724.773545:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803947660689ns, next at 756024029964ns, rc = 0 00000100:00100000:1.0:1746147724.773557:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793902720:12345-192.168.202.10@tcp:3:cat.0 Request processed in 38077us (39059us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147724.773565:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7278 00002000:00100000:1.0:1746147724.773573:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a5e37100 x1830967793902720/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147724.773581:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e37100 with x1830967793902720 ext(0->1048575) 00002000:00010000:1.0:1746147724.773585:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e37100 00000040:00080000:2.0:1746147724.773636:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3645, 88 off305128 00000004:00080000:2.0:1746147724.773641:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803947756786ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147724.773653:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3646, 88 off305216 00000004:00080000:2.0:1746147724.773655:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803947770791ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147724.773661:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3647, 88 off305304 00000004:00080000:2.0:1746147724.773664:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803947779363ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147724.773670:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3648, 88 off305392 00000004:00080000:2.0:1746147724.773672:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803947787626ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147724.773680:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3659, 88 off306008 00000004:00080000:2.0:1746147724.773682:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803947797989ns, next at 756024029964ns, rc = 0 00000100:00100000:2.0:1746147724.777871:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793904128:12345-192.168.202.10@tcp:3:cat.0 Request processed in 30611us (32368us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147724.777881:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7283 00002000:00100000:2.0:1746147724.777914:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a5e34a80 x1830967793904128/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.777922:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e34a80 with x1830967793904128 ext(2097152->3145727) 00002000:00010000:2.0:1746147724.777925:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e34a80 00000100:00100000:3.0:1746147724.780484:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793903744:12345-192.168.202.10@tcp:3:cat.0 Request processed in 34319us (35007us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147724.780494:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7282 00002000:00100000:3.0:1746147724.780503:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a5e35180 x1830967793903744/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.780510:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e35180 with x1830967793903744 ext(3145728->4194303) 00002000:00010000:3.0:1746147724.780515:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e35180 00000100:00100000:0.0:1746147724.784195:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793903616:12345-192.168.202.10@tcp:3:cat.0 Request processed in 38480us (38767us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147724.784206:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7281 00002000:00100000:0.0:1746147724.784215:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a5e36680 x1830967793903616/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.784224:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e36680 with x1830967793903616 ext(2097152->3145727) 00002000:00010000:0.0:1746147724.784228:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e36680 00010000:00010000:2.0:1746147724.784982:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147724.785556:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.785752:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793905152 00000100:00100000:0.0:1746147724.785759:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793905152 00000100:00100000:0.0:1746147724.785799:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11987 00000100:00100000:0.0:1746147724.785805:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32141:x1830967793905152:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147724.785817:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147724.785830:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb72f expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.785871:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.785878:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 4/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.785905:0:5744:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147724.785915:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.785926:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147724.785929:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147724.785932:0:5744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.785938:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02f8c00, rc 0) 00000100:00100000:0.0:1746147724.785989:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32141:x1830967793905152:12345-192.168.202.10@tcp:101:cat.0 Request processed in 183us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147724.785994:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11987 00000100:00100000:3.0:1746147724.786410:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793904256:12345-192.168.202.10@tcp:3:cat.0 Request processed in 35772us (39103us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147724.786418:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7284 00002000:00100000:3.0:1746147724.786424:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a5e34380 x1830967793904256/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.786432:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e34380 with x1830967793904256 ext(3145728->4194303) 00002000:00010000:3.0:1746147724.786435:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e34380 00000100:00100000:0.0:1746147724.800943:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.800979:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793905280 00000100:00100000:1.0:1746147724.800987:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793905280 00000100:00100000:1.0:1746147724.801035:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11988 00000100:00100000:1.0:1746147724.801042:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32133:x1830967793905280:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147724.801061:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147724.801077:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa11200/0xe64d3fbf12a7d672 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb736 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.801124:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa11200/0xe64d3fbf12a7d672 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb736 expref: 329 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.801143:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa11200/0xe64d3fbf12a7d672 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb736 expref: 329 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.801154:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147724.801156:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147724.801159:0:14546:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.801164:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa11200, rc 0) 00000100:00100000:1.0:1746147724.801211:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:32133:x1830967793905280:12345-192.168.202.10@tcp:101:cat.0 Request processed in 169us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.801216:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11988 00000001:00080000:0.0:1746147724.820534:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945993 is committed 00000001:00080000:0.0:1746147724.820547:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945996 is committed 00000001:00080000:0.0:1746147724.820552:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945994 is committed 00000001:00080000:0.0:1746147724.820558:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945998 is committed 00000004:00080000:0.0:1746147724.820562:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2727 committed 00000004:00080000:0.0:1746147724.820568:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2716 committed 00000004:00080000:0.0:1746147724.820573:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2715 committed 00000004:00080000:0.0:1746147724.820574:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2714 committed 00000004:00080000:0.0:1746147724.820575:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2713 committed 00000004:00080000:0.0:1746147724.820577:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2726 committed 00000004:00080000:0.0:1746147724.820578:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2712 committed 00000004:00080000:0.0:1746147724.820579:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2725 committed 00000004:00080000:0.0:1746147724.820580:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2711 committed 00000004:00080000:0.0:1746147724.820581:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2724 committed 00000004:00080000:0.0:1746147724.820582:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2723 committed 00000004:00080000:0.0:1746147724.820584:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2722 committed 00000004:00080000:0.0:1746147724.820585:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2710 committed 00000004:00080000:0.0:1746147724.820586:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2709 committed 00000004:00080000:0.0:1746147724.820587:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2721 committed 00000004:00080000:0.0:1746147724.820588:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2720 committed 00000004:00080000:0.0:1746147724.820589:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2708 committed 00000001:00080000:0.0:1746147724.820597:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945991 is committed 00000001:00080000:0.0:1746147724.820601:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945992 is committed 00000100:00100000:0.0:1746147724.820744:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796436224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.820795:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147724.820830:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796436736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.820843:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147724.820857:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746147724.820861:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796436608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.820871:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147724.820880:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796437120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.820909:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147724.820927:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796436352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.820940:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147724.820949:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796436864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.820960:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147724.820969:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147724.820972:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796436480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.820983:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147724.820992:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796436992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.821002:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147724.821020:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796436224 00000100:00100000:0.0:1746147724.821026:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796436224 00000100:00100000:0.0:1746147724.821050:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796436736 00000100:00100000:0.0:1746147724.821052:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796436736 00000100:00100000:0.0:1746147724.821060:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796436608 00000100:00100000:0.0:1746147724.821062:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796436608 00000100:00100000:0.0:1746147724.821069:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796437120 00000100:00100000:0.0:1746147724.821070:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796437120 00000100:00100000:0.0:1746147724.821078:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796436352 00000100:00100000:0.0:1746147724.821080:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796436352 00000100:00100000:0.0:1746147724.821088:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796436864 00000100:00100000:0.0:1746147724.821089:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796436864 00000100:00100000:0.0:1746147724.821096:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16367 00000100:00100000:0.0:1746147724.821102:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3302:x1830967796436224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147724.821246:0:8468:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147724.821249:0:8468:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147723 -> 1746147723 00002000:00010000:0.0:1746147724.821251:0:8468:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147723 -> 1746147723 00002000:00010000:0.0:1746147724.821253:0:8468:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147723 -> 1746147723 00002000:00010000:0.0:1746147724.821255:0:8468:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:0.0:1746147724.821281:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3302:x1830967796436224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (485us total) trans 17179874340 rc 0/0 00000100:00100000:0.0:1746147724.821287:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16367 00000100:00100000:0.0:1746147724.821298:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796436480 00000100:00100000:0.0:1746147724.821300:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796436480 00000100:00100000:0.0:1746147724.821307:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796436992 00000100:00100000:0.0:1746147724.821308:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796436992 00000100:00100000:0.0:1746147724.821316:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16368 00000100:00100000:0.0:1746147724.821320:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3302:x1830967796436736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.821392:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3302:x1830967796436736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (547us total) trans 17179874341 rc 0/0 00000100:00100000:0.0:1746147724.821398:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16368 00000100:00100000:0.0:1746147724.821406:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16369 00000100:00100000:0.0:1746147724.821410:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3302:x1830967796436608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.821476:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3302:x1830967796436608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (603us total) trans 17179874342 rc 0/0 00000100:00100000:0.0:1746147724.821484:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16369 00000100:00100000:0.0:1746147724.821493:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16370 00000100:00100000:0.0:1746147724.821497:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3302:x1830967796437120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.821565:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3302:x1830967796437120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (655us total) trans 17179874343 rc 0/0 00000100:00100000:0.0:1746147724.821571:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16370 00000100:00100000:0.0:1746147724.821579:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16371 00000100:00100000:0.0:1746147724.821583:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3303:x1830967796436352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147724.821643:0:8468:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147724.821646:0:8468:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147725 -> 1746147725 00002000:00010000:0.0:1746147724.821648:0:8468:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147725 -> 1746147725 00002000:00010000:0.0:1746147724.821650:0:8468:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147725 -> 1746147725 00002000:00010000:0.0:1746147724.821652:0:8468:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147724.821671:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3303:x1830967796436352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (730us total) trans 17179874344 rc 0/0 00000100:00100000:0.0:1746147724.821675:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16371 00000100:00100000:0.0:1746147724.821683:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16372 00000100:00100000:0.0:1746147724.821687:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3303:x1830967796436864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.821764:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3303:x1830967796436864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (803us total) trans 17179874345 rc 0/0 00000100:00100000:0.0:1746147724.821770:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16372 00000100:00100000:0.0:1746147724.821778:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16373 00000100:00100000:0.0:1746147724.821782:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3303:x1830967796436480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147724.821840:0:8468:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:0.0:1746147724.821843:0:8468:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147725 -> 1746147725 00002000:00010000:0.0:1746147724.821844:0:8468:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147725 -> 1746147725 00002000:00010000:0.0:1746147724.821846:0:8468:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147725 -> 1746147725 00002000:00010000:0.0:1746147724.821847:0:8468:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:0.0:1746147724.821862:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3303:x1830967796436480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (878us total) trans 17179874346 rc 0/0 00000100:00100000:0.0:1746147724.821866:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16373 00000100:00100000:0.0:1746147724.821874:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16374 00000100:00100000:0.0:1746147724.821878:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3303:x1830967796436992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.821970:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3303:x1830967796436992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (966us total) trans 17179874347 rc 0/0 00000100:00100000:0.0:1746147724.821975:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16374 00000004:00080000:0.0:1746147724.822014:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a08ab800/2, rc 0, transno 17179874346 00000100:00100000:0.0:1746147724.822021:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796436480:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147724.822027:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a08a9880/2, rc 0, transno 17179874347 00000100:00100000:0.0:1746147724.822029:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796436992:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147724.822034:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a08aaa00/2, rc 0, transno 17179874344 00000100:00100000:0.0:1746147724.822037:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796436352:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147724.822042:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a08a8000/2, rc 0, transno 17179874345 00000100:00100000:0.0:1746147724.822044:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796436864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.822069:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796437248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.822090:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147724.822109:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a08ab480/2, rc 0, transno 17179874342 00000100:00100000:0.0:1746147724.822112:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796436608:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147724.822118:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a08abb80/2, rc 0, transno 17179874343 00000100:00100000:0.0:1746147724.822120:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796437120:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147724.822125:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a08a9c00/2, rc 0, transno 17179874340 00000100:00100000:0.0:1746147724.822128:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796436224:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147724.822132:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a08a8a80/2, rc 0, transno 17179874341 00000100:00100000:0.0:1746147724.822135:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796436736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.822146:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796437248 00000100:00100000:0.0:1746147724.822148:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796437248 00000100:00100000:0.0:1746147724.822161:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16375 00000100:00100000:0.0:1746147724.822165:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3302:x1830967796437248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147724.822241:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3302:x1830967796437248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (149us total) trans 17179874348 rc 0/0 00000100:00100000:0.0:1746147724.822245:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16375 00000004:00080000:0.0:1746147724.822334:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d24e00/2, rc 0, transno 17179874348 00000100:00100000:0.0:1746147724.822337:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796437248:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147724.822658:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb728 expref: 325 pid: 17544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.822658:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796437632:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746147724.822668:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147724.822671:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746147724.822675:0:17544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 6 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.822679:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746147724.822683:0:17544:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 6 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.822689:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 6 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.822690:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796438144:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746147724.822695:0:17544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa11200/0xe64d3fbf12a7d672 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb736 expref: 325 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.822700:0:17544:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa11200/0xe64d3fbf12a7d672 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb736 expref: 325 pid: 14546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.822700:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.822708:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00010000:00010000:2.0:1746147724.822710:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa11200/0xe64d3fbf12a7d672 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb736 expref: 325 pid: 14546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.822711:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796437760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.822731:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.822739:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796438272:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746147724.822743:0:17544:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa11200/0xe64d3fbf12a7d672 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb736 expref: 325 pid: 14546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.822749:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147724.822752:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796438400:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147724.822762:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796437504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.822783:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.822792:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796438016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.822802:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746147724.822805:0:17544:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 6 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.822809:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147724.822812:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796438528:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147724.822812:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a213bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796437376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147724.822827:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147724.822827:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147724.822833:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796437888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147724.822842:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796437632 00000100:00100000:1.0:1746147724.822842:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147724.822845:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796437632 00000100:00100000:1.0:1746147724.822855:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796438144 00000100:00100000:2.0:1746147724.822857:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796437760 00000100:00100000:1.0:1746147724.822857:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796438144 00000100:00100000:2.0:1746147724.822859:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796437760 00000100:00100000:2.0:1746147724.822867:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796437504 00000100:00100000:1.0:1746147724.822867:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796438272 00000100:00100000:1.0:1746147724.822868:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796438272 00000100:00100000:2.0:1746147724.822869:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796437504 00000100:00100000:1.0:1746147724.822873:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796438016 00000100:00100000:2.0:1746147724.822875:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796437376 00000100:00100000:1.0:1746147724.822875:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796438016 00000100:00100000:2.0:1746147724.822877:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796437376 00000100:00100000:1.0:1746147724.822881:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796437888 00000100:00100000:1.0:1746147724.822894:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796437888 00000100:00100000:2.0:1746147724.822904:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16376 00000100:00100000:2.0:1746147724.822908:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3301:x1830967796437632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147724.823009:0:21480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147724.823011:0:21480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147724 -> 1746147724 00002000:00010000:2.0:1746147724.823013:0:21480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147724 -> 1746147724 00002000:00010000:2.0:1746147724.823015:0:21480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147724 -> 1746147724 00002000:00010000:2.0:1746147724.823016:0:21480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:2.0:1746147724.823042:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3301:x1830967796437632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 133us (362us total) trans 21474841569 rc 0/0 00000100:00100000:1.0:1746147724.824485:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16377 00000100:00100000:2.0:1746147724.824492:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16376 00000100:00100000:1.0:1746147724.824496:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3301:x1830967796438144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147724.824518:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16378 00000100:00100000:2.0:1746147724.824524:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3301:x1830967796437760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147724.824573:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16379 00000100:00100000:2.0:1746147724.824578:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3301:x1830967796438272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147724.824628:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16380 00000100:00100000:2.0:1746147724.824633:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3304:x1830967796437504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147724.824655:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16381 00000100:00100000:3.0:1746147724.824662:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3304:x1830967796438016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.824804:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16382 00000100:00100000:1.0:1746147724.824810:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3304:x1830967796437376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.824852:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16383 00000100:00100000:1.0:1746147724.824858:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3304:x1830967796437888:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147724.824927:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2139500/2, rc 0, transno 21474841569 00000100:00100000:1.0:1746147724.824932:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796437632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147724.825117:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3304:x1830967796438016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 455us (2313us total) trans 21474841571 rc 0/0 00000100:00100000:3.0:1746147724.825122:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16381 00000100:00100000:3.0:1746147724.825191:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3301:x1830967796437760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 668us (2459us total) trans 21474841572 rc 0/0 00000100:00100000:3.0:1746147724.825196:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16378 00000100:00100000:2.0:1746147724.825293:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3301:x1830967796438272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 714us (2541us total) trans 21474841573 rc 0/0 00000100:00100000:2.0:1746147724.825298:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16379 00002000:00010000:2.0:1746147724.825349:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00000004:00080000:1.0:1746147724.825530:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aee8e00/2, rc 0, transno 21474841571 00000100:00100000:1.0:1746147724.825534:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796438016:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147724.825546:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2139f80/2, rc 0, transno 21474841572 00000100:00100000:1.0:1746147724.825549:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796437760:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147724.825555:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aee9500/2, rc 0, transno 21474841573 00000100:00100000:1.0:1746147724.825558:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796438272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147724.825620:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3301:x1830967796438144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1128us (2919us total) trans 21474841570 rc 0/0 00000100:00100000:3.0:1746147724.825626:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16377 00002000:00010000:2.0:1746147724.825657:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147725 -> 1746147725 00002000:00010000:2.0:1746147724.825660:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147725 -> 1746147725 00002000:00010000:2.0:1746147724.825661:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147725 -> 1746147725 00002000:00010000:2.0:1746147724.825663:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147724.825686:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3304:x1830967796437504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1053us (2901us total) trans 21474841574 rc 0/0 00000100:00100000:2.0:1746147724.825691:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16380 00002000:00010000:1.0:1746147724.825790:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147724.825793:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147723 -> 1746147723 00002000:00010000:1.0:1746147724.825794:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147723 -> 1746147723 00002000:00010000:1.0:1746147724.825796:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147723 -> 1746147723 00002000:00010000:1.0:1746147724.825797:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746147724.825818:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3304:x1830967796437376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1008us (2989us total) trans 21474841575 rc 0/0 00000100:00100000:1.0:1746147724.825823:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16382 00002000:00010000:1.0:1746147724.825870:0:8469:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:1.0:1746147724.825873:0:8469:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147724.825874:0:8469:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147724.825876:0:8469:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147724.825877:0:8469:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:1.0:1746147724.825908:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3304:x1830967796437888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1051us (3064us total) trans 21474841576 rc 0/0 00000100:00100000:1.0:1746147724.825913:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16383 00000004:00080000:1.0:1746147724.825931:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aee9180/2, rc 0, transno 21474841570 00000100:00100000:1.0:1746147724.825934:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796438144:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147724.825984:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a213bb80/2, rc 0, transno 21474841575 00000100:00100000:3.0:1746147724.825987:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a213bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796437376:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147724.825993:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aee8a80/2, rc 0, transno 21474841576 00000100:00100000:3.0:1746147724.825995:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796437888:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147724.826001:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2138700/2, rc 0, transno 21474841574 00000100:00100000:3.0:1746147724.826002:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796437504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147724.827287:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.827316:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.827867:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796438400:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147724.827877:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796438528:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147724.827929:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5635400/0xe64d3fbf12a7d65d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb728 expref: 325 pid: 17544 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746147724.827948:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb728 expref: 324 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.827972:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8b0c00, rc 0) 00000100:00100000:2.0:1746147724.828004:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32138:x1830967793904640:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 67624us (67789us total) trans 8589945998 rc 0/0 00000100:00100000:2.0:1746147724.828011:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11986 00000100:00100000:1.0:1746147724.828584:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.828831:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793905408 00000100:00100000:0.0:1746147724.828838:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793905408 00000100:00100000:0.0:1746147724.828862:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793905536 00000100:00100000:0.0:1746147724.828864:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793905536 00000100:00100000:0.0:1746147724.828877:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4983 00000100:00100000:0.0:1746147724.828882:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32133:x1830967793905408:12345-192.168.202.10@tcp:49:cat.0 00000100:00100000:0.0:1746147724.828969:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32133:x1830967793905408:12345-192.168.202.10@tcp:49:cat.0 Request processed in 86us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147724.828974:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4983 00000100:00100000:0.0:1746147724.828986:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4984 00000100:00100000:0.0:1746147724.828991:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:32141:x1830967793905536:12345-192.168.202.10@tcp:49:cat.0 00000100:00100000:0.0:1746147724.829020:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:32141:x1830967793905536:12345-192.168.202.10@tcp:49:cat.0 Request processed in 29us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147724.829025:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4984 00000100:00100000:2.0:1746147724.829239:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793905664 00000100:00100000:2.0:1746147724.829242:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793905664 00000100:00100000:2.0:1746147724.829261:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11989 00000100:00100000:2.0:1746147724.829265:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:32135:x1830967793905664:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147724.829272:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.829283:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7d679 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb73d expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.829311:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7d679 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb73d expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.829323:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7d679 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb73d expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.829333:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147724.829336:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147724.829338:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134edfa00, rc 0) 00000100:00100000:2.0:1746147724.829356:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32135:x1830967793905664:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 90us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.829363:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11989 00000100:00100000:0.0:1746147724.830320:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.830409:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793905792 00000100:00100000:1.0:1746147724.830413:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793905792 00000100:00100000:1.0:1746147724.830432:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4985 00000100:00100000:1.0:1746147724.830437:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6668050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32138:x1830967793905792:12345-192.168.202.10@tcp:49:multiop.0 00000100:00100000:1.0:1746147724.830498:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6668050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32138:x1830967793905792:12345-192.168.202.10@tcp:49:multiop.0 Request processed in 61us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.830504:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4985 00000100:00100000:0.0:1746147724.838597:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.838870:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793905920 00000100:00100000:1.0:1746147724.838878:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793905920 00000100:00100000:1.0:1746147724.838947:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 907 00000100:00100000:1.0:1746147724.838954:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1959:x1830967793905920:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.838966:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.838988:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7d679 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb73d expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.839002:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147724.839006:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.839039:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1959:x1830967793905920:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 86us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.839045:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 907 00000100:00100000:0.0:1746147724.845839:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.845933:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793906048 00000100:00100000:2.0:1746147724.845940:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793906048 00000100:00100000:2.0:1746147724.845983:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16384 00000100:00100000:2.0:1746147724.845989:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32135:x1830967793906048:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147724.846005:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.846019:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb744 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.846045:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d5bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6d4 expref: 31 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.846052:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094081600/0xe64d3fbf12a7d656 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb71a expref: 21 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.846057:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.846058:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.846061:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.846084:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094081600/0xe64d3fbf12a7d656 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb71a expref: 21 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.846092:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094081600/0xe64d3fbf12a7d656 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb71a expref: 21 pid: 7050 timeout: 904 lvb_type: 1 00000100:00100000:2.0:1746147724.846103:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796438656:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.846184:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d5bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6d4 expref: 31 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147724.846192:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d5bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6d4 expref: 31 pid: 21480 timeout: 904 lvb_type: 1 00000100:00100000:2.0:1746147724.846200:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796438784:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147724.846218:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.846425:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.846532:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793906304 00000100:00100000:3.0:1746147724.846537:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793906304 00002000:00100000:3.0:1746147724.846559:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880130d24380 x1830967793906304/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.846567:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d24380 with x1830967793906304 ext(1048576->2097151) 00002000:00010000:3.0:1746147724.846571:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d24380 00000100:00100000:3.0:1746147724.846581:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7285 00000100:00100000:3.0:1746147724.846585:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967793906304:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147724.853608:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796438656:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147724.856246:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.856265:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.856286:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.856304:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793906432 00000100:00100000:0.0:1746147724.856310:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793906432 00010000:00010000:0.0:1746147724.856336:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094081600/0xe64d3fbf12a7d656 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb71a expref: 24 pid: 7050 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746147724.856457:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793906688 00000100:00100000:1.0:1746147724.856461:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793906688 00000100:00100000:0.0:1746147724.856692:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793906560 00000100:00100000:0.0:1746147724.856694:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793906560 00010000:00010000:0.0:1746147724.856702:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d5bc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6d4 expref: 33 pid: 21480 timeout: 904 lvb_type: 1 00000100:00100000:0.0:1746147724.856716:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8304 00000100:00100000:3.0:1746147724.856717:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796438784:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147724.856732:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6673050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967793906432:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147724.856742:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147724.856754:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 24 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.856760:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094081600/0xe64d3fbf12a7d656 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb71a expref: 24 pid: 7050 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746147724.856767:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ede600, rc 0) 00010000:00010000:0.0:1746147724.856773:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094081600/0xe64d3fbf12a7d656 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb71a expref: 24 pid: 7050 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746147724.856791:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094081600/0xe64d3fbf12a7d656 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb71a expref: 24 pid: 7050 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147724.856802:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:32135:x1830967793906048:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 10813us (10970us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147724.856803:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147724.856808:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16384 00000100:00100000:0.0:1746147724.856817:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6673050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967793906432:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 86us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.856822:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16385 00000100:00100000:0.0:1746147724.856822:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8304 00000100:00100000:3.0:1746147724.856828:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:32138:x1830967793906688:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147724.856839:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.856849:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb74b expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147724.856855:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8305 00000100:00100000:0.0:1746147724.856859:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967793906560:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147724.856863:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d5c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6bf expref: 34 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147724.856864:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147724.856868:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d5bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6d4 expref: 34 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746147724.856870:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d63a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb705 expref: 21 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.856875:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.856875:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d5bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6d4 expref: 34 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746147724.856877:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.856879:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1241088->1794047] (req 1241088->1794047) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 34 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.856898:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fff8200/0xe64d3fbf12a7d5bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6d4 expref: 34 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746147724.856905:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.856907:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147724.856911:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.856916:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d63a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb705 expref: 21 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147724.856918:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.856926:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d63a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb705 expref: 21 pid: 9615 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746147724.856933:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147724.856936:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796438912:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147724.856940:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d25880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796439040:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147724.856973:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6170c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147724.856990:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d5c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6bf expref: 33 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.856997:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d5c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6bf expref: 33 pid: 21480 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147724.857005:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796439168:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.857020:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1cf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.859569:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.859804:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793906816 00000100:00100000:3.0:1746147724.859814:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793906816 00000100:00100000:0.0:1746147724.860348:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.860433:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d25880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796439040:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147724.860449:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.860481:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967793906560:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3621us (4215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.860490:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8305 00000100:00100000:3.0:1746147724.860555:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16386 00000100:00100000:3.0:1746147724.860562:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:32133:x1830967793906816:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147724.860574:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.860588:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d68e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb752 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.860608:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.860615:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147724.860616:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147724.860619:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d68e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb752 expref: 34 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.860639:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.860647:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 21 pid: 22183 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147724.860655:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796439296:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.860690:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1cf900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147724.861034:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793906304:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 14447us (14608us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147724.861042:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7285 00002000:00100000:3.0:1746147724.861049:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880130d24380 x1830967793906304/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.861058:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d24380 with x1830967793906304 ext(1048576->2097151) 00002000:00010000:3.0:1746147724.861061:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d24380 00000100:00100000:2.0:1746147724.861179:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796438912:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147724.861186:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796439168:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.861199:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1241088->1794047] (req 1241088->1794047) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 34 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.861208:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f819400, rc 0) 00000100:00100000:2.0:1746147724.861222:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32138:x1830967793906688:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4395us (4936us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.861227:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16385 00000100:00100000:0.0:1746147724.861326:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.861367:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793906944 00000100:00100000:1.0:1746147724.861370:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793906944 00010000:00010000:1.0:1746147724.861384:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d63a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb705 expref: 20 pid: 9615 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746147724.861398:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8306 00000100:00100000:1.0:1746147724.861402:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967793906944:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.861408:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.861422:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d63a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb705 expref: 20 pid: 9615 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746147724.861429:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d63a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb705 expref: 20 pid: 9615 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746147724.861443:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0278e00/0xe64d3fbf12a7d63a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb705 expref: 20 pid: 9615 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746147724.861455:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.861466:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967793906944:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 64us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.861470:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8306 00000100:00100000:0.0:1746147724.861532:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.862570:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793907072 00000100:00100000:3.0:1746147724.862575:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793907072 00010000:00010000:3.0:1746147724.862590:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d5c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6bf expref: 34 pid: 21480 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147724.862609:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8307 00000100:00100000:3.0:1746147724.862614:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793907072:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147724.862620:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147724.862630:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d5c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6bf expref: 34 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746147724.862639:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d5c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6bf expref: 34 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746147724.862651:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fff8600/0xe64d3fbf12a7d5c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6bf expref: 34 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746147724.862664:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.862666:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.862671:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 33 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.862679:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 33 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.862700:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 33 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147724.862709:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796439424:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147724.862759:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1cfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147724.862774:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793907328 00000100:00100000:3.0:1746147724.862776:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793907328 00002000:00100000:3.0:1746147724.862794:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (2818048->2822143) req@ffff880130d25880 x1830967793907328/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.862801:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d25880 with x1830967793907328 ext(2818048->2822143) 00010000:00010000:3.0:1746147724.862807:0:31359:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 19 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147724.862815:0:31359:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 19 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:3.0:1746147724.862820:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130d25880 00000100:00100000:3.0:1746147724.862831:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1450 00000100:00100000:3.0:1746147724.862835:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1958:x1830967793907328:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147724.862956:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1958:x1830967793907328:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 120us (1423us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147724.862963:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1450 00002000:00100000:3.0:1746147724.862967:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (2818048->2822143) req@ffff880130d25880 x1830967793907328/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/4536 e 0 to 0 dl 1746147735 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.862973:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d25880 with x1830967793907328 ext(2818048->2822143) 00010000:00010000:3.0:1746147724.862977:0:31359:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 19 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147724.862985:0:31359:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 19 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:3.0:1746147724.862990:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130d25880 00000100:00100000:3.0:1746147724.864415:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796439296:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.864435:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d68e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb752 expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.864445:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e5000, rc 0) 00000100:00100000:3.0:1746147724.864481:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:32133:x1830967793906816:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3919us (4917us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.864487:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16386 00000100:00100000:0.0:1746147724.866420:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.866799:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796439424:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147724.866814:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147724.866842:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793907072:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4228us (5516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.866851:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8307 00000100:00100000:2.0:1746147724.866977:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793907584 00000100:00100000:2.0:1746147724.866983:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793907584 00002000:00100000:2.0:1746147724.867010:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1241088->1245183) req@ffff88009fe38380 x1830967793907584/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.867018:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe38380 with x1830967793907584 ext(1241088->1245183) 00002000:00010000:2.0:1746147724.867022:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe38380 00000100:00100000:2.0:1746147724.867034:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7286 00000100:00100000:2.0:1746147724.867039:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967793907584:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147724.867414:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967793907584:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 374us (999us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147724.867420:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7286 00002000:00100000:2.0:1746147724.867425:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1241088->1245183) req@ffff88009fe38380 x1830967793907584/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/4536 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.867431:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe38380 with x1830967793907584 ext(1241088->1245183) 00002000:00010000:2.0:1746147724.867433:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe38380 00000100:00100000:0.0:1746147724.867494:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147724.867570:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793907712 00000100:00100000:3.0:1746147724.867573:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793907712 00000100:00100000:3.0:1746147724.867590:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16387 00000100:00100000:3.0:1746147724.867594:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:32141:x1830967793907712:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147724.867602:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.867613:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d695 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb759 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.867631:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 31 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.867641:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147724.867642:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147724.867645:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d695 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb759 expref: 20 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.867666:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 31 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.867674:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 31 pid: 22183 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147724.867683:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796439552:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.867728:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1cfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.876047:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.876117:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.876158:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.876183:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793907968 00000100:00100000:0.0:1746147724.876190:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793907968 00002000:00100000:0.0:1746147724.876227:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1789952->1794047) req@ffff88009fe3b800 x1830967793907968/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.876237:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe3b800 with x1830967793907968 ext(1789952->1794047) 00010000:00010000:0.0:1746147724.876245:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 32 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746147724.876262:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 32 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:0.0:1746147724.876269:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe3b800 00000100:00100000:0.0:1746147724.876286:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793908352 00000100:00100000:0.0:1746147724.876289:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793908352 00002000:00100000:0.0:1746147724.876300:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2818048->3145727) req@ffff88009fe39500 x1830967793908352/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.876306:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39500 with x1830967793908352 ext(2818048->3145727) 00010000:00010000:0.0:1746147724.876310:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 21 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746147724.876318:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 21 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:0.0:1746147724.876323:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe39500 00000100:00100000:0.0:1746147724.876333:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1451 00000100:00100000:0.0:1746147724.876339:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967793907968:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147724.876472:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967793907968:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 132us (432us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147724.876478:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1451 00002000:00100000:0.0:1746147724.876483:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1789952->1794047) req@ffff88009fe3b800 x1830967793907968/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/4536 e 0 to 0 dl 1746147735 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.876489:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe3b800 with x1830967793907968 ext(1789952->1794047) 00010000:00010000:0.0:1746147724.876493:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 32 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746147724.876499:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 32 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:0.0:1746147724.876504:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe3b800 00000100:00100000:0.0:1746147724.876518:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1452 00000100:00100000:0.0:1746147724.876522:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967793908352:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:3.0:1746147724.876977:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796439552:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.876998:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d695 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb759 expref: 22 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.877008:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e5a00, rc 0) 00000100:00100000:3.0:1746147724.877025:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32141:x1830967793907712:12345-192.168.202.10@tcp:101:cat.0 Request processed in 9430us (9531us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.877030:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16387 00000100:00100000:3.0:1746147724.877040:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793908224 00000100:00100000:3.0:1746147724.877042:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793908224 00000100:00100000:3.0:1746147724.877055:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16388 00000100:00100000:3.0:1746147724.877059:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:32135:x1830967793908224:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147724.877066:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147724.877076:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb760 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.877089:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d5ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6cd expref: 31 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.877095:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7d641 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb713 expref: 25 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.877100:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.877101:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147724.877103:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->3764223] (req 3145728->3764223) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 25 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.877121:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7d641 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb713 expref: 25 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.877129:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7d641 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb713 expref: 25 pid: 22183 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147724.877136:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796439680:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.877184:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d5ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6cd expref: 31 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147724.877192:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d5ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6cd expref: 31 pid: 21480 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147724.877204:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796439808:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147724.877220:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1cfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147724.889660:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967793908352:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 13128us (13492us total) trans 21474841577 rc 0/0 00000100:00100000:2.0:1746147724.889672:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1452 00002000:00100000:2.0:1746147724.889683:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2818048->3145727) req@ffff88009fe39500 x1830967793908352/t21474841577(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/448 e 0 to 0 dl 1746147735 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.889692:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39500 with x1830967793908352 ext(2818048->3145727) 00010000:00010000:2.0:1746147724.889701:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 22 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147724.889713:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 22 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:2.0:1746147724.889733:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe39500 00000100:00100000:1.0:1746147724.892241:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.892272:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.892301:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.892320:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793908992 00000100:00100000:1.0:1746147724.892326:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793908992 00010000:00010000:1.0:1746147724.892352:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7d641 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb713 expref: 26 pid: 22183 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746147724.892372:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8308 00000100:00100000:1.0:1746147724.892377:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793908992:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.892387:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.892406:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7d641 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb713 expref: 26 pid: 22183 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746147724.892416:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7d641 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb713 expref: 26 pid: 22183 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746147724.892436:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147724.892462:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793908992:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 85us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147724.892468:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8308 00000100:00100000:1.0:1746147724.892539:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147724.892549:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793909120 00000100:00100000:1.0:1746147724.892551:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793909120 00010000:00010000:1.0:1746147724.892561:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d5ca lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6cd expref: 32 pid: 21480 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746147724.892571:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8309 00000100:00100000:1.0:1746147724.892575:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e387100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793909120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147724.892581:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147724.892587:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d5ca lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6cd expref: 32 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746147724.892595:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d5ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6cd expref: 32 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746147724.892604:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.892606:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147724.892611:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 25 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.892618:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 25 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147724.892640:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 25 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147724.892649:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796439936:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147724.892691:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.892780:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793908864 00000100:00100000:0.0:1746147724.892784:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793908864 00000100:00100000:0.0:1746147724.892806:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4986 00000100:00100000:0.0:1746147724.892810:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32138:x1830967793908864:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:0.0:1746147724.893009:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32138:x1830967793908864:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 197us (735us total) trans 8589945999 rc 0/0 00000100:00100000:0.0:1746147724.893014:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4986 00000100:00100000:3.0:1746147724.893334:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793908608 00000100:00100000:3.0:1746147724.893338:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793908608 00002000:00100000:3.0:1746147724.893358:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1241088->1794047) req@ffff88012e384e00 x1830967793908608/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.893366:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e384e00 with x1830967793908608 ext(1241088->1794047) 00010000:00010000:3.0:1746147724.893371:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 32 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147724.893379:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 32 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:3.0:1746147724.893384:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e384e00 00000100:00100000:3.0:1746147724.893405:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1453 00000100:00100000:3.0:1746147724.893409:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793908608:12345-192.168.202.10@tcp:4:multiop.0 00010000:00010000:0.0:1746147724.894253:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7d641 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb713 expref: 25 pid: 22183 timeout: 904 lvb_type: 1 00000100:00100000:0.0:1746147724.894267:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796439680:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.894511:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7d5ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6cd expref: 32 pid: 21480 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147724.895073:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796439808:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147724.895097:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 24 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147724.895111:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e5800, rc 0) 00000100:00100000:3.0:1746147724.895182:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:32135:x1830967793908224:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 18121us (19063us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147724.895189:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16388 00000100:00100000:0.0:1746147724.913232:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.913351:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796439936:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147724.913370:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147724.913406:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e387100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967793909120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 20830us (20866us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.913416:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8309 00000100:00100000:2.0:1746147724.913437:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793909248 00000100:00100000:2.0:1746147724.913441:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793909248 00010000:00010000:2.0:1746147724.913463:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 22 pid: 22183 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147724.913498:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8310 00000100:00100000:2.0:1746147724.913505:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967793909248:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.913517:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147724.913532:0:7095:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147724 -> 1746147725 00002000:00010000:2.0:1746147724.913535:0:7095:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147724 -> 1746147725 00010000:00010000:2.0:1746147724.913540:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 22 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147724.913549:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 22 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147724.913566:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134ede600/0xe64d3fbf12a7d680 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb744 expref: 22 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147724.913581:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.913583:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.913588:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d68e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb752 expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.913594:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d68e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb752 expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.913621:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d68e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb752 expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147724.913630:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796440064:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147724.913677:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147724.924988:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796440064:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147724.925007:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147724.925051:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967793909248:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 11546us (11825us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.925061:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8310 00000100:00100000:0.0:1746147724.928119:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.928147:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.928179:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793909504 00000100:00100000:0.0:1746147724.928189:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793909504 00002000:00100000:0.0:1746147724.928220:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3760128->3764223) req@ffff88009fe3a680 x1830967793909504/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.928230:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe3a680 with x1830967793909504 ext(3760128->3764223) 00002000:00010000:0.0:1746147724.928235:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe3a680 00000100:00100000:0.0:1746147724.928247:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793909760 00000100:00100000:0.0:1746147724.928249:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793909760 00002000:00100000:0.0:1746147724.928259:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fe38e00 x1830967793909760/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.928266:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe38e00 with x1830967793909760 ext(2097152->3145727) 00002000:00010000:0.0:1746147724.928269:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe38e00 00000100:00100000:0.0:1746147724.928278:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7287 00000100:00100000:0.0:1746147724.928284:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967793909504:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147724.928421:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967793909504:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 137us (308us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147724.928426:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7287 00002000:00100000:0.0:1746147724.928431:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3760128->3764223) req@ffff88009fe3a680 x1830967793909504/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/4536 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.928437:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe3a680 with x1830967793909504 ext(3760128->3764223) 00002000:00010000:0.0:1746147724.928439:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe3a680 00000100:00100000:0.0:1746147724.928451:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7288 00000100:00100000:0.0:1746147724.928455:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793909760:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147724.932228:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967793908608:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 38809us (39985us total) trans 21474841578 rc 0/0 00000100:00100000:3.0:1746147724.932238:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1453 00002000:00100000:3.0:1746147724.932247:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1241088->1794047) req@ffff88012e384e00 x1830967793908608/t21474841578(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/448 e 0 to 0 dl 1746147735 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.932256:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e384e00 with x1830967793908608 ext(1241088->1794047) 00010000:00010000:3.0:1746147724.932264:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 36 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147724.932278:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 36 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:3.0:1746147724.932285:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e384e00 00000100:00100000:1.0:1746147724.944011:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.944097:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793910016 00000100:00100000:2.0:1746147724.944106:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793910016 00000100:00100000:2.0:1746147724.944143:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4987 00000100:00100000:2.0:1746147724.944150:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:32135:x1830967793910016:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:2.0:1746147724.944332:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32135:x1830967793910016:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 182us (329us total) trans 8589946000 rc 0/0 00000100:00100000:2.0:1746147724.944338:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4987 00000100:00100000:0.0:1746147724.945148:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.946129:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793910144 00000100:00100000:2.0:1746147724.946134:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793910144 00010000:00010000:2.0:1746147724.946159:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 36 pid: 22183 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147724.947061:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8311 00000100:00100000:2.0:1746147724.947069:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6671450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967793910144:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147724.947080:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147724.947096:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 36 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147724.947107:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 36 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147724.947126:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d687 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1241088->1794047) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb74b expref: 36 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147724.947137:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.947139:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147724.947145:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d695 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb759 expref: 20 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.947152:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d695 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb759 expref: 20 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.947178:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d695 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb759 expref: 20 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147724.947187:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796440192:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147724.947250:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147724.947645:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793909760:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 19188us (19496us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147724.947656:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7288 00002000:00100000:0.0:1746147724.947663:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fe38e00 x1830967793909760/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147724.947670:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe38e00 with x1830967793909760 ext(2097152->3145727) 00002000:00010000:0.0:1746147724.947674:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe38e00 00000100:00100000:2.0:1746147724.953302:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796440192:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147724.953322:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147724.953408:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6671450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967793910144:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6339us (8259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.953418:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8311 00000100:00100000:0.0:1746147724.956813:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.956846:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.956914:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147724.956945:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793910784 00000100:00100000:0.0:1746147724.956951:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793910784 00000100:00100000:0.0:1746147724.956983:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16389 00000100:00100000:0.0:1746147724.956989:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:32133:x1830967793910784:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147724.957003:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147724.957016:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7d6a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb767 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.957039:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.957046:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147724.957048:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147724.957051:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7d6a3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb767 expref: 32 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.957074:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147724.957090:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 23 pid: 7050 timeout: 904 lvb_type: 0 00000100:00100000:0.0:1746147724.957101:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce61c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796440320:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147724.957161:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147724.957331:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793910528 00000100:00100000:3.0:1746147724.957334:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793910528 00002000:00100000:3.0:1746147724.957356:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009fe39c00 x1830967793910528/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.957364:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39c00 with x1830967793910528 ext(1048576->2097151) 00002000:00010000:3.0:1746147724.957368:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe39c00 00000100:00100000:3.0:1746147724.957378:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793910656 00000100:00100000:3.0:1746147724.957380:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793910656 00002000:00100000:3.0:1746147724.957388:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009ce60380 x1830967793910656/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.957395:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60380 with x1830967793910656 ext(1048576->2097151) 00002000:00010000:3.0:1746147724.957397:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60380 00000100:00100000:3.0:1746147724.957411:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7289 00000100:00100000:3.0:1746147724.957415:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793910528:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147724.959000:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7290 00000100:00100000:3.0:1746147724.959009:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967793910656:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147724.973090:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce61c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796440320:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147724.973121:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7d6a3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb767 expref: 32 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.973137:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03b7400, rc 0) 00000100:00100000:2.0:1746147724.974478:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:32133:x1830967793910784:12345-192.168.202.10@tcp:101:cat.0 Request processed in 17486us (17591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.974486:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16389 00000100:00100000:3.0:1746147724.975476:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793910528:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 18057us (18667us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147724.975484:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7289 00002000:00100000:3.0:1746147724.975492:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009fe39c00 x1830967793910528/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.975501:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe39c00 with x1830967793910528 ext(1048576->2097151) 00002000:00010000:3.0:1746147724.975506:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe39c00 00000100:00100000:0.0:1746147724.976651:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.976861:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793910912 00000100:00100000:2.0:1746147724.976867:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793910912 00002000:00100000:2.0:1746147724.976907:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3764223) req@ffff88009ce61500 x1830967793910912/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/0 e 0 to 0 dl 1746147735 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147724.976915:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61500 with x1830967793910912 ext(3145728->3764223) 00010000:00010000:2.0:1746147724.976923:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 24 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147724.976935:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 24 pid: 7050 timeout: 904 lvb_type: 0 00002000:00010000:2.0:1746147724.976941:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ce61500 00000100:00100000:2.0:1746147724.976956:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1454 00000100:00100000:2.0:1746147724.976961:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793910912:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:3.0:1746147724.978076:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967793910656:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 19066us (21226us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147724.978083:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7290 00002000:00100000:3.0:1746147724.978090:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009ce60380 x1830967793910656/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/440 e 0 to 0 dl 1746147735 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.978097:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60380 with x1830967793910656 ext(1048576->2097151) 00002000:00010000:3.0:1746147724.978101:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60380 00000100:00100000:2.0:1746147724.993074:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.993105:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793911040 00000100:00100000:2.0:1746147724.993112:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793911040 00000100:00100000:2.0:1746147724.993164:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16390 00000100:00100000:2.0:1746147724.993172:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32141:x1830967793911040:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147724.993187:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147724.993200:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7d6aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb76e expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.993223:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147724.993226:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147724.993229:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7d6aa lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb76e expref: 27 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.993240:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7d6aa lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb76e expref: 27 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147724.993249:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ede800, rc 0) 00000100:00100000:2.0:1746147724.993287:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32141:x1830967793911040:12345-192.168.202.10@tcp:101:cat.0 Request processed in 115us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147724.993293:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16390 00000100:00100000:3.0:1746147724.997068:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967793910912:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 20096us (20409us total) trans 17179874349 rc 0/0 00000100:00100000:3.0:1746147724.997080:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1454 00002000:00100000:3.0:1746147724.997090:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3764223) req@ffff88009ce61500 x1830967793910912/t17179874349(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:345/0 lens 488/448 e 0 to 0 dl 1746147735 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147724.997098:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61500 with x1830967793910912 ext(3145728->3764223) 00010000:00010000:3.0:1746147724.997106:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 27 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147724.997120:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 27 pid: 7050 timeout: 904 lvb_type: 0 00002000:00010000:3.0:1746147724.997126:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ce61500 00000100:00100000:0.0:1746147724.999391:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147724.999490:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793911168 00000100:00100000:2.0:1746147724.999497:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793911168 00010000:00010000:2.0:1746147724.999524:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 27 pid: 7050 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746147725.000404:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8312 00000100:00100000:1.0:1746147725.000414:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967793911168:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147725.000428:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147725.000450:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 27 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746147725.000462:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 27 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746147725.000487:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5800/0xe64d3fbf12a7d69c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb760 expref: 27 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746147725.000514:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.000516:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.000522:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7d6a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb767 expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.000529:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7d6a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb767 expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.000537:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.000538:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.000541:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7d6aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb76e expref: 26 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.000546:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7d6aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb76e expref: 26 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.000573:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7d6aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb76e expref: 26 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147725.000583:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796440448:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147725.000671:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7d6a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb767 expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147725.000683:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796440576:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147725.000700:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147725.004229:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796440448:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147725.004240:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796440576:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147725.004256:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147725.004303:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793911168:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3889us (4916us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147725.004313:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8312 00000100:00100000:0.0:1746147725.007483:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.007593:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793911424 00000100:00100000:3.0:1746147725.007600:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793911424 00002000:00100000:3.0:1746147725.007634:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009ce63800 x1830967793911424/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.007643:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63800 with x1830967793911424 ext(2097152->3145727) 00002000:00010000:3.0:1746147725.007647:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce63800 00000100:00100000:3.0:1746147725.007844:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7291 00000100:00100000:3.0:1746147725.007852:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793911424:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147725.017350:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.018196:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.018218:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793911680 00000100:00100000:0.0:1746147725.018224:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793911680 00002000:00100000:0.0:1746147725.018265:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009ce60a80 x1830967793911680/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147725.018273:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60a80 with x1830967793911680 ext(3145728->4194303) 00002000:00010000:0.0:1746147725.018278:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce60a80 00000100:00080000:1.0:1746147725.020277:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147725.020949:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793911936 00000100:00100000:1.0:1746147725.020957:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793911936 00002000:00100000:1.0:1746147725.021001:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009ce60000 x1830967793911936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147725.021010:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60000 with x1830967793911936 ext(3145728->4194303) 00002000:00010000:1.0:1746147725.021015:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60000 00000100:00100000:1.0:1746147725.021030:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7292 00000100:00100000:1.0:1746147725.021039:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793911680:12345-192.168.202.10@tcp:3:multiop.0 00000100:00080000:1.0:1746147725.022151:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147725.022223:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7293 00000100:00100000:2.0:1746147725.022233:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967793911936:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147725.041923:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793911424:12345-192.168.202.10@tcp:3:cat.0 Request processed in 34063us (34438us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147725.041934:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7291 00002000:00100000:3.0:1746147725.041946:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009ce63800 x1830967793911424/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.041955:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63800 with x1830967793911424 ext(2097152->3145727) 00002000:00010000:3.0:1746147725.041959:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce63800 00000100:00100000:1.0:1746147725.045050:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793911680:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 24005us (27700us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147725.045060:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7292 00002000:00100000:1.0:1746147725.045810:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009ce60a80 x1830967793911680/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147725.045821:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60a80 with x1830967793911680 ext(3145728->4194303) 00002000:00010000:1.0:1746147725.045827:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce60a80 00000100:00100000:2.0:1746147725.047915:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967793911936:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 25678us (29713us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147725.047925:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7293 00002000:00100000:2.0:1746147725.047933:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009ce60000 x1830967793911936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.047942:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60000 with x1830967793911936 ext(3145728->4194303) 00002000:00010000:2.0:1746147725.047946:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60000 00000100:00100000:0.0:1746147725.061618:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.063564:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793912064 00000100:00100000:2.0:1746147725.063576:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793912064 00000100:00100000:2.0:1746147725.063638:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16391 00000100:00100000:2.0:1746147725.063646:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32141:x1830967793912064:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147725.063662:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147725.063679:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d6b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb775 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.063701:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.063703:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.063709:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d6b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb775 expref: 22 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.063733:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d6b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb775 expref: 22 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.063741:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095092a00, rc 0) 00000100:00100000:2.0:1746147725.063797:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32141:x1830967793912064:12345-192.168.202.10@tcp:101:cat.0 Request processed in 152us (2186us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.063802:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16391 00000100:00100000:2.0:1746147725.065198:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.065201:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.065260:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793912448 00000100:00100000:1.0:1746147725.065274:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793912448 00000100:00100000:1.0:1746147725.065317:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16392 00000100:00100000:1.0:1746147725.065326:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967793912448:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147725.065336:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.065346:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7d6b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb77c expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147725.065414:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793912320 00000100:00100000:3.0:1746147725.065418:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793912320 00000100:00100000:3.0:1746147725.065440:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11990 00000100:00100000:3.0:1746147725.065445:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32145:x1830967793912320:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147725.065458:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.065468:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79c00/0xe64d3fbf12a7d6bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb783 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.065543:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.065545:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.065551:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7d6b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb77c expref: 34 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.065667:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7d6b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb77c expref: 34 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.065676:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0db400, rc 0) 00000100:00100000:1.0:1746147725.065714:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793912448:12345-192.168.202.10@tcp:101:cat.0 Request processed in 391us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.065728:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16392 00010000:00010000:3.0:1746147725.065908:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d6c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.065917:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d6c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.065924:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d6c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.065936:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a600/0xe64d3fbf12a7d6cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.065940:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a600/0xe64d3fbf12a7d6cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.065944:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a600/0xe64d3fbf12a7d6cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066030:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013aa00/0xe64d3fbf12a7d6d4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066039:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013013aa00/0xe64d3fbf12a7d6d4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066044:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013013aa00/0xe64d3fbf12a7d6d4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:3.0:1746147725.066051:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147725.066122:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d6c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066127:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d6c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066132:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d6c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066137:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc78c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147725.066140:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d6c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066145:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d6c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066153:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147725.066156:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147725.066158:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d6c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066163:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc78c00/0xe64d3fbf12a7d6c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066175:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a600/0xe64d3fbf12a7d6cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066183:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a600/0xe64d3fbf12a7d6cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066188:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a600/0xe64d3fbf12a7d6cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066191:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013013a600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147725.066193:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a600/0xe64d3fbf12a7d6cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066197:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a600/0xe64d3fbf12a7d6cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066202:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a02f4500) 00010000:00010000:3.0:1746147725.066204:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147725.066206:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a600/0xe64d3fbf12a7d6cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066209:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a600/0xe64d3fbf12a7d6cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.066241:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc79c00/0xe64d3fbf12a7d6bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb783 expref: 328 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.066249:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013aa00/0xe64d3fbf12a7d6d4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb783 expref: 327 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.066255:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.066257:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147725.066259:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013aa00, rc 0) 00000100:00100000:3.0:1746147725.067402:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32145:x1830967793912320:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1952us (2196us total) trans 8589946001 rc 0/0 00000100:00100000:3.0:1746147725.067410:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11990 00000100:00100000:0.0:1746147725.076271:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.076777:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793912704 00000100:00100000:2.0:1746147725.076786:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793912704 00002000:00100000:2.0:1746147725.076826:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a5e36a00 x1830967793912704/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.076835:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e36a00 with x1830967793912704 ext(4194304->5017599) 00002000:00010000:2.0:1746147725.076840:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e36a00 00000100:00100000:2.0:1746147725.076873:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7294 00000100:00100000:2.0:1746147725.076880:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793912704:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147725.079833:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.079851:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.079903:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.079911:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793913088 00000100:00100000:3.0:1746147725.079919:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793913088 00000100:00100000:0.0:1746147725.079928:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793913216 00000100:00100000:0.0:1746147725.079931:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793913216 00002000:00100000:3.0:1746147725.079954:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a5e35f80 x1830967793913088/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147725.079954:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a5e35500 x1830967793913216/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.079963:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e35f80 with x1830967793913088 ext(3145728->4194303) 00002000:00100000:0.0:1746147725.079963:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e35500 with x1830967793913216 ext(2097152->3145727) 00002000:00010000:3.0:1746147725.079968:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e35f80 00002000:00010000:0.0:1746147725.079968:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e35500 00000100:00100000:3.0:1746147725.080047:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793913344 00000100:00100000:3.0:1746147725.080050:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793913344 00000100:00100000:1.0:1746147725.080073:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7295 00000100:00100000:1.0:1746147725.080080:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967793913216:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147725.080526:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7296 00000100:00100000:0.0:1746147725.080531:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967793913088:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:3.0:1746147725.081917:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a5e34000 x1830967793913344/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.081927:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e34000 with x1830967793913344 ext(3145728->4194303) 00002000:00010000:3.0:1746147725.081931:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e34000 00000100:00100000:3.0:1746147725.081958:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7297 00000100:00100000:3.0:1746147725.081965:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793913344:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147725.088218:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793912704:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11330us (11946us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147725.088229:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7294 00002000:00100000:2.0:1746147725.088240:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a5e36a00 x1830967793912704/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.088248:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e36a00 with x1830967793912704 ext(4194304->5017599) 00002000:00010000:2.0:1746147725.088253:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e36a00 00000100:00100000:1.0:1746147725.103956:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793913216:12345-192.168.202.10@tcp:3:cat.0 Request processed in 23866us (24094us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147725.103968:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7295 00002000:00100000:1.0:1746147725.103979:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a5e35500 x1830967793913216/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147725.103988:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e35500 with x1830967793913216 ext(2097152->3145727) 00002000:00010000:1.0:1746147725.103993:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e35500 00000100:00100000:2.0:1746147725.104005:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967793913088:12345-192.168.202.10@tcp:3:cat.0 Request processed in 23471us (24176us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147725.104013:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7296 00002000:00100000:2.0:1746147725.104019:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a5e35f80 x1830967793913088/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.104027:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e35f80 with x1830967793913088 ext(3145728->4194303) 00002000:00010000:2.0:1746147725.104030:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5e35f80 00000100:00100000:3.0:1746147725.104828:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967793913344:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22859us (24940us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147725.104837:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7297 00002000:00100000:3.0:1746147725.104844:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a5e34000 x1830967793913344/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.104851:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5e34000 with x1830967793913344 ext(3145728->4194303) 00002000:00010000:3.0:1746147725.104854:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5e34000 00000100:00100000:0.0:1746147725.117797:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.118589:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793913728 00000100:00100000:3.0:1746147725.118598:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793913728 00002000:00100000:3.0:1746147725.118634:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a08aad80 x1830967793913728/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.118644:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08aad80 with x1830967793913728 ext(4194304->5017599) 00002000:00010000:3.0:1746147725.118649:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08aad80 00000100:00100000:3.0:1746147725.118677:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7298 00000100:00100000:3.0:1746147725.118683:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967793913728:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147725.135029:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967793913728:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16337us (17231us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746147725.135044:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7298 00002000:00100000:3.0:1746147725.135054:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a08aad80 x1830967793913728/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.135062:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08aad80 with x1830967793913728 ext(4194304->5017599) 00002000:00010000:3.0:1746147725.135067:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08aad80 00000100:00100000:0.0:1746147725.145492:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.145559:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793913984 00000100:00100000:1.0:1746147725.145568:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793913984 00000100:00100000:1.0:1746147725.146268:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4988 00000100:00100000:1.0:1746147725.146277:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32141:x1830967793913984:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:1.0:1746147725.146464:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32141:x1830967793913984:12345-192.168.202.10@tcp:35:cat.0 Request processed in 188us (978us total) trans 8589946002 rc 0/0 00000100:00100000:1.0:1746147725.146470:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4988 00000100:00100000:0.0:1746147725.189639:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.189838:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793914240 00000100:00100000:3.0:1746147725.189846:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793914240 00000100:00100000:3.0:1746147725.190569:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11991 00000100:00100000:3.0:1746147725.190578:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32149:x1830967793914240:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147725.190599:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.190619:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7d6e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb78a expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.190710:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a800/0xe64d3fbf12a7d6e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.190730:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a800/0xe64d3fbf12a7d6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.190742:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a800/0xe64d3fbf12a7d6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.190753:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7d6f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.190757:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7d6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.190762:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7d6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.190850:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b400/0xe64d3fbf12a7d6f7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.190856:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b400/0xe64d3fbf12a7d6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.190861:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b400/0xe64d3fbf12a7d6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:3.0:1746147725.190868:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147725.190948:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a800/0xe64d3fbf12a7d6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.190953:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a800/0xe64d3fbf12a7d6e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.190958:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a800/0xe64d3fbf12a7d6e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.190962:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013013a800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147725.190965:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a800/0xe64d3fbf12a7d6e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.190971:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a800/0xe64d3fbf12a7d6e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.190979:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147725.190981:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147725.190985:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a800/0xe64d3fbf12a7d6e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.190989:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a800/0xe64d3fbf12a7d6e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.191012:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7d6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.191017:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7d6f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.191021:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7d6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.191025:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013013b200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147725.191026:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7d6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.191030:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7d6f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.191035:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a02f4f00) 00010000:00010000:3.0:1746147725.191037:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147725.191039:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7d6f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.191043:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7d6f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.191075:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7d6e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb78a expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.191084:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b400/0xe64d3fbf12a7d6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb78a expref: 11 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.191090:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.191091:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147725.191093:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013b400, rc 0) 00000100:00100000:3.0:1746147725.191140:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32149:x1830967793914240:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 563us (1509us total) trans 8589946003 rc 0/0 00000100:00100000:3.0:1746147725.191146:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11991 00000100:00100000:0.0:1746147725.263675:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.263708:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.263754:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.263847:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793914496 00000100:00100000:1.0:1746147725.263854:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793914496 00002000:00100000:1.0:1746147725.263915:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a08a9500 x1830967793914496/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147725.263925:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a9500 with x1830967793914496 ext(0->1048575) 00002000:00010000:1.0:1746147725.263930:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08a9500 00000100:00100000:1.0:1746147725.263944:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793914752 00000100:00100000:1.0:1746147725.263946:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793914752 00002000:00100000:1.0:1746147725.263956:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a08aa680 x1830967793914752/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147725.263963:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08aa680 with x1830967793914752 ext(1048576->2097151) 00002000:00010000:1.0:1746147725.263966:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a08aa680 00000100:00100000:1.0:1746147725.263973:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7299 00000100:00100000:1.0:1746147725.263978:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967793914496:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147725.264944:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793915008 00000100:00100000:2.0:1746147725.264950:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793915008 00002000:00100000:2.0:1746147725.264968:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a08ab100 x1830967793915008/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.264976:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08ab100 with x1830967793915008 ext(1048576->2097151) 00002000:00010000:2.0:1746147725.264980:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a08ab100 00000100:00100000:2.0:1746147725.264999:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7300 00000100:00100000:2.0:1746147725.265006:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967793914752:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147725.265068:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7301 00000100:00100000:0.0:1746147725.265075:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967793915008:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147725.268349:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.269738:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793915264 00000100:00100000:3.0:1746147725.269746:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793915264 00002000:00100000:3.0:1746147725.269778:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a08a9f80 x1830967793915264/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.269787:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a9f80 with x1830967793915264 ext(1048576->2097151) 00002000:00010000:3.0:1746147725.269791:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08a9f80 00000100:00100000:3.0:1746147725.269810:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7302 00000100:00100000:3.0:1746147725.269817:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967793915264:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147725.292191:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967793914496:12345-192.168.202.10@tcp:3:cat.0 Request processed in 28203us (28514us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147725.292201:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7299 00002000:00100000:1.0:1746147725.292211:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a08a9500 x1830967793914496/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147725.292220:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a9500 with x1830967793914496 ext(0->1048575) 00002000:00010000:1.0:1746147725.292225:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08a9500 00000100:00100000:0.0:1746147725.296933:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.298064:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793915520 00000100:00100000:3.0:1746147725.298073:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793915520 00000100:00100000:3.0:1746147725.298121:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11992 00000100:00100000:3.0:1746147725.298128:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32157:x1830967793915520:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147725.298147:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.298162:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b800/0xe64d3fbf12a7d705 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb791 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.298233:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7d70c lrc: 3/1,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.298244:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7d70c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.298252:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7d70c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:3.0:1746147725.298259:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147725.298340:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b800/0xe64d3fbf12a7d705 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb791 expref: 14 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.298355:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7d70c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb791 expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.298361:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.298364:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746147725.298367:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013b000, rc 0) 00000100:00100000:0.0:1746147725.298412:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967793915008:12345-192.168.202.10@tcp:3:cat.0 Request processed in 33337us (34655us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147725.298421:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7301 00002000:00100000:0.0:1746147725.298429:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a08ab100 x1830967793915008/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147725.298435:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32157:x1830967793915520:12345-192.168.202.10@tcp:101:cat.0 Request processed in 307us (1509us total) trans 8589946004 rc 0/0 00002000:00100000:0.0:1746147725.298439:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08ab100 with x1830967793915008 ext(1048576->2097151) 00000100:00100000:3.0:1746147725.298441:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11992 00002000:00010000:0.0:1746147725.298442:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a08ab100 00000100:00100000:0.0:1746147725.318472:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.318623:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793915648 00000100:00100000:1.0:1746147725.318632:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793915648 00000100:00100000:1.0:1746147725.318680:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16393 00000100:00100000:1.0:1746147725.318687:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32149:x1830967793915648:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147725.318704:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.318734:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb798 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.318761:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d68e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb752 expref: 35 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.318769:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d6b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb775 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.318775:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.318776:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.318780:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3629056->4194303] (req 3629056->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 23 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.318807:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d6b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb775 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.318816:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d6b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb775 expref: 23 pid: 7050 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746147725.318832:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796440704:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147725.318941:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d68e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb752 expref: 35 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.318949:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d68e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb752 expref: 35 pid: 7050 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746147725.318957:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796440832:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147725.318974:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147725.319676:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967793914752:12345-192.168.202.10@tcp:3:cat.0 Request processed in 54670us (55966us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147725.319684:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7300 00002000:00100000:0.0:1746147725.319692:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a08aa680 x1830967793914752/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147725.319701:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08aa680 with x1830967793914752 ext(1048576->2097151) 00002000:00010000:0.0:1746147725.319705:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a08aa680 00000100:00100000:3.0:1746147725.321645:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967793915264:12345-192.168.202.10@tcp:3:cat.0 Request processed in 51823us (53296us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147725.321655:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7302 00002000:00100000:3.0:1746147725.321663:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a08a9f80 x1830967793915264/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.321676:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a9f80 with x1830967793915264 ext(1048576->2097151) 00002000:00010000:3.0:1746147725.321680:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08a9f80 00000100:00100000:1.0:1746147725.322363:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796440704:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147725.322371:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796440832:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147725.322392:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3629056->4194303] (req 3629056->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 23 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.322406:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091628e00, rc 0) 00000100:00100000:1.0:1746147725.322441:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:32149:x1830967793915648:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3754us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.322447:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16393 00000100:00100000:0.0:1746147725.325584:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.326270:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793916032 00000100:00100000:3.0:1746147725.326278:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793916032 00002000:00100000:3.0:1746147725.326313:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a02ac380 x1830967793916032/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.326322:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ac380 with x1830967793916032 ext(0->1048575) 00002000:00010000:3.0:1746147725.326327:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02ac380 00000100:00100000:3.0:1746147725.326353:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7303 00000100:00100000:3.0:1746147725.326360:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967793916032:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147725.329912:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.330057:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.330114:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793915904 00000100:00100000:2.0:1746147725.330121:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793915904 00010000:00010000:2.0:1746147725.330149:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d6b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb775 expref: 23 pid: 7050 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.330175:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793916160 00000100:00100000:2.0:1746147725.330177:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793916160 00010000:00010000:2.0:1746147725.330187:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d68e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb752 expref: 34 pid: 7050 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.330201:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8313 00000100:00100000:2.0:1746147725.330207:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967793915904:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.330218:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.330238:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d6b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb775 expref: 23 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.330247:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d6b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb775 expref: 23 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.330265:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d6b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb775 expref: 23 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.330285:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.330317:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967793915904:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 110us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.330322:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8313 00000100:00100000:2.0:1746147725.330335:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8314 00000100:00100000:2.0:1746147725.330339:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793916160:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.330343:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.330349:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d68e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb752 expref: 34 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.330357:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d68e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb752 expref: 34 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.330366:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5000/0xe64d3fbf12a7d68e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb752 expref: 34 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.330373:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.330375:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.330380:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.330387:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.330410:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.330420:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796440960:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147725.330462:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147725.338028:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.338166:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793916416 00000100:00100000:2.0:1746147725.338174:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793916416 00002000:00100000:2.0:1746147725.338212:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a02aca80 x1830967793916416/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.338221:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02aca80 with x1830967793916416 ext(2097152->3145727) 00002000:00010000:2.0:1746147725.338226:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02aca80 00000100:00100000:2.0:1746147725.338243:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7304 00000100:00100000:2.0:1746147725.338249:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793916416:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147725.341367:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967793916032:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14998us (15781us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147725.341378:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7303 00002000:00100000:3.0:1746147725.341389:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a02ac380 x1830967793916032/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.341397:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ac380 with x1830967793916032 ext(0->1048575) 00002000:00010000:3.0:1746147725.341401:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02ac380 00000100:00100000:0.0:1746147725.346401:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.346536:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793916544 00000100:00100000:1.0:1746147725.346544:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793916544 00000100:00100000:1.0:1746147725.346594:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16394 00000100:00100000:1.0:1746147725.346602:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32145:x1830967793916544:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147725.346617:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.346632:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb79f expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.346656:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.346663:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147725.346664:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147725.346667:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2322432->3145727] (req 2322432->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 35 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.346693:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.346703:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 21 pid: 22183 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746147725.346724:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796441088:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147725.346799:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147725.348233:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.348325:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793916800 00000100:00100000:0.0:1746147725.348330:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793916800 00002000:00100000:0.0:1746147725.348362:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3629056->3633151) req@ffff8800a02ad500 x1830967793916800/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147725.348371:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ad500 with x1830967793916800 ext(3629056->3633151) 00010000:00010000:0.0:1746147725.348378:0:31359:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 22 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746147725.348394:0:31359:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 22 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:0.0:1746147725.348400:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a02ad500 00000100:00100000:0.0:1746147725.348416:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1455 00000100:00100000:0.0:1746147725.348422:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967793916800:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147725.348562:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967793916800:12345-192.168.202.10@tcp:3:cat.0 Request processed in 139us (333us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147725.348568:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1455 00002000:00100000:0.0:1746147725.348573:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3629056->3633151) req@ffff8800a02ad500 x1830967793916800/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/4536 e 0 to 0 dl 1746147736 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147725.348580:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ad500 with x1830967793916800 ext(3629056->3633151) 00010000:00010000:0.0:1746147725.348584:0:31359:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 22 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746147725.348591:0:31359:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 22 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:0.0:1746147725.348596:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a02ad500 00000100:00100000:2.0:1746147725.348740:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796440960:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147725.348756:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.348779:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967793916160:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 18439us (18722us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.348787:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8314 00000100:00100000:1.0:1746147725.349130:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796441088:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147725.349144:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2322432->3145727] (req 2322432->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 34 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.349155:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a221e000, rc 0) 00000100:00100000:1.0:1746147725.349171:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32145:x1830967793916544:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2572us (2780us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.349177:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16394 00000100:00100000:3.0:1746147725.349698:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793916416:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11448us (11676us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147725.349705:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7304 00002000:00100000:3.0:1746147725.349711:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a02aca80 x1830967793916416/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.349727:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02aca80 with x1830967793916416 ext(2097152->3145727) 00002000:00010000:3.0:1746147725.349731:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02aca80 00000100:00100000:0.0:1746147725.361740:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.361779:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.361805:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.362123:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.363278:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793917056 00000100:00100000:3.0:1746147725.363287:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793917056 00002000:00100000:3.0:1746147725.363325:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3629056->4194303) req@ffff8800a02ae680 x1830967793917056/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.363335:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ae680 with x1830967793917056 ext(3629056->4194303) 00010000:00010000:3.0:1746147725.363344:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 22 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.363357:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 22 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:3.0:1746147725.363364:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a02ae680 00000100:00100000:3.0:1746147725.363386:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1456 00000100:00100000:3.0:1746147725.363391:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967793917056:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147725.364847:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793917184 00000100:00100000:1.0:1746147725.364853:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793917184 00000100:00100000:1.0:1746147725.364897:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793917312 00000100:00100000:1.0:1746147725.364899:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793917312 00000100:00100000:1.0:1746147725.364912:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793917440 00000100:00100000:1.0:1746147725.364913:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793917440 00000100:00100000:1.0:1746147725.364933:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16395 00000100:00100000:1.0:1746147725.364939:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32149:x1830967793917184:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147725.364949:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.364960:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb7a6 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.364980:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7d6a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb767 expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.364987:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7d6aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb76e expref: 27 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.364992:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.364994:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.364996:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [4194304->4481023] (req 4194304->4481023) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 27 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.365020:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7d6aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb76e expref: 27 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.365028:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7d6aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb76e expref: 27 pid: 7050 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746147725.365042:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796441216:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147725.365099:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7d6a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb767 expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.365107:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7d6a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb767 expref: 31 pid: 7050 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746147725.365114:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796441344:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147725.365128:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90c480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147725.365145:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16396 00000100:00100000:1.0:1746147725.365150:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32154:x1830967793917312:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147725.365156:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.365164:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d72f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb7ad expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.365173:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147725.365177:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2322432->3145727] (req 2322432->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 35 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.365182:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147725.365184:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d72f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ad expref: 35 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.365201:0:20619:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2322432->3145727] (req 2322432->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 35 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.365211:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d72f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ad expref: 35 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.365220:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009528f200, rc 0) 00000100:00100000:1.0:1746147725.365235:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:32154:x1830967793917312:12345-192.168.202.10@tcp:101:cat.0 Request processed in 85us (3429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.365240:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16396 00000100:00100000:1.0:1746147725.365250:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16397 00000100:00100000:1.0:1746147725.365254:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:32157:x1830967793917440:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147725.365259:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.365262:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7d736 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb7b4 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.365271:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147725.365273:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7d736 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7b4 expref: 25 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.365280:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7d736 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7b4 expref: 25 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.365285:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009528e800, rc 0) 00000100:00100000:1.0:1746147725.365294:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32157:x1830967793917440:12345-192.168.202.10@tcp:101:cat.0 Request processed in 39us (3171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.365297:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16397 00000100:00100000:1.0:1746147725.369700:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796441216:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147725.369711:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796441344:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147725.369745:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [4194304->4481023] (req 4194304->4481023) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 27 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.369761:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095698600, rc 0) 00000100:00100000:1.0:1746147725.369808:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32149:x1830967793917184:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4869us (8028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.369816:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16395 00000100:00100000:0.0:1746147725.378083:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.378902:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793917568 00000100:00100000:2.0:1746147725.378910:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793917568 00010000:00010000:2.0:1746147725.378938:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7d6a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb767 expref: 32 pid: 7050 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.378968:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8315 00000100:00100000:2.0:1746147725.378975:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793917568:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.378986:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.379003:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7d6a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb767 expref: 32 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.379012:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7d6a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb767 expref: 32 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.379029:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7d6a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb767 expref: 32 pid: 7050 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147725.380030:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967793917056:12345-192.168.202.10@tcp:4:cat.0 Request processed in 16633us (18292us total) trans 21474841579 rc 0/0 00000100:00100000:3.0:1746147725.380040:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1456 00002000:00100000:3.0:1746147725.380049:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3629056->4194303) req@ffff8800a02ae680 x1830967793917056/t21474841579(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/448 e 0 to 0 dl 1746147736 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.380058:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ae680 with x1830967793917056 ext(3629056->4194303) 00010000:00010000:3.0:1746147725.380066:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 25 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.380077:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 25 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:3.0:1746147725.380083:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a02ae680 00010000:00010000:2.0:1746147725.380184:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.380723:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967793917568:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1737us (2638us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.380730:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8315 00000100:00100000:1.0:1746147725.380767:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.382158:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793917696 00000100:00100000:2.0:1746147725.382166:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793917696 00010000:00010000:2.0:1746147725.382190:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7d6aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb76e expref: 27 pid: 7050 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.382223:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8316 00000100:00100000:2.0:1746147725.382229:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793917696:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.382240:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.382258:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7d6aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb76e expref: 27 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.382267:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7d6aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb76e expref: 27 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.382291:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134ede800/0xe64d3fbf12a7d6aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb76e expref: 27 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.382303:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.382304:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.382309:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.382316:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.382342:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.382350:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796441600:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147725.382411:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147725.389201:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.389557:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793917824 00000100:00100000:1.0:1746147725.389565:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793917824 00010000:00010000:1.0:1746147725.389593:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 25 pid: 22183 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746147725.389627:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8317 00000100:00100000:1.0:1746147725.389633:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1957:x1830967793917824:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147725.389645:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147725.389661:0:7095:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147725 -> 1746147726 00002000:00010000:1.0:1746147725.389664:0:7095:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147725 -> 1746147726 00010000:00010000:1.0:1746147725.389668:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 25 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746147725.389678:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 25 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746147725.389702:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091628e00/0xe64d3fbf12a7d71a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3629056->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb798 expref: 25 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746147725.389728:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.389729:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.389736:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 34 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.389742:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 34 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.389770:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 34 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.389779:0:7095:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 34 pid: 22183 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746147725.389788:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091631880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796441728:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147725.389847:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90c480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147725.390788:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796441600:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147725.390807:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.390844:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967793917696:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 8615us (10077us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.390853:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8316 00000100:00100000:2.0:1746147725.391442:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091631880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796441728:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147725.391451:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147725.391457:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.391471:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967793917824:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1838us (2277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.391480:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8317 00000100:00100000:3.0:1746147725.391576:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793918080 00000100:00100000:3.0:1746147725.391582:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793918080 00002000:00100000:3.0:1746147725.391611:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (4476928->4481023) req@ffff8800a02adf80 x1830967793918080/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.391619:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02adf80 with x1830967793918080 ext(4476928->4481023) 00002000:00010000:3.0:1746147725.391623:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02adf80 00000100:00100000:3.0:1746147725.391646:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7305 00000100:00100000:3.0:1746147725.391652:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793918080:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147725.391792:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793918080:12345-192.168.202.10@tcp:3:cat.0 Request processed in 140us (336us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147725.391798:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7305 00002000:00100000:3.0:1746147725.391807:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (4476928->4481023) req@ffff8800a02adf80 x1830967793918080/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/4536 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.391814:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02adf80 with x1830967793918080 ext(4476928->4481023) 00002000:00010000:3.0:1746147725.391816:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a02adf80 00000100:00100000:0.0:1746147725.396709:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.397926:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793918336 00000100:00100000:3.0:1746147725.397935:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793918336 00002000:00100000:3.0:1746147725.397974:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2322432->2326527) req@ffff8800a02ad180 x1830967793918336/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.397983:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ad180 with x1830967793918336 ext(2322432->2326527) 00010000:00010000:3.0:1746147725.397992:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 35 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.398011:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 35 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:3.0:1746147725.398017:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a02ad180 00000100:00100000:3.0:1746147725.398053:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1457 00000100:00100000:3.0:1746147725.398060:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967793918336:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147725.398323:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967793918336:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 263us (1620us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147725.398329:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1457 00002000:00100000:3.0:1746147725.398334:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2322432->2326527) req@ffff8800a02ad180 x1830967793918336/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/4536 e 0 to 0 dl 1746147736 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.398341:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ad180 with x1830967793918336 ext(2322432->2326527) 00010000:00010000:3.0:1746147725.398345:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 35 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.398354:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 35 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:3.0:1746147725.398359:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a02ad180 00000100:00100000:0.0:1746147725.398688:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.399108:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793918592 00000100:00100000:3.0:1746147725.399111:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793918592 00000100:00100000:3.0:1746147725.399146:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4989 00000100:00100000:3.0:1746147725.399151:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32149:x1830967793918592:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147725.399332:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32149:x1830967793918592:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 180us (644us total) trans 8589946005 rc 0/0 00000100:00100000:3.0:1746147725.399337:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4989 00000100:00100000:0.0:1746147725.406246:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.406624:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.406675:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793918848 00000100:00100000:1.0:1746147725.406682:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793918848 00000100:00100000:1.0:1746147725.406728:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16398 00000100:00100000:1.0:1746147725.406736:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:32145:x1830967793918848:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147725.406751:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147725.406815:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793918976 00000100:00100000:3.0:1746147725.406820:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793918976 00002000:00100000:3.0:1746147725.406846:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2322432->3145727) req@ffff88009b10aa00 x1830967793918976/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.406855:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10aa00 with x1830967793918976 ext(2322432->3145727) 00010000:00010000:3.0:1746147725.406863:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 35 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.406875:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 35 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:3.0:1746147725.406905:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b10aa00 00000100:00100000:3.0:1746147725.406934:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1458 00000100:00100000:3.0:1746147725.406940:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967793918976:12345-192.168.202.10@tcp:4:multiop.0 00010000:00010000:1.0:1746147725.407186:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb7bb expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.407210:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 25 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.407216:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147725.407218:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147725.407221:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->3301375] (req 3145728->3301375) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 32 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.407247:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 25 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.407256:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 25 pid: 8469 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746147725.407267:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796441856:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147725.407792:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147725.415814:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.415906:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793919104 00000100:00100000:3.0:1746147725.415914:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793919104 00002000:00100000:3.0:1746147725.415952:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4481023) req@ffff88009505e680 x1830967793919104/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.415961:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505e680 with x1830967793919104 ext(4194304->4481023) 00010000:00010000:3.0:1746147725.415970:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 26 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.415987:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 26 pid: 8469 timeout: 904 lvb_type: 0 00002000:00010000:3.0:1746147725.415994:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009505e680 00000100:00100000:3.0:1746147725.416023:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1459 00000100:00100000:3.0:1746147725.416030:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967793919104:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147725.416064:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796441856:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147725.416087:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->3301375] (req 3145728->3301375) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 32 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.416099:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9323e00, rc 0) 00000100:00100000:1.0:1746147725.416201:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:32145:x1830967793918848:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 9466us (9962us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.416208:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16398 00000100:00100000:2.0:1746147725.425970:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793919104:12345-192.168.202.10@tcp:4:cat.0 Request processed in 9931us (10156us total) trans 17179874350 rc 0/0 00000100:00100000:2.0:1746147725.425982:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1459 00002000:00100000:2.0:1746147725.425992:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4481023) req@ffff88009505e680 x1830967793919104/t17179874350(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/448 e 0 to 0 dl 1746147736 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.426000:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505e680 with x1830967793919104 ext(4194304->4481023) 00010000:00010000:2.0:1746147725.426007:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 28 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.426019:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 28 pid: 8469 timeout: 904 lvb_type: 0 00002000:00010000:2.0:1746147725.426025:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009505e680 00000100:00100000:2.0:1746147725.429664:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1959:x1830967793918976:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 22716us (23032us total) trans 21474841580 rc 0/0 00000100:00100000:2.0:1746147725.429674:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1458 00002000:00100000:2.0:1746147725.429683:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2322432->3145727) req@ffff88009b10aa00 x1830967793918976/t21474841580(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/448 e 0 to 0 dl 1746147736 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.429692:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10aa00 with x1830967793918976 ext(2322432->3145727) 00010000:00010000:2.0:1746147725.429700:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 37 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.429727:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 37 pid: 22183 timeout: 904 lvb_type: 0 00002000:00010000:2.0:1746147725.429733:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b10aa00 00000100:00100000:1.0:1746147725.431952:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.433068:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793919232 00000100:00100000:2.0:1746147725.433077:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793919232 00010000:00010000:2.0:1746147725.433107:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 28 pid: 8469 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.433143:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8318 00000100:00100000:2.0:1746147725.433150:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6672c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793919232:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.433167:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147725.433183:0:7095:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147725 -> 1746147726 00002000:00010000:2.0:1746147725.433186:0:7095:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147725 -> 1746147726 00010000:00010000:2.0:1746147725.433190:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 28 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.433200:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 28 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.433219:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095698600/0xe64d3fbf12a7d728 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7a6 expref: 28 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.433233:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.433235:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.433242:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 31 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.433249:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 31 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.433277:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 31 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.433288:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796441984:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147725.433912:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147725.434215:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.434375:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793919360 00000100:00100000:2.0:1746147725.434380:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793919360 00010000:00010000:2.0:1746147725.434397:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 37 pid: 22183 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.434413:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8319 00000100:00100000:2.0:1746147725.434418:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793919360:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.434425:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.434438:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 37 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.434452:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 37 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.434466:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d721 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb79f expref: 37 pid: 22183 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.434479:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.434481:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.434485:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d72f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ad expref: 36 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.434492:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d72f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ad expref: 36 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.434497:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.434499:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.434502:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7d736 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7b4 expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.434507:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7d736 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7b4 expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.434524:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7d736 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7b4 expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.434532:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796442112:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147725.435137:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d72f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ad expref: 36 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.435146:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796442240:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147725.435586:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147725.436134:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796441984:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147725.436150:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.436230:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6672c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967793919232:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3078us (4281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.436239:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8318 00000100:00100000:2.0:1746147725.441673:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796442112:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147725.442102:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.442509:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796442240:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147725.442532:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147725.442549:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793919616 00000100:00100000:3.0:1746147725.442555:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793919616 00002000:00100000:3.0:1746147725.442588:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009b108a80 x1830967793919616/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.442596:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b108a80 with x1830967793919616 ext(2097152->3145727) 00002000:00010000:3.0:1746147725.442600:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b108a80 00000100:00100000:3.0:1746147725.442619:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7306 00000100:00100000:3.0:1746147725.442625:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1960:x1830967793919616:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147725.442633:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793919360:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 8212us (8417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.442641:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8319 00000100:00100000:0.0:1746147725.445771:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.448879:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793919872 00000100:00100000:2.0:1746147725.448901:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793919872 00002000:00100000:2.0:1746147725.448941:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009b109c00 x1830967793919872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.448949:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b109c00 with x1830967793919872 ext(2097152->3145727) 00002000:00010000:2.0:1746147725.448953:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b109c00 00000100:00100000:2.0:1746147725.448979:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7307 00000100:00100000:2.0:1746147725.448985:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967793919872:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147725.452597:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.453871:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793920128 00000100:00100000:0.0:1746147725.454009:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793920128 00002000:00100000:1.0:1746147725.454297:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3297280->3301375) req@ffff88009505c380 x1830967793920128/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147725.454307:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505c380 with x1830967793920128 ext(3297280->3301375) 00002000:00010000:1.0:1746147725.454311:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009505c380 00000100:00100000:1.0:1746147725.456372:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7308 00000100:00100000:1.0:1746147725.456385:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793920128:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147725.456564:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793920128:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 181us (3973us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147725.456571:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7308 00002000:00100000:1.0:1746147725.456577:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3297280->3301375) req@ffff88009505c380 x1830967793920128/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/4536 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147725.456585:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009505c380 with x1830967793920128 ext(3297280->3301375) 00002000:00010000:1.0:1746147725.456589:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009505c380 00000100:00100000:3.0:1746147725.467972:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967793919616:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 25338us (25862us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147725.467984:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7306 00002000:00100000:3.0:1746147725.467994:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009b108a80 x1830967793919616/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.468002:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b108a80 with x1830967793919616 ext(2097152->3145727) 00002000:00010000:3.0:1746147725.468007:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b108a80 00000100:00100000:1.0:1746147725.468194:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.468214:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793920384 00000100:00100000:1.0:1746147725.468220:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793920384 00000100:00100000:1.0:1746147725.468244:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4990 00000100:00100000:1.0:1746147725.468250:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32145:x1830967793920384:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:1.0:1746147725.468401:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32145:x1830967793920384:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 151us (207us total) trans 8589946006 rc 0/0 00000100:00100000:1.0:1746147725.468407:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4990 00000100:00100000:3.0:1746147725.468700:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967793919872:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19714us (22935us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147725.468707:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7307 00002000:00100000:3.0:1746147725.468722:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009b109c00 x1830967793919872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.468730:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b109c00 with x1830967793919872 ext(2097152->3145727) 00002000:00010000:3.0:1746147725.468733:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b109c00 00000100:00100000:0.0:1746147725.478866:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.479661:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793920512 00000100:00100000:1.0:1746147725.479669:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793920512 00000100:00100000:0.0:1746147725.480751:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.480819:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793920768 00000100:00100000:3.0:1746147725.480824:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793920768 00002000:00100000:3.0:1746147725.480855:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3301376->4194303) req@ffff88009b108380 x1830967793920768/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.480863:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b108380 with x1830967793920768 ext(3301376->4194303) 00002000:00010000:3.0:1746147725.480868:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b108380 00000100:00100000:3.0:1746147725.480909:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7309 00000100:00100000:3.0:1746147725.480917:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793920768:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147725.483129:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16399 00000100:00100000:1.0:1746147725.483143:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32157:x1830967793920512:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147725.483157:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.483171:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136273e00/0xe64d3fbf12a7d744 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb7c2 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.483194:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 33 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.483201:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147725.483202:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147725.483205:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136273e00/0xe64d3fbf12a7d744 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7c2 expref: 28 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.483230:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 33 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.483240:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 33 pid: 8469 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746147725.483251:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796442368:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147725.483324:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147725.487087:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.489033:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793921024 00000100:00100000:2.0:1746147725.489043:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793921024 00002000:00100000:2.0:1746147725.489084:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009b10bb80 x1830967793921024/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.489093:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10bb80 with x1830967793921024 ext(3145728->4194303) 00002000:00010000:2.0:1746147725.489099:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b10bb80 00000100:00100000:2.0:1746147725.489128:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7310 00000100:00100000:2.0:1746147725.489135:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967793921024:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147725.492230:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967793920768:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 11306us (11475us total) trans 0 rc 892928/892928 00000100:00100000:0.0:1746147725.492240:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7309 00002000:00100000:0.0:1746147725.492250:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3301376->4194303) req@ffff88009b108380 x1830967793920768/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 892928/892928 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147725.492258:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b108380 with x1830967793920768 ext(3301376->4194303) 00010000:00010000:0.0:1746147725.492267:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 32 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746147725.492280:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 32 pid: 8469 timeout: 904 lvb_type: 0 00002000:00010000:0.0:1746147725.492287:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b108380 00000100:00100000:1.0:1746147725.500165:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796442368:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147725.500189:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136273e00/0xe64d3fbf12a7d744 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7c2 expref: 28 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.500203:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136273e00, rc 0) 00000100:00100000:1.0:1746147725.500249:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32157:x1830967793920512:12345-192.168.202.10@tcp:101:cat.0 Request processed in 17110us (21390us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147725.500254:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.500257:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16399 00000100:00100000:0.0:1746147725.500278:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793921152 00000100:00100000:0.0:1746147725.500283:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793921152 00002000:00100000:0.0:1746147725.500312:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3301375) req@ffff88009b108000 x1830967793921152/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147725.500320:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b108000 with x1830967793921152 ext(3145728->3301375) 00010000:00010000:0.0:1746147725.500325:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 32 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746147725.500334:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 32 pid: 8469 timeout: 904 lvb_type: 0 00002000:00010000:0.0:1746147725.500340:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b108000 00000100:00100000:0.0:1746147725.500353:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1460 00000100:00100000:0.0:1746147725.500359:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793921152:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:3.0:1746147725.501041:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967793921024:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 11905us (13958us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147725.501048:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7310 00002000:00100000:3.0:1746147725.501054:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009b10bb80 x1830967793921024/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.501061:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10bb80 with x1830967793921024 ext(3145728->4194303) 00002000:00010000:3.0:1746147725.501064:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b10bb80 00000100:00100000:2.0:1746147725.502709:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793921152:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 2345us (2450us total) trans 17179874351 rc 0/0 00000100:00100000:2.0:1746147725.502726:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1460 00002000:00100000:2.0:1746147725.502733:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3301375) req@ffff88009b108000 x1830967793921152/t17179874351(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/448 e 0 to 0 dl 1746147736 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.502740:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b108000 with x1830967793921152 ext(3145728->3301375) 00010000:00010000:2.0:1746147725.502747:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 34 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.502760:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 34 pid: 8469 timeout: 904 lvb_type: 0 00002000:00010000:2.0:1746147725.502766:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b108000 00000100:00100000:0.0:1746147725.505878:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.506617:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793921280 00000100:00100000:1.0:1746147725.506625:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793921280 00000100:00100000:1.0:1746147725.506989:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16400 00000100:00100000:1.0:1746147725.506996:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967793921280:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147725.507010:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.507024:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136273200/0xe64d3fbf12a7d74b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb7c9 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147725.507064:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796442496:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147725.507135:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147725.508414:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.508491:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793921408 00000100:00100000:2.0:1746147725.508496:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793921408 00010000:00010000:2.0:1746147725.508515:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 36 pid: 8469 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.508534:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8320 00000100:00100000:2.0:1746147725.508538:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967793921408:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.508547:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147725.508563:0:15900:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147725 -> 1746147726 00010000:00010000:2.0:1746147725.508569:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 36 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.508580:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 36 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.508599:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.508601:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.508608:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136273e00/0xe64d3fbf12a7d744 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7c2 expref: 27 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.508616:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136273e00/0xe64d3fbf12a7d744 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7c2 expref: 27 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.508639:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136273e00/0xe64d3fbf12a7d744 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7c2 expref: 27 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.508648:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796442624:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147725.508707:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746147725.509217:0:8469:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.10@tcp) returned -22 from glimpse AST (req@ffff880091630700 x1830967796442496) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 36 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746147725.509234:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7d73d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7bb expref: 36 pid: 8469 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746147725.509265:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796442496:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147725.509282:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136273200/0xe64d3fbf12a7d74b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7c9 expref: 35 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.509290:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136273200/0xe64d3fbf12a7d74b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7c9 expref: 35 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.509301:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136273200, rc 0) 00000100:00100000:1.0:1746147725.509341:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967793921280:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2345us (3470us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147725.509347:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16400 00000100:00100000:0.0:1746147725.511703:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.511841:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793921536 00000100:00100000:1.0:1746147725.511847:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793921536 00000100:00100000:1.0:1746147725.511912:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16401 00000100:00100000:1.0:1746147725.511919:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32154:x1830967793921536:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147725.511933:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.511946:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136272800/0xe64d3fbf12a7d752 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb7d0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.511967:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.511968:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.511973:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136272800/0xe64d3fbf12a7d752 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d0 expref: 35 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.511984:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136272800/0xe64d3fbf12a7d752 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d0 expref: 35 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.511992:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136272800, rc 0) 00000100:00100000:1.0:1746147725.512032:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:32154:x1830967793921536:12345-192.168.202.10@tcp:101:cat.0 Request processed in 112us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.512037:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16401 00000100:00100000:2.0:1746147725.512201:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796442624:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147725.512218:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.512255:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793921408:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3715us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.512264:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8320 00000100:00100000:0.0:1746147725.516117:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.516205:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793921920 00000100:00100000:2.0:1746147725.516212:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793921920 00002000:00100000:2.0:1746147725.516248:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009b10b480 x1830967793921920/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.516258:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10b480 with x1830967793921920 ext(3145728->4194303) 00002000:00010000:2.0:1746147725.516263:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b10b480 00000100:00100000:2.0:1746147725.516292:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7311 00000100:00100000:2.0:1746147725.516299:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967793921920:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147725.517486:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.517518:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793922176 00000100:00100000:3.0:1746147725.517523:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793922176 00002000:00100000:3.0:1746147725.517544:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800951d6300 x1830967793922176/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.517552:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d6300 with x1830967793922176 ext(3145728->4194303) 00002000:00010000:3.0:1746147725.517556:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d6300 00000100:00100000:3.0:1746147725.517569:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7312 00000100:00100000:3.0:1746147725.517575:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967793922176:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147725.518790:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.518934:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793922304 00000100:00100000:3.0:1746147725.518939:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793922304 00002000:00100000:3.0:1746147725.518959:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880091630700 x1830967793922304/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.518967:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091630700 with x1830967793922304 ext(4194304->5017599) 00002000:00010000:3.0:1746147725.518971:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091630700 00000100:00100000:3.0:1746147725.519120:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7313 00000100:00100000:3.0:1746147725.519126:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793922304:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147725.529037:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967793921920:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12728us (12917us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147725.529049:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7311 00002000:00100000:2.0:1746147725.529059:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009b10b480 x1830967793921920/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.529068:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10b480 with x1830967793921920 ext(3145728->4194303) 00002000:00010000:2.0:1746147725.529073:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b10b480 00000100:00100000:3.0:1746147725.534125:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967793922176:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16541us (16632us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147725.534135:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7312 00002000:00100000:3.0:1746147725.534145:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800951d6300 x1830967793922176/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.534153:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d6300 with x1830967793922176 ext(3145728->4194303) 00002000:00010000:3.0:1746147725.534158:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d6300 00000100:00100000:2.0:1746147725.534579:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793922304:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15450us (15789us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147725.534587:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7313 00002000:00100000:2.0:1746147725.534592:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880091630700 x1830967793922304/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.534600:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091630700 with x1830967793922304 ext(4194304->5017599) 00002000:00010000:2.0:1746147725.534604:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091630700 00000100:00100000:0.0:1746147725.544256:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.544314:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793922560 00000100:00100000:2.0:1746147725.544321:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793922560 00002000:00100000:2.0:1746147725.544355:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800951d4a80 x1830967793922560/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.544363:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d4a80 with x1830967793922560 ext(4194304->5017599) 00002000:00010000:2.0:1746147725.544369:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800951d4a80 00000100:00100000:2.0:1746147725.545672:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7314 00000100:00100000:2.0:1746147725.545683:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793922560:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147725.564273:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793922560:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18584us (20014us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147725.564284:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7314 00002000:00100000:2.0:1746147725.564296:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800951d4a80 x1830967793922560/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.564306:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d4a80 with x1830967793922560 ext(4194304->5017599) 00002000:00010000:2.0:1746147725.564311:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800951d4a80 00000100:00100000:0.0:1746147725.594049:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.596512:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793922688 00000100:00100000:2.0:1746147725.596523:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793922688 00000100:00100000:2.0:1746147725.597865:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11993 00000100:00100000:2.0:1746147725.597876:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+6:32162:x1830967793922688:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147725.597911:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147725.597927:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7d759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb7d7 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.597982:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d760 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.597992:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598001:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598011:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7d767 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598017:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7d767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598022:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7d767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598118:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7d76e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598125:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7d76e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598130:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7d76e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147725.598157:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147725.598161:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147725.598176:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7d76e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598184:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7d76e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598190:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598194:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d760 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598199:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d760 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598203:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095092a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147725.598206:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d760 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598212:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d760 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598221:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147725.598224:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147725.598227:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d760 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.598231:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d760 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.599217:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7d767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.599225:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7d767 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.599230:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7d767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.599234:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095093400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147725.599236:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7d767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.599241:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7d767 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.599248:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bd4a000) 00010000:00010000:2.0:1746147725.599250:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147725.599253:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7d767 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.599257:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7d767 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.599297:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7d759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d7 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.599308:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7d76e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d7 expref: 7 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.599314:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147725.599315:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147725.599317:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095093a00, rc 0) 00000100:00100000:2.0:1746147725.599376:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+7:32162:x1830967793922688:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1503us (5335us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.599383:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11993 00000100:00100000:0.0:1746147725.603203:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.603540:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793922816 00000100:00100000:1.0:1746147725.603549:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793922816 00000100:00100000:1.0:1746147725.603589:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16402 00000100:00100000:1.0:1746147725.603596:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+5:1960:x1830967793922816:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147725.603611:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.603625:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136273200/0xe64d3fbf12a7d775 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb7de expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.603646:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.603647:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.603655:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136273200/0xe64d3fbf12a7d775 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7de expref: 6 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.603667:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136273200/0xe64d3fbf12a7d775 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7de expref: 6 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.603677:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136273200, rc 0) 00000100:00100000:1.0:1746147725.603721:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967793922816:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 126us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.603727:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16402 00000100:00100000:1.0:1746147725.606965:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.607000:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.607020:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793922944 00000100:00100000:1.0:1746147725.607026:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793922944 00000100:00100000:1.0:1746147725.607066:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793923072 00000100:00100000:1.0:1746147725.607069:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793923072 00000100:00100000:1.0:1746147725.607084:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16403 00000100:00100000:1.0:1746147725.607091:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793922944:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147725.607108:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.607125:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7d77c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb7e5 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.607144:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.607146:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.607153:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7d77c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7e5 expref: 8 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.607166:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7d77c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7e5 expref: 8 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.607176:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e7800, rc 0) 00000100:00100000:1.0:1746147725.607210:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793922944:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 119us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.607216:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16403 00000100:00100000:1.0:1746147725.607229:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16404 00000100:00100000:1.0:1746147725.607234:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967793923072:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147725.607239:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.607246:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136273c00/0xe64d3fbf12a7d783 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb7ec expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.607255:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.607256:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.607260:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136273c00/0xe64d3fbf12a7d783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ec expref: 8 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.607268:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136273c00/0xe64d3fbf12a7d783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ec expref: 8 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.607275:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136273c00, rc 0) 00000100:00100000:1.0:1746147725.607288:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793923072:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 55us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.607293:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16404 00000100:00100000:1.0:1746147725.607332:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.607345:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793923200 00000100:00100000:1.0:1746147725.607348:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793923200 00000100:00100000:1.0:1746147725.607364:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16405 00000100:00100000:1.0:1746147725.607368:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967793923200:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147725.607375:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.607384:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5516600/0xe64d3fbf12a7d78a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb7f3 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.607394:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.607395:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.607399:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5516600/0xe64d3fbf12a7d78a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7f3 expref: 7 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.607407:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5516600/0xe64d3fbf12a7d78a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7f3 expref: 7 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.607413:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5516600, rc 0) 00000100:00100000:1.0:1746147725.607427:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967793923200:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 58us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.607432:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16405 00000100:00100000:0.0:1746147725.607654:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.607677:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.607965:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793923328 00000100:00100000:3.0:1746147725.607969:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793923328 00000100:00100000:3.0:1746147725.607989:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793923456 00000100:00100000:3.0:1746147725.607990:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793923456 00000100:00100000:3.0:1746147725.608002:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16406 00000100:00100000:3.0:1746147725.608007:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967793923328:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147725.608013:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.608019:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5634400/0xe64d3fbf12a7d791 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb7fa expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.608029:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.608030:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.608034:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5634400/0xe64d3fbf12a7d791 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7fa expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.608042:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5634400/0xe64d3fbf12a7d791 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7fa expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.608049:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5634400, rc 0) 00000100:00100000:2.0:1746147725.608428:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16407 00000100:00100000:2.0:1746147725.608435:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793923456:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147725.608442:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147725.608449:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7d798 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb801 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.608458:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.608460:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.608464:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7d798 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb801 expref: 9 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147725.608473:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7d798 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb801 expref: 9 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147725.608479:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095093000, rc 0) 00000100:00100000:3.0:1746147725.608911:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793923328:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 903us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.608917:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16406 00000100:00100000:2.0:1746147725.609202:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793923456:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 767us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.609207:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16407 00000100:00100000:0.0:1746147725.612019:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.612203:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793923712 00000100:00100000:2.0:1746147725.612210:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793923712 00000100:00100000:2.0:1746147725.612255:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11994 00000100:00100000:2.0:1746147725.612261:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+7:32162:x1830967793923712:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147725.612276:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147725.612290:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7d79f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb808 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.612710:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.612732:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013aa00/0xe64d3fbf12a7d6d4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb783 expref: 327 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.612739:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b400/0xe64d3fbf12a7d6f7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb78a expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.612745:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7d76e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d7 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.612751:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.612778:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7d76e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d7 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.612787:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7d76e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d7 expref: 8 pid: 17544 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.612797:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796442752:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147725.613342:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b400/0xe64d3fbf12a7d6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb78a expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.613351:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b400/0xe64d3fbf12a7d6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb78a expref: 13 pid: 14546 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.613359:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796442880:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147725.614946:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013013aa00/0xe64d3fbf12a7d6d4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb783 expref: 327 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.614957:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013aa00/0xe64d3fbf12a7d6d4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb783 expref: 327 pid: 14546 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.614966:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796443008:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147725.615022:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147725.616982:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.617209:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796442752:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147725.617217:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796442880:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147725.617577:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.618111:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793923840 00000100:00100000:3.0:1746147725.618116:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793923840 00010000:00010000:3.0:1746147725.618144:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7d76e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d7 expref: 9 pid: 17544 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147725.618173:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793923968 00000100:00100000:3.0:1746147725.618176:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793923968 00010000:00010000:3.0:1746147725.618187:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b400/0xe64d3fbf12a7d6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb78a expref: 14 pid: 14546 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.618254:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796443008:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147725.618284:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:3.0:1746147725.618784:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8321 00000100:00100000:3.0:1746147725.618792:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793923840:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147725.618805:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147725.618811:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7d76e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d7 expref: 9 pid: 17544 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.618820:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7d76e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d7 expref: 9 pid: 17544 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.618836:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7d76e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d7 expref: 9 pid: 17544 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.618853:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.618857:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.618864:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.618868:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147725.618915:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793923840:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 124us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.618921:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8321 00000100:00100000:3.0:1746147725.618934:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8322 00000100:00100000:3.0:1746147725.618938:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967793923968:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147725.618944:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147725.618948:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b400/0xe64d3fbf12a7d6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb78a expref: 14 pid: 14546 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.618958:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b400/0xe64d3fbf12a7d6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb78a expref: 14 pid: 14546 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.618968:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b400/0xe64d3fbf12a7d6f7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb78a expref: 14 pid: 14546 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.618975:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.618977:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.618981:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.618985:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147725.618998:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967793923968:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 60us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.619003:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8322 00000100:00100000:1.0:1746147725.619309:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.619326:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793924096 00000100:00100000:1.0:1746147725.619329:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793924096 00010000:00010000:1.0:1746147725.619344:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013013aa00/0xe64d3fbf12a7d6d4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb783 expref: 328 pid: 14546 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746147725.619361:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8323 00000100:00100000:1.0:1746147725.619366:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:1959:x1830967793924096:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147725.619372:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147725.619376:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013013aa00/0xe64d3fbf12a7d6d4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb783 expref: 328 pid: 14546 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746147725.619383:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013013aa00/0xe64d3fbf12a7d6d4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb783 expref: 328 pid: 14546 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746147725.619394:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013aa00/0xe64d3fbf12a7d6d4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb783 expref: 328 pid: 14546 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746147725.619408:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147725.619411:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147725.619417:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147725.619422:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147725.619436:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147725.619979:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.619986:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:1.0:1746147725.619992:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:1959:x1830967793924096:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 625us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.619999:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8323 00000004:00200000:3.0:1746147725.620002:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147725.620119:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7d79f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb808 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.620131:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb808 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.620140:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.620142:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147725.620144:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095092a00, rc 0) 00000100:00100000:3.0:1746147725.620181:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32162:x1830967793923712:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 7919us (8167us total) trans 8589946007 rc 0/0 00000100:00100000:3.0:1746147725.620187:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11994 00000100:00100000:0.0:1746147725.623496:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.623599:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793924224 00000100:00100000:3.0:1746147725.623606:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793924224 00000100:00100000:3.0:1746147725.623653:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11995 00000100:00100000:3.0:1746147725.623660:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32162:x1830967793924224:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147725.623680:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.623695:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5635200/0xe64d3fbf12a7d7b4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb80f expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.623780:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634600/0xe64d3fbf12a7d7bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.623795:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb808 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.623801:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634600/0xe64d3fbf12a7d7bb lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.623826:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb808 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.623835:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb808 expref: 9 pid: 17544 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147725.623850:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796443136:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147725.624352:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1cf000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147725.626494:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.626559:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796443136:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.626576:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634600/0xe64d3fbf12a7d7bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:2.0:1746147725.626629:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793924352 00000100:00100000:2.0:1746147725.626634:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793924352 00010000:00010000:2.0:1746147725.626657:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb808 expref: 10 pid: 17544 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.626774:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8324 00000100:00100000:2.0:1746147725.626781:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793924352:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.626792:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.626797:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb808 expref: 10 pid: 17544 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.626805:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb808 expref: 10 pid: 17544 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.626820:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7d7a6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb808 expref: 10 pid: 17544 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.626843:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147725.626847:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634600/0xe64d3fbf12a7d7bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.626854:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634600/0xe64d3fbf12a7d7bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.626859:0:7096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634600/0xe64d3fbf12a7d7bb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.626875:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147725.626903:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634600/0xe64d3fbf12a7d7bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.626910:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634600/0xe64d3fbf12a7d7bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:2.0:1746147725.626923:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793924352:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 142us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.626928:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8324 00000004:00200000:3.0:1746147725.626945:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:3.0:1746147725.626949:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147725.626960:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634600/0xe64d3fbf12a7d7bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.626984:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5635200/0xe64d3fbf12a7d7b4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb80f expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.626995:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634600/0xe64d3fbf12a7d7bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb80f expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.627000:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.627002:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147725.627004:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5634600, rc 0) 00000100:00100000:3.0:1746147725.627026:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32162:x1830967793924224:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 3367us (3538us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.627034:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11995 00000100:00100000:0.0:1746147725.634002:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.634420:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793924608 00000100:00100000:3.0:1746147725.634429:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793924608 00000100:00100000:3.0:1746147725.634481:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11996 00000100:00100000:3.0:1746147725.634488:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32162:x1830967793924608:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147725.634505:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.634521:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5635600/0xe64d3fbf12a7d7c2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb816 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.634602:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634a00/0xe64d3fbf12a7d7c9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.634613:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634a00/0xe64d3fbf12a7d7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.634623:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634a00/0xe64d3fbf12a7d7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:3.0:1746147725.634633:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147725.634738:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5635600/0xe64d3fbf12a7d7c2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb816 expref: 11 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.634752:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634a00/0xe64d3fbf12a7d7c9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb816 expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.634759:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.634761:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147725.634764:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5634a00, rc 0) 00000100:00100000:3.0:1746147725.634816:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+10:32162:x1830967793924608:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 328us (821us total) trans 8589946008 rc 0/0 00000100:00100000:3.0:1746147725.634822:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11996 00000100:00100000:0.0:1746147725.639512:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.639554:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.639585:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.639614:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.639628:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.639646:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793924736 00000100:00100000:3.0:1746147725.639654:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793924736 00000100:00100000:0.0:1746147725.639655:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.639686:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793924992 00000100:00100000:3.0:1746147725.639687:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793924992 00000100:00100000:3.0:1746147725.639698:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793925248 00000100:00100000:3.0:1746147725.639699:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793925248 00000100:00100000:3.0:1746147725.639706:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793924864 00000100:00100000:3.0:1746147725.639708:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793924864 00000100:00100000:1.0:1746147725.639724:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793925120 00000100:00100000:3.0:1746147725.639728:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793925376 00000100:00100000:3.0:1746147725.639729:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793925376 00000100:00100000:1.0:1746147725.639729:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793925120 00000100:00100000:3.0:1746147725.639740:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16408 00000100:00100000:3.0:1746147725.639747:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967793924736:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:3.0:1746147725.639782:0:7050:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e13aa00/0xe64d3fbf12a7d7d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.639797:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7d5b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b1 expref: 33 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.639804:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136273200/0xe64d3fbf12a7d775 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7de expref: 10 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.639811:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d62c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f7 expref: 27 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.639820:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.639822:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.639824:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e13aa00/0xe64d3fbf12a7d7d7 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.639849:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d62c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f7 expref: 27 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.639859:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d62c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f7 expref: 27 pid: 22183 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147725.639870:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796443264:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.640389:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136273200/0xe64d3fbf12a7d775 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7de expref: 10 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.640399:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136273200/0xe64d3fbf12a7d775 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7de expref: 10 pid: 8469 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147725.640407:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796443392:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.640431:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7d5b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b1 expref: 33 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.640439:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7d5b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b1 expref: 33 pid: 21480 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147725.640447:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796443520:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147725.640459:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1cf000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147725.640825:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16409 00000100:00100000:1.0:1746147725.640832:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967793924992:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:1.0:1746147725.640853:0:8469:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d7de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.640864:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d695 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb759 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.640870:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136273c00/0xe64d3fbf12a7d783 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ec expref: 11 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.640877:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7d6b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb77c expref: 35 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.640898:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.640899:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.640901:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d7de lrc: 6/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.640918:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16410 00010000:00010000:1.0:1746147725.640918:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7d6b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb77c expref: 35 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.640925:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7d6b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb77c expref: 35 pid: 22183 timeout: 904 lvb_type: 1 00000100:00100000:2.0:1746147725.640926:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967793925248:12345-192.168.202.10@tcp:1:lfs.0 00000100:00100000:1.0:1746147725.640939:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796443648:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147725.640943:0:8470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7d7e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.640950:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136273e00/0xe64d3fbf12a7d744 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7c2 expref: 27 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.640965:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136273c00/0xe64d3fbf12a7d783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ec expref: 11 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.640972:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136273c00/0xe64d3fbf12a7d783 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ec expref: 11 pid: 8469 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746147725.640979:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796443776:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147725.641000:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d695 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb759 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.641006:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d695 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb759 expref: 23 pid: 7050 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746147725.641012:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796443904:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147725.641025:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90cd80 going to sleep for 11 seconds 00010000:00010000:2.0:1746147725.641061:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5634400/0xe64d3fbf12a7d791 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7fa expref: 10 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147725.641067:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136272800/0xe64d3fbf12a7d752 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d0 expref: 33 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.641072:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.641073:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.641076:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7d7e5 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.641089:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136272800/0xe64d3fbf12a7d752 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d0 expref: 33 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.641095:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136272800/0xe64d3fbf12a7d752 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d0 expref: 33 pid: 8469 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.641102:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796444032:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147725.641124:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5634400/0xe64d3fbf12a7d791 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7fa expref: 10 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147725.641135:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5634400/0xe64d3fbf12a7d791 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7fa expref: 10 pid: 8184 timeout: 904 lvb_type: 1 00000100:00100000:2.0:1746147725.641141:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796444160:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147725.641154:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136273e00/0xe64d3fbf12a7d744 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7c2 expref: 27 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.641160:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136273e00/0xe64d3fbf12a7d744 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7c2 expref: 27 pid: 8469 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.641165:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796444288:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147725.641174:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147725.641277:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16411 00000100:00100000:3.0:1746147725.641284:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967793924864:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:3.0:1746147725.641303:0:4591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7d7ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.641314:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9213c00/0xe64d3fbf12a7d5a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b8 expref: 35 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.641320:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7d77c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7e5 expref: 11 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.641327:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0278c00/0xe64d3fbf12a7d648 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6fe expref: 23 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.641331:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.641332:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.641334:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7d7ec lrc: 6/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.641348:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0278c00/0xe64d3fbf12a7d648 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6fe expref: 23 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.641356:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0278c00/0xe64d3fbf12a7d648 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6fe expref: 23 pid: 9615 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147725.641363:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796444416:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.641389:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7d77c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7e5 expref: 11 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.641400:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7d77c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7e5 expref: 11 pid: 8469 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147725.641408:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796444544:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.641427:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a9213c00/0xe64d3fbf12a7d5a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b8 expref: 35 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.641439:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a9213c00/0xe64d3fbf12a7d5a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b8 expref: 35 pid: 21480 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147725.641446:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796444672:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147725.641459:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1cfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147725.641476:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16412 00000100:00100000:3.0:1746147725.641482:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967793925376:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:3.0:1746147725.641498:0:21480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7d7f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.641507:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d72f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ad expref: 35 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.641513:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7d798 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb801 expref: 11 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.641519:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7d736 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7b4 expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.641524:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.641525:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.641527:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7d7f3 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.641539:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7d736 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7b4 expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.641546:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7d736 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7b4 expref: 23 pid: 20619 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147725.641552:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796444800:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.641571:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7d798 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb801 expref: 11 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.641578:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7d798 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb801 expref: 11 pid: 7050 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147725.641584:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796444928:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.641601:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d72f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ad expref: 35 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.641607:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d72f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ad expref: 35 pid: 20619 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147725.641618:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796445056:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147725.641629:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4cf7840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147725.641646:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16413 00000100:00100000:3.0:1746147725.641651:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967793925120:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:3.0:1746147725.641667:0:6715:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d189400/0xe64d3fbf12a7d7fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.641676:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d5ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6c6 expref: 33 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.641682:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5516600/0xe64d3fbf12a7d78a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7f3 expref: 10 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.641688:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5c00/0xe64d3fbf12a7d64f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb70c expref: 27 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.641692:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.641693:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.641695:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d189400/0xe64d3fbf12a7d7fa lrc: 6/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.641708:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5c00/0xe64d3fbf12a7d64f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb70c expref: 27 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.641727:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5c00/0xe64d3fbf12a7d64f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb70c expref: 27 pid: 22183 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147725.641736:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796445184:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.641755:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5516600/0xe64d3fbf12a7d78a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7f3 expref: 10 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.641763:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5516600/0xe64d3fbf12a7d78a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7f3 expref: 10 pid: 8470 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147725.641770:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796445312:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.641785:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d5ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6c6 expref: 33 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.641794:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d5ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6c6 expref: 33 pid: 21480 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147725.641801:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796445440:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147725.641812:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934a3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147725.647761:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796443264:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147725.647770:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796443392:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147725.647777:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796443520:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147725.647805:0:7050:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e13aa00/0xe64d3fbf12a7d7d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147725.649729:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796444416:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147725.649756:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0436300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796444544:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147725.649773:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796444672:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.649791:0:4591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7d7ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147725.649829:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796444800:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147725.649852:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796444928:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147725.649869:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796445056:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.649907:0:21480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7d7f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.650511:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796444032:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147725.650520:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796444160:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147725.650527:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796444288:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147725.650549:0:8470:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7d7e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147725.650675:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796443648:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147725.650684:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796443776:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147725.650690:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796443904:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147725.650704:0:8469:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d7de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147725.650799:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.650814:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.650843:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.650861:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793925760 00000100:00100000:3.0:1746147725.650865:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793925760 00010000:00010000:3.0:1746147725.650907:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136273c00/0xe64d3fbf12a7d783 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ec expref: 12 pid: 8469 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147725.650925:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793925632 00000100:00100000:3.0:1746147725.650927:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793925632 00010000:00010000:3.0:1746147725.650936:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d62c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f7 expref: 28 pid: 22183 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147725.650946:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793926144 00000100:00100000:3.0:1746147725.650947:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793926144 00010000:00010000:3.0:1746147725.650954:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5634400/0xe64d3fbf12a7d791 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7fa expref: 11 pid: 8184 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746147725.650964:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8325 00000100:00100000:3.0:1746147725.650970:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6673450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+12:1958:x1830967793925760:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147725.650981:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147725.650998:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136273c00/0xe64d3fbf12a7d783 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ec expref: 12 pid: 8469 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746147725.651007:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136273c00/0xe64d3fbf12a7d783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ec expref: 12 pid: 8469 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746147725.651026:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136273c00/0xe64d3fbf12a7d783 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ec expref: 12 pid: 8469 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746147725.651039:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.651198:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8326 00000100:00100000:2.0:1746147725.651204:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1958:x1830967793925632:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.651211:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.651223:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d62c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f7 expref: 28 pid: 22183 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.651232:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d62c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f7 expref: 28 pid: 22183 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.651244:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4c00/0xe64d3fbf12a7d62c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6f7 expref: 28 pid: 22183 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.651257:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147725.651400:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8327 00000100:00100000:1.0:1746147725.651406:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967793926144:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147725.651412:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147725.651422:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5634400/0xe64d3fbf12a7d791 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7fa expref: 11 pid: 8184 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746147725.651429:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5634400/0xe64d3fbf12a7d791 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7fa expref: 11 pid: 8184 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746147725.651439:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5634400/0xe64d3fbf12a7d791 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7fa expref: 11 pid: 8184 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746147725.651449:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147725.652138:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796445184:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147725.652148:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0436680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796445312:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147725.652154:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796445440:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147725.652174:0:6715:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d189400/0xe64d3fbf12a7d7fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147725.652582:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6673450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967793925760:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1610us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.652589:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8325 00000100:00100000:2.0:1746147725.652691:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967793925632:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1486us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.652698:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8326 00000100:00100000:1.0:1746147725.652820:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967793926144:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1412us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.652825:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8327 00000100:00100000:0.0:1746147725.662934:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.662965:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.662993:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.663020:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.663044:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.663059:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.663077:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793925888 00000100:00100000:0.0:1746147725.663084:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793925888 00010000:00010000:0.0:1746147725.663111:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7d6b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb77c expref: 36 pid: 22183 timeout: 904 lvb_type: 1 00000100:00100000:0.0:1746147725.663128:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793926272 00000100:00100000:0.0:1746147725.663130:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793926272 00010000:00010000:0.0:1746147725.663141:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7d5b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b1 expref: 34 pid: 21480 timeout: 904 lvb_type: 1 00000100:00100000:0.0:1746147725.663149:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793926784 00000100:00100000:0.0:1746147725.663150:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793926784 00010000:00010000:0.0:1746147725.663158:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9213c00/0xe64d3fbf12a7d5a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b8 expref: 37 pid: 21480 timeout: 904 lvb_type: 1 00000100:00100000:0.0:1746147725.663164:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793925504 00000100:00100000:0.0:1746147725.663165:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793925504 00000100:00100000:2.0:1746147725.663338:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793926016 00000100:00100000:2.0:1746147725.663341:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793926016 00010000:00010000:2.0:1746147725.663355:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d695 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb759 expref: 24 pid: 7050 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.663365:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793926400 00000100:00100000:2.0:1746147725.663366:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793926400 00010000:00010000:2.0:1746147725.663373:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7d77c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7e5 expref: 11 pid: 8469 timeout: 904 lvb_type: 1 00000100:00100000:2.0:1746147725.663381:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8328 00000100:00100000:2.0:1746147725.663387:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1959:x1830967793925888:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.663398:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.663417:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7d6b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb77c expref: 37 pid: 22183 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.663431:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7d6b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb77c expref: 37 pid: 22183 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.663450:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7d6b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb77c expref: 37 pid: 22183 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.663468:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.663503:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967793925888:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 116us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.663508:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8328 00000100:00100000:2.0:1746147725.663522:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8329 00000100:00100000:2.0:1746147725.663526:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793926272:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.663533:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.663544:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7d5b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b1 expref: 34 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.663551:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7d5b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b1 expref: 34 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.663563:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7d5b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b1 expref: 34 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.663572:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.663585:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967793926272:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 58us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.663592:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8329 00000100:00100000:2.0:1746147725.663600:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8330 00000100:00100000:2.0:1746147725.663604:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967793926784:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.663608:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.663616:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a9213c00/0xe64d3fbf12a7d5a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b8 expref: 35 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.663622:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a9213c00/0xe64d3fbf12a7d5a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b8 expref: 35 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.663631:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9213c00/0xe64d3fbf12a7d5a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6b8 expref: 35 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.663639:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.663649:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793926784:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 46us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.663653:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8330 00000100:00100000:2.0:1746147725.663660:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8331 00000100:00100000:2.0:1746147725.663663:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6673c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793926016:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.663669:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.663674:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d695 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb759 expref: 24 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.663680:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d695 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb759 expref: 24 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.663700:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5a00/0xe64d3fbf12a7d695 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb759 expref: 24 pid: 7050 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.663707:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.663709:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.663720:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d7de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.663727:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d7de lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.663745:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.663758:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6673c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967793926016:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 94us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.663762:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8331 00000100:00100000:2.0:1746147725.663773:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8332 00000100:00100000:2.0:1746147725.663777:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967793926400:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.663782:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.663787:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7d77c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7e5 expref: 11 pid: 8469 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.663794:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7d77c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7e5 expref: 11 pid: 8469 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.663803:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e7800/0xe64d3fbf12a7d77c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7e5 expref: 11 pid: 8469 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.663814:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.663827:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793926400:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 50us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.663832:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8332 00000100:00100000:2.0:1746147725.663911:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.663925:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793927168 00000100:00100000:2.0:1746147725.663928:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793927168 00010000:00010000:2.0:1746147725.663939:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136273e00/0xe64d3fbf12a7d744 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7c2 expref: 27 pid: 8469 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.663950:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8333 00000100:00100000:2.0:1746147725.663954:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967793927168:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.663959:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.663968:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136273e00/0xe64d3fbf12a7d744 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7c2 expref: 27 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.663974:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136273e00/0xe64d3fbf12a7d744 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7c2 expref: 27 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.663984:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136273e00/0xe64d3fbf12a7d744 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7c2 expref: 27 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.663991:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.664003:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793927168:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 49us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.664010:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8333 00000100:00100000:2.0:1746147725.664056:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.664065:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793926528 00000100:00100000:2.0:1746147725.664068:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793926528 00010000:00010000:2.0:1746147725.664076:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0278c00/0xe64d3fbf12a7d648 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6fe expref: 23 pid: 9615 timeout: 904 lvb_type: 1 00000100:00100000:2.0:1746147725.664087:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8334 00000100:00100000:2.0:1746147725.664091:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967793926528:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.664096:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.664102:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0278c00/0xe64d3fbf12a7d648 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6fe expref: 23 pid: 9615 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664110:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0278c00/0xe64d3fbf12a7d648 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6fe expref: 23 pid: 9615 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664119:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0278c00/0xe64d3fbf12a7d648 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6fe expref: 23 pid: 9615 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664126:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.664127:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.664129:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7d7ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.664135:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7d7ec lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.664152:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.664164:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967793926528:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 73us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.664169:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8334 00000100:00100000:2.0:1746147725.664198:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.664207:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793926912 00000100:00100000:2.0:1746147725.664209:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793926912 00010000:00010000:2.0:1746147725.664217:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7d736 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7b4 expref: 22 pid: 20619 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.664227:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8335 00000100:00100000:2.0:1746147725.664231:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967793926912:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.664235:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.664243:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7d736 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7b4 expref: 22 pid: 20619 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.664249:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7d736 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7b4 expref: 22 pid: 20619 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.664258:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009528e800/0xe64d3fbf12a7d736 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7b4 expref: 22 pid: 20619 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.664265:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.664277:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967793926912:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 46us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.664284:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8335 00000100:00100000:2.0:1746147725.664313:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.664322:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793926656 00000100:00100000:2.0:1746147725.664325:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793926656 00010000:00010000:2.0:1746147725.664334:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7d798 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb801 expref: 10 pid: 7050 timeout: 904 lvb_type: 1 00000100:00100000:2.0:1746147725.664344:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8336 00000100:00100000:2.0:1746147725.664347:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967793926656:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.664353:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.664359:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7d798 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb801 expref: 10 pid: 7050 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664365:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7d798 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb801 expref: 10 pid: 7050 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664374:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7d798 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb801 expref: 10 pid: 7050 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664381:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.664393:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967793926656:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 45us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.664397:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8336 00000100:00100000:2.0:1746147725.664426:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.664435:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793927040 00000100:00100000:2.0:1746147725.664437:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793927040 00010000:00010000:2.0:1746147725.664446:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5516600/0xe64d3fbf12a7d78a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7f3 expref: 11 pid: 8470 timeout: 904 lvb_type: 1 00000100:00100000:2.0:1746147725.664456:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8337 00000100:00100000:2.0:1746147725.664459:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967793927040:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.664464:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.664471:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5516600/0xe64d3fbf12a7d78a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7f3 expref: 11 pid: 8470 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664478:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5516600/0xe64d3fbf12a7d78a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7f3 expref: 11 pid: 8470 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664487:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5516600/0xe64d3fbf12a7d78a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7f3 expref: 11 pid: 8470 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664495:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.664507:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967793927040:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 47us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.664511:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8337 00000100:00100000:2.0:1746147725.664545:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.664554:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793927296 00000100:00100000:2.0:1746147725.664555:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793927296 00010000:00010000:2.0:1746147725.664563:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d5ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6c6 expref: 33 pid: 21480 timeout: 904 lvb_type: 1 00000100:00100000:2.0:1746147725.664573:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8338 00000100:00100000:2.0:1746147725.664577:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6672450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1958:x1830967793927296:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.664582:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.664587:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d5ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6c6 expref: 33 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664592:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d5ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6c6 expref: 33 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664600:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d5ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb6c6 expref: 33 pid: 21480 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664606:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.664616:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6672450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967793927296:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.664620:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8338 00000100:00100000:2.0:1746147725.664657:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.664666:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793927424 00000100:00100000:2.0:1746147725.664667:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793927424 00010000:00010000:2.0:1746147725.664674:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5c00/0xe64d3fbf12a7d64f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb70c expref: 26 pid: 22183 timeout: 904 lvb_type: 1 00000100:00100000:2.0:1746147725.664683:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8339 00000100:00100000:2.0:1746147725.664686:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793927424:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.664690:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.664695:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5c00/0xe64d3fbf12a7d64f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb70c expref: 26 pid: 22183 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664704:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5c00/0xe64d3fbf12a7d64f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb70c expref: 26 pid: 22183 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664724:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5c00/0xe64d3fbf12a7d64f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb70c expref: 26 pid: 22183 timeout: 904 lvb_type: 1 00010000:00010000:2.0:1746147725.664731:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.664732:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.664734:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d189400/0xe64d3fbf12a7d7fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.664739:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d189400/0xe64d3fbf12a7d7fa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.664752:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.664763:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967793927424:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 77us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.664767:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8339 00000100:00100000:2.0:1746147725.664805:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.664814:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793927552 00000100:00100000:2.0:1746147725.664816:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793927552 00010000:00010000:2.0:1746147725.664824:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136272800/0xe64d3fbf12a7d752 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d0 expref: 32 pid: 8469 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.664834:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8340 00000100:00100000:2.0:1746147725.664838:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1957:x1830967793927552:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.664844:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.664851:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136272800/0xe64d3fbf12a7d752 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d0 expref: 32 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.664858:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136272800/0xe64d3fbf12a7d752 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d0 expref: 32 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.664866:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136272800/0xe64d3fbf12a7d752 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7d0 expref: 32 pid: 8469 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.664872:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.664873:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.664876:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7d7e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.664881:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7d7e5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.664909:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.664920:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1957:x1830967793927552:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 82us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.664924:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8340 00010000:00010000:2.0:1746147725.664939:0:8470:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7d7e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.664945:0:8470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7d7e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.664963:0:8470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7d7e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.664970:0:8470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7d7e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.664975:0:8470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7d7e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.664980:0:8470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800950f4600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147725.664983:0:8470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7d7e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.664989:0:8470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7d7e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.664997:0:8470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7d7e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.665002:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7d7e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.665038:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967793925248:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 24113us (25452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.665045:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16410 00010000:00010000:2.0:1746147725.665158:0:4591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7d7ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.665165:0:4591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7d7ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.665178:0:4591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7d7ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.665183:0:4591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7d7ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.665188:0:4591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7d7ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.665193:0:4591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090abb600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147725.665195:0:4591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7d7ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.665199:0:4591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7d7ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.665207:0:4591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7d7ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.665213:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7d7ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.665244:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967793924864:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 23961us (25630us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.665251:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16411 00010000:00010000:2.0:1746147725.665307:0:6715:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d189400/0xe64d3fbf12a7d7fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.665339:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136273200/0xe64d3fbf12a7d775 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7de expref: 8 pid: 8469 timeout: 904 lvb_type: 1 00000100:00100000:0.0:1746147725.665355:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8341 00000100:00100000:0.0:1746147725.665360:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967793925504:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147725.665365:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147725.665373:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136273200/0xe64d3fbf12a7d775 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7de expref: 8 pid: 8469 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746147725.665380:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136273200/0xe64d3fbf12a7d775 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7de expref: 8 pid: 8469 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746147725.665393:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136273200/0xe64d3fbf12a7d775 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7de expref: 8 pid: 8469 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746147725.665404:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147725.665405:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147725.665407:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e13aa00/0xe64d3fbf12a7d7d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.665412:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e13aa00/0xe64d3fbf12a7d7d7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.665425:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147725.665442:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967793925504:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 82us (2421us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147725.665447:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8341 00010000:00010000:0.0:1746147725.665478:0:7050:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e13aa00/0xe64d3fbf12a7d7d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.665484:0:7050:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e13aa00/0xe64d3fbf12a7d7d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.665497:0:7050:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e13aa00/0xe64d3fbf12a7d7d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.665502:0:7050:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e13aa00/0xe64d3fbf12a7d7d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.665512:0:7050:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e13aa00/0xe64d3fbf12a7d7d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.665517:0:7050:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e13aa00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147725.665519:0:7050:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e13aa00/0xe64d3fbf12a7d7d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.665524:0:7050:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e13aa00/0xe64d3fbf12a7d7d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.665532:0:7050:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e13aa00/0xe64d3fbf12a7d7d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.665538:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e13aa00/0xe64d3fbf12a7d7d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147725.665573:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967793924736:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 25827us (26069us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147725.665578:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16408 00010000:00010000:1.0:1746147725.665663:0:8469:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d7de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.665670:0:8469:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d7de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.665684:0:8469:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d7de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.665698:0:8469:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d7de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.665703:0:8469:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d7de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.665707:0:8469:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5516000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147725.665709:0:8469:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d7de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.665722:0:8469:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d7de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.665730:0:8469:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d7de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.665734:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d7de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147725.665778:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967793924992:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 24946us (26224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.665783:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16409 00010000:00010000:2.0:1746147725.667172:0:6715:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d189400/0xe64d3fbf12a7d7fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.667199:0:6715:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d189400/0xe64d3fbf12a7d7fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.667205:0:6715:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d189400/0xe64d3fbf12a7d7fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.667210:0:6715:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d189400/0xe64d3fbf12a7d7fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.667216:0:6715:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d189400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147725.667219:0:6715:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d189400/0xe64d3fbf12a7d7fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.667224:0:6715:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d189400/0xe64d3fbf12a7d7fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.667235:0:6715:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d189400/0xe64d3fbf12a7d7fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147725.667395:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.667499:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793927680 00000100:00100000:0.0:1746147725.667504:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793927680 00010000:00010000:0.0:1746147725.667522:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d72f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ad expref: 34 pid: 20619 timeout: 904 lvb_type: 0 00000100:00100000:0.0:1746147725.667537:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8342 00000100:00100000:0.0:1746147725.667542:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967793927680:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147725.667550:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147725.667562:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d72f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ad expref: 34 pid: 20619 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746147725.667570:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d72f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ad expref: 34 pid: 20619 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746147725.667582:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009528f200/0xe64d3fbf12a7d72f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb7ad expref: 34 pid: 20619 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746147725.667591:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147725.667592:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147725.667595:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7d7f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.667601:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7d7f3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.667697:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d189400/0xe64d3fbf12a7d7fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.667765:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147725.667816:0:21480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7d7f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.667824:0:21480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7d7f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.667837:0:21480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7d7f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.667843:0:21480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7d7f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.667854:0:21480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7d7f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.667859:0:21480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090abaa00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147725.667862:0:21480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7d7f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.667868:0:21480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7d7f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.667876:0:21480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7d7f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.667881:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7d7f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.667961:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+5:1957:x1830967793925120:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 26309us (28331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.667967:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16413 00000100:00100000:0.0:1746147725.668022:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1957:x1830967793927680:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 479us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147725.668027:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8342 00000100:00100000:3.0:1746147725.668280:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967793925376:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 26797us (28623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.668286:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16412 00000100:00100000:0.0:1746147725.672022:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.672213:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793927936 00000100:00100000:3.0:1746147725.672221:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793927936 00000100:00100000:3.0:1746147725.672672:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11997 00000100:00100000:3.0:1746147725.672680:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+10:32162:x1830967793927936:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:3.0:1746147725.672737:0:17544:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147725.672759:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634600/0xe64d3fbf12a7d7bb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb80f expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.672771:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.672775:0:17544:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147725.672799:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.672809:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb728 expref: 326 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.672815:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.672821:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa11200/0xe64d3fbf12a7d672 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb736 expref: 326 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.672826:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7d70c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb791 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.672832:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.672858:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7d70c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb791 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.672869:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7d70c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb791 expref: 12 pid: 14546 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147725.672879:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796445568:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.674140:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa11200/0xe64d3fbf12a7d672 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb736 expref: 326 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.674152:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa11200/0xe64d3fbf12a7d672 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb736 expref: 326 pid: 14546 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147725.674161:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796445696:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.674731:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.674739:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 12 pid: 5744 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147725.674746:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796445824:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.674778:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb728 expref: 326 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.674785:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb728 expref: 326 pid: 17544 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147725.674791:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796445952:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147725.674808:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4cf7840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147725.678400:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.678434:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.678460:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.678481:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793928448 00000100:00100000:2.0:1746147725.678487:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793928448 00010000:00010000:2.0:1746147725.678518:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 13 pid: 5744 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.678539:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793928320 00000100:00100000:2.0:1746147725.678541:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793928320 00010000:00010000:2.0:1746147725.678549:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa11200/0xe64d3fbf12a7d672 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb736 expref: 327 pid: 14546 timeout: 904 lvb_type: 0 00000100:00100000:2.0:1746147725.678560:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8343 00000100:00100000:2.0:1746147725.678567:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967793928448:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.678578:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.678583:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 13 pid: 5744 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.678593:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 13 pid: 5744 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.678613:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147725.678618:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.678625:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.678656:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967793928448:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 90us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.678662:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8343 00000100:00100000:2.0:1746147725.678675:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8344 00000100:00100000:2.0:1746147725.678680:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:1958:x1830967793928320:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147725.678685:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.678689:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa11200/0xe64d3fbf12a7d672 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb736 expref: 327 pid: 14546 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.678695:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa11200/0xe64d3fbf12a7d672 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb736 expref: 327 pid: 14546 timeout: 904 lvb_type: 0 00010000:00010000:2.0:1746147725.678705:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147725.678708:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.678722:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147725.678736:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:1958:x1830967793928320:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 56us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.678741:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8344 00000100:00100000:3.0:1746147725.678781:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796445568:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147725.678782:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147725.678792:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa11200/0xe64d3fbf12a7d672 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb736 expref: 326 pid: 14546 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147725.678805:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796445696:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.678813:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02f8c00/0xe64d3fbf12a7d66b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb72f expref: 12 pid: 5744 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147725.678823:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0436300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796445824:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147725.678829:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796445952:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.678852:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:3.0:1746147725.678867:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793928576 00000100:00100000:3.0:1746147725.678870:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793928576 00010000:00010000:3.0:1746147725.678881:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb728 expref: 326 pid: 17544 timeout: 904 lvb_type: 0 00000100:00100000:0.0:1746147725.678911:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793928192 00000100:00100000:3.0:1746147725.678912:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8345 00000100:00100000:0.0:1746147725.678915:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793928192 00000100:00100000:3.0:1746147725.678917:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:1958:x1830967793928576:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147725.678923:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147725.678927:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb728 expref: 326 pid: 17544 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.678933:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb728 expref: 326 pid: 17544 timeout: 904 lvb_type: 0 00000100:00100000:0.0:1746147725.678937:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4991 00000100:00100000:0.0:1746147725.678942:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a666a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:27451:x1830967793928192:12345-192.168.202.10@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1746147725.678944:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8b0c00/0xe64d3fbf12a7d664 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb728 expref: 326 pid: 17544 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.678951:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.678954:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.678959:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147725.678979:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:1958:x1830967793928576:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 62us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.678985:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8345 00000100:00100000:3.0:1746147725.679132:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a666a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:27451:x1830967793928192:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 189us (739us total) trans 8589946009 rc 0/0 00000100:00100000:3.0:1746147725.679137:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4991 00000100:00100000:2.0:1746147725.681239:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.681632:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793928704 00000100:00100000:1.0:1746147725.681638:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793928704 00010000:00010000:1.0:1746147725.681661:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7d70c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb791 expref: 13 pid: 14546 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746147725.681683:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8346 00000100:00100000:1.0:1746147725.681689:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6672050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967793928704:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147725.681698:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147725.681703:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7d70c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb791 expref: 13 pid: 14546 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746147725.681724:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7d70c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb791 expref: 13 pid: 14546 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746147725.681740:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7d70c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb791 expref: 13 pid: 14546 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746147725.681763:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147725.681768:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147725.681775:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147725.681781:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147725.681798:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147725.681826:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6672050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967793928704:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 137us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.681832:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8346 00010000:00010000:3.0:1746147725.682067:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.682075:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000040:00080000:3.0:1746147725.683267:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3649, 88 off305480 00000004:00080000:3.0:1746147725.683275:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804857390454ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.683324:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3660, 88 off306096 00000004:00080000:3.0:1746147725.683328:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804857443809ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147725.683350:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3661, 88 off306184 00000004:00080000:3.0:1746147725.683413:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804857528445ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147725.683426:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3650, 88 off305568 00000004:00080000:3.0:1746147725.683429:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804857544548ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.683443:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3651, 88 off305656 00000004:00080000:3.0:1746147725.683445:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804857560890ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.683452:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3662, 88 off306272 00000004:00080000:3.0:1746147725.683454:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804857569225ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147725.683459:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3663, 88 off306360 00000004:00080000:3.0:1746147725.683461:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804857576125ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147725.683465:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3664, 88 off306448 00000004:00080000:3.0:1746147725.683467:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804857582715ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147725.683473:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3652, 88 off305744 00000004:00080000:3.0:1746147725.683475:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804857590200ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.683479:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3665, 88 off306536 00000004:00080000:3.0:1746147725.683481:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804857596985ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147725.683486:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3653, 88 off305832 00000004:00080000:3.0:1746147725.683488:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804857603385ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.683492:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3666, 88 off306624 00000004:00080000:3.0:1746147725.683494:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804857609620ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147725.683499:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3654, 88 off305920 00000004:00080000:3.0:1746147725.683500:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804857615875ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.683505:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3655, 88 off306008 00000004:00080000:3.0:1746147725.683507:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804857622808ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.683512:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3656, 88 off306096 00000004:00080000:3.0:1746147725.683514:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804857630075ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.683521:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3657, 88 off306184 00000004:00080000:3.0:1746147725.683523:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804857638998ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.683530:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3667, 88 off306712 00000004:00080000:3.0:1746147725.683532:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804857648030ns, next at 756024029964ns, rc = 0 00000001:00080000:0.0:1746147725.699784:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945999 is committed 00000001:00080000:0.0:1746147725.699796:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946006 is committed 00000001:00080000:0.0:1746147725.699800:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946002 is committed 00000004:00010000:3.0:1746147725.699806:0:17544:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009fe40e00 reply state ffff88009fc5b400 transno 8589946010 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000001:00080000:0.0:1746147725.699808:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946010 is committed 00000004:00080000:0.0:1746147725.699811:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2735 committed 00000100:00100000:3.0:1746147725.699816:0:17544:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1746147725.699817:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2725 committed 00000004:00080000:0.0:1746147725.699823:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2724 committed 00000004:00080000:0.0:1746147725.699824:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2723 committed 00000004:00080000:0.0:1746147725.699826:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2722 committed 00000004:00080000:0.0:1746147725.699828:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2734 committed 00000004:00080000:0.0:1746147725.699829:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2721 committed 00000004:00080000:0.0:1746147725.699830:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2733 committed 00000004:00080000:0.0:1746147725.699831:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2720 committed 00000004:00080000:0.0:1746147725.699833:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2732 committed 00000004:00080000:0.0:1746147725.699834:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2731 committed 00000004:00080000:0.0:1746147725.699835:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2730 committed 00000004:00080000:0.0:1746147725.699837:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2719 committed 00000004:00080000:0.0:1746147725.699838:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2718 committed 00000004:00080000:0.0:1746147725.699839:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2729 committed 00000004:00080000:0.0:1746147725.699840:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2728 committed 00000004:00080000:0.0:1746147725.699841:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2717 committed 00000001:00080000:0.0:1746147725.699844:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946009 is committed 00010000:00080000:3.0:1746147725.699918:0:17544:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147725.699930:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32162:x1830967793927936:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 27247us (27911us total) trans 8589946010 rc 0/0 00000100:00100000:3.0:1746147725.699938:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11997 00000100:00100000:3.0:1746147725.699968:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796446208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147725.699992:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796446464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.700010:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147725.700032:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.700044:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796446720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.700060:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147725.700060:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796446976:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.700072:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746147725.700077:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796446080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147725.700090:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.700100:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147725.700104:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746147725.700108:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796446336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.700113:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796446592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147725.700125:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.700136:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796446208 00000100:00100000:0.0:1746147725.700140:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796446848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.700141:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796446208 00000100:00100000:0.0:1746147725.700152:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.700169:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796446464 00000100:00100000:0.0:1746147725.700169:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796446720 00000100:00100000:3.0:1746147725.700171:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796446464 00000100:00100000:0.0:1746147725.700172:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796446720 00000100:00100000:3.0:1746147725.700182:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796446976 00000100:00100000:3.0:1746147725.700184:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796446976 00000100:00100000:0.0:1746147725.700186:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796446080 00000100:00100000:0.0:1746147725.700188:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796446080 00000100:00100000:3.0:1746147725.700194:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16414 00000100:00100000:3.0:1746147725.700200:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3304:x1830967796446208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.700353:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3304:x1830967796446208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 153us (342us total) trans 17179874352 rc 0/0 00010000:00010000:2.0:1746147725.700406:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.700414:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.700421:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.700426:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e13b000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147725.700430:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.700435:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.700448:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147725.700451:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147725.700454:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.700458:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e13b000/0xe64d3fbf12a7d801 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00000100:00100000:2.0:1746147725.700474:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796446336 00000100:00100000:2.0:1746147725.700477:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796446336 00000100:00100000:1.0:1746147725.700949:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796447360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147725.700974:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147725.700988:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796447872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147725.701000:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147725.701011:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746147725.701014:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796447488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147725.701025:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147725.701033:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796448000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147725.701043:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147725.701054:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796446848 00000100:00100000:1.0:1746147725.701057:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796446848 00000100:00100000:0.0:1746147725.701534:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796447360 00000100:00100000:0.0:1746147725.701538:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796447360 00000100:00100000:0.0:1746147725.701553:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796447872 00000100:00100000:0.0:1746147725.701554:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796447872 00000100:00100000:0.0:1746147725.701561:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796447488 00000100:00100000:0.0:1746147725.701562:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796447488 00000100:00100000:0.0:1746147725.701568:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796448000 00000100:00100000:0.0:1746147725.701569:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796448000 00000100:00100000:0.0:1746147725.701577:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16415 00000100:00100000:0.0:1746147725.701581:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+48:3302:x1830967796446464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147725.701696:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+49:3302:x1830967796446464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (1663us total) trans 17179874353 rc 0/0 00000100:00100000:0.0:1746147725.701701:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16415 00000100:00100000:3.0:1746147725.702008:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16414 00000100:00100000:2.0:1746147725.702022:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16416 00000100:00100000:3.0:1746147725.702026:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16417 00000100:00100000:2.0:1746147725.702029:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3304:x1830967796446720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.702031:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3302:x1830967796446976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.702057:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16418 00000100:00100000:3.0:1746147725.702061:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3304:x1830967796446080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147725.702078:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16419 00000100:00100000:1.0:1746147725.702083:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3301:x1830967796447360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147725.702147:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3304:x1830967796446080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (2045us total) trans 17179874354 rc 0/0 00000100:00100000:3.0:1746147725.702152:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16418 00000100:00100000:3.0:1746147725.702162:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16420 00000100:00100000:3.0:1746147725.702167:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3301:x1830967796447872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147725.702185:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3301:x1830967796447360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (1210us total) trans 21474841581 rc 0/0 00000100:00100000:1.0:1746147725.702191:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16419 00000100:00100000:1.0:1746147725.702201:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16421 00000100:00100000:1.0:1746147725.702204:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3301:x1830967796447488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147725.702236:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3301:x1830967796447872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1235us total) trans 21474841582 rc 0/0 00000100:00100000:3.0:1746147725.702240:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16420 00000100:00100000:3.0:1746147725.702248:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16422 00000100:00100000:3.0:1746147725.702251:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3301:x1830967796448000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147725.702285:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3301:x1830967796447488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (1258us total) trans 21474841583 rc 0/0 00000100:00100000:1.0:1746147725.702290:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16421 00000100:00100000:1.0:1746147725.702299:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16423 00000100:00100000:1.0:1746147725.702302:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3302:x1830967796446336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.702307:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3301:x1830967796448000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (1263us total) trans 21474841584 rc 0/0 00000100:00100000:3.0:1746147725.702312:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16422 00000100:00100000:3.0:1746147725.702319:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16424 00000100:00100000:3.0:1746147725.702323:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3302:x1830967796446848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.702430:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.702438:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796447104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.702462:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147725.702464:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe41880/2, rc 0, transno 17179874352 00000100:00100000:3.0:1746147725.702471:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796446208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.702475:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796447616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147725.702479:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796447232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.702486:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.702493:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.702501:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796447744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.702503:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796446592 00000100:00100000:2.0:1746147725.702506:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796446592 00000100:00100000:3.0:1746147725.702509:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147725.702517:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe40a80/2, rc 0, transno 17179874354 00000100:00100000:3.0:1746147725.702519:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796446080:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.702524:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796447104 00000100:00100000:2.0:1746147725.702526:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796447104 00000100:00100000:3.0:1746147725.702529:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796447616 00000100:00100000:3.0:1746147725.702532:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796447616 00000100:00100000:2.0:1746147725.702532:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796447232 00000100:00100000:2.0:1746147725.702534:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796447232 00000100:00100000:3.0:1746147725.702540:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796447744 00000100:00100000:3.0:1746147725.702541:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796447744 00000100:00100000:2.0:1746147725.702542:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16425 00000100:00100000:2.0:1746147725.702546:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3304:x1830967796446592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147725.702546:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16426 00000100:00100000:3.0:1746147725.702550:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16427 00000100:00100000:0.0:1746147725.702550:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+44:3303:x1830967796447104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147725.702554:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3303:x1830967796447616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.702572:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16428 00000100:00100000:2.0:1746147725.702576:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3304:x1830967796447232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147725.702576:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16429 00000100:00100000:0.0:1746147725.702580:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3304:x1830967796447744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147725.702622:0:22183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:3.0:1746147725.702625:0:22183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:3.0:1746147725.702627:0:22183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147725.702628:0:22183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:3.0:1746147725.702630:0:22183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:3.0:1746147725.702647:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3303:x1830967796447616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (160us total) trans 21474841585 rc 0/0 00000100:00100000:3.0:1746147725.702651:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16427 00000100:00100000:3.0:1746147725.702685:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746147725.702690:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796448128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.702705:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.702728:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796448128 00000100:00100000:3.0:1746147725.702730:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796448128 00000100:00100000:3.0:1746147725.702740:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16430 00000100:00100000:3.0:1746147725.702744:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3304:x1830967796448128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147725.702791:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3304:x1830967796447744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 210us (280us total) trans 21474841586 rc 0/0 00000100:00100000:0.0:1746147725.702796:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16429 00000004:00080000:0.0:1746147725.702823:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe43b80/2, rc 0, transno 17179874353 00000100:00100000:3.0:1746147725.702826:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+45:3303:x1830967796447104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 275us (362us total) trans 21474841587 rc 0/0 00000100:00100000:0.0:1746147725.702827:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796446464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.702831:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16426 00000100:00100000:3.0:1746147725.702921:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3304:x1830967796447232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 345us (426us total) trans 21474841588 rc 0/0 00000100:00100000:3.0:1746147725.702926:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16428 00000004:00080000:3.0:1746147725.702949:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172f100/2, rc 0, transno 21474841588 00000100:00100000:3.0:1746147725.702952:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796447232:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147725.702958:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172fb80/2, rc 0, transno 21474841586 00000100:00100000:3.0:1746147725.702960:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796447744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.703145:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000004:00080000:2.0:1746147725.703197:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172d180/2, rc 0, transno 21474841587 00000100:00100000:2.0:1746147725.703202:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796447104:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147725.703208:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172d880/2, rc 0, transno 21474841585 00000100:00100000:2.0:1746147725.703210:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796447616:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1746147725.703296:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147725.703299:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1746147725.703328:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172f800/2, rc 0, transno 21474841583 00000100:00100000:1.0:1746147725.703333:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796447488:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147725.703339:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172e300/2, rc 0, transno 21474841584 00000100:00100000:1.0:1746147725.703341:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796448000:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147725.703347:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172ce00/2, rc 0, transno 21474841581 00000100:00100000:1.0:1746147725.703349:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796447360:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147725.703354:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172c700/2, rc 0, transno 21474841582 00000100:00100000:1.0:1746147725.703356:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796447872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147725.705017:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3302:x1830967796446976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2980us (4920us total) trans 17179874355 rc 0/0 00000100:00100000:3.0:1746147725.705025:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16417 00000100:00100000:3.0:1746147725.705052:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793928832 00000100:00100000:3.0:1746147725.705056:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793928832 00000100:00100000:3.0:1746147725.705091:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11998 00000100:00100000:3.0:1746147725.705097:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+7:32162:x1830967793928832:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147725.705110:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.705124:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7d808 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb81d expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746147725.705191:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ee5aa00/2, rc 0, transno 17179874355 00000100:00100000:0.0:1746147725.705196:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796446976:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147725.705312:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7d808 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb81d expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.705323:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7d808 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb81d expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.705338:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.705345:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147725.705348:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950f5600, rc 0) 00000100:00100000:3.0:1746147725.705605:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32162:x1830967793928832:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 506us (2459us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.705610:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11998 00000100:00100000:3.0:1746147725.705782:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3302:x1830967796446848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3457us (5628us total) trans 17179874356 rc 0/0 00000100:00100000:3.0:1746147725.705787:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16424 00000004:00080000:1.0:1746147725.705837:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ee59180/2, rc 0, transno 17179874356 00000100:00100000:1.0:1746147725.705841:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796446848:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147725.705877:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ee5ad80/2, rc 0, transno 17179874357 00000100:00100000:3.0:1746147725.705881:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796446720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147725.705984:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3304:x1830967796446720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3955us (5922us total) trans 17179874357 rc 0/0 00000100:00100000:0.0:1746147725.705989:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16416 00000100:00100000:2.0:1746147725.706262:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3304:x1830967796446592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3715us (3830us total) trans 17179874358 rc 0/0 00000100:00100000:2.0:1746147725.706268:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16425 00000100:00100000:3.0:1746147725.707543:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3304:x1830967796448128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4795us (4833us total) trans 17179874359 rc 0/0 00000100:00100000:3.0:1746147725.707549:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16430 00000004:00080000:3.0:1746147725.707577:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0435880/2, rc 0, transno 17179874359 00000100:00100000:3.0:1746147725.707582:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796448128:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147725.707588:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe42a00/2, rc 0, transno 17179874358 00000100:00100000:3.0:1746147725.707591:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796446592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147725.708052:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3302:x1830967796446336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5748us (7925us total) trans 17179874360 rc 0/0 00000100:00100000:1.0:1746147725.708059:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16423 00000004:00080000:2.0:1746147725.708074:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe40380/2, rc 0, transno 17179874360 00000100:00100000:2.0:1746147725.708078:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796446336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147725.708965:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.709028:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793928960 00000100:00100000:3.0:1746147725.709034:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793928960 00000100:00100000:3.0:1746147725.709076:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11999 00000100:00100000:3.0:1746147725.709082:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32162:x1830967793928960:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147725.709100:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.709115:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d80f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb824 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.709178:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03b7200/0xe64d3fbf12a7d816 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.709188:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03b7200/0xe64d3fbf12a7d816 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.709196:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03b7200/0xe64d3fbf12a7d816 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:3.0:1746147725.709216:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:3.0:1746147725.709219:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147725.709231:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03b7200/0xe64d3fbf12a7d816 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.709253:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d80f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb824 expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.709285:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03b7200/0xe64d3fbf12a7d816 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb824 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.709291:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.709293:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147725.709296:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03b7200, rc 0) 00000100:00100000:3.0:1746147725.709343:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+9:32162:x1830967793928960:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 260us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.709348:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11999 00000100:00100000:0.0:1746147725.711845:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.711873:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.711908:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.711910:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793929216 00000100:00100000:1.0:1746147725.711916:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793929216 00000100:00100000:0.0:1746147725.711930:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.711941:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.711948:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793929472 00000100:00100000:1.0:1746147725.711950:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793929472 00000100:00100000:1.0:1746147725.711962:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793929728 00000100:00100000:1.0:1746147725.711963:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793929728 00000100:00100000:1.0:1746147725.711970:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793929088 00000100:00100000:1.0:1746147725.711972:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793929088 00000100:00100000:1.0:1746147725.711980:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793929344 00000100:00100000:1.0:1746147725.711981:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793929344 00000100:00100000:1.0:1746147725.711993:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16431 00000100:00100000:1.0:1746147725.711999:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793929216:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147725.712012:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.712029:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d81d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb832 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147725.712054:0:8469:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x6814198b, atime: 0x6814198b, ctime: 0x6814198b, blocks: 0x81f 00010000:00010000:1.0:1746147725.712069:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.712070:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.712078:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d81d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb832 expref: 9 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.712089:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d81d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb832 expref: 9 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.712097:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5516000, rc 0) 00000100:00100000:1.0:1746147725.712129:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793929216:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 130us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.712134:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16431 00000100:00100000:1.0:1746147725.712149:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16432 00000100:00100000:1.0:1746147725.712153:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967793929472:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147725.712159:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.712170:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5516c00/0xe64d3fbf12a7d824 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb840 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147725.712182:0:8469:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x6814198d, atime: 0x6814198d, ctime: 0x6814198d, blocks: 0x821 00010000:00010000:1.0:1746147725.712190:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.712192:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.712195:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5516c00/0xe64d3fbf12a7d824 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb840 expref: 7 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.712207:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5516c00/0xe64d3fbf12a7d824 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb840 expref: 7 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.712213:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5516c00, rc 0) 00000100:00100000:1.0:1746147725.712227:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793929472:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 74us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.712232:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16432 00000100:00100000:1.0:1746147725.712242:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16433 00000100:00100000:1.0:1746147725.712246:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793929728:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147725.712251:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.712258:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5517000/0xe64d3fbf12a7d82b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb84e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147725.712266:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:1.0:1746147725.712268:0:8469:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x456:0x0] initial LVB size: 4194304, mtime: 0x6814198e, atime: 0x6814198c, ctime: 0x6814198e, blocks: 0x102b 00010000:00010000:1.0:1746147725.712276:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.712277:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.712280:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5517000/0xe64d3fbf12a7d82b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb84e expref: 9 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.712295:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5517000/0xe64d3fbf12a7d82b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb84e expref: 9 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.712301:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5517000, rc 0) 00000100:00100000:1.0:1746147725.712316:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793929728:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 69us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.712322:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16433 00000100:00100000:1.0:1746147725.712330:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793929600 00000100:00100000:1.0:1746147725.712332:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793929600 00000100:00100000:1.0:1746147725.712345:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16434 00000100:00100000:1.0:1746147725.712348:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793929088:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147725.712353:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.712359:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a051ba00/0xe64d3fbf12a7d832 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb82b expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147725.712369:0:8469:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x6814198b, atime: 0x6814198b, ctime: 0x6814198b, blocks: 0x79f 00010000:00010000:1.0:1746147725.712375:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.712376:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.712379:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a051ba00/0xe64d3fbf12a7d832 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb82b expref: 8 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.712386:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a051ba00/0xe64d3fbf12a7d832 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb82b expref: 8 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.712391:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a051ba00, rc 0) 00000100:00100000:1.0:1746147725.712405:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793929088:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 56us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.712409:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16434 00000100:00100000:1.0:1746147725.712419:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16435 00000100:00100000:1.0:1746147725.712423:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793929344:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147725.712427:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.712435:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d839 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb839 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147725.712443:0:8469:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x6814198d, atime: 0x6814198d, ctime: 0x6814198d, blocks: 0x821 00010000:00010000:1.0:1746147725.712449:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.712450:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.712453:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d839 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb839 expref: 9 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.712460:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d839 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb839 expref: 9 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.712465:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5516400, rc 0) 00000100:00100000:1.0:1746147725.712477:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793929344:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 54us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.712480:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16435 00000100:00100000:1.0:1746147725.712489:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16436 00000100:00100000:1.0:1746147725.712492:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793929600:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147725.712496:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.712503:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5516200/0xe64d3fbf12a7d840 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb847 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147725.712511:0:8469:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x458:0x0] initial LVB size: 5013696, mtime: 0x6814198e, atime: 0x6814198e, ctime: 0x6814198e, blocks: 0x1691 00010000:00010000:1.0:1746147725.712516:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.712517:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.712520:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5516200/0xe64d3fbf12a7d840 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb847 expref: 8 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.712530:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5516200/0xe64d3fbf12a7d840 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb847 expref: 8 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.712536:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5516200, rc 0) 00000100:00100000:1.0:1746147725.712548:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793929600:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 56us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.712552:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16436 00000100:00100000:0.0:1746147725.721298:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.721408:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793929984 00000100:00100000:2.0:1746147725.721416:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793929984 00000100:00100000:2.0:1746147725.721475:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7315 00000100:00100000:2.0:1746147725.721483:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967793929984:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:2.0:1746147725.721512:0:8473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095093a00/0xe64d3fbf12a7d847 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.721523:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.721525:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.721531:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095093a00/0xe64d3fbf12a7d847 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.721542:0:8473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095093a00/0xe64d3fbf12a7d847 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.727555:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.727624:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793930240 00000100:00100000:3.0:1746147725.727632:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793930240 00000100:00100000:3.0:1746147725.727693:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7316 00000100:00100000:3.0:1746147725.727700:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967793930240:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:3.0:1746147725.727743:0:8474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6400/0xe64d3fbf12a7d84e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.727755:0:8474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.727756:0:8474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.727760:0:8474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6400/0xe64d3fbf12a7d84e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.727771:0:8474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6400/0xe64d3fbf12a7d84e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147725.728785:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.728815:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.728841:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.728897:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793930752 00000100:00100000:2.0:1746147725.728902:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793930752 00000100:00100000:2.0:1746147725.728929:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793930624 00000100:00100000:2.0:1746147725.728931:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793930624 00000100:00100000:2.0:1746147725.728942:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793931008 00000100:00100000:2.0:1746147725.728944:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793931008 00000100:00100000:2.0:1746147725.728957:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7317 00000100:00100000:2.0:1746147725.728962:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967793930752:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:2.0:1746147725.728980:0:31354:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d855 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.728988:0:31354:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.728989:0:31354:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.728992:0:31354:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d855 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.729000:0:31354:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d855 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147725.729072:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.729382:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793931136 00000100:00100000:0.0:1746147725.729385:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793931136 00000100:00100000:0.0:1746147725.729403:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7318 00000100:00100000:0.0:1746147725.729408:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967793930624:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:0.0:1746147725.729420:0:31355:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095445a00/0xe64d3fbf12a7d85c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.729427:0:31355:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147725.729429:0:31355:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147725.729431:0:31355:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095445a00/0xe64d3fbf12a7d85c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.729438:0:31355:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095445a00/0xe64d3fbf12a7d85c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147725.729601:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7319 00000100:00100000:1.0:1746147725.729609:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967793931008:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:1.0:1746147725.729626:0:31359:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5516a00/0xe64d3fbf12a7d863 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.729633:0:31359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.729635:0:31359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.729637:0:31359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5516a00/0xe64d3fbf12a7d863 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.729645:0:31359:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5516a00/0xe64d3fbf12a7d863 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147725.729802:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7320 00000100:00100000:0.0:1746147725.729808:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967793931136:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:0.0:1746147725.729823:0:31357:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095445800/0xe64d3fbf12a7d86a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.729830:0:31357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147725.729831:0:31357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147725.729833:0:31357:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095445800/0xe64d3fbf12a7d86a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.729840:0:31357:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095445800/0xe64d3fbf12a7d86a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147725.738934:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.738960:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.738997:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793931520 00000100:00100000:2.0:1746147725.739005:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793931520 00000100:00100000:2.0:1746147725.739046:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793931776 00000100:00100000:2.0:1746147725.739048:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793931776 00000100:00100000:2.0:1746147725.740305:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7321 00000100:00100000:2.0:1746147725.740315:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41587371-240a-4781-aecb-638f17200fbd+14:1957:x1830967793931520:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:2.0:1746147725.740349:0:8475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d871 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.740361:0:8475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.740363:0:8475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.740368:0:8475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d871 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.740378:0:8475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d871 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147725.740404:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7322 00000100:00100000:3.0:1746147725.740412:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41587371-240a-4781-aecb-638f17200fbd+15:1957:x1830967793931776:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:3.0:1746147725.740430:0:31358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6000/0xe64d3fbf12a7d878 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.740437:0:31358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.740438:0:31358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.740442:0:31358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6000/0xe64d3fbf12a7d878 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.740449:0:31358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6000/0xe64d3fbf12a7d878 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.745567:0:8473:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095093a00/0xe64d3fbf12a7d847 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.745582:0:8473:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095093a00/0xe64d3fbf12a7d847 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.745589:0:8473:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095093a00/0xe64d3fbf12a7d847 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.745595:0:8473:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095093a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147725.745598:0:8473:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095093a00/0xe64d3fbf12a7d847 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.745604:0:8473:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095093a00/0xe64d3fbf12a7d847 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.745619:0:8473:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095093a00/0xe64d3fbf12a7d847 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.745624:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095093a00/0xe64d3fbf12a7d847 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.745696:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41587371-240a-4781-aecb-638f17200fbd+14:1957:x1830967793929984:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 24211us (24405us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147725.745704:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7315 00010000:00010000:2.0:1746147725.747413:0:31359:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5516a00/0xe64d3fbf12a7d863 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.747425:0:31359:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5516a00/0xe64d3fbf12a7d863 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.747431:0:31359:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5516a00/0xe64d3fbf12a7d863 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.747437:0:31359:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5516a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147725.747440:0:31359:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5516a00/0xe64d3fbf12a7d863 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.747446:0:31359:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5516a00/0xe64d3fbf12a7d863 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.747457:0:31359:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5516a00/0xe64d3fbf12a7d863 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.747463:0:31359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5516a00/0xe64d3fbf12a7d863 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.747513:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41587371-240a-4781-aecb-638f17200fbd+15:1957:x1830967793931008:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 17904us (18669us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147725.747520:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7319 00010000:00010000:3.0:1746147725.752564:0:31354:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d855 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.752578:0:31354:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d855 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.752586:0:31354:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d855 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.752591:0:31354:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a9213a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147725.752595:0:31354:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d855 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.752600:0:31354:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d855 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.752614:0:31354:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d855 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.752620:0:31354:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7d855 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147725.752678:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967793930752:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 23712us (23891us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147725.752686:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7317 00010000:00010000:3.0:1746147725.754633:0:8474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6400/0xe64d3fbf12a7d84e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.754645:0:8474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6400/0xe64d3fbf12a7d84e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.754652:0:8474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6400/0xe64d3fbf12a7d84e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.754657:0:8474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a03b6400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147725.754659:0:8474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6400/0xe64d3fbf12a7d84e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.754665:0:8474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6400/0xe64d3fbf12a7d84e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.754676:0:8474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6400/0xe64d3fbf12a7d84e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.754682:0:8474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6400/0xe64d3fbf12a7d84e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147725.755679:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41587371-240a-4781-aecb-638f17200fbd+13:1958:x1830967793930240:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 27972us (28124us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147725.755690:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7316 00010000:00010000:1.0:1746147725.758360:0:31357:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095445800/0xe64d3fbf12a7d86a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.758374:0:31357:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095445800/0xe64d3fbf12a7d86a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.758381:0:31357:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095445800/0xe64d3fbf12a7d86a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.758388:0:31357:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095445800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147725.758392:0:31357:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095445800/0xe64d3fbf12a7d86a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.758397:0:31357:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095445800/0xe64d3fbf12a7d86a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.758411:0:31357:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095445800/0xe64d3fbf12a7d86a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.758416:0:31357:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095445800/0xe64d3fbf12a7d86a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147725.758489:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967793931136:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 28678us (29413us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147725.758498:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7320 00010000:00010000:2.0:1746147725.764686:0:31355:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095445a00/0xe64d3fbf12a7d85c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.764700:0:31355:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095445a00/0xe64d3fbf12a7d85c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.764708:0:31355:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095445a00/0xe64d3fbf12a7d85c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.764724:0:31355:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095445a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147725.764727:0:31355:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095445a00/0xe64d3fbf12a7d85c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.764734:0:31355:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095445a00/0xe64d3fbf12a7d85c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.764749:0:31355:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095445a00/0xe64d3fbf12a7d85c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.764754:0:31355:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095445a00/0xe64d3fbf12a7d85c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.764813:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967793930624:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 35399us (35992us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147725.764825:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7318 00010000:00010000:2.0:1746147725.767583:0:8475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d871 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.767596:0:8475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d871 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.767603:0:8475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d871 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.767609:0:8475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe53000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147725.767611:0:8475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d871 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.767617:0:8475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d871 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.767631:0:8475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d871 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.767635:0:8475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d871 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147725.767697:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967793931520:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 27380us (28766us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147725.767705:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7321 00010000:00010000:3.0:1746147725.770801:0:31358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6000/0xe64d3fbf12a7d878 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.770818:0:31358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6000/0xe64d3fbf12a7d878 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.770825:0:31358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6000/0xe64d3fbf12a7d878 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.770831:0:31358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a03b6000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147725.770834:0:31358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6000/0xe64d3fbf12a7d878 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.770841:0:31358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6000/0xe64d3fbf12a7d878 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.770854:0:31358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6000/0xe64d3fbf12a7d878 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.770860:0:31358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03b6000/0xe64d3fbf12a7d878 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147725.770952:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967793931776:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 30537us (31987us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147725.770963:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7322 00000100:00100000:0.0:1746147725.778230:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.778622:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793932032 00000100:00100000:1.0:1746147725.778630:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793932032 00000100:00100000:1.0:1746147725.778686:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12000 00000100:00100000:1.0:1746147725.778693:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+9:32162:x1830967793932032:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:1.0:1746147725.778746:0:14546:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147725.778769:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03b7200/0xe64d3fbf12a7d816 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb824 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.778807:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147725.778811:0:14546:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147725.778844:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7d87f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147725.778854:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7d87f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147725.778861:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7d87f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00010000:1.0:1746147725.779048:0:14546:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009aeeb480 reply state ffff880135f19000 transno 8589946011 ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7d87f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:1.0:1746147725.779055:0:14546:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746147725.779568:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+10:32162:x1830967793932032:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 874us (1344us total) trans 8589946011 rc 0/0 00000100:00100000:1.0:1746147725.779574:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12000 00010000:00010000:1.0:1746147725.781643:0:3288:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7d87f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147725.781653:0:3288:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7d87f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147725.781658:0:3288:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7d87f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147725.781663:0:3288:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134b2fa00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147725.781666:0:3288:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7d87f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147725.781674:0:3288:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7d87f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147725.781684:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147725.781686:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147725.781689:0:3288:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7d87f lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147725.781693:0:3288:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7d87f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147725.784032:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.784120:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.784318:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793932160 00000100:00100000:2.0:1746147725.784318:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793932288 00000100:00100000:3.0:1746147725.784326:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793932160 00000100:00100000:2.0:1746147725.784326:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793932288 00000100:00100000:2.0:1746147725.784374:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16437 00000100:00100000:3.0:1746147725.784380:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16438 00000100:00100000:2.0:1746147725.784382:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793932288:12345-192.168.202.10@tcp:2:lfs.0 00000100:00100000:3.0:1746147725.784385:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793932160:12345-192.168.202.10@tcp:2:lfs.0 00002000:00010000:2.0:1746147725.784537:0:6715:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147725.784540:0:6715:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147723 -> 1746147726 00002000:00010000:2.0:1746147725.784542:0:6715:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147723 -> 1746147726 00002000:00010000:2.0:1746147725.784544:0:6715:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147723 -> 1746147726 00002000:00010000:2.0:1746147725.784545:0:6715:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746147725.784602:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793932288:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 221us (481us total) trans 21474841589 rc 0/0 00000100:00100000:2.0:1746147725.784608:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16437 00002000:00010000:3.0:1746147725.785146:0:21480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147725.785149:0:21480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147723 -> 1746147726 00002000:00010000:3.0:1746147725.785150:0:21480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147723 -> 1746147726 00002000:00010000:3.0:1746147725.785152:0:21480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147723 -> 1746147726 00002000:00010000:3.0:1746147725.785154:0:21480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:3.0:1746147725.785174:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793932160:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 788us (1149us total) trans 17179874361 rc 0/0 00000100:00100000:3.0:1746147725.785179:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16438 00000100:00100000:0.0:1746147725.785555:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.785586:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.785597:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793932416 00000100:00100000:0.0:1746147725.785600:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793932416 00000100:00100000:0.0:1746147725.785613:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793932544 00000100:00100000:0.0:1746147725.785615:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793932544 00000100:00100000:0.0:1746147725.785623:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16439 00000100:00100000:0.0:1746147725.785628:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793932416:12345-192.168.202.10@tcp:2:lfs.0 00002000:00010000:0.0:1746147725.785701:0:22183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147725.785704:0:22183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147725 -> 1746147726 00002000:00010000:0.0:1746147725.785705:0:22183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147725 -> 1746147726 00002000:00010000:0.0:1746147725.785707:0:22183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147725 -> 1746147726 00002000:00010000:0.0:1746147725.785708:0:22183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147725.785736:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967793932416:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 107us (181us total) trans 21474841590 rc 0/0 00000100:00100000:0.0:1746147725.785741:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16439 00000100:00100000:0.0:1746147725.785752:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16440 00000100:00100000:0.0:1746147725.785757:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793932544:12345-192.168.202.10@tcp:2:lfs.0 00002000:00010000:0.0:1746147725.785815:0:22183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147725.785817:0:22183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147725 -> 1746147726 00002000:00010000:0.0:1746147725.785819:0:22183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147725 -> 1746147726 00002000:00010000:0.0:1746147725.785821:0:22183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147725 -> 1746147726 00002000:00010000:0.0:1746147725.785822:0:22183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147725.785835:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793932544:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 78us (248us total) trans 17179874362 rc 0/0 00000100:00100000:0.0:1746147725.785839:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16440 00000100:00100000:0.0:1746147725.785867:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.785875:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793932672 00000100:00100000:0.0:1746147725.785877:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793932672 00000100:00100000:0.0:1746147725.785902:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16441 00000100:00100000:0.0:1746147725.785907:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793932672:12345-192.168.202.10@tcp:2:lfs.0 00002000:00010000:0.0:1746147725.785952:0:22183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:0.0:1746147725.785955:0:22183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147726 -> 1746147726 00002000:00010000:0.0:1746147725.785956:0:22183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147726 -> 1746147726 00002000:00010000:0.0:1746147725.785958:0:22183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147726 -> 1746147726 00002000:00010000:0.0:1746147725.785959:0:22183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:0.0:1746147725.785971:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967793932672:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 65us (104us total) trans 17179874363 rc 0/0 00000100:00100000:0.0:1746147725.785975:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16441 00000100:00100000:0.0:1746147725.786008:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.786016:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793932800 00000100:00100000:0.0:1746147725.786019:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793932800 00000100:00100000:0.0:1746147725.786029:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16442 00000100:00100000:0.0:1746147725.786032:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967793932800:12345-192.168.202.10@tcp:2:lfs.0 00002000:00010000:0.0:1746147725.786081:0:22183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147725.786083:0:22183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147726 -> 1746147726 00002000:00010000:0.0:1746147725.786085:0:22183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147724 -> 1746147726 00002000:00010000:0.0:1746147725.786086:0:22183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147726 -> 1746147726 00002000:00010000:0.0:1746147725.786088:0:22183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746147725.786099:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967793932800:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 66us (90us total) trans 21474841591 rc 0/0 00000100:00100000:0.0:1746147725.786103:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16442 00010000:00010000:1.0:1746147725.786983:0:20300:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147725.788238:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.789282:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793933056 00000100:00100000:3.0:1746147725.789290:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793933056 00000100:00100000:3.0:1746147725.789327:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4992 00000100:00100000:3.0:1746147725.789333:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+9:32162:x1830967793933056:12345-192.168.202.10@tcp:35:lfs.0 00000004:00010000:3.0:1746147725.789384:0:14549:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x3bf:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634a00/0xe64d3fbf12a7d7c9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb816 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.789429:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147725.789439:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7d808 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb81d expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.789449:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147725.789701:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7d808 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb81d expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.789721:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7d808 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb81d expref: 9 pid: 17544 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147725.789732:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14549:1830967796448256:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147725.790075:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b54e13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147725.793953:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14549:1830967796448256:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.793976:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746147725.794163:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.794220:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793933184 00000100:00100000:3.0:1746147725.794225:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793933184 00010000:00010000:3.0:1746147725.794253:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7d808 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb81d expref: 10 pid: 17544 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746147725.794288:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8347 00000100:00100000:3.0:1746147725.794294:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793933184:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147725.794304:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147725.794310:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7d808 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb81d expref: 10 pid: 17544 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.794319:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7d808 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb81d expref: 10 pid: 17544 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.794336:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7d808 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb81d expref: 10 pid: 17544 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746147725.794352:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.794356:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147725.794363:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147725.794368:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147725.794396:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147725.794429:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793933184:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 135us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.794435:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8347 00010000:00010000:2.0:1746147725.794598:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746147725.794604:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000040:00080000:2.0:1746147725.795346:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3658, 88 off306272 00000004:00080000:2.0:1746147725.795353:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804969467716ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147725.795402:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3668, 88 off306800 00000004:00080000:2.0:1746147725.795406:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804969521079ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147725.796056:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3669, 88 off306888 00000004:00080000:2.0:1746147725.796062:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804970177061ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147725.796070:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3659, 88 off306360 00000004:00080000:2.0:1746147725.796072:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804970187942ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147725.796093:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3660, 88 off306448 00000004:00080000:2.0:1746147725.796096:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804970211462ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147725.796103:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3670, 88 off306976 00000004:00080000:2.0:1746147725.796106:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804970221337ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147725.796112:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3671, 88 off307064 00000004:00080000:2.0:1746147725.796114:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804970229165ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147725.796119:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3672, 88 off307152 00000004:00080000:2.0:1746147725.796121:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804970236876ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147725.796127:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3661, 88 off306536 00000004:00080000:2.0:1746147725.796130:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804970245402ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147725.796136:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3673, 88 off307240 00000004:00080000:2.0:1746147725.796139:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804970254690ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147725.796145:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3662, 88 off306624 00000004:00080000:2.0:1746147725.796148:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804970263720ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147725.796154:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3674, 88 off307328 00000004:00080000:2.0:1746147725.796156:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804970271549ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147725.796162:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3663, 88 off306712 00000004:00080000:2.0:1746147725.796164:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804970279282ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147725.796169:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3664, 88 off306800 00000004:00080000:2.0:1746147725.796171:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804970286745ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147725.796177:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3665, 88 off306888 00000004:00080000:2.0:1746147725.796179:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804970294942ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147725.796185:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3666, 88 off306976 00000004:00080000:2.0:1746147725.796187:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804970303015ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147725.796193:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3675, 88 off307416 00000004:00080000:2.0:1746147725.796196:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804970311469ns, next at 756024029964ns, rc = 0 00000001:00080000:0.0:1746147725.824844:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946011 is committed 00000001:00080000:0.0:1746147725.824856:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946012 is committed 00000004:00080000:0.0:1746147725.824858:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2743 committed 00000004:00080000:0.0:1746147725.824864:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2734 committed 00000004:00080000:0.0:1746147725.824870:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2733 committed 00000004:00080000:0.0:1746147725.824873:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2732 committed 00000004:00080000:0.0:1746147725.824874:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2731 committed 00000004:00080000:0.0:1746147725.824875:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2742 committed 00000004:00080000:0.0:1746147725.824877:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2730 committed 00000004:00080000:0.0:1746147725.824878:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2741 committed 00000004:00080000:0.0:1746147725.824880:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2729 committed 00000004:00080000:0.0:1746147725.824881:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2740 committed 00000004:00080000:0.0:1746147725.824897:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2739 committed 00000004:00080000:0.0:1746147725.824899:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2738 committed 00000004:00080000:0.0:1746147725.824900:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2728 committed 00000004:00080000:0.0:1746147725.824901:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2727 committed 00000004:00080000:0.0:1746147725.824902:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2737 committed 00000004:00080000:0.0:1746147725.824904:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2736 committed 00000004:00080000:0.0:1746147725.824905:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2726 committed 00000100:00100000:2.0:1746147725.825059:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796448768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.825108:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.825139:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796449280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.825152:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.825164:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746147725.825167:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796448384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.825178:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.825185:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796448896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.825194:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.825205:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796448640:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.825218:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.825224:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796449152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.825233:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.825240:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746147725.825243:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796448512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.825253:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.825259:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009505c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796449024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.825269:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.825283:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796448768 00000100:00100000:2.0:1746147725.825289:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796448768 00000100:00100000:2.0:1746147725.825313:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796449280 00000100:00100000:2.0:1746147725.825314:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796449280 00000100:00100000:2.0:1746147725.825321:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796448384 00000100:00100000:2.0:1746147725.825322:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796448384 00000100:00100000:2.0:1746147725.825328:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796448896 00000100:00100000:2.0:1746147725.825329:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796448896 00000100:00100000:2.0:1746147725.825336:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796448640 00000100:00100000:2.0:1746147725.825337:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796448640 00000100:00100000:2.0:1746147725.825344:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796449152 00000100:00100000:2.0:1746147725.825345:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796449152 00000100:00100000:2.0:1746147725.825350:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796448512 00000100:00100000:2.0:1746147725.825352:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796448512 00000100:00100000:2.0:1746147725.825357:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796449024 00000100:00100000:2.0:1746147725.825358:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796449024 00000100:00100000:2.0:1746147725.825365:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16443 00000100:00100000:2.0:1746147725.825370:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+57:3303:x1830967796448768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.825520:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+58:3303:x1830967796448768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (410us total) trans 17179874364 rc 0/0 00000100:00100000:2.0:1746147725.825526:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16443 00000100:00100000:2.0:1746147725.825542:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16444 00000100:00100000:2.0:1746147725.825546:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+57:3303:x1830967796449280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.825617:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+58:3303:x1830967796449280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (464us total) trans 17179874365 rc 0/0 00000100:00100000:2.0:1746147725.825622:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16444 00000100:00100000:2.0:1746147725.825629:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16445 00000100:00100000:2.0:1746147725.825633:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+57:3303:x1830967796448384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147725.825695:0:6715:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147725.825698:0:6715:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.825700:0:6715:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.825702:0:6715:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.825703:0:6715:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:2.0:1746147725.825729:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+58:3303:x1830967796448384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (549us total) trans 17179874366 rc 0/0 00000100:00100000:2.0:1746147725.825733:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16445 00000100:00100000:2.0:1746147725.825740:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16446 00000100:00100000:2.0:1746147725.825743:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+57:3303:x1830967796448896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.825799:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+58:3303:x1830967796448896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (603us total) trans 17179874367 rc 0/0 00000100:00100000:2.0:1746147725.825804:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16446 00000100:00100000:2.0:1746147725.825810:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16447 00000100:00100000:2.0:1746147725.825814:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+57:3302:x1830967796448640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147725.825864:0:6715:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:2.0:1746147725.825866:0:6715:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.825868:0:6715:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.825870:0:6715:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.825871:0:6715:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:2.0:1746147725.825909:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+58:3302:x1830967796448640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (690us total) trans 17179874368 rc 0/0 00000100:00100000:2.0:1746147725.825913:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16447 00000100:00100000:2.0:1746147725.825921:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16448 00000100:00100000:2.0:1746147725.825925:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+57:3302:x1830967796449152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.825995:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+58:3302:x1830967796449152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (760us total) trans 17179874369 rc 0/0 00000100:00100000:2.0:1746147725.826000:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16448 00000100:00100000:2.0:1746147725.826008:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16449 00000100:00100000:2.0:1746147725.826012:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+57:3302:x1830967796448512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147725.826071:0:6715:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147725.826073:0:6715:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.826075:0:6715:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.826077:0:6715:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.826078:0:6715:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147725.826095:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+58:3302:x1830967796448512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (841us total) trans 17179874370 rc 0/0 00000100:00100000:2.0:1746147725.826099:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16449 00000100:00100000:2.0:1746147725.826109:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16450 00000100:00100000:2.0:1746147725.826113:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+57:3302:x1830967796449024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.826177:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+58:3302:x1830967796449024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (906us total) trans 17179874371 rc 0/0 00000100:00100000:2.0:1746147725.826181:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16450 00000004:00080000:2.0:1746147725.826219:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009505df80/2, rc 0, transno 17179874370 00000100:00100000:2.0:1746147725.826227:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796448512:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147725.826234:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009505c700/2, rc 0, transno 17179874371 00000100:00100000:2.0:1746147725.826236:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796449024:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147725.826241:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009505d880/2, rc 0, transno 17179874368 00000100:00100000:2.0:1746147725.826243:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796448640:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147725.826248:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009505c000/2, rc 0, transno 17179874369 00000100:00100000:2.0:1746147725.826251:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796449152:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147725.826262:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009505f800/2, rc 0, transno 17179874366 00000100:00100000:2.0:1746147725.826265:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796448384:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147725.826269:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009505fb80/2, rc 0, transno 17179874367 00000100:00100000:2.0:1746147725.826271:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796448896:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147725.826276:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009505ea00/2, rc 0, transno 17179874364 00000100:00100000:2.0:1746147725.826278:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009505ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796448768:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147725.826283:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ce61180/2, rc 0, transno 17179874365 00000100:00100000:2.0:1746147725.826284:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796449280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.826307:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746147725.826313:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796449408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.826330:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.826355:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796449408 00000100:00100000:2.0:1746147725.826359:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796449408 00000100:00100000:2.0:1746147725.826372:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16451 00000100:00100000:2.0:1746147725.826376:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3303:x1830967796449408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.826454:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3303:x1830967796449408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (123us total) trans 17179874372 rc 0/0 00000100:00100000:2.0:1746147725.826459:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16451 00000004:00080000:2.0:1746147725.826478:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02aea00/2, rc 0, transno 17179874372 00000100:00100000:2.0:1746147725.826481:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796449408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.826661:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796449920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147725.826684:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.826717:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796450432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147725.826731:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.826742:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746147725.826745:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796449792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147725.826758:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.826765:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796450304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147725.826777:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.826793:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796449920 00000100:00100000:3.0:1746147725.826797:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796449920 00000100:00100000:3.0:1746147725.826812:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796450432 00000100:00100000:3.0:1746147725.826813:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796450432 00000100:00100000:3.0:1746147725.826824:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796449792 00000100:00100000:3.0:1746147725.826825:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796449792 00000100:00100000:3.0:1746147725.826831:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796450304 00000100:00100000:3.0:1746147725.826833:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796450304 00000100:00100000:3.0:1746147725.826840:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16452 00000100:00100000:3.0:1746147725.826844:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3304:x1830967796449920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147725.826979:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3304:x1830967796449920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (293us total) trans 21474841592 rc 0/0 00000100:00100000:3.0:1746147725.826984:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16452 00000100:00100000:3.0:1746147725.826996:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16453 00000100:00100000:3.0:1746147725.827000:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3304:x1830967796450432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147725.827072:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3304:x1830967796450432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (339us total) trans 21474841593 rc 0/0 00000100:00100000:3.0:1746147725.827077:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16453 00000100:00100000:3.0:1746147725.827085:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16454 00000100:00100000:3.0:1746147725.827088:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3304:x1830967796449792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147725.827151:0:21480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147725.827154:0:21480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147726 -> 1746147726 00002000:00010000:3.0:1746147725.827155:0:21480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147726 -> 1746147726 00002000:00010000:3.0:1746147725.827157:0:21480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147726 -> 1746147726 00002000:00010000:3.0:1746147725.827159:0:21480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746147725.827175:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3304:x1830967796449792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (416us total) trans 21474841594 rc 0/0 00000100:00100000:3.0:1746147725.827180:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16454 00000100:00100000:3.0:1746147725.827284:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16455 00000100:00100000:3.0:1746147725.827289:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3304:x1830967796450304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147725.827364:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3304:x1830967796450304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (585us total) trans 21474841595 rc 0/0 00000100:00100000:3.0:1746147725.827369:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16455 00000004:00080000:3.0:1746147725.827393:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c0380/2, rc 0, transno 21474841594 00000100:00100000:3.0:1746147725.827396:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796449792:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147725.827401:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c2680/2, rc 0, transno 21474841595 00000100:00100000:3.0:1746147725.827403:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796450304:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147725.827408:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c3b80/2, rc 0, transno 21474841592 00000100:00100000:3.0:1746147725.827410:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796449920:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147725.827415:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c3800/2, rc 0, transno 21474841593 00000100:00100000:3.0:1746147725.827417:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796450432:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746147725.827438:0:14549:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009fe41f80 reply state ffff88009a5b5c00 transno 8589946012 ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746147725.827446:0:14549:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746147725.827452:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.827455:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147725.827462:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5634a00/0xe64d3fbf12a7d7c9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb816 expref: 7 pid: 17544 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746147725.829541:0:14549:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147725.829558:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+7:32162:x1830967793933056:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 40220us (41319us total) trans 8589946012 rc 0/0 00000100:00100000:3.0:1746147725.829567:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4992 00000100:00100000:0.0:1746147725.830053:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796449536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147725.830098:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147725.830127:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796450048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147725.830139:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147725.830151:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147725.830156:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796449664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147725.830167:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147725.830175:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796450176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147725.830185:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147725.830206:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796449536 00000100:00100000:0.0:1746147725.830212:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796449536 00000100:00100000:0.0:1746147725.830234:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796450048 00000100:00100000:0.0:1746147725.830236:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796450048 00000100:00100000:0.0:1746147725.830243:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796449664 00000100:00100000:0.0:1746147725.830245:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796449664 00000100:00100000:0.0:1746147725.830249:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796450176 00000100:00100000:0.0:1746147725.830251:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796450176 00000100:00100000:0.0:1746147725.830259:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16456 00000100:00100000:0.0:1746147725.830263:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3301:x1830967796449536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147725.830417:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147725.830420:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147726 -> 1746147726 00002000:00010000:0.0:1746147725.830422:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147726 -> 1746147726 00002000:00010000:0.0:1746147725.830424:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147726 -> 1746147726 00002000:00010000:0.0:1746147725.830425:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147725.830445:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3301:x1830967796449536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (347us total) trans 21474841596 rc 0/0 00000100:00100000:0.0:1746147725.830450:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16456 00000100:00100000:0.0:1746147725.830459:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16457 00000100:00100000:0.0:1746147725.830462:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3301:x1830967796450048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147725.830515:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:0.0:1746147725.830517:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147725.830519:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147725.830520:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147725.830522:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:0.0:1746147725.830535:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3301:x1830967796450048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (395us total) trans 21474841597 rc 0/0 00000100:00100000:0.0:1746147725.830539:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16457 00000100:00100000:0.0:1746147725.830545:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16458 00000100:00100000:0.0:1746147725.830549:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3301:x1830967796449664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147725.830598:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147725.830601:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147726 -> 1746147726 00002000:00010000:0.0:1746147725.830602:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147726 -> 1746147726 00002000:00010000:0.0:1746147725.830604:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147726 -> 1746147726 00002000:00010000:0.0:1746147725.830605:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746147725.830618:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3301:x1830967796449664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (450us total) trans 21474841598 rc 0/0 00000100:00100000:0.0:1746147725.830622:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16458 00000100:00100000:0.0:1746147725.830628:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16459 00000100:00100000:0.0:1746147725.830631:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3301:x1830967796450176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147725.830682:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3301:x1830967796450176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (495us total) trans 21474841599 rc 0/0 00000100:00100000:0.0:1746147725.830686:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16459 00000004:00080000:0.0:1746147725.830729:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c1f80/2, rc 0, transno 21474841598 00000100:00100000:0.0:1746147725.830734:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796449664:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147725.830739:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c1180/2, rc 0, transno 21474841599 00000100:00100000:0.0:1746147725.830741:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796450176:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147725.830746:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c1500/2, rc 0, transno 21474841596 00000100:00100000:0.0:1746147725.830748:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796449536:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147725.830752:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c3480/2, rc 0, transno 21474841597 00000100:00100000:0.0:1746147725.830754:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796450048:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746147725.830876:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147725.830897:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147725.830904:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147725.830909:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800950f4000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147725.830912:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147725.830918:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147725.830931:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.830934:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147725.830937:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147725.830941:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950f4000/0xe64d3fbf12a7d886 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746147725.832806:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.833100:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793933312 00000100:00100000:1.0:1746147725.833108:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793933312 00000100:00100000:1.0:1746147725.833303:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12001 00000100:00100000:1.0:1746147725.833311:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+6:32162:x1830967793933312:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147725.833328:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.833345:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7cce00/0xe64d3fbf12a7d88d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb855 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.833391:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7cce00/0xe64d3fbf12a7d88d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb855 expref: 7 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.833401:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7cce00/0xe64d3fbf12a7d88d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb855 expref: 7 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.833415:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147725.833417:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147725.833419:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7cce00, rc 0) 00000100:00100000:1.0:1746147725.833452:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+7:32162:x1830967793933312:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 143us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.833457:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12001 00000100:00100000:0.0:1746147725.839631:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.840112:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793933568 00000100:00100000:3.0:1746147725.840120:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793933568 00000100:00100000:3.0:1746147725.840157:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4993 00000100:00100000:3.0:1746147725.840164:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+7:32162:x1830967793933568:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:3.0:1746147725.840394:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+8:32162:x1830967793933568:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 229us (767us total) trans 8589946013 rc 0/0 00000100:00100000:3.0:1746147725.840401:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4993 00000100:00100000:0.0:1746147725.861271:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.861411:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793933824 00000100:00100000:3.0:1746147725.861423:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793933824 00000100:00100000:3.0:1746147725.861652:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12002 00000100:00100000:3.0:1746147725.861660:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:32173:x1830967793933824:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147725.861680:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.861696:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136273e00/0xe64d3fbf12a7d894 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb85c expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.861801:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7d89b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.861811:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7d89b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.861819:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7d89b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.861830:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7d8a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.861834:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7d8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.861838:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7d8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862067:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d8a9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862074:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862079:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:3.0:1746147725.862089:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147725.862160:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7d89b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862165:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7d89b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862170:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7d89b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862175:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801308bc400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147725.862178:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7d89b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862183:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7d89b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862192:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147725.862195:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147725.862198:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7d89b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862202:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7d89b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862495:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7d8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862504:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7d8a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862509:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7d8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862516:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801308bc600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147725.862519:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7d8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862524:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7d8a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862530:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a024b700) 00010000:00010000:3.0:1746147725.862532:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147725.862534:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7d8a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862538:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7d8a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.862573:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136273e00/0xe64d3fbf12a7d894 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb85c expref: 325 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.862583:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb85c expref: 324 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.862589:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.862591:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147725.862593:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a221e000, rc 0) 00000100:00100000:3.0:1746147725.862644:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32173:x1830967793933824:12345-192.168.202.10@tcp:101:cat.0 Request processed in 985us (1385us total) trans 8589946014 rc 0/0 00000100:00100000:3.0:1746147725.862650:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12002 00000100:00100000:0.0:1746147725.862839:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.863110:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793934080 00000100:00100000:3.0:1746147725.863114:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793934080 00000100:00100000:3.0:1746147725.863439:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12003 00000100:00100000:3.0:1746147725.863445:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+6:32169:x1830967793934080:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147725.863457:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.863465:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7d8b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb863 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.863509:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.863515:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.863521:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.863529:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221f800/0xe64d3fbf12a7d8c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.863534:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221f800/0xe64d3fbf12a7d8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.863539:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221f800/0xe64d3fbf12a7d8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.863591:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d8cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.863596:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d8cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.863602:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d8cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:3.0:1746147725.863607:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147725.863649:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.863654:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.863658:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.863662:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a221e400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147725.865490:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.865502:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.865513:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147725.865516:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147725.865519:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.865524:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.865535:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221f800/0xe64d3fbf12a7d8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.865539:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221f800/0xe64d3fbf12a7d8c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.865544:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221f800/0xe64d3fbf12a7d8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.865548:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a221f800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147725.865549:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221f800/0xe64d3fbf12a7d8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.865554:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221f800/0xe64d3fbf12a7d8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.865559:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a024b800) 00010000:00010000:3.0:1746147725.865560:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147725.865562:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221f800/0xe64d3fbf12a7d8c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.865565:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221f800/0xe64d3fbf12a7d8c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.865604:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221ec00/0xe64d3fbf12a7d8b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb863 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.865613:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d8cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb863 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.865617:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.865619:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147725.865621:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe53000, rc 0) 00000100:00100000:3.0:1746147725.865665:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32169:x1830967793934080:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2220us (2830us total) trans 8589946015 rc 0/0 00000100:00100000:3.0:1746147725.865671:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12003 00000100:00100000:2.0:1746147725.871072:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.871522:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793934336 00000100:00100000:0.0:1746147725.871534:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793934336 00000100:00100000:0.0:1746147725.871592:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4994 00000100:00100000:0.0:1746147725.871600:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32173:x1830967793934336:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:0.0:1746147725.874617:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32173:x1830967793934336:12345-192.168.202.10@tcp:35:cat.0 Request processed in 3006us (3545us total) trans 8589946016 rc 0/0 00000100:00100000:0.0:1746147725.874632:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4994 00000100:00100000:3.0:1746147725.874937:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.874970:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793934848 00000100:00100000:3.0:1746147725.874976:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793934848 00000100:00100000:3.0:1746147725.875021:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12004 00000100:00100000:3.0:1746147725.875029:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32169:x1830967793934848:12345-192.168.202.10@tcp:101:multiop.0 00000100:00100000:1.0:1746147725.875086:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.875134:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793934592 00000100:00100000:0.0:1746147725.875140:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793934592 00010000:00010000:3.0:1746147725.875151:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.875154:0:17544:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:0.0:1746147725.875168:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12005 00000100:00100000:0.0:1746147725.875174:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32174:x1830967793934592:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147725.875177:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe53000/0xe64d3fbf12a7d8cc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb863 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.875187:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.875201:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.875205:0:17544:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147725.875212:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae8c00/0xe64d3fbf12a7d8da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb86a expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.875213:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221f800/0xe64d3fbf12a7d8e1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb871 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.875253:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.875262:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7cce00/0xe64d3fbf12a7d88d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb855 expref: 7 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.875269:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d8a9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb85c expref: 324 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.875274:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.875295:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb85c expref: 324 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.875297:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9200/0xe64d3fbf12a7d8ef lrc: 3/1,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.875302:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d8a9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb85c expref: 324 pid: 17544 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147725.875311:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796450560:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.875375:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7cce00/0xe64d3fbf12a7d88d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb855 expref: 7 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.875382:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7cce00/0xe64d3fbf12a7d88d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb855 expref: 7 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147725.875388:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796450688:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147725.875401:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6c00 going to sleep for 11 seconds 00010000:00010000:0.0:1746147725.875569:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9200/0xe64d3fbf12a7d8ef lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147725.875579:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9200/0xe64d3fbf12a7d8ef lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:0.0:1746147725.875590:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147725.875696:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae8c00/0xe64d3fbf12a7d8da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb86a expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.875720:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9200/0xe64d3fbf12a7d8ef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb86a expref: 11 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.875732:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147725.875735:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147725.875738:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dae9200, rc 0) 00000100:00100000:0.0:1746147725.875777:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32174:x1830967793934592:12345-192.168.202.10@tcp:101:cat.0 Request processed in 604us (691us total) trans 8589946017 rc 0/0 00000100:00100000:0.0:1746147725.875783:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12005 00000100:00100000:3.0:1746147725.878116:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796450560:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147725.878128:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796450688:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147725.878155:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147725.880529:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.880572:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.880680:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793934976 00000100:00100000:1.0:1746147725.880689:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793934976 00010000:00010000:1.0:1746147725.880734:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7cce00/0xe64d3fbf12a7d88d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb855 expref: 8 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746147725.880775:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8348 00000100:00100000:1.0:1746147725.880782:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967793934976:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147725.880794:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147725.880799:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7cce00/0xe64d3fbf12a7d88d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb855 expref: 8 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147725.880806:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7cce00/0xe64d3fbf12a7d88d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb855 expref: 8 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147725.880830:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7cce00/0xe64d3fbf12a7d88d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb855 expref: 8 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147725.880851:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147725.880856:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147725.880862:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147725.880866:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147725.882414:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967793934976:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1626us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.882432:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8348 00000100:00100000:1.0:1746147725.882734:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.882735:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793935104 00000100:00100000:2.0:1746147725.882745:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793935104 00000100:00100000:1.0:1746147725.882772:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.882905:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.884434:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793935232 00000100:00100000:2.0:1746147725.884445:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793935232 00000100:00100000:1.0:1746147725.884456:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793935360 00000100:00100000:1.0:1746147725.884464:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793935360 00000100:00100000:2.0:1746147725.884492:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793935616 00010000:00010000:1.0:1746147725.884492:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d8a9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb85c expref: 326 pid: 17544 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147725.884494:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793935616 00000100:00100000:2.0:1746147725.884511:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12006 00000100:00100000:1.0:1746147725.884517:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8349 00000100:00100000:2.0:1746147725.884519:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32173:x1830967793935104:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147725.884524:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:1959:x1830967793935360:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147725.884535:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147725.884540:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d8a9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb85c expref: 327 pid: 17544 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147725.884544:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.884550:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb85c expref: 327 pid: 17544 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147725.884561:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7d8fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb878 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.884568:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e000/0xe64d3fbf12a7d8a9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb85c expref: 327 pid: 17544 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147725.884581:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147725.884586:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147725.884594:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147725.884600:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147725.884617:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147725.884624:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147725.884640:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.884646:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x40 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147725.884650:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:1959:x1830967793935360:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 127us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.884655:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8349 00010000:00010000:2.0:1746147725.884662:0:5744:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147725.884670:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x40 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147725.884695:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12007 00000100:00100000:2.0:1746147725.884701:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32174:x1830967793935232:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147725.884723:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147725.884731:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7d90b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb87f expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147725.884988:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12008 00000100:00100000:0.0:1746147725.884997:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32168:x1830967793935616:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147725.885004:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147725.885011:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7d912 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb886 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.885026:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147725.885034:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147725.885073:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147725.885080:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147725.885085:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147725.885092:0:14546:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210400000020 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147725.885102:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147725.885537:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147725.885545:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147725.885549:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147725.885557:0:14547:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147725.885563:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000040:00080000:3.0:1746147725.885724:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3667, 88 off307064 00000004:00080000:3.0:1746147725.885730:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805059844670ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.885781:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3676, 88 off307504 00000004:00080000:3.0:1746147725.885785:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805059900196ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147725.885807:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3677, 88 off307592 00000004:00080000:3.0:1746147725.885811:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805059926205ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147725.885817:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3668, 88 off307152 00000004:00080000:3.0:1746147725.885820:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805059935594ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.885862:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3669, 88 off307240 00000004:00080000:3.0:1746147725.885866:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805059981580ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.885874:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3678, 88 off307680 00000004:00080000:3.0:1746147725.885876:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805059991527ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147725.885897:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3679, 88 off307768 00000004:00080000:3.0:1746147725.885901:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805060016466ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147725.885909:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3680, 88 off307856 00000004:00080000:3.0:1746147725.885912:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805060027454ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147725.888121:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3670, 88 off307328 00000004:00080000:3.0:1746147725.888139:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805062253901ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.888180:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3681, 88 off307944 00000004:00080000:3.0:1746147725.888183:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805062298986ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147725.888208:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3671, 88 off307416 00000004:00080000:3.0:1746147725.888211:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805062326835ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.888218:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3682, 88 off308032 00000004:00080000:3.0:1746147725.888221:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805062336523ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147725.888228:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3672, 88 off307504 00000004:00080000:3.0:1746147725.888230:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805062345555ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.888237:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3673, 88 off307592 00000004:00080000:3.0:1746147725.888241:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805062356895ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.888247:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3674, 88 off307680 00000004:00080000:3.0:1746147725.888250:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805062365675ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.888256:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3675, 88 off307768 00000004:00080000:3.0:1746147725.888259:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805062374397ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147725.888266:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3683, 88 off308120 00000004:00080000:3.0:1746147725.888268:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805062383668ns, next at 756024029964ns, rc = 0 00010000:00010000:3.0:1746147725.930235:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb871 expref: 14 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.930251:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147725.930255:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147725.930258:0:17544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x40 rrc: 9 type: IBT flags: 0x40210400000020 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147725.930267:0:17544:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x53/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147725.930272:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x53/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147725.930277:0:17544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147725.930282:0:17544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147725.930286:0:17544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000001:00080000:1.0:1746147725.930308:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946017 is committed 00010000:00010000:3.0:1746147725.930323:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221f800/0xe64d3fbf12a7d8e1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb871 expref: 14 pid: 17544 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746147725.930346:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb871 expref: 13 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.930382:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a221e400, rc 0) 00000100:00100000:3.0:1746147725.930453:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32169:x1830967793934848:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 55423us (55522us total) trans 8589946018 rc 0/0 00000100:00100000:3.0:1746147725.930462:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12004 00010000:00010000:2.0:1746147725.930538:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x53/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147725.930546:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x53/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 5744 initiator: MDT0 00000004:00200000:2.0:1746147725.930578:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147725.930582:0:5744:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147725.930597:0:5744:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x53/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147725.930605:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147725.930627:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2b600/0xe64d3fbf12a7d8fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb878 expref: 328 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.930643:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb878 expref: 327 pid: 5744 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147725.930649:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb878 expref: 327 pid: 5744 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147725.930654:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc2a200, rc 0) 00000100:00100000:2.0:1746147725.930672:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32173:x1830967793935104:12345-192.168.202.10@tcp:101:cat.0 Request processed in 46155us (50099us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.930676:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12006 00000001:00080000:1.0:1746147725.930880:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946016 is committed 00000001:00080000:1.0:1746147725.930911:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946018 is committed 00000004:00080000:1.0:1746147725.930919:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2751 committed 00000004:00080000:1.0:1746147725.930936:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2743 committed 00000004:00080000:1.0:1746147725.930947:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2742 committed 00000004:00080000:1.0:1746147725.930949:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2741 committed 00000004:00080000:1.0:1746147725.930951:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2740 committed 00000004:00080000:1.0:1746147725.930954:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2750 committed 00000004:00080000:1.0:1746147725.930955:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2739 committed 00000004:00080000:1.0:1746147725.930957:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2749 committed 00000004:00080000:1.0:1746147725.930958:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2738 committed 00000004:00080000:1.0:1746147725.930959:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2748 committed 00000004:00080000:1.0:1746147725.930961:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2747 committed 00000004:00080000:1.0:1746147725.930962:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2746 committed 00000004:00080000:1.0:1746147725.930964:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2737 committed 00000004:00080000:1.0:1746147725.930966:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2736 committed 00000004:00080000:1.0:1746147725.930970:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2745 committed 00000004:00080000:1.0:1746147725.930971:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2744 committed 00000004:00080000:1.0:1746147725.930972:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2735 committed 00000001:00080000:1.0:1746147725.930982:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946013 is committed 00000100:00100000:3.0:1746147725.931309:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796451072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.931358:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.931404:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796451584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.931419:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.931434:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746147725.931439:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796451200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.931452:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.931462:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796451712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.931474:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.931499:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796451072 00000100:00100000:3.0:1746147725.931506:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796451072 00000100:00100000:2.0:1746147725.931790:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796450944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.931812:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.931827:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796451456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.931840:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.931851:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796451968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.931865:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.931874:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796452480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.931909:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.931921:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1746147725.931926:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796450816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.931940:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.931950:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796451328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.931961:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.931971:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796451840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.931984:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.931994:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796452352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.932006:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.932023:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796451584 00000100:00100000:2.0:1746147725.932027:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796451584 00000100:00100000:2.0:1746147725.932040:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796451200 00000100:00100000:2.0:1746147725.932041:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796451200 00000100:00100000:2.0:1746147725.932047:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796451712 00000100:00100000:2.0:1746147725.932049:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796451712 00000100:00100000:2.0:1746147725.932056:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796450944 00000100:00100000:2.0:1746147725.932057:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796450944 00000100:00100000:2.0:1746147725.932063:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796451456 00000100:00100000:2.0:1746147725.932065:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796451456 00000100:00100000:2.0:1746147725.932072:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796451968 00000100:00100000:2.0:1746147725.932073:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796451968 00000100:00100000:2.0:1746147725.932081:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796452480 00000100:00100000:2.0:1746147725.932083:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796452480 00000100:00100000:2.0:1746147725.932089:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796450816 00000100:00100000:2.0:1746147725.932091:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796450816 00000100:00100000:2.0:1746147725.932097:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796451328 00000100:00100000:2.0:1746147725.932098:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796451328 00000100:00100000:2.0:1746147725.932104:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796451840 00000100:00100000:2.0:1746147725.932105:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796451840 00000100:00100000:2.0:1746147725.932111:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796452352 00000100:00100000:2.0:1746147725.932112:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796452352 00000100:00100000:2.0:1746147725.932122:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16460 00000100:00100000:2.0:1746147725.932128:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3303:x1830967796451072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147725.932320:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:2.0:1746147725.932324:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.932326:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.932328:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.932330:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:2.0:1746147725.932356:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3303:x1830967796451072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 228us (998us total) trans 17179874373 rc 0/0 00000100:00100000:2.0:1746147725.932363:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16460 00000100:00100000:2.0:1746147725.932376:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16461 00000100:00100000:2.0:1746147725.932380:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3303:x1830967796451584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.932460:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3303:x1830967796451584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (1040us total) trans 17179874374 rc 0/0 00000100:00100000:2.0:1746147725.932465:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16461 00000100:00100000:2.0:1746147725.932474:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16462 00000100:00100000:2.0:1746147725.932478:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3303:x1830967796451200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.932545:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3303:x1830967796451200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (1092us total) trans 17179874375 rc 0/0 00000100:00100000:2.0:1746147725.932551:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16462 00000100:00100000:2.0:1746147725.932559:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16463 00000100:00100000:2.0:1746147725.932563:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3303:x1830967796451712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.932633:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3303:x1830967796451712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (1157us total) trans 17179874376 rc 0/0 00000100:00100000:2.0:1746147725.932638:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16463 00000100:00100000:2.0:1746147725.932646:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16464 00000100:00100000:2.0:1746147725.932650:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3302:x1830967796450944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147725.932727:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147725.932730:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.932732:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.932733:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.932736:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147725.932759:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3302:x1830967796450944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (946us total) trans 17179874377 rc 0/0 00000100:00100000:2.0:1746147725.932764:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16464 00000100:00100000:2.0:1746147725.932772:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16465 00000100:00100000:2.0:1746147725.932776:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3302:x1830967796451456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.932846:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3302:x1830967796451456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (1004us total) trans 17179874378 rc 0/0 00000100:00100000:2.0:1746147725.932850:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16465 00000100:00100000:2.0:1746147725.932859:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16466 00000100:00100000:2.0:1746147725.932863:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3302:x1830967796451968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147725.932982:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147725.932986:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.932987:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.932989:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.932990:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147725.933008:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3302:x1830967796451968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (1142us total) trans 21474841600 rc 0/0 00000100:00100000:2.0:1746147725.933013:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16466 00000100:00100000:2.0:1746147725.933024:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16467 00000100:00100000:2.0:1746147725.933028:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3302:x1830967796452480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.933099:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3302:x1830967796452480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1189us total) trans 21474841601 rc 0/0 00000100:00100000:2.0:1746147725.933104:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16467 00000100:00100000:2.0:1746147725.933115:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16468 00000100:00100000:2.0:1746147725.933120:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3302:x1830967796450816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147725.933127:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16469 00000100:00100000:0.0:1746147725.933141:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3302:x1830967796451328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147725.933185:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147725.933187:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.933189:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.933190:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.933192:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 1951 -> 1951 00000100:00100000:2.0:1746147725.933210:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3302:x1830967796450816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (1269us total) trans 17179874379 rc 0/0 00000100:00100000:2.0:1746147725.933216:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16468 00000100:00100000:2.0:1746147725.933225:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16470 00000100:00100000:2.0:1746147725.933229:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3302:x1830967796451840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147725.933293:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147725.933296:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.933298:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.933299:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.933301:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746147725.933371:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16471 00000100:00100000:3.0:1746147725.933379:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+57:3302:x1830967796452352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147725.933461:0:6715:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:3.0:1746147725.933463:0:6715:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:3.0:1746147725.933465:0:6715:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147725.933466:0:6715:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:3.0:1746147725.933468:0:6715:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:2.0:1746147725.940729:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3302:x1830967796451840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 7476us (8721us total) trans 21474841602 rc 0/0 00000100:00100000:2.0:1746147725.940745:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16470 00000100:00100000:0.0:1746147725.940759:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3302:x1830967796451328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 7616us (8789us total) trans 17179874380 rc 0/0 00000100:00100000:0.0:1746147725.940770:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16469 00000100:00100000:2.0:1746147725.940833:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796452224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.940914:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.940955:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796452736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.942218:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.942262:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147725.942271:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796452096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.942297:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.942309:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796452608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.942322:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.942347:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796452224 00000100:00100000:2.0:1746147725.942355:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796452224 00000100:00100000:2.0:1746147725.942389:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796452736 00000100:00100000:2.0:1746147725.942391:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796452736 00000100:00100000:2.0:1746147725.942399:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796452096 00000100:00100000:2.0:1746147725.942401:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796452096 00000100:00100000:2.0:1746147725.942411:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796452608 00000100:00100000:2.0:1746147725.942412:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796452608 00000100:00100000:2.0:1746147725.942423:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16472 00000100:00100000:2.0:1746147725.942430:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3304:x1830967796452224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.942674:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3304:x1830967796452224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 244us (1759us total) trans 21474841604 rc 0/0 00000100:00100000:2.0:1746147725.942681:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16472 00000100:00100000:2.0:1746147725.942697:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16473 00000100:00100000:2.0:1746147725.942701:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3304:x1830967796452736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.942795:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3304:x1830967796452736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (579us total) trans 21474841605 rc 0/0 00000100:00100000:2.0:1746147725.942799:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16473 00000100:00100000:2.0:1746147725.942808:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16474 00000100:00100000:2.0:1746147725.942813:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3304:x1830967796452096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147725.942912:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147725.942915:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.942917:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.942919:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147726 -> 1746147726 00002000:00010000:2.0:1746147725.942921:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:2.0:1746147725.942941:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3304:x1830967796452096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 128us (643us total) trans 21474841606 rc 0/0 00000100:00100000:2.0:1746147725.942946:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16474 00000100:00100000:2.0:1746147725.942955:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16475 00000100:00100000:2.0:1746147725.942959:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3304:x1830967796452608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.943033:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3304:x1830967796452608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (710us total) trans 21474841607 rc 0/0 00000100:00100000:2.0:1746147725.943038:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16475 00000004:00080000:2.0:1746147725.943081:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0434e00/2, rc 0, transno 17179874379 00000100:00100000:2.0:1746147725.943093:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796450816:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147725.943105:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0435180/2, rc 0, transno 17179874380 00000100:00100000:2.0:1746147725.943110:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796451328:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147725.943119:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02afb80/2, rc 0, transno 21474841602 00000100:00100000:2.0:1746147725.943123:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796451840:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147725.943132:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0437800/2, rc 0, transno 17179874377 00000100:00100000:2.0:1746147725.943134:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796450944:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147725.943142:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0436d80/2, rc 0, transno 17179874378 00000100:00100000:2.0:1746147725.943145:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796451456:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147725.943153:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02af480/2, rc 0, transno 21474841600 00000100:00100000:2.0:1746147725.943156:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796451968:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147725.943164:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02af100/2, rc 0, transno 21474841601 00000100:00100000:2.0:1746147725.943166:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796452480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147725.943219:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746147725.943228:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796452864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147725.943248:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147725.943274:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796452864 00000100:00100000:2.0:1746147725.943278:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796452864 00000100:00100000:2.0:1746147725.943298:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16476 00000100:00100000:2.0:1746147725.943303:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3302:x1830967796452864:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147725.943463:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0434a80/2, rc 0, transno 17179874375 00000100:00100000:3.0:1746147725.943468:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796451200:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147725.943476:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0434380/2, rc 0, transno 17179874376 00000100:00100000:3.0:1746147725.943479:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796451712:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147725.943487:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0435f80/2, rc 0, transno 17179874373 00000100:00100000:3.0:1746147725.943490:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796451072:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147725.943498:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0435c00/2, rc 0, transno 17179874374 00000100:00100000:3.0:1746147725.943501:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796451584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147725.943526:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+61:3302:x1830967796452352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 10148us (11518us total) trans 21474841603 rc 0/0 00000100:00100000:3.0:1746147725.943532:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16471 00000004:00080000:3.0:1746147725.943552:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02ad880/2, rc 0, transno 21474841603 00000100:00100000:3.0:1746147725.943555:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796452352:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147725.943698:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02af800/2, rc 0, transno 21474841606 00000100:00100000:3.0:1746147725.943701:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796452096:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147725.943718:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d25c00/2, rc 0, transno 21474841607 00000100:00100000:3.0:1746147725.943721:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796452608:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147725.943729:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02ae300/2, rc 0, transno 21474841604 00000100:00100000:3.0:1746147725.943731:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796452224:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147725.943738:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d25f80/2, rc 0, transno 21474841605 00000100:00100000:3.0:1746147725.943740:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796452736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147725.944239:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.944245:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3302:x1830967796452864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 941us (995us total) trans 17179874381 rc 0/0 00000100:00100000:2.0:1746147725.944253:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16476 00000100:00100000:2.0:1746147725.944264:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793935744 00000100:00100000:2.0:1746147725.944267:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793935744 00000100:00100000:2.0:1746147725.944295:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16477 00000100:00100000:1.0:1746147725.944296:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.944305:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32169:x1830967793935744:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147725.944319:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147725.944338:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb88d expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.944368:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5517000/0xe64d3fbf12a7d82b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb84e expref: 11 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147725.944376:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.944378:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.944382:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3506176->3616767] (req 3506176->3616767) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147725.944395:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147725.944408:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5517000/0xe64d3fbf12a7d82b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb84e expref: 11 pid: 8469 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147725.944418:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793936000 00010000:00010000:2.0:1746147725.944419:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5517000/0xe64d3fbf12a7d82b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb84e expref: 11 pid: 8469 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746147725.944425:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793936000 00000100:00100000:2.0:1746147725.944430:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796452992:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147725.944452:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb878 expref: 325 pid: 5744 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746147725.944485:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8350 00000100:00100000:1.0:1746147725.944492:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:1957:x1830967793936000:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147725.944494:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fe40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147725.944503:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147725.944508:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb878 expref: 325 pid: 5744 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147725.944510:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793935872 00000100:00100000:2.0:1746147725.944514:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793935872 00010000:00010000:1.0:1746147725.944519:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb878 expref: 326 pid: 5744 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147725.944537:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12009 00010000:00010000:1.0:1746147725.944539:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc2a200/0xe64d3fbf12a7d904 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb878 expref: 326 pid: 5744 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147725.944542:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32173:x1830967793935872:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147725.944552:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.944563:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147725.944564:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7d92e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb894 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.944568:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147725.944577:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147725.944582:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147725.944589:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147725.944593:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147725.944601:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147725.944615:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7d92e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb894 expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.944626:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7d92e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb894 expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.944633:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147725.944640:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147725.944641:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147725.944645:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147725.944647:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00ba400, rc 0) 00010000:00010000:0.0:1746147725.944649:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00000100:00100000:1.0:1746147725.944664:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:1957:x1830967793936000:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 173us (268us total) trans 0 rc 0/0 00000004:00200000:0.0:1746147725.944667:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:1.0:1746147725.944671:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8350 00000100:00100000:2.0:1746147725.944672:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32173:x1830967793935872:12345-192.168.202.10@tcp:101:cat.0 Request processed in 129us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.944678:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12009 00000004:00080000:3.0:1746147725.944766:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d7480/2, rc 0, transno 17179874381 00000100:00100000:3.0:1746147725.944772:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796452864:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147725.944842:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7d912 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb886 expref: 326 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147725.944855:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb886 expref: 325 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746147725.944862:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb886 expref: 325 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746147725.944868:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dae9e00, rc 0) 00000100:00100000:0.0:1746147725.944912:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32168:x1830967793935616:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 59917us (62139us total) trans 8589946019 rc 0/0 00000100:00100000:0.0:1746147725.944918:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12008 00000100:00100000:0.0:1746147725.944958:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147725.944967:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796453120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746147725.944995:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.945009:0:10630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796453120 00000100:00100000:3.0:1746147725.945013:0:10630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796453120 00000100:00100000:3.0:1746147725.945047:0:10630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1746147725.945052:0:10630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+68:3301:x1830967796453120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746147725.945075:0:10630:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 609026048 pending 28966912 free 3849322496 avail 3847225344 00000100:00100000:3.0:1746147725.945103:0:10630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+68:3301:x1830967796453120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.945108:0:10630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1746147725.945117:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796453120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746147725.945123:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796453248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746147725.945150:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147725.945158:0:10630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796453248 00000100:00100000:0.0:1746147725.945161:0:10630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796453248 00000100:00100000:0.0:1746147725.945191:0:10630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1746147725.948246:0:10630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3303:x1830967796453248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746147725.948282:0:10630:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 551223296 pending 30670848 free 3850371072 avail 3848273920 00000100:00100000:0.0:1746147725.948371:0:10630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3303:x1830967796453248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (3219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147725.948378:0:10630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1746147725.948452:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a634195-95c6-4e3b-860d-2cf2df4961a5:3304:1830967796453376:0@lo:400:kworker.0 00000100:00100000:3.0:1746147725.948495:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.948535:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746147725.948540:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1830967796453760:0@lo:400:kworker.0 00000100:00100000:3.0:1746147725.948567:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.948595:0:14542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796453376 00000100:00100000:3.0:1746147725.948602:0:14542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796453376 00000100:00100000:3.0:1746147725.948631:0:14542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1746147725.948636:0:14542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a634195-95c6-4e3b-860d-2cf2df4961a5+18:3304:x1830967796453376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147725.948663:0:14542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a634195-95c6-4e3b-860d-2cf2df4961a5+18:3304:x1830967796453376:12345-0@lo:400:kworker.0 Request processed in 27us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.948668:0:14542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1746147725.948702:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a634195-95c6-4e3b-860d-2cf2df4961a5:3304:1830967796453376:0@lo:400:kworker.0 00000100:00100000:3.0:1746147725.948735:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1830967796453632:0@lo:400:kworker.0 00000100:00100000:2.0:1746147725.948920:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796453248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746147725.948925:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.948940:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746147725.948945:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1830967796453504:0@lo:400:kworker.0 00000100:00100000:3.0:1746147725.948960:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147725.948997:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796453760 00000100:00100000:3.0:1746147725.949000:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796453760 00000100:00100000:3.0:1746147725.949018:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796453632 00000100:00100000:3.0:1746147725.949020:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796453632 00000100:00100000:3.0:1746147725.949035:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796453504 00000100:00100000:3.0:1746147725.949037:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796453504 00000100:00100000:3.0:1746147725.949046:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1746147725.949051:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1830967796453760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147725.949077:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1830967796453760:12345-0@lo:400:kworker.0 Request processed in 26us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.949082:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1746147725.949091:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1746147725.949095:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1830967796453632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147725.949115:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1830967796453632:12345-0@lo:400:kworker.0 Request processed in 20us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.949120:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1746147725.949127:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1746147725.949132:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1830967796453504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147725.949148:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1830967796453504:12345-0@lo:400:kworker.0 Request processed in 17us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.949153:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1746147725.949176:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1830967796453760:0@lo:400:kworker.0 00000100:00100000:3.0:1746147725.949190:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1830967796453504:0@lo:400:kworker.0 00000100:00100000:3.0:1746147725.949197:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1830967796453632:0@lo:400:kworker.0 00000100:00080000:1.0:1746147725.949504:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147725.950647:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.950675:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.951057:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796452992:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147725.951085:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3506176->3616767] (req 3506176->3616767) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.951105:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00bba00, rc 0) 00000100:00100000:2.0:1746147725.951149:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32169:x1830967793935744:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 6847us (6915us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.951157:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16477 00000100:00100000:0.0:1746147725.951337:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.951356:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793936384 00000100:00100000:3.0:1746147725.951364:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793936384 00000100:00100000:2.0:1746147725.951365:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793936640 00000100:00100000:2.0:1746147725.951369:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793936640 00000100:00100000:2.0:1746147725.951393:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16478 00000100:00100000:2.0:1746147725.951400:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967793936640:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147725.951402:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16479 00000100:00100000:3.0:1746147725.951409:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967793936384:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147725.951415:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.951418:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.951430:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7d943 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb8a2 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.951430:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00bae00/0xe64d3fbf12a7d93c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb8b0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.951446:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.951446:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.951448:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.951448:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.951456:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7d943 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a2 expref: 34 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147725.951456:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00bae00/0xe64d3fbf12a7d93c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b0 expref: 32 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.951469:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7d943 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a2 expref: 34 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147725.951469:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00bae00/0xe64d3fbf12a7d93c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b0 expref: 32 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.951475:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925ec00, rc 0) 00010000:00010000:2.0:1746147725.951476:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00bae00, rc 0) 00000100:00100000:3.0:1746147725.951507:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793936384:12345-192.168.202.10@tcp:101:cat.0 Request processed in 98us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.951512:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16479 00000100:00100000:3.0:1746147725.956952:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793936896 00000100:00100000:3.0:1746147725.956963:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793936896 00000100:00100000:3.0:1746147725.957006:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16480 00000100:00100000:3.0:1746147725.957012:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793936896:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147725.957027:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.957044:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a925ee00/0xe64d3fbf12a7d94a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb8be expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.957064:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.957073:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a925ee00/0xe64d3fbf12a7d94a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8be expref: 35 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.957081:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a925ee00/0xe64d3fbf12a7d94a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8be expref: 35 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.957101:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925ee00, rc 0) 00000100:00100000:2.0:1746147725.957215:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967793936640:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5806us (6529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.957225:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16478 00000100:00100000:3.0:1746147725.957509:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793936896:12345-192.168.202.10@tcp:101:cat.0 Request processed in 494us (6170us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147725.957515:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16480 00000100:00100000:3.0:1746147725.957564:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.957607:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.957622:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.957650:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.957685:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.957692:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793936256 00000100:00100000:2.0:1746147725.957699:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793936256 00000100:00100000:3.0:1746147725.957705:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793936512 00000100:00100000:3.0:1746147725.957720:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793936512 00000100:00100000:2.0:1746147725.957734:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793936768 00000100:00100000:2.0:1746147725.957737:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793936768 00000100:00100000:3.0:1746147725.957744:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16481 00000100:00100000:3.0:1746147725.957750:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967793936256:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147725.957758:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.957768:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7d951 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb89b expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.957780:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.957782:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.957788:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7d951 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb89b expref: 34 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.957799:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7d951 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb89b expref: 34 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.957807:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925f600, rc 0) 00000100:00100000:3.0:1746147725.957826:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793936256:12345-192.168.202.10@tcp:101:cat.0 Request processed in 76us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.957863:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16482 00000100:00100000:1.0:1746147725.957870:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793936512:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147725.957874:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16483 00010000:00010000:1.0:1746147725.957877:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147725.957881:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793936768:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147725.957900:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095445c00/0xe64d3fbf12a7d958 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb8a9 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.957911:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.957912:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.957912:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.957917:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095445c00/0xe64d3fbf12a7d958 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a9 expref: 35 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147725.957925:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba000/0xe64d3fbf12a7d95f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb8b7 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.957926:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095445c00/0xe64d3fbf12a7d958 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a9 expref: 35 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.957932:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095445c00, rc 0) 00010000:00010000:2.0:1746147725.957942:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.957944:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147725.957948:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967793936512:12345-192.168.202.10@tcp:101:cat.0 Request processed in 80us (341us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147725.957950:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba000/0xe64d3fbf12a7d95f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b7 expref: 35 pid: 8184 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147725.957954:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16482 00010000:00010000:2.0:1746147725.957962:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba000/0xe64d3fbf12a7d95f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b7 expref: 35 pid: 8184 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147725.957971:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793937024 00010000:00010000:2.0:1746147725.957972:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00ba000, rc 0) 00000100:00100000:1.0:1746147725.957974:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793937024 00010000:00010000:1.0:1746147725.957989:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb886 expref: 325 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147725.957998:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967793936768:12345-192.168.202.10@tcp:101:cat.0 Request processed in 118us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.958004:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16483 00000100:00100000:1.0:1746147725.958004:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793936128 00000100:00100000:1.0:1746147725.958006:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793936128 00010000:00010000:1.0:1746147725.958015:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5517000/0xe64d3fbf12a7d82b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb84e expref: 12 pid: 8469 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147725.958028:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8351 00000100:00100000:2.0:1746147725.958034:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:1960:x1830967793937024:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147725.958042:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8352 00000100:00100000:1.0:1746147725.958047:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967793936128:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147725.958055:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147725.958235:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16481 00010000:00010000:1.0:1746147725.958304:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5517000/0xe64d3fbf12a7d82b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb84e expref: 12 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147725.958314:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5517000/0xe64d3fbf12a7d82b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb84e expref: 12 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147725.958327:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5517000/0xe64d3fbf12a7d82b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb84e expref: 12 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147725.958336:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.958338:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.958342:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3616767) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147725.958354:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3616767) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.958368:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147725.958377:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb886 expref: 325 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147725.958388:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb886 expref: 325 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147725.958390:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3616767) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147725.958401:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796453888:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147725.958404:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7d919 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb886 expref: 325 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147725.958415:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147725.958420:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147725.958429:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147725.958439:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147725.958458:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147725.958549:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147725.958691:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:1960:x1830967793937024:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 656us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.958698:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8351 00010000:00010000:2.0:1746147725.958733:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147725.958740:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746147725.958786:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147725.958790:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147725.958807:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147725.958839:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7d90b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb87f expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.958849:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb87f expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.958855:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147725.958857:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746147725.958859:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fc5800, rc 0) 00000100:00100000:2.0:1746147725.958920:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32174:x1830967793935232:12345-192.168.202.10@tcp:101:cat.0 Request processed in 74218us (76186us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.958925:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12007 00000100:00100000:0.0:1746147725.960867:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.961470:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.961503:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.961516:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.961666:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793937152 00000100:00100000:1.0:1746147725.961680:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793937152 00000100:00100000:1.0:1746147725.961729:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793937280 00000100:00100000:1.0:1746147725.961731:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793937280 00000100:00100000:3.0:1746147725.962099:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793937408 00000100:00100000:3.0:1746147725.962107:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793937408 00000100:00100000:3.0:1746147725.962137:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793937536 00000100:00100000:3.0:1746147725.962139:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793937536 00000100:00100000:3.0:1746147725.962156:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16484 00000100:00100000:3.0:1746147725.962163:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793937152:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147725.962183:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147725.962201:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7d966 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb8c5 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.962224:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.962226:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.962235:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7d966 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8c5 expref: 27 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.962250:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7d966 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8c5 expref: 27 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.962260:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925fc00, rc 0) 00000100:00100000:1.0:1746147725.962282:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16485 00000100:00100000:1.0:1746147725.962290:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967793937280:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147725.962305:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967793937152:12345-192.168.202.10@tcp:101:cat.0 Request processed in 142us (1445us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147725.962305:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147725.962311:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16484 00010000:00010000:1.0:1746147725.962320:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095444e00/0xe64d3fbf12a7d96d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb8cc expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147725.962326:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16486 00000100:00100000:3.0:1746147725.962331:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793937408:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147725.962339:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.962340:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147725.962341:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.962348:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095444e00/0xe64d3fbf12a7d96d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8cc expref: 24 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.962349:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a925f200/0xe64d3fbf12a7d974 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb8d3 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.962359:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.962360:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147725.962361:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095444e00/0xe64d3fbf12a7d96d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8cc expref: 25 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.962364:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a925f200/0xe64d3fbf12a7d974 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8d3 expref: 25 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147725.962370:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095444e00, rc 0) 00010000:00010000:3.0:1746147725.962373:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a925f200/0xe64d3fbf12a7d974 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8d3 expref: 25 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.962379:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925f200, rc 0) 00000100:00100000:3.0:1746147725.962392:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967793937408:12345-192.168.202.10@tcp:101:cat.0 Request processed in 62us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.962397:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16486 00000100:00100000:3.0:1746147725.962408:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16487 00000100:00100000:1.0:1746147725.962412:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793937280:12345-192.168.202.10@tcp:101:cat.0 Request processed in 121us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147725.962413:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793937536:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147725.962417:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147725.962421:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16485 00010000:00010000:3.0:1746147725.962423:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a925f800/0xe64d3fbf12a7d97b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb8da expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147725.962432:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.962433:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147725.962437:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925f800/0xe64d3fbf12a7d97b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8da expref: 27 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.962445:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a925f800/0xe64d3fbf12a7d97b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8da expref: 27 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147725.962452:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925f800, rc 0) 00000100:00100000:3.0:1746147725.962467:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967793937536:12345-192.168.202.10@tcp:101:cat.0 Request processed in 55us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147725.962726:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147725.962757:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793937792 00000100:00100000:0.0:1746147725.962761:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793937792 00000100:00100000:0.0:1746147725.962780:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16488 00000100:00100000:0.0:1746147725.962784:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793937792:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147725.962790:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147725.962798:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0e00/0xe64d3fbf12a7d982 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb8e8 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147725.962837:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5488000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796454016:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147725.963089:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16487 00000100:00100000:0.0:1746147725.966119:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147725.967607:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147725.967781:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796453888:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147725.967799:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147725.967845:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967793936128:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 9797us (10158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147725.967854:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8352 00000100:00100000:0.0:1746147725.970792:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.970957:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793938048 00000100:00100000:3.0:1746147725.970968:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793938048 00002000:00100000:3.0:1746147725.971009:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3506176->3510271) req@ffff880094690700 x1830967793938048/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.971019:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094690700 with x1830967793938048 ext(3506176->3510271) 00002000:00010000:3.0:1746147725.971023:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094690700 00000100:00100000:3.0:1746147725.971051:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7323 00000100:00100000:2.0:1746147725.971055:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793937664 00000100:00100000:3.0:1746147725.971058:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967793938048:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147725.971063:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793937664 00000100:00100000:2.0:1746147725.971113:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16489 00000100:00100000:2.0:1746147725.971120:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967793937664:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147725.971136:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147725.971154:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7d989 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb8e1 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147725.971178:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.971181:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147725.971191:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7d989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8e1 expref: 28 pid: 8184 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147725.971200:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967793938048:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 143us (418us total) trans 0 rc 4096/4096 00010000:00010000:2.0:1746147725.971205:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7d989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8e1 expref: 28 pid: 8184 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147725.971207:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7323 00002000:00100000:3.0:1746147725.971213:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3506176->3510271) req@ffff880094690700 x1830967793938048/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/4536 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746147725.971216:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00bb600, rc 0) 00002000:00100000:3.0:1746147725.971220:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094690700 with x1830967793938048 ext(3506176->3510271) 00002000:00010000:3.0:1746147725.971223:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094690700 00000100:00100000:2.0:1746147725.971250:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793937664:12345-192.168.202.10@tcp:101:cat.0 Request processed in 131us (3653us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147725.971256:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16489 00002000:00010000:0.0:1746147725.971356:0:7050:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime: 1746147726 -> 1746147727 00002000:00010000:0.0:1746147725.971359:0:7050:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime: 1746147726 -> 1746147727 00000100:00100000:0.0:1746147725.971376:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5488000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796454016:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147725.971411:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0e00/0xe64d3fbf12a7d982 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8e8 expref: 25 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147725.971420:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0e00/0xe64d3fbf12a7d982 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8e8 expref: 25 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147725.971432:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2b0e00, rc 0) 00000100:00100000:0.0:1746147725.971454:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793937792:12345-192.168.202.10@tcp:101:cat.0 Request processed in 8669us (8729us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147725.971459:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16488 00000100:00100000:3.0:1746147725.977664:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.977686:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.977719:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.977735:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.978008:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147725.978134:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793938304 00000100:00100000:2.0:1746147725.978147:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793938304 00000100:00100000:0.0:1746147725.978160:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793938560 00000100:00100000:0.0:1746147725.978168:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793938560 00002000:00100000:2.0:1746147725.978199:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3612672->3616767) req@ffff880094efa680 x1830967793938304/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147725.978204:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880094efb480 x1830967793938560/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.978209:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efa680 with x1830967793938304 ext(3612672->3616767) 00002000:00100000:0.0:1746147725.978212:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efb480 with x1830967793938560 ext(0->1048575) 00002000:00010000:2.0:1746147725.978215:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efa680 00002000:00010000:0.0:1746147725.978216:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efb480 00000100:00100000:2.0:1746147725.978249:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793938816 00000100:00100000:2.0:1746147725.978252:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793938816 00000100:00100000:3.0:1746147725.978261:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793939072 00000100:00100000:3.0:1746147725.978264:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793939072 00002000:00100000:2.0:1746147725.978267:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880094ef9c00 x1830967793938816/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.978274:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef9c00 with x1830967793938816 ext(1048576->2097151) 00002000:00010000:2.0:1746147725.978277:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ef9c00 00002000:00100000:3.0:1746147725.978280:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880094ef8380 x1830967793939072/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.978286:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef8380 with x1830967793939072 ext(1048576->2097151) 00000100:00100000:2.0:1746147725.978288:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793939328 00002000:00010000:3.0:1746147725.978290:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ef8380 00000100:00100000:2.0:1746147725.978290:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793939328 00000100:00100000:3.0:1746147725.978304:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7324 00002000:00100000:2.0:1746147725.978304:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880094ef9880 x1830967793939328/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/0 e 0 to 0 dl 1746147736 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147725.978310:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef9880 with x1830967793939328 ext(1048576->2097151) 00000100:00100000:3.0:1746147725.978311:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967793938304:12345-192.168.202.10@tcp:3:multiop.0 00002000:00010000:2.0:1746147725.978313:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ef9880 00000100:00100000:2.0:1746147725.978324:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7325 00000100:00100000:2.0:1746147725.978330:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967793938560:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147725.978457:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967793938304:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 145us (800us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147725.978463:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7324 00002000:00100000:3.0:1746147725.978468:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3612672->3616767) req@ffff880094efa680 x1830967793938304/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:346/0 lens 488/4536 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.978475:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efa680 with x1830967793938304 ext(3612672->3616767) 00002000:00010000:3.0:1746147725.978478:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efa680 00000100:00100000:3.0:1746147725.978493:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7326 00000100:00100000:3.0:1746147725.978499:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967793938816:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147725.978794:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7327 00000100:00100000:3.0:1746147725.978800:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967793939072:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147725.978847:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7328 00000100:00100000:2.0:1746147725.978853:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967793939328:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147725.982442:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147725.984217:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793939584 00000100:00100000:3.0:1746147725.984227:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793939584 00000100:00100000:3.0:1746147725.984276:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4995 00000100:00100000:3.0:1746147725.984284:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32169:x1830967793939584:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147725.984525:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32169:x1830967793939584:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 241us (2088us total) trans 8589946020 rc 0/0 00000100:00100000:3.0:1746147725.984532:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4995 00000100:00100000:3.0:1746147725.998310:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1960:x1830967793939072:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19500us (20563us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147725.998322:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7327 00002000:00100000:3.0:1746147725.998745:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880094ef8380 x1830967793939072/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147725.998755:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef8380 with x1830967793939072 ext(1048576->2097151) 00002000:00010000:3.0:1746147725.998760:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ef8380 00000100:00100000:0.0:1746147726.001007:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.001040:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.001097:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.001135:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.001159:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793940096 00000100:00100000:0.0:1746147726.001167:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793940096 00002000:00100000:0.0:1746147726.001217:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880094691180 x1830967793940096/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147726.001227:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094691180 with x1830967793940096 ext(1048576->2097151) 00002000:00010000:0.0:1746147726.001233:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094691180 00000100:00100000:0.0:1746147726.001246:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793939968 00000100:00100000:0.0:1746147726.001248:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793939968 00002000:00100000:0.0:1746147726.001262:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880094690000 x1830967793939968/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147726.001268:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094690000 with x1830967793939968 ext(0->1048575) 00002000:00010000:0.0:1746147726.001271:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094690000 00000100:00100000:0.0:1746147726.001278:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793940352 00000100:00100000:0.0:1746147726.001280:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793940352 00002000:00100000:0.0:1746147726.001289:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880094690380 x1830967793940352/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147726.001294:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094690380 with x1830967793940352 ext(1048576->2097151) 00002000:00010000:0.0:1746147726.001297:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094690380 00000100:00100000:0.0:1746147726.002923:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793940608 00000100:00100000:0.0:1746147726.002935:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793940608 00002000:00100000:0.0:1746147726.003103:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880094692680 x1830967793940608/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147726.003112:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094692680 with x1830967793940608 ext(1048576->2097151) 00002000:00010000:0.0:1746147726.003118:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094692680 00000100:00100000:1.0:1746147726.003221:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7329 00000100:00100000:1.0:1746147726.003237:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967793940096:12345-192.168.202.10@tcp:3:cat.0 00000100:00080000:1.0:1746147726.005035:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746147726.005042:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147726.005068:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7330 00000100:00100000:1.0:1746147726.005079:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1957:x1830967793939968:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147726.006829:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7331 00000100:00100000:2.0:1746147726.006843:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967793940352:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147726.006992:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7332 00000100:00100000:3.0:1746147726.007024:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1957:x1830967793940608:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147726.008434:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967793938816:12345-192.168.202.10@tcp:3:cat.0 Request processed in 29927us (30717us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147726.008444:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7326 00002000:00100000:2.0:1746147726.008454:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880094ef9c00 x1830967793938816/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.008463:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef9c00 with x1830967793938816 ext(1048576->2097151) 00002000:00010000:2.0:1746147726.008470:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ef9c00 00000100:00100000:1.0:1746147726.014008:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967793938560:12345-192.168.202.10@tcp:3:cat.0 Request processed in 35665us (36307us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147726.014020:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7325 00002000:00100000:1.0:1746147726.014034:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880094efb480 x1830967793938560/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.014044:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efb480 with x1830967793938560 ext(0->1048575) 00002000:00010000:1.0:1746147726.014050:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efb480 00000100:00100000:3.0:1746147726.014828:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793939328:12345-192.168.202.10@tcp:3:cat.0 Request processed in 35968us (36812us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147726.014839:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7328 00002000:00100000:3.0:1746147726.014848:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880094ef9880 x1830967793939328/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:346/0 lens 488/440 e 0 to 0 dl 1746147736 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.014858:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef9880 with x1830967793939328 ext(1048576->2097151) 00002000:00010000:3.0:1746147726.014862:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ef9880 00000100:00100000:1.0:1746147726.022866:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967793940096:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19622us (21855us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147726.022926:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7329 00002000:00100000:1.0:1746147726.022941:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880094691180 x1830967793940096/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.022951:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094691180 with x1830967793940096 ext(1048576->2097151) 00002000:00010000:1.0:1746147726.022957:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094691180 00000100:00100000:2.0:1746147726.031466:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967793940352:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24615us (30356us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147726.031480:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7331 00002000:00100000:2.0:1746147726.031493:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880094690380 x1830967793940352/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.031503:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094690380 with x1830967793940352 ext(1048576->2097151) 00002000:00010000:2.0:1746147726.031510:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094690380 00000100:00100000:3.0:1746147726.033801:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1957:x1830967793940608:12345-192.168.202.10@tcp:3:cat.0 Request processed in 26792us (32658us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147726.033816:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7332 00002000:00100000:3.0:1746147726.033826:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880094692680 x1830967793940608/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.033836:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094692680 with x1830967793940608 ext(1048576->2097151) 00002000:00010000:3.0:1746147726.033841:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094692680 00000100:00100000:1.0:1746147726.037300:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967793939968:12345-192.168.202.10@tcp:3:cat.0 Request processed in 32211us (36246us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147726.037313:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7330 00002000:00100000:1.0:1746147726.037327:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880094690000 x1830967793939968/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.037338:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094690000 with x1830967793939968 ext(0->1048575) 00002000:00010000:1.0:1746147726.037344:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094690000 00000100:00100000:0.0:1746147726.039515:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.039768:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793940736 00000100:00100000:2.0:1746147726.039775:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793940736 00000100:00100000:2.0:1746147726.039829:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16490 00000100:00100000:2.0:1746147726.039837:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32168:x1830967793940736:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147726.039852:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.039867:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb8ef expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.039924:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a051ba00/0xe64d3fbf12a7d832 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb82b expref: 10 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.039938:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7d966 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8c5 expref: 27 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.039958:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7d951 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb89b expref: 35 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.039964:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.039965:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.039968:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [45056->651263] (req 45056->651263) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 35 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.039993:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7d951 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb89b expref: 35 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.040005:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7d951 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb89b expref: 35 pid: 8470 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.040015:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796454144:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.040103:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7d966 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8c5 expref: 27 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.040111:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7d966 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8c5 expref: 27 pid: 4592 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.040117:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796454272:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.040138:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a051ba00/0xe64d3fbf12a7d832 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb82b expref: 10 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.040145:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a051ba00/0xe64d3fbf12a7d832 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb82b expref: 10 pid: 8469 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.040151:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796454400:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.040164:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.046037:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.046059:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.046165:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796454144:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.046175:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796454272:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.046181:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796454400:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.046203:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [45056->651263] (req 45056->651263) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 35 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.046228:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935e0800, rc 0) 00000100:00100000:2.0:1746147726.046266:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:32168:x1830967793940736:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 6431us (6791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.046274:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16490 00000100:00100000:1.0:1746147726.046325:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793940864 00000100:00100000:1.0:1746147726.046335:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793940864 00010000:00010000:1.0:1746147726.046374:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7d951 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb89b expref: 35 pid: 8470 timeout: 905 lvb_type: 1 00000100:00100000:0.0:1746147726.047148:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.048272:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793940992 00000100:00100000:1.0:1746147726.048273:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793941120 00000100:00100000:3.0:1746147726.048280:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793940992 00000100:00100000:1.0:1746147726.048282:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793941120 00010000:00010000:3.0:1746147726.048318:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a051ba00/0xe64d3fbf12a7d832 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb82b expref: 11 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.048318:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7d966 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8c5 expref: 28 pid: 4592 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746147726.048347:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8353 00000100:00100000:1.0:1746147726.048355:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6670850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967793940864:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147726.048369:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147726.048391:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7d951 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb89b expref: 35 pid: 8470 timeout: 905 lvb_type: 1 00000100:00100000:0.0:1746147726.048392:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8354 00000100:00100000:0.0:1746147726.048400:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793941120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147726.048407:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7d951 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb89b expref: 35 pid: 8470 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.048412:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147726.048430:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7d951 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb89b expref: 35 pid: 8470 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.048431:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7d966 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8c5 expref: 28 pid: 4592 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.048441:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7d966 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8c5 expref: 28 pid: 4592 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.048458:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7d966 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8c5 expref: 28 pid: 4592 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.048461:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147726.048477:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147726.048506:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6670850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793940864:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 152us (2476us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.048513:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8353 00000100:00100000:1.0:1746147726.048566:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8355 00000100:00100000:1.0:1746147726.048571:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967793940992:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147726.048579:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147726.048586:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a051ba00/0xe64d3fbf12a7d832 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb82b expref: 11 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.048596:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a051ba00/0xe64d3fbf12a7d832 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb82b expref: 11 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.048608:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a051ba00/0xe64d3fbf12a7d832 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb82b expref: 11 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.048616:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.048618:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.048625:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->651263) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.048638:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->651263) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.048667:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->651263) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147726.048678:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd18a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796454528:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147726.048820:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793941120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 419us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.048826:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8354 00000100:00100000:1.0:1746147726.048833:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6c00 going to sleep for 11 seconds 00000100:00080000:1.0:1746147726.048856:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147726.051418:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd18a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796454528:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147726.051443:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147726.051509:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793940992:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2936us (5447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.051520:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8355 00000100:00100000:0.0:1746147726.051817:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.051878:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793941376 00000100:00100000:2.0:1746147726.051900:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793941376 00002000:00100000:2.0:1746147726.051938:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (45056->49151) req@ffff880094693b80 x1830967793941376/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.051946:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094693b80 with x1830967793941376 ext(45056->49151) 00002000:00010000:2.0:1746147726.051951:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094693b80 00000100:00100000:2.0:1746147726.052241:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7333 00000100:00100000:2.0:1746147726.052248:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793941376:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147726.053046:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793941376:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 797us (1232us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147726.053053:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7333 00002000:00100000:2.0:1746147726.053058:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (45056->49151) req@ffff880094693b80 x1830967793941376/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/4536 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.053064:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094693b80 with x1830967793941376 ext(45056->49151) 00002000:00010000:2.0:1746147726.053067:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094693b80 00000100:00100000:0.0:1746147726.061439:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.061679:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793941632 00000100:00100000:2.0:1746147726.061687:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793941632 00002000:00100000:2.0:1746147726.061733:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880094693800 x1830967793941632/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.061741:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094693800 with x1830967793941632 ext(2097152->3145727) 00002000:00010000:2.0:1746147726.061746:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094693800 00000100:00100000:2.0:1746147726.061775:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7334 00000100:00100000:2.0:1746147726.061781:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793941632:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147726.062698:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.062728:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.062740:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.062775:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.062818:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793941888 00000100:00100000:3.0:1746147726.062821:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793941888 00002000:00100000:3.0:1746147726.062841:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880094692a00 x1830967793941888/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.062849:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094692a00 with x1830967793941888 ext(2097152->3145727) 00002000:00010000:3.0:1746147726.062852:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094692a00 00000100:00100000:3.0:1746147726.062861:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793942144 00000100:00100000:3.0:1746147726.062863:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793942144 00002000:00100000:3.0:1746147726.062869:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880094691500 x1830967793942144/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.062875:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094691500 with x1830967793942144 ext(3145728->4194303) 00002000:00010000:3.0:1746147726.062877:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094691500 00000100:00100000:3.0:1746147726.062894:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793942400 00000100:00100000:3.0:1746147726.062896:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793942400 00002000:00100000:3.0:1746147726.062905:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880094691c00 x1830967793942400/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.062911:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094691c00 with x1830967793942400 ext(2097152->3145727) 00002000:00010000:3.0:1746147726.062913:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094691c00 00000100:00100000:3.0:1746147726.062920:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793942656 00000100:00100000:3.0:1746147726.062921:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793942656 00002000:00100000:3.0:1746147726.062927:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880094691880 x1830967793942656/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 504/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.062933:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094691880 with x1830967793942656 ext(3145728->4194303) 00002000:00010000:3.0:1746147726.062934:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094691880 00000100:00100000:3.0:1746147726.062941:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7335 00000100:00100000:3.0:1746147726.062945:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1958:x1830967793941888:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147726.063748:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7336 00000100:00100000:3.0:1746147726.063753:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1958:x1830967793942144:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147726.064703:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7337 00000100:00100000:3.0:1746147726.064721:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967793942400:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147726.065655:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7338 00000100:00100000:3.0:1746147726.065662:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967793942656:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147726.067828:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.067912:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793942912 00000100:00100000:0.0:1746147726.067919:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793942912 00002000:00100000:0.0:1746147726.067949:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (647168->651263) req@ffff88009fd18a80 x1830967793942912/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147726.067957:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18a80 with x1830967793942912 ext(647168->651263) 00002000:00010000:0.0:1746147726.067961:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd18a80 00000100:00100000:0.0:1746147726.067980:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7339 00000100:00100000:0.0:1746147726.067986:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967793942912:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147726.068089:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967793942912:12345-192.168.202.10@tcp:3:cat.0 Request processed in 103us (265us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147726.068095:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7339 00002000:00100000:0.0:1746147726.068100:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (647168->651263) req@ffff88009fd18a80 x1830967793942912/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/4536 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147726.068106:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18a80 with x1830967793942912 ext(647168->651263) 00002000:00010000:0.0:1746147726.068109:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd18a80 00000100:00100000:3.0:1746147726.085038:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1958:x1830967793941888:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22082us (22331us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147726.085049:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7335 00002000:00100000:3.0:1746147726.085060:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880094692a00 x1830967793941888/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.085069:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094692a00 with x1830967793941888 ext(2097152->3145727) 00002000:00010000:3.0:1746147726.085073:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094692a00 00000100:00100000:3.0:1746147726.086726:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967793942144:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22968us (23993us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147726.086736:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7336 00002000:00100000:3.0:1746147726.086742:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880094691500 x1830967793942144/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.086750:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094691500 with x1830967793942144 ext(3145728->4194303) 00002000:00010000:3.0:1746147726.086753:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094691500 00000100:00100000:3.0:1746147726.098838:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967793942400:12345-192.168.202.10@tcp:3:cat.0 Request processed in 34120us (36087us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147726.098849:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7337 00002000:00100000:3.0:1746147726.098859:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880094691c00 x1830967793942400/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.098868:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094691c00 with x1830967793942400 ext(2097152->3145727) 00002000:00010000:3.0:1746147726.098873:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094691c00 00000100:00100000:3.0:1746147726.108490:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967793942656:12345-192.168.202.10@tcp:3:cat.0 Request processed in 42815us (45700us total) trans 0 rc 937984/937984 00000100:00100000:3.0:1746147726.108504:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7338 00002000:00100000:3.0:1746147726.108519:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880094691880 x1830967793942656/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 504/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 937984/937984 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.108529:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094691880 with x1830967793942656 ext(3145728->4194303) 00002000:00010000:3.0:1746147726.108535:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094691880 00000100:00100000:1.0:1746147726.109925:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.110336:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793941632:12345-192.168.202.10@tcp:3:cat.0 Request processed in 48552us (48902us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147726.110348:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7334 00002000:00100000:2.0:1746147726.110358:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880094693800 x1830967793941632/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.110367:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094693800 with x1830967793941632 ext(2097152->3145727) 00002000:00010000:2.0:1746147726.110372:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094693800 00000100:00100000:3.0:1746147726.110441:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793943168 00000100:00100000:3.0:1746147726.110449:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793943168 00000100:00100000:3.0:1746147726.110500:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4996 00000100:00100000:3.0:1746147726.110506:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a666a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32168:x1830967793943168:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147726.111097:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a666a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32168:x1830967793943168:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 589us (1180us total) trans 8589946021 rc 0/0 00000100:00100000:3.0:1746147726.111103:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4996 00000100:00080000:1.0:1746147726.111231:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147726.115158:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.116331:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793943296 00000100:00100000:2.0:1746147726.116342:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793943296 00000100:00100000:2.0:1746147726.116399:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16491 00000100:00100000:2.0:1746147726.116408:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793943296:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147726.116429:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.116448:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4eb7e00/0xe64d3fbf12a7d997 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb8f6 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147726.116508:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796454656:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147726.116595:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.122466:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:2.0:1746147726.122614:0:7050:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime: 1746147726 -> 1746147727 00002000:00010000:2.0:1746147726.122619:0:7050:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime: 1746147726 -> 1746147727 00002000:00010000:2.0:1746147726.122620:0:7050:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime: 1746147726 -> 1746147727 00000100:00100000:2.0:1746147726.122643:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796454656:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147726.122676:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4eb7e00/0xe64d3fbf12a7d997 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8f6 expref: 28 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.122690:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4eb7e00/0xe64d3fbf12a7d997 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8f6 expref: 28 pid: 7050 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147726.122834:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793943424 00000100:00100000:3.0:1746147726.122841:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793943424 00000100:00100000:3.0:1746147726.122912:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16492 00000100:00100000:3.0:1746147726.122920:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:32173:x1830967793943424:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.122937:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.122953:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7d99e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb8fd expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.122977:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3616767) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.122985:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147726.122986:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147726.122989:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7d99e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8fd expref: 36 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.123018:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3616767) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.123030:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3616767) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 23 pid: 8468 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.123042:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796454784:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.123351:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4eb7e00, rc 0) 00000100:00100000:2.0:1746147726.123376:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793943296:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6969us (8228us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147726.123383:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16491 00000100:00100000:3.0:1746147726.124546:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c229c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147726.125379:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796454784:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.125411:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7d99e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8fd expref: 36 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.125429:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0298c00, rc 0) 00000100:00100000:3.0:1746147726.125467:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:32173:x1830967793943424:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2546us (3010us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.125475:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16492 00000100:00100000:0.0:1746147726.125677:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.126574:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793943552 00000100:00100000:3.0:1746147726.126581:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793943552 00002000:00100000:3.0:1746147726.126617:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (3506176->3616767) req@ffff8800a548b100 x1830967793943552/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.126626:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548b100 with x1830967793943552 ext(3506176->3616767) 00010000:00010000:3.0:1746147726.126633:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 24 pid: 8468 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.126646:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 24 pid: 8468 timeout: 905 lvb_type: 0 00002000:00010000:3.0:1746147726.126653:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a548b100 00000100:00100000:3.0:1746147726.127248:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1461 00000100:00100000:3.0:1746147726.127256:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793943552:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147726.131477:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.131594:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793943808 00000100:00100000:2.0:1746147726.131606:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793943808 00002000:00100000:2.0:1746147726.131656:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a548bb80 x1830967793943808/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.131667:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548bb80 with x1830967793943808 ext(4194304->5017599) 00002000:00010000:2.0:1746147726.131673:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a548bb80 00000100:00100000:2.0:1746147726.131720:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7340 00000100:00100000:2.0:1746147726.131729:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1957:x1830967793943808:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147726.137203:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793943552:12345-192.168.202.10@tcp:4:cat.0 Request processed in 9936us (11516us total) trans 21474841608 rc 0/0 00000100:00100000:3.0:1746147726.137221:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1461 00002000:00100000:3.0:1746147726.137233:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (3506176->3616767) req@ffff8800a548b100 x1830967793943552/t21474841608(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/448 e 0 to 0 dl 1746147737 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.137244:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548b100 with x1830967793943552 ext(3506176->3616767) 00010000:00010000:3.0:1746147726.137254:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 26 pid: 8468 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.137269:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 26 pid: 8468 timeout: 905 lvb_type: 0 00002000:00010000:3.0:1746147726.137277:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a548b100 00000100:00100000:2.0:1746147726.140369:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1957:x1830967793943808:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8629us (8891us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147726.140382:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7340 00002000:00100000:2.0:1746147726.140396:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a548bb80 x1830967793943808/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.140405:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548bb80 with x1830967793943808 ext(4194304->5017599) 00002000:00010000:2.0:1746147726.140411:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a548bb80 00000100:00100000:0.0:1746147726.146523:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.146628:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793943936 00000100:00100000:1.0:1746147726.146638:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793943936 00010000:00010000:1.0:1746147726.146672:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 26 pid: 8468 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746147726.147387:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8356 00000100:00100000:1.0:1746147726.147396:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967793943936:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147726.147409:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147726.147429:0:7097:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147726 -> 1746147727 00010000:00010000:1.0:1746147726.147435:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 26 pid: 8468 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147726.147448:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->3616767) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 26 pid: 8468 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147726.147470:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00bba00/0xe64d3fbf12a7d927 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->3616767) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb88d expref: 26 pid: 8468 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147726.147489:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.147491:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.147498:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7d99e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8fd expref: 35 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.147507:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7d99e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8fd expref: 35 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.147537:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7d99e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8fd expref: 35 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147726.147548:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796454912:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147726.147625:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.153658:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.153807:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793944064 00000100:00100000:3.0:1746147726.153818:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793944064 00000100:00100000:3.0:1746147726.154591:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16493 00000100:00100000:3.0:1746147726.154600:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967793944064:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.154620:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.154638:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009545ba00/0xe64d3fbf12a7d9a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb904 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147726.154694:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796455040:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147726.155350:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c229c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.155562:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.155662:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796454912:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147726.155680:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147726.155718:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967793943936:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 8314us (9196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.155731:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8356 00000100:00100000:3.0:1746147726.155871:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793944192 00000100:00100000:3.0:1746147726.155875:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793944192 00000100:00100000:3.0:1746147726.155922:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16494 00000100:00100000:3.0:1746147726.155928:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967793944192:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.155941:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.155954:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7d9ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb90b expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.155968:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.155970:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.155978:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7d9ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb90b expref: 26 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.155995:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7d9ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb90b expref: 26 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.156004:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931ce400, rc 0) 00000100:00100000:3.0:1746147726.156028:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967793944192:12345-192.168.202.10@tcp:101:cat.0 Request processed in 100us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.156034:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16494 00000100:00100000:3.0:1746147726.159275:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796455040:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147726.159316:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009545ba00/0xe64d3fbf12a7d9a5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb904 expref: 28 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.159331:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009545ba00/0xe64d3fbf12a7d9a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb904 expref: 28 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.159635:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009545ba00, rc 0) 00000100:00100000:3.0:1746147726.159723:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967793944064:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5122us (6073us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147726.159732:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16493 00000100:00100000:0.0:1746147726.165853:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.165926:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.165952:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.165986:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.167102:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793944448 00000100:00100000:3.0:1746147726.167114:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793945088 00000100:00100000:2.0:1746147726.167115:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793944448 00000100:00100000:3.0:1746147726.167119:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793945088 00002000:00100000:2.0:1746147726.167168:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800943c4000 x1830967793944448/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.167178:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4000 with x1830967793944448 ext(2097152->3145727) 00000100:00100000:3.0:1746147726.167179:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16495 00002000:00010000:2.0:1746147726.167183:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c4000 00000100:00100000:3.0:1746147726.167187:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967793945088:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147726.167201:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793944704 00010000:00010000:3.0:1746147726.167202:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147726.167203:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793944704 00002000:00100000:2.0:1746147726.167217:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800943c4a80 x1830967793944704/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147726.167220:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d9b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb912 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147726.167223:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4a80 with x1830967793944704 ext(3145728->4194303) 00002000:00010000:2.0:1746147726.167225:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c4a80 00000100:00100000:2.0:1746147726.167240:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793944960 00000100:00100000:2.0:1746147726.167242:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793944960 00000100:00100000:3.0:1746147726.167247:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7341 00000100:00100000:3.0:1746147726.167252:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1960:x1830967793944448:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:2.0:1746147726.167253:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800943c5880 x1830967793944960/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.167259:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5880 with x1830967793944960 ext(3145728->4194303) 00002000:00010000:2.0:1746147726.167262:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c5880 00000100:00100000:2.0:1746147726.167279:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7342 00000100:00100000:2.0:1746147726.167283:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1960:x1830967793944704:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147726.167307:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7343 00000100:00100000:2.0:1746147726.168673:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793944960:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147726.171501:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796455168:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147726.171983:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c229c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.175366:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1960:x1830967793944704:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8071us (9428us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147726.175378:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7342 00002000:00100000:2.0:1746147726.175390:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800943c4a80 x1830967793944704/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.175399:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4a80 with x1830967793944704 ext(3145728->4194303) 00002000:00010000:2.0:1746147726.175405:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c4a80 00000100:00100000:0.0:1746147726.183181:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.183256:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793945216 00000100:00100000:2.0:1746147726.183266:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793945216 00000100:00100000:2.0:1746147726.183482:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12010 00000100:00100000:2.0:1746147726.183492:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+6:32177:x1830967793945216:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147726.183519:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.183541:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d9ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb919 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.183608:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb7e00/0xe64d3fbf12a7d9c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183621:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb7e00/0xe64d3fbf12a7d9c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183631:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb7e00/0xe64d3fbf12a7d9c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183646:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183650:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183656:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183787:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3a00/0xe64d3fbf12a7d9cf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183793:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3a00/0xe64d3fbf12a7d9cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183798:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3a00/0xe64d3fbf12a7d9cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746147726.183828:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147726.183833:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147726.183848:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3a00/0xe64d3fbf12a7d9cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183856:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3a00/0xe64d3fbf12a7d9cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183863:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb7e00/0xe64d3fbf12a7d9c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183868:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb7e00/0xe64d3fbf12a7d9c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183873:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb7e00/0xe64d3fbf12a7d9c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183878:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4eb7e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147726.183881:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb7e00/0xe64d3fbf12a7d9c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183918:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb7e00/0xe64d3fbf12a7d9c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183929:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147726.183932:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147726.183935:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb7e00/0xe64d3fbf12a7d9c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183940:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb7e00/0xe64d3fbf12a7d9c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183957:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183961:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183965:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183969:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4eb6600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147726.183972:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183975:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183980:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a00f3300) 00010000:00010000:2.0:1746147726.183981:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147726.183983:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.183987:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147726.184010:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7d9ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb919 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.184021:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3a00/0xe64d3fbf12a7d9cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb919 expref: 7 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.184026:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147726.184028:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147726.184030:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed3a00, rc 0) 00000100:00100000:2.0:1746147726.184098:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+7:32177:x1830967793945216:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 608us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.184104:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12010 00000100:00080000:1.0:1746147726.184210:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147726.188607:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796455168:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147726.188647:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d9b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb912 expref: 28 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.188661:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d9b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb912 expref: 28 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.188680:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931cf800, rc 0) 00000100:00100000:3.0:1746147726.188752:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967793945088:12345-192.168.202.10@tcp:101:cat.0 Request processed in 21563us (22762us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147726.188760:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16495 00000100:00100000:2.0:1746147726.189376:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967793944448:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22121us (23530us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147726.189384:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7341 00002000:00100000:2.0:1746147726.189393:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800943c4000 x1830967793944448/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.189401:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4000 with x1830967793944448 ext(2097152->3145727) 00002000:00010000:2.0:1746147726.189406:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c4000 00000100:00100000:2.0:1746147726.191768:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793944960:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24442us (25803us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147726.191780:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7343 00002000:00100000:2.0:1746147726.191790:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800943c5880 x1830967793944960/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.191799:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5880 with x1830967793944960 ext(3145728->4194303) 00002000:00010000:2.0:1746147726.191805:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c5880 00000100:00100000:0.0:1746147726.198038:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.198089:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.198621:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793945344 00000100:00100000:1.0:1746147726.198631:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793945344 00000100:00100000:1.0:1746147726.198682:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793945472 00000100:00100000:1.0:1746147726.198683:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793945472 00000100:00100000:1.0:1746147726.198742:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16496 00000100:00100000:1.0:1746147726.198749:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967793945344:12345-192.168.202.10@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147726.198761:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16497 00010000:00010000:1.0:1746147726.198768:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147726.198770:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967793945472:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147726.198781:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147726.198786:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc31e00/0xe64d3fbf12a7d9d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb920 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.198793:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d9dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb927 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.198808:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.198810:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.198819:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d9dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb927 expref: 12 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.198833:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d9dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb927 expref: 12 pid: 6715 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147726.198838:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796455296:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147726.198844:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931cf800, rc 0) 00000100:00100000:3.0:1746147726.198913:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967793945472:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 145us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.198919:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16497 00000100:00100000:1.0:1746147726.198929:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6c00 going to sleep for 11 seconds 00000100:00080000:0.0:1746147726.198988:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147726.205341:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796455296:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147726.205391:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cc31e00/0xe64d3fbf12a7d9d6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb920 expref: 11 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.205405:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc31e00/0xe64d3fbf12a7d9d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb920 expref: 11 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.205431:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc31e00, rc 0) 00000100:00100000:1.0:1746147726.205491:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967793945344:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 6742us (7463us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147726.205500:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16496 00000100:00100000:0.0:1746147726.209455:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.209626:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793945984 00000100:00100000:2.0:1746147726.209636:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793945984 00000100:00100000:2.0:1746147726.209693:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12011 00000100:00100000:2.0:1746147726.209701:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+7:32177:x1830967793945984:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147726.209732:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.209751:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3200/0xe64d3fbf12a7d9e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb92e expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.209851:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9eb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.209869:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb87f expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.209875:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3a00/0xe64d3fbf12a7d9cf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb919 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.209905:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9eb lrc: 5/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.209937:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3a00/0xe64d3fbf12a7d9cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb919 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.209949:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3a00/0xe64d3fbf12a7d9cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb919 expref: 8 pid: 14547 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.209964:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796455424:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.210055:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb87f expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.210067:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb87f expref: 9 pid: 14547 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.210074:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796455552:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.210174:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.213274:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.215519:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793945728 00000100:00100000:2.0:1746147726.215532:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793945728 00002000:00100000:2.0:1746147726.215587:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800943c4380 x1830967793945728/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.215597:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4380 with x1830967793945728 ext(4194304->5017599) 00002000:00010000:2.0:1746147726.215604:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c4380 00000100:00100000:2.0:1746147726.215640:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7344 00000100:00100000:2.0:1746147726.215647:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793945728:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147726.216135:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.216934:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796455424:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147726.216987:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793946112 00000100:00100000:0.0:1746147726.216992:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793946112 00010000:00010000:0.0:1746147726.217018:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3a00/0xe64d3fbf12a7d9cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb919 expref: 9 pid: 14547 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746147726.217039:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8357 00000100:00100000:0.0:1746147726.217045:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967793946112:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147726.217055:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147726.217060:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3a00/0xe64d3fbf12a7d9cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb919 expref: 9 pid: 14547 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746147726.217070:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3a00/0xe64d3fbf12a7d9cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb919 expref: 9 pid: 14547 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746147726.217091:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3a00/0xe64d3fbf12a7d9cf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb919 expref: 9 pid: 14547 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746147726.217119:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147726.217124:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9eb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.217132:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9eb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.217137:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147726.217177:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967793946112:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 132us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.217184:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8357 00000100:00100000:0.0:1746147726.222494:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.222627:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793946240 00000100:00100000:3.0:1746147726.222636:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793946240 00010000:00010000:3.0:1746147726.222683:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb87f expref: 10 pid: 14547 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.222730:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8358 00000100:00100000:3.0:1746147726.222737:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967793946240:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.222753:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.222759:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb87f expref: 10 pid: 14547 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.222777:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb87f expref: 10 pid: 14547 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.222804:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147726.222809:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9eb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.222818:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9eb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.222824:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9eb lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.222841:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.222909:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967793946240:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 149us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.222916:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8358 00010000:00010000:3.0:1746147726.222964:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fc5800/0xe64d3fbf12a7d920 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb87f expref: 9 pid: 14547 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.222980:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796455552:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.223000:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9eb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.223007:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9eb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.223011:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9eb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:3.0:1746147726.223033:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147726.223181:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed3200/0xe64d3fbf12a7d9e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb92e expref: 9 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.223195:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9eb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb92e expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.223201:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147726.223203:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147726.223205:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4eb6600, rc 0) 00000100:00100000:3.0:1746147726.223232:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+8:32177:x1830967793945984:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 13532us (13788us total) trans 8589946022 rc 0/0 00000100:00100000:3.0:1746147726.223238:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12011 00000100:00080000:0.0:1746147726.223933:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147726.226560:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793945728:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10902us (13286us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746147726.226571:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7344 00002000:00100000:3.0:1746147726.226584:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800943c4380 x1830967793945728/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.226594:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4380 with x1830967793945728 ext(4194304->5017599) 00002000:00010000:3.0:1746147726.226600:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c4380 00000100:00100000:0.0:1746147726.229653:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.229733:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793946496 00000100:00100000:3.0:1746147726.229743:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793946496 00000100:00100000:3.0:1746147726.229803:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12012 00000100:00100000:3.0:1746147726.229811:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+8:32177:x1830967793946496:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147726.230361:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.230366:0:14546:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147726.230395:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7d9eb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb92e expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.230418:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147726.230423:0:14546:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147726.230434:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf000/0xe64d3fbf12a7d9f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb935 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.233293:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7da00 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.233312:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7da00 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.233324:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7da00 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:3.0:1746147726.233342:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147726.233492:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf000/0xe64d3fbf12a7d9f9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb935 expref: 10 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.233512:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7da00 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb935 expref: 9 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.233520:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147726.233523:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147726.233526:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931cf600, rc 0) 00000100:00100000:3.0:1746147726.233926:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+9:32177:x1830967793946496:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 4114us (4282us total) trans 8589946023 rc 0/0 00000100:00100000:3.0:1746147726.233936:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12012 00000100:00100000:0.0:1746147726.235132:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.235210:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793946752 00000100:00100000:3.0:1746147726.235220:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793946752 00000100:00100000:3.0:1746147726.235267:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12013 00000100:00100000:3.0:1746147726.235275:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32180:x1830967793946752:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147726.235299:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.235318:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce800/0xe64d3fbf12a7da0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb93c expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.235429:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7da15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.235442:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7da15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.235452:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7da15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.235466:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7da1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.235471:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7da1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.235476:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7da1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.235583:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.235592:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7da00 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb935 expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.235598:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.235630:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7da00 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb935 expref: 8 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.235642:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7da00 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb935 expref: 8 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.235655:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796455680:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.240074:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147726.243358:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.243523:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793946880 00000100:00100000:0.0:1746147726.243535:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793946880 00000100:00100000:0.0:1746147726.243602:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12014 00000100:00100000:0.0:1746147726.243611:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+9:32177:x1830967793946880:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147726.243638:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147726.243658:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1600/0xe64d3fbf12a7da2a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb943 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147726.243697:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796455680:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147726.243725:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1600/0xe64d3fbf12a7da2a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb943 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147726.243942:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147726.244508:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.244558:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1600/0xe64d3fbf12a7da2a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb943 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.244584:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147726.244587:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147726.244590:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2b1600, rc 0) 00000100:00100000:0.0:1746147726.244639:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+10:32177:x1830967793946880:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 1028us (4676us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.244646:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12014 00000100:00100000:1.0:1746147726.245762:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793947008 00000100:00100000:1.0:1746147726.245772:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793947008 00010000:00010000:1.0:1746147726.245803:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7da00 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb935 expref: 10 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746147726.245832:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8359 00000100:00100000:1.0:1746147726.245839:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967793947008:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147726.245851:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147726.245857:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7da00 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb935 expref: 10 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147726.245867:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7da00 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb935 expref: 10 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147726.245902:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7da00 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb935 expref: 10 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147726.245931:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147726.245935:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.245943:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.245949:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.245970:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147726.246004:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967793947008:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 166us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.246011:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8359 00010000:00010000:1.0:1746147726.246033:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246038:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:1.0:1746147726.246053:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147726.246157:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246164:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246170:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246176:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931cfe00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147726.246180:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246186:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246192:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147726.246194:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147726.246197:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246201:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cfe00/0xe64d3fbf12a7da23 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246214:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7da15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246219:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7da15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246223:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7da15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246226:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931cf400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147726.246228:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7da15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246231:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7da15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246236:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147726.246238:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147726.246239:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7da15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246243:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7da15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246249:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7da1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246253:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7da1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246256:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7da1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246259:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931ce600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147726.246261:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7da1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246269:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7da1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246274:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a024bb00) 00010000:00010000:1.0:1746147726.246275:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147726.246277:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7da1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.246280:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7da1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.248651:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce800/0xe64d3fbf12a7da0e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb93c expref: 11 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.248665:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931ce800/0xe64d3fbf12a7da0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb93c expref: 11 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.248684:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931ce800, rc 0) 00000100:00100000:1.0:1746147726.248765:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32180:x1830967793946752:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 13488us (13637us total) trans 8589946024 rc 301/301 00000100:00100000:1.0:1746147726.248774:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12013 00000100:00100000:0.0:1746147726.249202:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.249256:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793947136 00000100:00100000:1.0:1746147726.249266:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793947136 00000100:00100000:1.0:1746147726.249301:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16498 00000100:00100000:1.0:1746147726.249307:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967793947136:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147726.249347:0:8184:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cc30000/0xe64d3fbf12a7da38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.249370:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->651263) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.249377:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147726.249379:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147726.249382:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc30000/0xe64d3fbf12a7da38 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.249412:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->651263) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.249424:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->651263) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 33 pid: 7050 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746147726.249438:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796455808:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147726.250275:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.250914:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.250943:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.250965:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.250979:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.251011:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793947392 00000100:00100000:0.0:1746147726.251012:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.251018:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793947392 00000100:00100000:2.0:1746147726.251069:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793947648 00000100:00100000:2.0:1746147726.251073:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793947648 00000100:00100000:3.0:1746147726.251198:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793947264 00000100:00100000:3.0:1746147726.251201:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793947264 00000100:00100000:2.0:1746147726.251239:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793947520 00000100:00100000:2.0:1746147726.251243:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793947520 00000100:00100000:2.0:1746147726.251263:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793947776 00000100:00100000:2.0:1746147726.251265:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793947776 00000100:00100000:2.0:1746147726.251282:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16499 00000100:00100000:2.0:1746147726.251289:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+14:1957:x1830967793947392:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147726.251326:0:4591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7da3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.251348:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d839 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb839 expref: 14 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251355:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a925f200/0xe64d3fbf12a7d974 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8d3 expref: 25 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251362:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095445c00/0xe64d3fbf12a7d958 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a9 expref: 35 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251369:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.251371:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.251373:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7da3f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.251400:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095445c00/0xe64d3fbf12a7d958 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a9 expref: 35 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251410:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095445c00/0xe64d3fbf12a7d958 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a9 expref: 35 pid: 22183 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.251423:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796455936:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.251494:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a925f200/0xe64d3fbf12a7d974 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8d3 expref: 25 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251502:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a925f200/0xe64d3fbf12a7d974 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8d3 expref: 25 pid: 4592 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.251515:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796456064:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.251542:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d839 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb839 expref: 14 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251549:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d839 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb839 expref: 14 pid: 8469 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.251557:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796456192:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.251574:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.251593:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16500 00000100:00100000:2.0:1746147726.251599:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967793947648:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147726.251620:0:21480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134edf400/0xe64d3fbf12a7da46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.251630:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5516200/0xe64d3fbf12a7d840 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb847 expref: 12 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251636:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7d989 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8e1 expref: 26 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251643:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba000/0xe64d3fbf12a7d95f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b7 expref: 33 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251648:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.251650:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.251652:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134edf400/0xe64d3fbf12a7da46 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.251667:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba000/0xe64d3fbf12a7d95f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b7 expref: 33 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251675:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba000/0xe64d3fbf12a7d95f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b7 expref: 33 pid: 8184 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.251683:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796456320:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.251729:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7d989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8e1 expref: 26 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251737:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7d989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8e1 expref: 26 pid: 8184 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.251744:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796456448:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.251769:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5516200/0xe64d3fbf12a7d840 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb847 expref: 12 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251776:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5516200/0xe64d3fbf12a7d840 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb847 expref: 12 pid: 8469 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.251783:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796456576:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.251796:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.251809:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16501 00000100:00100000:2.0:1746147726.251815:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+14:1957:x1830967793947264:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147726.251830:0:8468:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094e7b800/0xe64d3fbf12a7da4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.251840:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d81d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb832 expref: 14 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251847:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095444e00/0xe64d3fbf12a7d96d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8cc expref: 25 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251855:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7d943 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a2 expref: 35 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251859:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.251860:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.251862:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e7b800/0xe64d3fbf12a7da4d lrc: 6/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.251873:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7d943 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a2 expref: 35 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251880:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7d943 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a2 expref: 35 pid: 8470 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.251916:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796456704:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.251948:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095444e00/0xe64d3fbf12a7d96d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8cc expref: 25 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251955:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095444e00/0xe64d3fbf12a7d96d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8cc expref: 25 pid: 9615 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.251961:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796456832:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.251977:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d81d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb832 expref: 14 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.251983:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d81d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb832 expref: 14 pid: 8469 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.251988:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796456960:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.251997:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.252055:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16502 00000100:00100000:0.0:1746147726.252063:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967793947520:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147726.252081:0:9615:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0400/0xe64d3fbf12a7da54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.252092:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5516c00/0xe64d3fbf12a7d824 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb840 expref: 12 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.252099:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a925f800/0xe64d3fbf12a7d97b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8da expref: 26 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.252105:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00bae00/0xe64d3fbf12a7d93c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b0 expref: 33 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.252109:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.252110:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.252112:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0400/0xe64d3fbf12a7da54 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147726.252115:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16503 00000100:00100000:3.0:1746147726.252121:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+14:1957:x1830967793947776:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147726.252125:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00bae00/0xe64d3fbf12a7d93c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b0 expref: 33 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.252131:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00bae00/0xe64d3fbf12a7d93c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b0 expref: 33 pid: 8468 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.252136:0:8470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7da5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147726.252144:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796457088:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.252146:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7d99e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8fd expref: 35 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.252152:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d9dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb927 expref: 14 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.252163:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7d9ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb90b expref: 25 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.252166:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a925f800/0xe64d3fbf12a7d97b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8da expref: 26 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.252167:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.252168:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.252170:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7da5b lrc: 6/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.252173:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a925f800/0xe64d3fbf12a7d97b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8da expref: 26 pid: 4592 timeout: 905 lvb_type: 1 00000100:00100000:0.0:1746147726.252179:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135848a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796457216:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.252183:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7d9ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb90b expref: 25 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.252189:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7d9ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb90b expref: 25 pid: 7050 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.252193:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5516c00/0xe64d3fbf12a7d824 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb840 expref: 12 pid: 8469 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147726.252195:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796457344:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147726.252198:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5516c00/0xe64d3fbf12a7d824 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb840 expref: 12 pid: 8469 timeout: 905 lvb_type: 1 00000100:00100000:0.0:1746147726.252205:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796457472:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.252215:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d9dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb927 expref: 14 pid: 6715 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147726.252215:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201900 going to sleep for 11 seconds 00010000:00010000:3.0:1746147726.252222:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d9dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb927 expref: 14 pid: 6715 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.252228:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796457600:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.252248:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7d99e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8fd expref: 35 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.252258:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7d99e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8fd expref: 35 pid: 8468 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.252264:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796457728:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.252273:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147726.262403:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796455808:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147726.262430:0:8184:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cc30000/0xe64d3fbf12a7da38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147726.263001:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796456320:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.263011:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796456448:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.263019:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796456576:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.263041:0:21480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880134edf400/0xe64d3fbf12a7da46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147726.263047:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796456704:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.263112:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796455936:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.263120:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796456064:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.263127:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796456192:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.263141:0:4591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7da3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147726.263551:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.264287:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.264309:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.264342:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.264356:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.264359:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793947904 00000100:00100000:2.0:1746147726.264367:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793947904 00000100:00100000:1.0:1746147726.264463:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796456832:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147726.264473:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796456960:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147726.264494:0:8468:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094e7b800/0xe64d3fbf12a7da4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147726.264500:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x455:0x0] (45056->651263) req@ffff88009fd19500 x1830967793947904/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.264509:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19500 with x1830967793947904 ext(45056->651263) 00010000:00010000:2.0:1746147726.264516:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->651263) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 34 pid: 7050 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.264526:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->651263) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 34 pid: 7050 timeout: 905 lvb_type: 0 00002000:00010000:2.0:1746147726.264532:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd19500 00000100:00100000:2.0:1746147726.264557:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1462 00000100:00100000:2.0:1746147726.264564:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967793947904:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147726.265157:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793948160 00000100:00100000:3.0:1746147726.265161:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793948160 00010000:00010000:3.0:1746147726.265183:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095445c00/0xe64d3fbf12a7d958 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a9 expref: 36 pid: 22183 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.265200:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793948416 00000100:00100000:3.0:1746147726.265203:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793948416 00010000:00010000:3.0:1746147726.265211:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7d943 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a2 expref: 37 pid: 8470 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.265221:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793948288 00000100:00100000:3.0:1746147726.265223:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793948288 00010000:00010000:3.0:1746147726.265232:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5516200/0xe64d3fbf12a7d840 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb847 expref: 13 pid: 8469 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.265244:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793948544 00000100:00100000:3.0:1746147726.265246:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793948544 00010000:00010000:3.0:1746147726.265253:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a925f200/0xe64d3fbf12a7d974 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8d3 expref: 26 pid: 4592 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.265261:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8360 00000100:00100000:3.0:1746147726.265266:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6671050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793948160:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.265276:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.265296:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095445c00/0xe64d3fbf12a7d958 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a9 expref: 37 pid: 22183 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.265305:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095445c00/0xe64d3fbf12a7d958 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a9 expref: 37 pid: 22183 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.265327:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095445c00/0xe64d3fbf12a7d958 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a9 expref: 37 pid: 22183 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.265345:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.265399:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6671050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967793948160:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 132us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.265405:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8360 00000100:00100000:3.0:1746147726.265454:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8361 00000100:00100000:3.0:1746147726.265459:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967793948416:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.265465:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.265475:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7d943 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a2 expref: 35 pid: 8470 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.265482:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7d943 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a2 expref: 35 pid: 8470 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.265493:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7d943 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8a2 expref: 35 pid: 8470 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.265502:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.265515:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967793948416:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 56us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.265520:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8361 00000100:00100000:3.0:1746147726.265529:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8362 00000100:00100000:3.0:1746147726.265533:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+13:1958:x1830967793948288:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.265541:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.265550:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5516200/0xe64d3fbf12a7d840 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb847 expref: 13 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.265559:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5516200/0xe64d3fbf12a7d840 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb847 expref: 13 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.265571:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5516200/0xe64d3fbf12a7d840 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb847 expref: 13 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.265582:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.265592:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+12:1958:x1830967793948288:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 60us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.265598:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8362 00000100:00100000:3.0:1746147726.265606:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8363 00000100:00100000:3.0:1746147726.265609:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967793948544:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.265614:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.265620:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a925f200/0xe64d3fbf12a7d974 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8d3 expref: 26 pid: 4592 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.265627:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a925f200/0xe64d3fbf12a7d974 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8d3 expref: 26 pid: 4592 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.265637:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a925f200/0xe64d3fbf12a7d974 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8d3 expref: 26 pid: 4592 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.265644:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.265654:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967793948544:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 44us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.265658:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8363 00000100:00100000:3.0:1746147726.265721:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796457600:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.265731:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796457728:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.266241:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796457088:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.266251:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135848a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796457216:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.266259:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796457472:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.266284:0:9615:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0400/0xe64d3fbf12a7da54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147726.267046:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.267074:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.267088:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.267094:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793949056 00000100:00100000:0.0:1746147726.267100:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793949056 00000100:00100000:1.0:1746147726.267121:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147726.267127:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095444e00/0xe64d3fbf12a7d96d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8cc expref: 25 pid: 9615 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746147726.267137:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793949312 00000100:00100000:1.0:1746147726.267140:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793949312 00000100:00100000:0.0:1746147726.267149:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793949184 00000100:00100000:0.0:1746147726.267152:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793949184 00010000:00010000:1.0:1746147726.267157:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d9dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb927 expref: 15 pid: 6715 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.267163:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5516c00/0xe64d3fbf12a7d824 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb840 expref: 12 pid: 8469 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746147726.267172:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793949440 00000100:00100000:1.0:1746147726.267174:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793949440 00000100:00100000:0.0:1746147726.267175:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8364 00000100:00100000:0.0:1746147726.267182:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967793949056:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147726.267184:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7d9ac lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb90b expref: 26 pid: 7050 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.267193:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147726.267195:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8365 00000100:00100000:1.0:1746147726.267199:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+15:1958:x1830967793949312:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147726.267206:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147726.267212:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095444e00/0xe64d3fbf12a7d96d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8cc expref: 26 pid: 9615 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.267217:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d9dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb927 expref: 15 pid: 6715 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.267222:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095444e00/0xe64d3fbf12a7d96d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8cc expref: 26 pid: 9615 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.267226:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d9dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb927 expref: 15 pid: 6715 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.267241:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095444e00/0xe64d3fbf12a7d96d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8cc expref: 26 pid: 9615 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.267242:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931cf800/0xe64d3fbf12a7d9dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb927 expref: 15 pid: 6715 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.267259:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147726.267260:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147726.267286:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+14:1958:x1830967793949312:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.267292:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8365 00000100:00100000:1.0:1746147726.267310:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8366 00000100:00100000:1.0:1746147726.267315:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+12:1958:x1830967793949184:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147726.267317:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8367 00010000:00010000:1.0:1746147726.267322:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147726.267324:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6673850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967793949440:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147726.267331:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147726.267334:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5516c00/0xe64d3fbf12a7d824 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb840 expref: 12 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.267338:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7d9ac lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb90b expref: 25 pid: 7050 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.267342:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5516c00/0xe64d3fbf12a7d824 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb840 expref: 12 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.267345:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7d9ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb90b expref: 25 pid: 7050 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.267354:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147726.267354:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5516c00/0xe64d3fbf12a7d824 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb840 expref: 12 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.267363:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147726.267437:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967793949056:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 255us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.267441:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6673850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967793949440:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 117us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.267444:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8364 00000100:00100000:2.0:1746147726.267447:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8367 00010000:00010000:2.0:1746147726.267482:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931ce400/0xe64d3fbf12a7d9ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb90b expref: 23 pid: 7050 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.267498:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796457344:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.267521:0:8470:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7da5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147726.267950:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967793949184:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 633us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.267956:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8366 00000100:00100000:0.0:1746147726.268481:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.268665:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793949568 00000100:00100000:1.0:1746147726.268670:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793949568 00010000:00010000:1.0:1746147726.269128:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925f800/0xe64d3fbf12a7d97b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8da expref: 27 pid: 4592 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746147726.269154:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8368 00000100:00100000:1.0:1746147726.269161:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1957:x1830967793949568:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147726.269170:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147726.269187:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a925f800/0xe64d3fbf12a7d97b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8da expref: 27 pid: 4592 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.269197:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a925f800/0xe64d3fbf12a7d97b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8da expref: 27 pid: 4592 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.269217:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a925f800/0xe64d3fbf12a7d97b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8da expref: 27 pid: 4592 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.269230:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147726.269269:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967793949568:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 108us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.269275:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8368 00000100:00100000:2.0:1746147726.273612:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.274123:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.274145:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.274453:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.275086:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.275123:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793948032 00000100:00100000:0.0:1746147726.275134:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793948032 00010000:00010000:0.0:1746147726.275171:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d839 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb839 expref: 14 pid: 8469 timeout: 905 lvb_type: 1 00000100:00100000:0.0:1746147726.275293:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793948800 00000100:00100000:0.0:1746147726.275296:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793948800 00010000:00010000:0.0:1746147726.275312:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba000/0xe64d3fbf12a7d95f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b7 expref: 36 pid: 8184 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.275365:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793948672 00000100:00100000:3.0:1746147726.275370:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793948672 00010000:00010000:3.0:1746147726.275389:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7d989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8e1 expref: 26 pid: 8184 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.275521:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793948928 00000100:00100000:3.0:1746147726.275524:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793948928 00010000:00010000:3.0:1746147726.275537:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d81d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb832 expref: 15 pid: 8469 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.275548:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8369 00000100:00100000:3.0:1746147726.275555:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+15:1960:x1830967793948032:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.275568:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.275590:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d839 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb839 expref: 15 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.275601:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d839 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb839 expref: 15 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.275624:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5516400/0xe64d3fbf12a7d839 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb839 expref: 15 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.275643:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.275645:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.275650:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7da3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.275658:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7da3f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.275679:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.275735:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967793948032:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 179us (2132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.275741:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8369 00000100:00100000:0.0:1746147726.276553:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8370 00000100:00100000:0.0:1746147726.276562:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967793948672:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147726.276572:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147726.276590:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7d989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8e1 expref: 26 pid: 8184 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.276599:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7d989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8e1 expref: 26 pid: 8184 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.276613:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00bb600/0xe64d3fbf12a7d989 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8e1 expref: 26 pid: 8184 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.276630:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147726.276650:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967793948672:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 90us (2504us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.276656:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8370 00000100:00100000:0.0:1746147726.276672:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8371 00000100:00100000:0.0:1746147726.276677:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967793948928:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147726.276684:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147726.276695:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d81d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb832 expref: 14 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.276703:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d81d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb832 expref: 14 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.276732:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5516000/0xe64d3fbf12a7d81d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb832 expref: 14 pid: 8469 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.276742:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.276744:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.276747:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e7b800/0xe64d3fbf12a7da4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.276754:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e7b800/0xe64d3fbf12a7da4d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.276775:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147726.276789:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967793948928:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 112us (2338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.276794:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8371 00000100:00100000:0.0:1746147726.276804:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8372 00000100:00100000:0.0:1746147726.276808:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967793948800:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147726.276814:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147726.276821:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba000/0xe64d3fbf12a7d95f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b7 expref: 36 pid: 8184 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.276829:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba000/0xe64d3fbf12a7d95f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b7 expref: 36 pid: 8184 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.276840:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00ba000/0xe64d3fbf12a7d95f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b7 expref: 36 pid: 8184 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.276854:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.276855:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.276858:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134edf400/0xe64d3fbf12a7da46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.276864:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134edf400/0xe64d3fbf12a7da46 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.276880:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147726.276911:0:21480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134edf400/0xe64d3fbf12a7da46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.276918:0:21480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134edf400/0xe64d3fbf12a7da46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.276937:0:21480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134edf400/0xe64d3fbf12a7da46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.276943:0:21480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134edf400/0xe64d3fbf12a7da46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.276950:0:21480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134edf400/0xe64d3fbf12a7da46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.276957:0:21480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134edf400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147726.276961:0:21480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134edf400/0xe64d3fbf12a7da46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.276971:0:21480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134edf400/0xe64d3fbf12a7da46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.276980:0:21480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134edf400/0xe64d3fbf12a7da46 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.276986:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134edf400/0xe64d3fbf12a7da46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147726.277029:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967793947648:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 25430us (26085us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.277036:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16500 00000100:00100000:0.0:1746147726.277066:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967793948800:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 257us (2943us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.277071:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8372 00000100:00100000:2.0:1746147726.277346:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793949696 00000100:00100000:2.0:1746147726.277352:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793949696 00010000:00010000:2.0:1746147726.277372:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7d99e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8fd expref: 34 pid: 8468 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.277387:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8373 00000100:00100000:2.0:1746147726.277392:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793949696:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147726.277399:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147726.277410:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7d99e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8fd expref: 34 pid: 8468 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.277418:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7d99e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8fd expref: 34 pid: 8468 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.277432:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7d99e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8fd expref: 34 pid: 8468 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.277446:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.277447:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.277450:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7da5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277457:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7da5b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277470:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147726.277487:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967793949696:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 95us (2401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.277493:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8373 00010000:00010000:2.0:1746147726.277511:0:4591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7da3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277518:0:4591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7da3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277533:0:4591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7da3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277539:0:4591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7da3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277550:0:4591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7da3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277555:0:4591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134edfa00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147726.277557:0:4591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7da3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277563:0:4591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7da3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277571:0:4591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7da3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277576:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134edfa00/0xe64d3fbf12a7da3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147726.277610:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967793947392:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 26322us (26699us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.277615:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16499 00010000:00010000:2.0:1746147726.277639:0:8470:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7da5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277645:0:8470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7da5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277657:0:8470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7da5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277664:0:8470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7da5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277670:0:8470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7da5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277675:0:8470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931cfa00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147726.277677:0:8470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7da5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277682:0:8470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7da5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277691:0:8470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7da5b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.277696:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7da5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147726.277752:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967793947776:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 25631us (26739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.277757:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16503 00010000:00010000:1.0:1746147726.278000:0:8468:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094e7b800/0xe64d3fbf12a7da4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.278009:0:8468:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e7b800/0xe64d3fbf12a7da4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.278022:0:8468:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094e7b800/0xe64d3fbf12a7da4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.278034:0:8468:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094e7b800/0xe64d3fbf12a7da4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.278040:0:8468:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094e7b800/0xe64d3fbf12a7da4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.278044:0:8468:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e7b800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147726.278047:0:8468:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e7b800/0xe64d3fbf12a7da4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.278052:0:8468:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e7b800/0xe64d3fbf12a7da4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.278061:0:8468:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094e7b800/0xe64d3fbf12a7da4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.278066:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e7b800/0xe64d3fbf12a7da4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147726.278078:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.278091:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793949824 00000100:00100000:2.0:1746147726.278094:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793949824 00010000:00010000:2.0:1746147726.278107:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00bae00/0xe64d3fbf12a7d93c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b0 expref: 35 pid: 8468 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746147726.278109:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967793947264:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 26294us (27143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.278115:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16501 00000100:00100000:2.0:1746147726.278120:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8374 00000100:00100000:2.0:1746147726.278125:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6672850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967793949824:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147726.278133:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147726.278143:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00bae00/0xe64d3fbf12a7d93c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b0 expref: 35 pid: 8468 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.278150:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00bae00/0xe64d3fbf12a7d93c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b0 expref: 35 pid: 8468 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.278399:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00bae00/0xe64d3fbf12a7d93c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8b0 expref: 35 pid: 8468 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.278412:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.278413:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.278416:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0400/0xe64d3fbf12a7da54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.278422:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0400/0xe64d3fbf12a7da54 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.279578:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147726.279608:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6672850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967793949824:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1480us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.279616:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8374 00010000:00010000:3.0:1746147726.279857:0:9615:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0400/0xe64d3fbf12a7da54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.279865:0:9615:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0400/0xe64d3fbf12a7da54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.279907:0:9615:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0400/0xe64d3fbf12a7da54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.279913:0:9615:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0400/0xe64d3fbf12a7da54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.279919:0:9615:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0400/0xe64d3fbf12a7da54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.279924:0:9615:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a2b0400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147726.279926:0:9615:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0400/0xe64d3fbf12a7da54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.279932:0:9615:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0400/0xe64d3fbf12a7da54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.279944:0:9615:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0400/0xe64d3fbf12a7da54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.279948:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0400/0xe64d3fbf12a7da54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147726.279990:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.280012:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967793947520:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 27949us (29031us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.280018:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16502 00000100:00100000:0.0:1746147726.280277:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793950080 00000100:00100000:0.0:1746147726.280284:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793950080 00000100:00100000:0.0:1746147726.280317:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12015 00000100:00100000:0.0:1746147726.280323:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32182:x1830967793950080:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147726.280349:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147726.280365:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e89400/0xe64d3fbf12a7da62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb94a expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.280466:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88800/0xe64d3fbf12a7da69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280481:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88800/0xe64d3fbf12a7da69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280489:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88800/0xe64d3fbf12a7da69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280500:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88e00/0xe64d3fbf12a7da70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280504:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88e00/0xe64d3fbf12a7da70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280509:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88e00/0xe64d3fbf12a7da70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280599:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7da77 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280606:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7da77 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280612:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7da77 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:0.0:1746147726.280619:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147726.280675:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7da77 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280681:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7da77 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280686:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7da77 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280693:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e88600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147726.280696:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7da77 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280701:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7da77 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280719:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147726.280722:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147726.280725:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7da77 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280730:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88600/0xe64d3fbf12a7da77 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280740:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88800/0xe64d3fbf12a7da69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280744:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88800/0xe64d3fbf12a7da69 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280748:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88800/0xe64d3fbf12a7da69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280752:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e88800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147726.280754:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88800/0xe64d3fbf12a7da69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280759:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88800/0xe64d3fbf12a7da69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280765:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147726.280766:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147726.280769:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88800/0xe64d3fbf12a7da69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280773:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88800/0xe64d3fbf12a7da69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280780:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88e00/0xe64d3fbf12a7da70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280784:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88e00/0xe64d3fbf12a7da70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280788:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88e00/0xe64d3fbf12a7da70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280792:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e88e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147726.280794:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88e00/0xe64d3fbf12a7da70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280798:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88e00/0xe64d3fbf12a7da70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280803:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e8b8900) 00010000:00010000:0.0:1746147726.280805:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147726.280807:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88e00/0xe64d3fbf12a7da70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280811:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e88e00/0xe64d3fbf12a7da70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147726.280837:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e89400/0xe64d3fbf12a7da62 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb94a expref: 327 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.280845:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e89400/0xe64d3fbf12a7da62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb94a expref: 327 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.280852:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e89400, rc 0) 00000100:00100000:0.0:1746147726.280880:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32182:x1830967793950080:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 558us (892us total) trans 8589946025 rc 301/301 00000100:00100000:0.0:1746147726.280914:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12015 00000100:00100000:2.0:1746147726.288589:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967793947904:12345-192.168.202.10@tcp:4:cat.0 Request processed in 24016us (24270us total) trans 17179874382 rc 0/0 00000100:00100000:2.0:1746147726.288600:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1462 00002000:00100000:2.0:1746147726.288610:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (45056->651263) req@ffff88009fd19500 x1830967793947904/t17179874382(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/448 e 0 to 0 dl 1746147737 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.288618:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19500 with x1830967793947904 ext(45056->651263) 00010000:00010000:2.0:1746147726.288626:0:31359:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->651263) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 34 pid: 7050 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.288641:0:31359:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->651263) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 34 pid: 7050 timeout: 905 lvb_type: 0 00002000:00010000:2.0:1746147726.288647:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd19500 00000100:00100000:0.0:1746147726.290499:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.290622:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793950208 00000100:00100000:2.0:1746147726.290631:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793950208 00010000:00010000:2.0:1746147726.290659:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->651263) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 34 pid: 7050 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.290691:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8375 00000100:00100000:2.0:1746147726.290698:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967793950208:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147726.290715:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147726.290730:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 45056->651263) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 34 pid: 7050 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.290740:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 45056->651263) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 34 pid: 7050 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.290763:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7d990 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 45056->651263) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb8ef expref: 34 pid: 7050 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.290778:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.290780:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.290784:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cc30000/0xe64d3fbf12a7da38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.290791:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc30000/0xe64d3fbf12a7da38 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.290818:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147726.290862:0:8184:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cc30000/0xe64d3fbf12a7da38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.290878:0:8184:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc30000/0xe64d3fbf12a7da38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.290937:0:8184:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cc30000/0xe64d3fbf12a7da38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.290944:0:8184:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc30000/0xe64d3fbf12a7da38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.290950:0:8184:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cc30000/0xe64d3fbf12a7da38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.290957:0:8184:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc30000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147726.290960:0:8184:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cc30000/0xe64d3fbf12a7da38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.290966:0:8184:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cc30000/0xe64d3fbf12a7da38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.290979:0:8184:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cc30000/0xe64d3fbf12a7da38 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.290984:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc30000/0xe64d3fbf12a7da38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147726.291071:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967793947136:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 41762us (41869us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.291075:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1957:x1830967793950208:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 376us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.291082:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16498 00000100:00100000:3.0:1746147726.291084:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8375 00000100:00100000:0.0:1746147726.292307:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.292407:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793950464 00000100:00100000:2.0:1746147726.292414:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793950464 00000100:00100000:2.0:1746147726.292457:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12016 00000100:00100000:2.0:1746147726.292462:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+9:32177:x1830967793950464:12345-192.168.202.10@tcp:36:mirror_io.0 00010000:00010000:2.0:1746147726.292503:0:14546:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147726.292525:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b1600/0xe64d3fbf12a7da2a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb943 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.292540:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147726.292544:0:14546:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147726.292585:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+8:32177:x1830967793950464:12345-192.168.202.10@tcp:36:mirror_io.0 Request processed in 122us (280us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746147726.292590:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12016 00000100:00100000:2.0:1746147726.295551:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.295630:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793950720 00000100:00100000:3.0:1746147726.295639:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793950720 00000100:00100000:3.0:1746147726.295683:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4997 00000100:00100000:3.0:1746147726.295691:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+8:32177:x1830967793950720:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147726.295956:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+9:32177:x1830967793950720:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 263us (414us total) trans 8589946026 rc 0/0 00000100:00100000:3.0:1746147726.295963:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4997 00000100:00100000:0.0:1746147726.298383:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.298479:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793950976 00000100:00100000:2.0:1746147726.298488:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793950976 00000100:00100000:2.0:1746147726.298532:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4998 00000100:00100000:2.0:1746147726.298541:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+9:32177:x1830967793950976:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147726.298779:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+10:32177:x1830967793950976:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 239us (405us total) trans 8589946027 rc 0/0 00000100:00100000:2.0:1746147726.298786:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4998 00000100:00100000:0.0:1746147726.305000:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.305108:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793951104 00000100:00100000:1.0:1746147726.305118:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793951104 00000100:00100000:1.0:1746147726.305176:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16504 00000100:00100000:1.0:1746147726.305184:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:32182:x1830967793951104:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147726.305204:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147726.305229:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc30800/0xe64d3fbf12a7da85 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb951 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147726.305255:0:8184:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x6814198f, atime: 0x6814198e, ctime: 0x6814198f, blocks: 0x79f 00010000:00010000:1.0:1746147726.305276:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.305278:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.305287:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc30800/0xe64d3fbf12a7da85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 516096->741375) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb951 expref: 34 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.305301:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cc30800/0xe64d3fbf12a7da85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 516096->741375) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb951 expref: 34 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.305312:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc30800, rc 0) 00000100:00100000:1.0:1746147726.305361:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32182:x1830967793951104:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 177us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.305367:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16504 00000100:00100000:0.0:1746147726.311031:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.312343:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793951360 00000100:00100000:2.0:1746147726.312354:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793951360 00002000:00100000:0.0:1746147726.312730:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (516096->520191) req@ffff88013584aa00 x1830967793951360/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147726.312742:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584aa00 with x1830967793951360 ext(516096->520191) 00002000:00010000:0.0:1746147726.312748:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584aa00 00000100:00100000:0.0:1746147726.312781:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7345 00000100:00100000:0.0:1746147726.312789:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793951360:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147726.313014:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967793951360:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 224us (1993us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147726.313021:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7345 00002000:00100000:0.0:1746147726.313027:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (516096->520191) req@ffff88013584aa00 x1830967793951360/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/4536 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147726.313034:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584aa00 with x1830967793951360 ext(516096->520191) 00002000:00010000:0.0:1746147726.313037:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584aa00 00000100:00100000:1.0:1746147726.319561:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.320232:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793951616 00000100:00100000:2.0:1746147726.320243:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793951616 00002000:00100000:2.0:1746147726.320293:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x455:0x0] (737280->741375) req@ffff88009fd19180 x1830967793951616/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.320303:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19180 with x1830967793951616 ext(737280->741375) 00002000:00010000:2.0:1746147726.320308:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd19180 00000100:00100000:2.0:1746147726.320337:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7346 00000100:00100000:2.0:1746147726.320345:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967793951616:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147726.320547:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967793951616:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 202us (998us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147726.320553:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7346 00002000:00100000:2.0:1746147726.320559:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x455:0x0] (737280->741375) req@ffff88009fd19180 x1830967793951616/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/4536 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.320565:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19180 with x1830967793951616 ext(737280->741375) 00002000:00010000:2.0:1746147726.320567:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd19180 00000100:00100000:0.0:1746147726.330153:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.330265:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793951872 00000100:00100000:3.0:1746147726.330274:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793951872 00000100:00100000:3.0:1746147726.330327:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4999 00000100:00100000:3.0:1746147726.330335:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32182:x1830967793951872:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147726.330562:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32182:x1830967793951872:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 227us (418us total) trans 8589946028 rc 0/0 00000100:00100000:3.0:1746147726.330569:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4999 00000100:00100000:0.0:1746147726.356835:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.357007:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793952128 00000100:00100000:2.0:1746147726.357016:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793952128 00000100:00100000:2.0:1746147726.357075:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12017 00000100:00100000:2.0:1746147726.357082:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32188:x1830967793952128:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147726.357112:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.357130:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1a00/0xe64d3fbf12a7da8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb958 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.357238:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7da93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357250:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7da93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357261:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7da93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357274:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7da9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357279:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7da9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357283:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7da9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357391:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7daa1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357398:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7daa1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357403:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7daa1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147726.357415:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147726.357496:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7da93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357502:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7da93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357508:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7da93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357513:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800935e1200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147726.357517:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7da93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357523:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7da93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357533:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147726.357536:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147726.357540:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7da93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357545:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7da93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357574:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7da9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357579:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7da9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357583:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7da9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357590:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800935e1c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147726.357592:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7da9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357596:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7da9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357601:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bd4a000) 00010000:00010000:2.0:1746147726.357603:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147726.357605:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7da9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357609:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7da9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.357655:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1a00/0xe64d3fbf12a7da8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb958 expref: 330 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.357667:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7daa1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb958 expref: 329 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.359548:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147726.359554:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147726.359558:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935e1800, rc 0) 00000100:00100000:2.0:1746147726.360245:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:32188:x1830967793952128:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3156us (3413us total) trans 8589946029 rc 0/0 00000100:00100000:2.0:1746147726.360256:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12017 00000100:00100000:0.0:1746147726.362579:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.362725:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793952384 00000100:00100000:2.0:1746147726.362735:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793952384 00000100:00100000:3.0:1746147726.363019:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5000 00000100:00100000:3.0:1746147726.363030:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:32188:x1830967793952384:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:3.0:1746147726.363264:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:32188:x1830967793952384:12345-192.168.202.10@tcp:35:cat.0 Request processed in 236us (695us total) trans 8589946030 rc 0/0 00000100:00100000:3.0:1746147726.363271:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5000 00000100:00100000:0.0:1746147726.366040:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.366126:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793952512 00000100:00100000:3.0:1746147726.366135:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793952512 00000100:00100000:3.0:1746147726.366442:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16505 00000100:00100000:3.0:1746147726.366451:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1958:x1830967793952512:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.366755:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.366778:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7daaf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb95f expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147726.366803:0:9615:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x6814198e, atime: 0x6814198e, ctime: 0x6814198e, blocks: 0x81f 00010000:00010000:3.0:1746147726.366826:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.366828:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.366838:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7daaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb95f expref: 34 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.366853:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7daaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb95f expref: 34 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.366865:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dae9e00, rc 0) 00000100:00100000:3.0:1746147726.366953:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967793952512:12345-192.168.202.10@tcp:101:cat.0 Request processed in 502us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.366958:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16505 00000100:00100000:0.0:1746147726.367665:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.367915:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793952640 00000100:00100000:3.0:1746147726.367920:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793952640 00000100:00100000:3.0:1746147726.367949:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16506 00000100:00100000:3.0:1746147726.367954:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967793952640:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.367969:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.367984:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7dab6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb966 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147726.368000:0:9615:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x6814198e, atime: 0x6814198e, ctime: 0x6814198e, blocks: 0x821 00010000:00010000:3.0:1746147726.368011:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.368013:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.368017:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7dab6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb966 expref: 35 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.368028:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7dab6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb966 expref: 35 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.368036:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4eb6600, rc 0) 00000100:00100000:3.0:1746147726.368060:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967793952640:12345-192.168.202.10@tcp:101:cat.0 Request processed in 106us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.368066:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16506 00000100:00100000:2.0:1746147726.369330:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.369350:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.369399:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.369443:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793952768 00000100:00100000:1.0:1746147726.369449:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793952768 00000100:00100000:1.0:1746147726.369476:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793953024 00000100:00100000:3.0:1746147726.369478:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793952896 00000100:00100000:1.0:1746147726.369479:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793953024 00000100:00100000:3.0:1746147726.369481:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793952896 00000100:00100000:1.0:1746147726.369493:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16507 00000100:00100000:3.0:1746147726.369497:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16508 00000100:00100000:1.0:1746147726.369499:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967793952768:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147726.369501:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967793953024:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.369514:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147726.369514:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147726.369530:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7dabd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb96d expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147726.369550:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x6814198e, atime: 0x6814198e, ctime: 0x6814198e, blocks: 0x821 00010000:00010000:1.0:1746147726.369564:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.369565:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.369571:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7dabd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb96d expref: 36 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.369584:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7dabd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb96d expref: 36 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.369593:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc30c00, rc 0) 00000100:00100000:1.0:1746147726.369628:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967793952768:12345-192.168.202.10@tcp:101:cat.0 Request processed in 129us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.369633:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16507 00000100:00100000:1.0:1746147726.369648:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16509 00000100:00100000:1.0:1746147726.369652:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967793952896:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147726.369657:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147726.369664:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dacb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb974 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147726.369676:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x458:0x0] initial LVB size: 5013696, mtime: 0x6814198e, atime: 0x6814198e, ctime: 0x6814198e, blocks: 0x1691 00010000:00010000:1.0:1746147726.369684:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.369685:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.369688:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dacb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb974 expref: 36 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.369696:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dacb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb974 expref: 36 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.369702:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc31c00, rc 0) 00000100:00100000:1.0:1746147726.369728:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967793952896:12345-192.168.202.10@tcp:101:cat.0 Request processed in 75us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.369733:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16509 00010000:00010000:3.0:1746147726.369970:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7dac4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb97b expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147726.369989:0:9615:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x456:0x0] initial LVB size: 4194304, mtime: 0x6814198f, atime: 0x6814198f, ctime: 0x6814198f, blocks: 0x102b 00010000:00010000:3.0:1746147726.369998:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.370001:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.370005:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7dac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb97b expref: 36 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.370015:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7dac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb97b expref: 36 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.370022:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dae8a00, rc 0) 00000100:00100000:3.0:1746147726.370417:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967793953024:12345-192.168.202.10@tcp:101:cat.0 Request processed in 541us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.370423:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16508 00000100:00100000:0.0:1746147726.379260:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.379305:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.379337:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.379386:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.379507:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793953280 00000100:00100000:2.0:1746147726.379519:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793953280 00002000:00100000:2.0:1746147726.379578:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880135848a80 x1830967793953280/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 504/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.379589:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848a80 with x1830967793953280 ext(0->1048575) 00002000:00010000:2.0:1746147726.379596:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135848a80 00000100:00100000:2.0:1746147726.379619:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793953920 00000100:00100000:2.0:1746147726.379624:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793953920 00002000:00100000:2.0:1746147726.379639:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880135849500 x1830967793953920/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.379646:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849500 with x1830967793953920 ext(1048576->2097151) 00002000:00010000:2.0:1746147726.379650:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135849500 00000100:00100000:2.0:1746147726.379663:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793953536 00000100:00100000:2.0:1746147726.379666:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793953536 00002000:00100000:2.0:1746147726.379682:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88008fb74e00 x1830967793953536/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.379689:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb74e00 with x1830967793953536 ext(1048576->2097151) 00002000:00010000:2.0:1746147726.379692:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb74e00 00000100:00100000:2.0:1746147726.379717:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793953792 00000100:00100000:2.0:1746147726.379722:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793953792 00002000:00100000:2.0:1746147726.379737:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88008fb75180 x1830967793953792/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.379743:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb75180 with x1830967793953792 ext(1048576->2097151) 00002000:00010000:2.0:1746147726.379747:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb75180 00000100:00100000:2.0:1746147726.379769:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7347 00000100:00100000:2.0:1746147726.379778:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793953280:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147726.381140:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7348 00000100:00100000:2.0:1746147726.381150:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1958:x1830967793953920:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147726.382788:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7349 00000100:00100000:3.0:1746147726.382800:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1957:x1830967793953536:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147726.384572:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7350 00000100:00100000:3.0:1746147726.384585:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967793953792:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147726.395548:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1958:x1830967793953280:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15759us (16287us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147726.395562:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7347 00002000:00100000:2.0:1746147726.395574:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880135848a80 x1830967793953280/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 504/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.395584:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848a80 with x1830967793953280 ext(0->1048575) 00002000:00010000:2.0:1746147726.395591:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135848a80 00000100:00100000:3.0:1746147726.403599:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967793953536:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20789us (24247us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147726.403610:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7349 00002000:00100000:3.0:1746147726.403623:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88008fb74e00 x1830967793953536/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.403633:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb74e00 with x1830967793953536 ext(1048576->2097151) 00002000:00010000:3.0:1746147726.403640:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb74e00 00000100:00100000:2.0:1746147726.405011:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967793953920:12345-192.168.202.10@tcp:3:cat.0 Request processed in 23855us (25697us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147726.405021:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7348 00002000:00100000:2.0:1746147726.405029:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880135849500 x1830967793953920/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.405037:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849500 with x1830967793953920 ext(1048576->2097151) 00002000:00010000:2.0:1746147726.405042:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135849500 00000100:00100000:3.0:1746147726.406563:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1957:x1830967793953792:12345-192.168.202.10@tcp:3:cat.0 Request processed in 21972us (27168us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147726.406575:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7350 00002000:00100000:3.0:1746147726.406584:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88008fb75180 x1830967793953792/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.406593:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb75180 with x1830967793953792 ext(1048576->2097151) 00002000:00010000:3.0:1746147726.406598:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb75180 00000100:00100000:0.0:1746147726.419127:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.419462:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793954304 00000100:00100000:2.0:1746147726.419476:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793954304 00000100:00100000:2.0:1746147726.419544:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12018 00000100:00100000:2.0:1746147726.419552:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32191:x1830967793954304:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147726.419581:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.419602:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0400/0xe64d3fbf12a7dad2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb982 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.419726:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7dad9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.419740:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7dad9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.419752:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7dad9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.419768:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7dae0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.419774:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7dae0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.419780:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7dae0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.419925:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dae7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.419934:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dae7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.419940:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dae7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147726.419950:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147726.420036:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7dad9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.420044:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7dad9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.420050:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7dad9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.420055:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800935e1200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147726.420059:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7dad9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.420065:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7dad9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.420076:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147726.420079:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147726.420083:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7dad9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.420088:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1200/0xe64d3fbf12a7dad9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.420117:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7dae0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.420122:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7dae0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.420126:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7dae0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.420130:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800935e1600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147726.420133:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7dae0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.420137:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7dae0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.420147:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bd4a000) 00010000:00010000:2.0:1746147726.420148:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147726.420151:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7dae0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.420155:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7dae0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.420196:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0400/0xe64d3fbf12a7dad2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb982 expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.420207:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dae7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb982 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.420213:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147726.420215:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147726.420218:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935e0800, rc 0) 00000100:00100000:2.0:1746147726.420269:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32191:x1830967793954304:12345-192.168.202.10@tcp:101:cat.0 Request processed in 718us (1152us total) trans 8589946031 rc 0/0 00000100:00100000:2.0:1746147726.420276:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12018 00000100:00100000:0.0:1746147726.420997:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.421116:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.421132:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.421171:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.421223:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793954560 00000100:00100000:3.0:1746147726.421229:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793954560 00002000:00100000:3.0:1746147726.421261:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88008fb76680 x1830967793954560/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.421270:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb76680 with x1830967793954560 ext(2097152->3145727) 00002000:00010000:3.0:1746147726.421274:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb76680 00000100:00100000:3.0:1746147726.421294:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793954816 00000100:00100000:3.0:1746147726.421296:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793954816 00002000:00100000:3.0:1746147726.421305:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88008fb75f80 x1830967793954816/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.421311:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb75f80 with x1830967793954816 ext(3145728->4194303) 00002000:00010000:3.0:1746147726.421313:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb75f80 00000100:00100000:3.0:1746147726.421319:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793955072 00000100:00100000:3.0:1746147726.421320:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793955072 00002000:00100000:3.0:1746147726.421329:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88008fb74a80 x1830967793955072/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.421335:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb74a80 with x1830967793955072 ext(2097152->3145727) 00002000:00010000:3.0:1746147726.421337:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb74a80 00000100:00100000:3.0:1746147726.421343:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793955328 00000100:00100000:3.0:1746147726.421345:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793955328 00002000:00100000:3.0:1746147726.421353:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88008fb74700 x1830967793955328/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.421364:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb74700 with x1830967793955328 ext(3145728->4194303) 00002000:00010000:3.0:1746147726.421366:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb74700 00000100:00100000:3.0:1746147726.421374:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7351 00000100:00100000:3.0:1746147726.421379:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1957:x1830967793954560:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147726.422645:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7352 00000100:00100000:0.0:1746147726.422666:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967793954816:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147726.423691:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7353 00000100:00100000:3.0:1746147726.423702:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793955072:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147726.423953:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7354 00000100:00100000:1.0:1746147726.423962:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793955328:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147726.444570:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.445018:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793955584 00000100:00100000:3.0:1746147726.445028:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793955584 00000100:00100000:1.0:1746147726.445676:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967793954560:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24287us (24673us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147726.445687:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7351 00002000:00100000:1.0:1746147726.445701:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88008fb76680 x1830967793954560/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.445721:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb76680 with x1830967793954560 ext(2097152->3145727) 00002000:00010000:1.0:1746147726.445726:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb76680 00000100:00100000:2.0:1746147726.446138:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5001 00000100:00100000:2.0:1746147726.446150:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32191:x1830967793955584:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:2.0:1746147726.446333:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32191:x1830967793955584:12345-192.168.202.10@tcp:35:cat.0 Request processed in 187us (1775us total) trans 8589946032 rc 0/0 00000100:00100000:2.0:1746147726.446339:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5001 00000100:00100000:0.0:1746147726.452520:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.452548:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.452560:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.452581:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.452609:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793955712 00000100:00100000:0.0:1746147726.452617:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793955712 00000100:00100000:0.0:1746147726.452652:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793955840 00000100:00100000:0.0:1746147726.452653:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793955840 00000100:00100000:0.0:1746147726.452663:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793955968 00000100:00100000:0.0:1746147726.452664:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793955968 00000100:00100000:0.0:1746147726.452671:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793956096 00000100:00100000:0.0:1746147726.452673:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793956096 00000100:00100000:0.0:1746147726.452685:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16510 00000100:00100000:0.0:1746147726.452691:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967793955712:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147726.452722:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147726.452740:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931cf600/0xe64d3fbf12a7daf5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb989 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147726.452797:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796457856:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147726.452872:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.452924:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16511 00000100:00100000:0.0:1746147726.452930:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967793955840:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147726.452940:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147726.452954:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7dafc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb990 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.452965:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.452966:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.452978:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7dafc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb990 expref: 25 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.452991:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7dafc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb990 expref: 25 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.453004:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931cf400, rc 0) 00000100:00100000:0.0:1746147726.453023:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967793955840:12345-192.168.202.10@tcp:101:cat.0 Request processed in 93us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.453028:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16511 00000100:00100000:0.0:1746147726.453042:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16512 00000100:00100000:0.0:1746147726.453045:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967793955968:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147726.453050:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147726.453055:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7db03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb997 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.453063:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.453064:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.453067:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7db03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb997 expref: 25 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.453075:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7db03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb997 expref: 25 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.453081:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931ce600, rc 0) 00000100:00100000:0.0:1746147726.453090:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967793955968:12345-192.168.202.10@tcp:101:cat.0 Request processed in 44us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.453094:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16512 00000100:00100000:0.0:1746147726.453100:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16513 00000100:00100000:0.0:1746147726.453103:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967793956096:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147726.453107:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147726.453111:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931cf800/0xe64d3fbf12a7db0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb99e expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.453119:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.453120:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.453123:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931cf800/0xe64d3fbf12a7db0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb99e expref: 28 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.453131:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931cf800/0xe64d3fbf12a7db0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb99e expref: 28 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.453137:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931cf800, rc 0) 00000100:00100000:0.0:1746147726.453146:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793956096:12345-192.168.202.10@tcp:101:cat.0 Request processed in 42us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.453150:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16513 00000100:00100000:0.0:1746147726.453171:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.453181:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793956224 00000100:00100000:0.0:1746147726.453189:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793956224 00000100:00100000:0.0:1746147726.453200:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16514 00000100:00100000:0.0:1746147726.453203:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793956224:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147726.453208:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147726.453213:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931ce400/0xe64d3fbf12a7db11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb9a5 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.453221:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.453222:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.453225:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931ce400/0xe64d3fbf12a7db11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9a5 expref: 29 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.453232:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931ce400/0xe64d3fbf12a7db11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9a5 expref: 29 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.453238:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931ce400, rc 0) 00000100:00100000:0.0:1746147726.453249:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967793956224:12345-192.168.202.10@tcp:101:cat.0 Request processed in 45us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.453253:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16514 00000100:00100000:0.0:1746147726.453312:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.453321:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793956352 00000100:00100000:0.0:1746147726.453323:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793956352 00000100:00100000:0.0:1746147726.453335:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16515 00000100:00100000:0.0:1746147726.453339:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967793956352:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147726.453344:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147726.453349:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931cfc00/0xe64d3fbf12a7db18 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb9ac expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.453357:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.453358:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.453361:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931cfc00/0xe64d3fbf12a7db18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ac expref: 26 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.453368:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931cfc00/0xe64d3fbf12a7db18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ac expref: 26 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.453374:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931cfc00, rc 0) 00000100:00100000:0.0:1746147726.453385:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793956352:12345-192.168.202.10@tcp:101:cat.0 Request processed in 45us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.453389:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16515 00000100:00100000:0.0:1746147726.454278:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.455269:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793956480 00000100:00100000:3.0:1746147726.455278:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793956480 00000100:00100000:3.0:1746147726.455321:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16516 00000100:00100000:3.0:1746147726.455329:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32180:x1830967793956480:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147726.455345:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.455362:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb9b3 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.455390:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7dab6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb966 expref: 39 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.455398:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7db03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb997 expref: 27 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.455404:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.455406:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.455409:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1679360->2097151] (req 1679360->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 27 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.455440:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7db03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb997 expref: 27 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.455451:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7db03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb997 expref: 27 pid: 21480 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.455463:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796457984:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.455544:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7dab6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb966 expref: 39 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.455551:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7dab6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb966 expref: 39 pid: 9615 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.455559:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796458112:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.455579:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.456144:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1957:x1830967793954816:12345-192.168.202.10@tcp:3:cat.0 Request processed in 33485us (35024us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147726.456157:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7352 00002000:00100000:2.0:1746147726.456166:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88008fb75f80 x1830967793954816/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.456175:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb75f80 with x1830967793954816 ext(3145728->4194303) 00002000:00010000:2.0:1746147726.456180:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb75f80 00000100:00100000:1.0:1746147726.464314:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.464337:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796457984:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147726.464341:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793956608 00000100:00100000:1.0:1746147726.464347:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793956608 00000100:00100000:3.0:1746147726.464348:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796458112:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.464385:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1679360->2097151] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 28 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.464385:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7db03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb997 expref: 28 pid: 21480 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.464401:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fc4c00, rc 0) 00000100:00100000:1.0:1746147726.464416:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8376 00000100:00100000:1.0:1746147726.464425:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967793956608:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147726.464437:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147726.464445:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32180:x1830967793956480:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 9117us (10171us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.464455:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16516 00010000:00010000:1.0:1746147726.464457:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7db03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb997 expref: 28 pid: 21480 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.464468:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7db03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb997 expref: 27 pid: 21480 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.464491:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931ce600/0xe64d3fbf12a7db03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb997 expref: 27 pid: 21480 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.464506:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147726.464521:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967793956608:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 99us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.464527:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8376 00000100:00100000:1.0:1746147726.464571:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.464584:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793956736 00000100:00100000:1.0:1746147726.464586:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793956736 00010000:00010000:1.0:1746147726.464599:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7dab6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb966 expref: 40 pid: 9615 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746147726.464614:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8377 00000100:00100000:1.0:1746147726.464618:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1957:x1830967793956736:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147726.464627:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147726.464634:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7dab6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb966 expref: 40 pid: 9615 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.464642:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7dab6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb966 expref: 40 pid: 9615 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.464652:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4eb6600/0xe64d3fbf12a7dab6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb966 expref: 40 pid: 9615 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.464662:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.464664:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.464670:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 25 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.464678:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 25 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.464719:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 25 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147726.464731:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796458240:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147726.464758:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793955072:12345-192.168.202.10@tcp:3:cat.0 Request processed in 41057us (43623us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147726.464765:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7353 00000100:00100000:2.0:1746147726.464770:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793955328:12345-192.168.202.10@tcp:3:cat.0 Request processed in 40808us (43597us total) trans 0 rc 1048576/1048576 00002000:00100000:3.0:1746147726.464773:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88008fb74a80 x1830967793955072/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147726.464776:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.464777:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7354 00002000:00100000:3.0:1746147726.464781:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb74a80 with x1830967793955072 ext(2097152->3145727) 00002000:00100000:2.0:1746147726.464784:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88008fb74700 x1830967793955328/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746147726.464785:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb74a80 00002000:00100000:2.0:1746147726.464792:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb74700 with x1830967793955328 ext(3145728->4194303) 00002000:00010000:2.0:1746147726.464795:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb74700 00002000:00010000:3.0:1746147726.464836:0:8184:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime: 1746147726 -> 1746147727 00000100:00100000:3.0:1746147726.464850:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fb77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796457856:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147726.464873:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931cf600/0xe64d3fbf12a7daf5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb989 expref: 28 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.464902:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931cf600/0xe64d3fbf12a7daf5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb989 expref: 28 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.464914:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931cf600, rc 0) 00000100:00100000:3.0:1746147726.464934:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793955712:12345-192.168.202.10@tcp:101:cat.0 Request processed in 12243us (12425us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147726.464938:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.464939:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16510 00000100:00100000:2.0:1746147726.465293:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793956992 00000100:00100000:2.0:1746147726.465297:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793956992 00000100:00100000:2.0:1746147726.465966:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12019 00000100:00100000:2.0:1746147726.465975:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:32193:x1830967793956992:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147726.465995:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.466011:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0400/0xe64d3fbf12a7db26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb9ba expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.466103:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.466117:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7daa1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb958 expref: 331 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.466129:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dae7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb982 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.466135:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 5/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.466159:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dae7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb982 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.466170:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dae7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb982 expref: 12 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.466188:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796458368:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.466266:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7daa1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb958 expref: 331 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.466274:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7daa1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb958 expref: 331 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.466282:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796458496:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.466302:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.470340:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796458368:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.470352:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796458496:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.470378:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:1.0:1746147726.470459:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796458240:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147726.470470:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147726.470524:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967793956736:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5904us (5951us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.470538:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8377 00000100:00100000:0.0:1746147726.472134:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.474274:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.475174:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.475206:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.475277:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.475367:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793957376 00000100:00100000:2.0:1746147726.475376:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793957376 00000100:00100000:2.0:1746147726.475411:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793957760 00000100:00100000:2.0:1746147726.475413:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793957760 00000100:00100000:2.0:1746147726.475436:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16517 00000100:00100000:2.0:1746147726.475443:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32191:x1830967793957376:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147726.475463:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.475479:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935e1200/0xe64d3fbf12a7db34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb9c1 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.475508:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cc30800/0xe64d3fbf12a7da85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->741375) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb951 expref: 35 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.475516:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147726.475518:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147726.475521:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935e1200/0xe64d3fbf12a7db34 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9c1 expref: 28 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.475550:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cc30800/0xe64d3fbf12a7da85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->741375) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb951 expref: 35 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.475561:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cc30800/0xe64d3fbf12a7da85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->741375) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb951 expref: 35 pid: 8184 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.475572:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796458624:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.475636:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.475654:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793957632 00000100:00100000:2.0:1746147726.475658:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793957632 00002000:00100000:2.0:1746147726.475682:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x455:0x0] (1679360->1683455) req@ffff88009d0dca80 x1830967793957632/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.475691:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dca80 with x1830967793957632 ext(1679360->1683455) 00002000:00010000:2.0:1746147726.475694:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0dca80 00000100:00100000:2.0:1746147726.475716:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7355 00000100:00100000:2.0:1746147726.475721:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793957632:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147726.475952:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793957248 00000100:00100000:3.0:1746147726.475956:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793957248 00010000:00010000:3.0:1746147726.475977:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7daa1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb958 expref: 332 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746147726.475982:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793957120 00000100:00100000:1.0:1746147726.475994:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793957120 00000100:00100000:3.0:1746147726.475999:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8378 00000100:00100000:3.0:1746147726.476003:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+332:1959:x1830967793957248:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.476013:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.476017:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7daa1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb958 expref: 332 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746147726.476024:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16518 00010000:00010000:3.0:1746147726.476027:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7daa1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb958 expref: 332 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746147726.476037:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967793957760:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.476046:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1800/0xe64d3fbf12a7daa1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb958 expref: 332 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147726.476054:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.476063:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147726.476068:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.476070:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ed3c00/0xe64d3fbf12a7db3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb9c8 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.476075:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.476080:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.476103:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+331:1959:x1830967793957248:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 98us (3977us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.476109:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8378 00000100:00100000:1.0:1746147726.476114:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796458752:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147726.476181:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dae7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb982 expref: 13 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746147726.476184:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147726.476200:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8379 00000100:00100000:3.0:1746147726.476204:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967793957120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.476210:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.476213:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dae7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb982 expref: 13 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.476220:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dae7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb982 expref: 13 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.476236:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dae7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb982 expref: 13 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.476244:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147726.476246:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.476253:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.476258:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.476274:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.476293:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967793957120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 88us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.476297:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8379 00010000:00010000:3.0:1746147726.476318:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.476324:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:3.0:1746147726.476342:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147726.476517:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e0400/0xe64d3fbf12a7db26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ba expref: 332 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.476529:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ba expref: 331 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.476534:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147726.476537:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147726.476539:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935e1600, rc 0) 00000100:00100000:3.0:1746147726.476562:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+331:32193:x1830967793956992:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 10590us (11625us total) trans 8589946033 rc 0/0 00000100:00100000:3.0:1746147726.476568:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12019 00000100:00100000:2.0:1746147726.477464:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793957632:12345-192.168.202.10@tcp:3:cat.0 Request processed in 1739us (2253us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147726.477472:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7355 00002000:00100000:2.0:1746147726.477481:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x455:0x0] (1679360->1683455) req@ffff88009d0dca80 x1830967793957632/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/4536 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.477489:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dca80 with x1830967793957632 ext(1679360->1683455) 00002000:00010000:2.0:1746147726.477494:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0dca80 00000100:00100000:0.0:1746147726.480046:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:1.0:1746147726.480158:0:9615:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime: 1746147726 -> 1746147727 00002000:00010000:1.0:1746147726.480164:0:9615:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime: 1746147726 -> 1746147727 00002000:00010000:1.0:1746147726.480166:0:9615:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime: 1746147726 -> 1746147727 00000100:00100000:1.0:1746147726.480190:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796458752:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147726.480225:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129ed3c00/0xe64d3fbf12a7db3b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9c8 expref: 36 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.480241:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ed3c00/0xe64d3fbf12a7db3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9c8 expref: 36 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.480257:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed3c00, rc 0) 00000100:00100000:3.0:1746147726.480268:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793957888 00000100:00100000:3.0:1746147726.480279:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793957888 00000100:00100000:1.0:1746147726.480303:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967793957760:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4271us (5024us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147726.480312:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16518 00002000:00100000:3.0:1746147726.480324:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (516096->741375) req@ffff88009d0df100 x1830967793957888/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.480333:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0df100 with x1830967793957888 ext(516096->741375) 00010000:00010000:3.0:1746147726.480341:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cc30800/0xe64d3fbf12a7da85 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->741375) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb951 expref: 36 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.480354:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cc30800/0xe64d3fbf12a7da85 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->741375) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb951 expref: 36 pid: 8184 timeout: 905 lvb_type: 0 00002000:00010000:3.0:1746147726.480361:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d0df100 00000100:00100000:3.0:1746147726.480381:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1463 00000100:00100000:3.0:1746147726.480388:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967793957888:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147726.480576:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796458624:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.480601:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935e1200/0xe64d3fbf12a7db34 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9c1 expref: 28 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.480614:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935e1200, rc 0) 00000100:00100000:2.0:1746147726.480648:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32191:x1830967793957376:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5205us (5476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.480654:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16517 00000100:00100000:3.0:1746147726.485810:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1960:x1830967793957888:12345-192.168.202.10@tcp:4:cat.0 Request processed in 5414us (5767us total) trans 17179874383 rc 0/0 00000100:00100000:3.0:1746147726.485822:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1463 00002000:00100000:3.0:1746147726.485832:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (516096->741375) req@ffff88009d0df100 x1830967793957888/t17179874383(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/448 e 0 to 0 dl 1746147737 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.485840:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0df100 with x1830967793957888 ext(516096->741375) 00010000:00010000:3.0:1746147726.485849:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cc30800/0xe64d3fbf12a7da85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->741375) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb951 expref: 38 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.485864:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cc30800/0xe64d3fbf12a7da85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->741375) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb951 expref: 38 pid: 8184 timeout: 905 lvb_type: 0 00002000:00010000:3.0:1746147726.485870:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d0df100 00000100:00100000:2.0:1746147726.486601:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.487839:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793958144 00000100:00100000:3.0:1746147726.487847:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793958144 00002000:00100000:3.0:1746147726.487878:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800956b7b80 x1830967793958144/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.487914:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b7b80 with x1830967793958144 ext(4194304->5017599) 00002000:00010000:3.0:1746147726.487919:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b7b80 00000100:00100000:3.0:1746147726.487939:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7356 00000100:00100000:3.0:1746147726.487945:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967793958144:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147726.490807:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.492148:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.492269:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793958400 00000100:00100000:2.0:1746147726.492279:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793958400 00010000:00010000:2.0:1746147726.492320:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc30800/0xe64d3fbf12a7da85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->741375) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb951 expref: 40 pid: 8184 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.492365:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8380 00000100:00100000:2.0:1746147726.492374:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1957:x1830967793958400:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147726.492389:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147726.492443:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793958272 00000100:00100000:3.0:1746147726.492448:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793958272 00000100:00100000:3.0:1746147726.492473:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16519 00000100:00100000:3.0:1746147726.492480:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32180:x1830967793958272:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147726.492498:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.492512:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb9cf expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.492538:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7dabd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb96d expref: 40 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.492548:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931cf800/0xe64d3fbf12a7db0a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb99e expref: 29 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.492554:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.492556:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.492560:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1527807] (req 1048576->1527807) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 29 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.492593:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931cf800/0xe64d3fbf12a7db0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb99e expref: 29 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.492605:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931cf800/0xe64d3fbf12a7db0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb99e expref: 29 pid: 21480 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.492618:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796458880:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.492718:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7dabd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb96d expref: 40 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.492727:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7dabd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb96d expref: 40 pid: 8468 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.492736:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796459008:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.492764:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147726.492986:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cc30800/0xe64d3fbf12a7da85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->741375) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb951 expref: 40 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.493026:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cc30800/0xe64d3fbf12a7da85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->741375) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb951 expref: 40 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.493045:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc30800/0xe64d3fbf12a7da85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->741375) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb951 expref: 40 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.493364:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.493366:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.493373:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935e1200/0xe64d3fbf12a7db34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9c1 expref: 29 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.493382:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935e1200/0xe64d3fbf12a7db34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9c1 expref: 29 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.493404:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800935e1200/0xe64d3fbf12a7db34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9c1 expref: 29 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147726.493411:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796459136:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147726.493459:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147726.497425:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796458880:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.497444:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796459008:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.497482:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1527807] (req 1048576->1527807) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 29 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.497502:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c9f5e00, rc 0) 00000100:00100000:3.0:1746147726.497564:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:32180:x1830967793958272:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5082us (6769us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.497574:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16519 00000100:00100000:3.0:1746147726.497954:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967793958144:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10008us (11353us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746147726.497962:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7356 00002000:00100000:3.0:1746147726.497971:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800956b7b80 x1830967793958144/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.497979:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b7b80 with x1830967793958144 ext(4194304->5017599) 00002000:00010000:3.0:1746147726.497984:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b7b80 00000100:00100000:2.0:1746147726.498066:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796459136:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147726.498078:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147726.498098:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1957:x1830967793958400:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5726us (5958us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.498106:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8380 00000100:00100000:0.0:1746147726.500797:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.500834:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.500873:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793958528 00000100:00100000:2.0:1746147726.500910:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793958528 00000100:00100000:1.0:1746147726.500914:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793958656 00000100:00100000:1.0:1746147726.500922:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793958656 00010000:00010000:2.0:1746147726.500948:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7dabd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb96d expref: 37 pid: 8468 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.500948:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931cf800/0xe64d3fbf12a7db0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb99e expref: 29 pid: 21480 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746147726.500986:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8381 00000100:00100000:1.0:1746147726.500993:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967793958656:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147726.501004:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147726.501027:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931cf800/0xe64d3fbf12a7db0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb99e expref: 29 pid: 21480 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.501030:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8382 00000100:00100000:2.0:1746147726.501036:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6671c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1959:x1830967793958528:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147726.501038:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931cf800/0xe64d3fbf12a7db0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb99e expref: 29 pid: 21480 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.501049:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147726.501057:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931cf800/0xe64d3fbf12a7db0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb99e expref: 29 pid: 21480 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.501066:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7dabd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb96d expref: 37 pid: 8468 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.501077:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7dabd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb96d expref: 37 pid: 8468 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.501145:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147726.501177:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793958656:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 184us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.501184:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8381 00010000:00010000:2.0:1746147726.501243:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7dabd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb96d expref: 37 pid: 8468 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.501267:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.501269:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.501276:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.501295:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.501330:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147726.501344:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796459264:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147726.502237:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.508074:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796459264:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147726.508095:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147726.508131:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6671c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967793958528:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7095us (7340us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.508141:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8382 00000100:00100000:0.0:1746147726.509727:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.510730:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.510751:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.510764:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.510776:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.510815:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.510832:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793959168 00000100:00100000:0.0:1746147726.510838:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793959168 00000100:00100000:0.0:1746147726.510878:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793959680 00000100:00100000:0.0:1746147726.510880:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793959680 00000100:00100000:0.0:1746147726.510903:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793959808 00000100:00100000:0.0:1746147726.510905:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793959808 00000100:00100000:0.0:1746147726.510915:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16520 00000100:00100000:0.0:1746147726.510921:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793959168:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147726.510936:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147726.510950:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7db50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb9d6 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.510966:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.510968:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.510974:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7db50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9d6 expref: 38 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.510985:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7db50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9d6 expref: 38 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.510998:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931cfa00, rc 0) 00000100:00100000:0.0:1746147726.511028:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1958:x1830967793959168:12345-192.168.202.10@tcp:101:cat.0 Request processed in 108us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.511033:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16520 00000100:00100000:1.0:1746147726.511056:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16521 00000100:00100000:1.0:1746147726.511072:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967793959680:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147726.511089:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147726.511105:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ed2800/0xe64d3fbf12a7db57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb9dd expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147726.511156:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796459392:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147726.511226:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.511540:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793958912 00000100:00100000:2.0:1746147726.511546:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793958912 00002000:00100000:2.0:1746147726.511577:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009d0ddf80 x1830967793958912/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.511587:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0ddf80 with x1830967793958912 ext(0->1048575) 00002000:00010000:2.0:1746147726.511590:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d0ddf80 00000100:00100000:2.0:1746147726.511608:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793959296 00000100:00100000:2.0:1746147726.511610:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793959296 00002000:00100000:2.0:1746147726.511626:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009d0dea00 x1830967793959296/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.511636:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dea00 with x1830967793959296 ext(1048576->2097151) 00002000:00010000:2.0:1746147726.511639:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0dea00 00000100:00100000:2.0:1746147726.511651:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793959424 00000100:00100000:2.0:1746147726.511653:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793959424 00002000:00100000:2.0:1746147726.511667:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1679359) req@ffff88009d0ddc00 x1830967793959424/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.511672:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0ddc00 with x1830967793959424 ext(1048576->1679359) 00002000:00010000:2.0:1746147726.511674:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0ddc00 00000100:00100000:2.0:1746147726.511689:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7357 00000100:00100000:2.0:1746147726.511698:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793958912:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147726.512109:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16522 00000100:00100000:0.0:1746147726.512117:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793959808:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147726.512124:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147726.512132:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931cf000/0xe64d3fbf12a7db5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb9e4 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147726.512145:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7358 00000100:00100000:1.0:1746147726.512154:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967793959296:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147726.512168:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796459520:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147726.512228:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147726.512240:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7359 00000100:00100000:3.0:1746147726.512247:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793959424:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147726.512598:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.512612:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793960064 00000100:00100000:0.0:1746147726.512615:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793960064 00002000:00100000:0.0:1746147726.512628:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1523712->1527807) req@ffff880135810000 x1830967793960064/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147726.512722:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135810000 with x1830967793960064 ext(1523712->1527807) 00002000:00010000:0.0:1746147726.512725:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135810000 00000100:00100000:0.0:1746147726.512736:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7360 00000100:00100000:0.0:1746147726.512741:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967793960064:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147726.512836:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967793960064:12345-192.168.202.10@tcp:3:cat.0 Request processed in 94us (238us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147726.512845:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7360 00002000:00100000:0.0:1746147726.512849:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1523712->1527807) req@ffff880135810000 x1830967793960064/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/4536 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147726.512856:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135810000 with x1830967793960064 ext(1523712->1527807) 00002000:00010000:0.0:1746147726.512858:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135810000 00000100:00100000:1.0:1746147726.515082:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796459392:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147726.515120:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129ed2800/0xe64d3fbf12a7db57 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9dd expref: 36 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.515135:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ed2800/0xe64d3fbf12a7db57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9dd expref: 36 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.515156:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed2800, rc 0) 00000100:00100000:1.0:1746147726.515206:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967793959680:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4138us (4426us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147726.515215:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16521 00002000:00010000:3.0:1746147726.515437:0:7050:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime: 1746147726 -> 1746147727 00002000:00010000:3.0:1746147726.515442:0:7050:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime: 1746147726 -> 1746147727 00002000:00010000:3.0:1746147726.515444:0:7050:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime: 1746147726 -> 1746147727 00000100:00100000:3.0:1746147726.515460:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796459520:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147726.515484:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931cf000/0xe64d3fbf12a7db5e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9e4 expref: 38 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.515496:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931cf000/0xe64d3fbf12a7db5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9e4 expref: 38 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.515508:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931cf000, rc 0) 00000100:00100000:3.0:1746147726.515542:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793959808:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3425us (4725us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147726.515549:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16522 00000100:00100000:0.0:1746147726.526194:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.526275:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.526341:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793960320 00000100:00100000:3.0:1746147726.526349:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793960320 00000100:00100000:3.0:1746147726.526387:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5002 00000100:00100000:3.0:1746147726.526394:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a666b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32180:x1830967793960320:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147726.526601:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a666b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32180:x1830967793960320:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 206us (413us total) trans 8589946034 rc 0/0 00000100:00100000:2.0:1746147726.526607:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793959424:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14353us (15833us total) trans 0 rc 630784/630784 00000100:00100000:3.0:1746147726.526608:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5002 00000100:00100000:2.0:1746147726.526619:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7359 00002000:00100000:2.0:1746147726.526631:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1679359) req@ffff88009d0ddc00 x1830967793959424/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 630784/630784 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.526642:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0ddc00 with x1830967793959424 ext(1048576->1679359) 00002000:00010000:2.0:1746147726.526647:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0ddc00 00000100:00100000:3.0:1746147726.526649:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793960448 00000100:00100000:3.0:1746147726.526652:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793960448 00000100:00100000:3.0:1746147726.526673:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16523 00000100:00100000:3.0:1746147726.526677:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967793960448:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.526687:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.526700:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c9f4a00/0xe64d3fbf12a7db65 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb9eb expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147726.526761:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796459648:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147726.526828:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.528779:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.529632:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793959296:12345-192.168.202.10@tcp:3:cat.0 Request processed in 17477us (18876us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147726.529642:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7358 00002000:00100000:1.0:1746147726.529652:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009d0dea00 x1830967793959296/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.529660:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dea00 with x1830967793959296 ext(1048576->2097151) 00002000:00010000:1.0:1746147726.529665:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0dea00 00000100:00100000:2.0:1746147726.529992:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793960576 00000100:00100000:2.0:1746147726.530005:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793960576 00000100:00100000:2.0:1746147726.530055:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16524 00000100:00100000:2.0:1746147726.530063:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793960576:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147726.530084:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.530116:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f819400/0xe64d3fbf12a7db6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb9f2 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147726.530176:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796459776:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147726.530267:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.534163:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793958912:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22460us (24431us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147726.534175:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7357 00002000:00100000:0.0:1746147726.534186:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009d0ddf80 x1830967793958912/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147726.534193:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0ddf80 with x1830967793958912 ext(0->1048575) 00002000:00010000:0.0:1746147726.534199:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d0ddf80 00000100:00100000:3.0:1746147726.537582:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796459648:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147726.537584:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796459776:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147726.537616:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c9f4a00/0xe64d3fbf12a7db65 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9eb expref: 36 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.537616:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f819400/0xe64d3fbf12a7db6c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f2 expref: 38 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.537630:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f819400/0xe64d3fbf12a7db6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f2 expref: 38 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.537633:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c9f4a00/0xe64d3fbf12a7db65 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9eb expref: 36 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.537661:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c9f4a00, rc 0) 00000100:00100000:3.0:1746147726.537699:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967793960448:12345-192.168.202.10@tcp:101:cat.0 Request processed in 11020us (11423us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147726.537716:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16523 00010000:00010000:2.0:1746147726.538666:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f819400, rc 0) 00000100:00100000:2.0:1746147726.538725:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793960576:12345-192.168.202.10@tcp:101:cat.0 Request processed in 8661us (9951us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147726.538732:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16524 00000100:00100000:2.0:1746147726.543443:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.543531:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793960832 00000100:00100000:0.0:1746147726.543542:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793960832 00002000:00100000:0.0:1746147726.543591:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1527808->2097151) req@ffff8800956b6680 x1830967793960832/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147726.543602:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b6680 with x1830967793960832 ext(1527808->2097151) 00002000:00010000:0.0:1746147726.543608:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b6680 00000100:00100000:0.0:1746147726.543638:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7361 00000100:00100000:0.0:1746147726.543646:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793960832:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147726.553541:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793960832:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9883us (10096us total) trans 0 rc 569344/569344 00000100:00100000:2.0:1746147726.553555:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7361 00002000:00100000:2.0:1746147726.553569:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1527808->2097151) req@ffff8800956b6680 x1830967793960832/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 569344/569344 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.553579:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b6680 with x1830967793960832 ext(1527808->2097151) 00002000:00010000:2.0:1746147726.553585:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b6680 00000100:00100000:0.0:1746147726.572475:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.572518:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.572545:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.572609:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.572688:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793961088 00000100:00100000:1.0:1746147726.572700:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793961088 00000100:00100000:3.0:1746147726.572714:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793961344 00000100:00100000:3.0:1746147726.572722:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793961344 00002000:00100000:1.0:1746147726.572756:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880135812300 x1830967793961088/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.572757:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880135813100 x1830967793961344/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.572765:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135813100 with x1830967793961344 ext(3145728->4194303) 00002000:00100000:1.0:1746147726.572765:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812300 with x1830967793961088 ext(2097152->3145727) 00002000:00010000:3.0:1746147726.572771:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135813100 00002000:00010000:1.0:1746147726.572771:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135812300 00000100:00100000:3.0:1746147726.572790:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793961600 00000100:00100000:3.0:1746147726.572792:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793961600 00002000:00100000:3.0:1746147726.572810:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880135813480 x1830967793961600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.572817:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135813480 with x1830967793961600 ext(2097152->3145727) 00002000:00010000:3.0:1746147726.572821:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135813480 00000100:00100000:1.0:1746147726.573201:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793961728 00000100:00100000:1.0:1746147726.573206:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793961728 00002000:00100000:1.0:1746147726.573221:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880135811880 x1830967793961728/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.573228:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135811880 with x1830967793961728 ext(3145728->4194303) 00002000:00010000:1.0:1746147726.573231:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135811880 00000100:00100000:1.0:1746147726.573247:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7362 00000100:00100000:1.0:1746147726.573254:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967793961344:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147726.573562:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7363 00000100:00100000:2.0:1746147726.573570:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7364 00000100:00100000:3.0:1746147726.573571:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967793961088:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147726.573580:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793961600:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147726.574036:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7365 00000100:00100000:0.0:1746147726.574045:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793961728:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147726.579998:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.580073:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793961984 00000100:00100000:2.0:1746147726.580081:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793961984 00000100:00100000:2.0:1746147726.580131:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16525 00000100:00100000:2.0:1746147726.580138:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:32193:x1830967793961984:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147726.580158:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.580176:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafb9f9 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.580204:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7dac4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb97b expref: 36 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.580213:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931cfc00/0xe64d3fbf12a7db18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ac expref: 29 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.580218:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.580220:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.580222:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 36 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.580249:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931cfc00/0xe64d3fbf12a7db18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ac expref: 29 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.580259:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931cfc00/0xe64d3fbf12a7db18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ac expref: 29 pid: 21480 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.580269:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796459904:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.580344:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7dac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb97b expref: 36 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.580356:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7dac4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb97b expref: 36 pid: 9615 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.580364:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796460032:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.580383:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.597480:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796459904:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147726.597878:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.600822:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793962112 00000100:00100000:3.0:1746147726.600837:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793962112 00010000:00010000:3.0:1746147726.600907:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7dac4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb97b expref: 37 pid: 9615 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.600966:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8383 00000100:00100000:3.0:1746147726.600975:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793962112:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.600992:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.601015:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7dac4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb97b expref: 37 pid: 9615 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.601027:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7dac4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb97b expref: 37 pid: 9615 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.601053:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.601110:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793962112:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 137us (3234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.601116:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8383 00000100:00100000:0.0:1746147726.602358:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967793961344:12345-192.168.202.10@tcp:3:cat.0 Request processed in 29100us (29834us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147726.602368:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7362 00002000:00100000:0.0:1746147726.602376:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880135813100 x1830967793961344/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147726.602385:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135813100 with x1830967793961344 ext(3145728->4194303) 00002000:00010000:0.0:1746147726.602390:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135813100 00000100:00100000:3.0:1746147726.603386:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793961088:12345-192.168.202.10@tcp:3:cat.0 Request processed in 29815us (30926us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147726.603395:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7363 00002000:00100000:3.0:1746147726.603402:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880135812300 x1830967793961088/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.603416:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812300 with x1830967793961088 ext(2097152->3145727) 00002000:00010000:3.0:1746147726.603419:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135812300 00010000:00010000:2.0:1746147726.604038:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dae8a00/0xe64d3fbf12a7dac4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb97b expref: 36 pid: 9615 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.604075:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796460032:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.604102:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 35 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.604119:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0562600, rc 0) 00000100:00100000:2.0:1746147726.604163:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:32193:x1830967793961984:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 24025us (24176us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.604171:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16525 00000100:00100000:1.0:1746147726.606342:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793961728:12345-192.168.202.10@tcp:3:cat.0 Request processed in 32287us (33720us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147726.606354:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7365 00002000:00100000:1.0:1746147726.606364:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880135811880 x1830967793961728/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.606373:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135811880 with x1830967793961728 ext(3145728->4194303) 00010000:00010000:1.0:1746147726.606383:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931cfc00/0xe64d3fbf12a7db18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ac expref: 28 pid: 21480 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746147726.606398:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931cfc00/0xe64d3fbf12a7db18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ac expref: 28 pid: 21480 timeout: 905 lvb_type: 1 00002000:00010000:1.0:1746147726.606406:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135811880 00000100:00100000:2.0:1746147726.606972:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967793961600:12345-192.168.202.10@tcp:3:cat.0 Request processed in 33394us (34424us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147726.606979:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7364 00002000:00100000:2.0:1746147726.606985:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880135813480 x1830967793961600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.606992:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135813480 with x1830967793961600 ext(2097152->3145727) 00010000:00010000:2.0:1746147726.606997:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931cfc00/0xe64d3fbf12a7db18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ac expref: 26 pid: 21480 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.607005:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931cfc00/0xe64d3fbf12a7db18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ac expref: 26 pid: 21480 timeout: 905 lvb_type: 1 00002000:00010000:2.0:1746147726.607011:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135813480 00000100:00100000:0.0:1746147726.613308:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.613393:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793962240 00000100:00100000:2.0:1746147726.613403:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793962240 00000100:00100000:2.0:1746147726.613447:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16526 00000100:00100000:2.0:1746147726.613455:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32191:x1830967793962240:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147726.613476:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.613495:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7db7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba00 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.613525:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.613532:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 34 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.613539:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147726.613542:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7db7a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba00 expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.613580:0:8184:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 34 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.613592:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7db7a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba00 expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.613608:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0562c00, rc 0) 00000100:00100000:2.0:1746147726.614090:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32191:x1830967793962240:12345-192.168.202.10@tcp:101:cat.0 Request processed in 634us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.614097:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16526 00000100:00100000:1.0:1746147726.618293:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.618396:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793962368 00000100:00100000:2.0:1746147726.618406:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793962368 00010000:00010000:2.0:1746147726.618445:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931cfc00/0xe64d3fbf12a7db18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ac expref: 27 pid: 21480 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.619659:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8384 00000100:00100000:3.0:1746147726.619673:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793962368:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.619690:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.619724:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931cfc00/0xe64d3fbf12a7db18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ac expref: 27 pid: 21480 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.619738:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931cfc00/0xe64d3fbf12a7db18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ac expref: 27 pid: 21480 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.619762:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931cfc00/0xe64d3fbf12a7db18 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ac expref: 27 pid: 21480 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.620133:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.620135:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.620144:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 34 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.620152:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 34 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.620189:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 34 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.620204:0:20557:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 34 pid: 8184 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.620216:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796460288:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147726.620325:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147726.622640:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796460288:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147726.622669:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.622872:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967793962368:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3203us (4588us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.623002:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8384 00000100:00100000:0.0:1746147726.625673:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.625851:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793962624 00000100:00100000:2.0:1746147726.625861:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793962624 00002000:00100000:2.0:1746147726.625951:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2588672->2592767) req@ffff880135813b80 x1830967793962624/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.625961:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135813b80 with x1830967793962624 ext(2588672->2592767) 00010000:00010000:2.0:1746147726.625971:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 35 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.625988:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 35 pid: 8184 timeout: 905 lvb_type: 0 00002000:00010000:2.0:1746147726.625995:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135813b80 00000100:00100000:2.0:1746147726.626026:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1464 00000100:00100000:2.0:1746147726.626034:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967793962624:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147726.626220:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967793962624:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 186us (557us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147726.626227:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1464 00002000:00100000:2.0:1746147726.626233:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2588672->2592767) req@ffff880135813b80 x1830967793962624/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/4536 e 0 to 0 dl 1746147737 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.626240:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135813b80 with x1830967793962624 ext(2588672->2592767) 00010000:00010000:2.0:1746147726.626250:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 35 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.626258:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 35 pid: 8184 timeout: 905 lvb_type: 0 00002000:00010000:2.0:1746147726.626264:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135813b80 00000100:00100000:0.0:1746147726.632689:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.632760:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.632861:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793962880 00000100:00100000:1.0:1746147726.632871:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793962880 00002000:00100000:1.0:1746147726.632964:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2588672->3145727) req@ffff880135810a80 x1830967793962880/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.632975:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135810a80 with x1830967793962880 ext(2588672->3145727) 00010000:00010000:1.0:1746147726.632985:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 35 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147726.633001:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 35 pid: 8184 timeout: 905 lvb_type: 0 00002000:00010000:1.0:1746147726.633009:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135810a80 00000100:00100000:1.0:1746147726.633045:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1465 00000100:00100000:1.0:1746147726.633053:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967793962880:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:2.0:1746147726.633648:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793963008 00000100:00100000:2.0:1746147726.633653:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793963008 00000100:00100000:2.0:1746147726.633681:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16527 00000100:00100000:2.0:1746147726.633686:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:32193:x1830967793963008:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147726.633697:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.633725:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba07 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.633751:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dacb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb974 expref: 38 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.633760:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931ce400/0xe64d3fbf12a7db11 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9a5 expref: 27 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.633771:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.633774:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.633777:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->3223551] (req 3145728->3223551) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 38 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.633809:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931ce400/0xe64d3fbf12a7db11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9a5 expref: 27 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.633821:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931ce400/0xe64d3fbf12a7db11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9a5 expref: 27 pid: 21480 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.633833:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796460416:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.633927:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dacb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb974 expref: 38 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.633936:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dacb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb974 expref: 38 pid: 8468 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.633945:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796460544:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.633970:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147726.637180:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796460416:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.637193:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796460544:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.637223:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->3223551] (req 3145728->3223551) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 38 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.637242:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0562a00, rc 0) 00000100:00100000:3.0:1746147726.637285:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:32193:x1830967793963008:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3598us (4525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.637294:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16527 00000100:00100000:1.0:1746147726.644528:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.644588:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.644935:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793963136 00000100:00100000:3.0:1746147726.644944:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793963136 00010000:00010000:3.0:1746147726.644982:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dacb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb974 expref: 38 pid: 8468 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.645018:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793963264 00000100:00100000:3.0:1746147726.645021:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793963264 00010000:00010000:3.0:1746147726.645031:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931ce400/0xe64d3fbf12a7db11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9a5 expref: 28 pid: 21480 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.645048:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8385 00000100:00100000:3.0:1746147726.645054:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967793963136:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.645069:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.645093:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dacb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb974 expref: 38 pid: 8468 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.645103:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dacb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb974 expref: 38 pid: 8468 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.645128:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dacb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb974 expref: 38 pid: 8468 timeout: 905 lvb_type: 1 00000100:00100000:0.0:1746147726.645950:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8386 00000100:00100000:0.0:1746147726.645960:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793963264:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147726.645971:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147726.645983:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931ce400/0xe64d3fbf12a7db11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9a5 expref: 28 pid: 21480 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.645999:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931ce400/0xe64d3fbf12a7db11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9a5 expref: 28 pid: 21480 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.646013:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931ce400/0xe64d3fbf12a7db11 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9a5 expref: 28 pid: 21480 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746147726.646031:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.646034:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.646040:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 37 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.646049:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 37 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.646081:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 37 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147726.646092:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135812d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796460672:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147726.646165:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746147726.646997:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.647039:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1959:x1830967793963136:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1981us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.647049:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8385 00000100:00100000:1.0:1746147726.648370:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793962880:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 15309us (15684us total) trans 21474841609 rc 0/0 00000100:00100000:1.0:1746147726.648381:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1465 00002000:00100000:1.0:1746147726.648394:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2588672->3145727) req@ffff880135810a80 x1830967793962880/t21474841609(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/448 e 0 to 0 dl 1746147737 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.648403:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135810a80 with x1830967793962880 ext(2588672->3145727) 00010000:00010000:1.0:1746147726.648414:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 37 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147726.648428:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 37 pid: 8184 timeout: 905 lvb_type: 0 00002000:00010000:1.0:1746147726.648435:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135810a80 00000100:00100000:0.0:1746147726.649302:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135812d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796460672:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147726.649326:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147726.649357:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793963264:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3398us (4768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.649365:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8386 00000100:00100000:0.0:1746147726.651790:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.652656:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793963520 00000100:00100000:1.0:1746147726.652667:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793963520 00002000:00100000:1.0:1746147726.652728:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3219456->3223551) req@ffff880135812d80 x1830967793963520/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.652738:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812d80 with x1830967793963520 ext(3219456->3223551) 00002000:00010000:1.0:1746147726.652743:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135812d80 00000100:00100000:1.0:1746147726.652777:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7366 00000100:00100000:1.0:1746147726.652785:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1959:x1830967793963520:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147726.652993:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1959:x1830967793963520:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 208us (1214us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147726.653000:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7366 00002000:00100000:1.0:1746147726.653005:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3219456->3223551) req@ffff880135812d80 x1830967793963520/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/4536 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.653012:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812d80 with x1830967793963520 ext(3219456->3223551) 00002000:00010000:1.0:1746147726.653015:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135812d80 00000100:00100000:2.0:1746147726.656542:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.656618:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793963648 00000100:00100000:0.0:1746147726.656628:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793963648 00010000:00010000:0.0:1746147726.656664:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 37 pid: 8184 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746147726.656714:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8387 00000100:00100000:0.0:1746147726.656721:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1959:x1830967793963648:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147726.656734:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147726.656757:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 37 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746147726.656768:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 37 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746147726.656790:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9f9 expref: 37 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746147726.656806:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.656808:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.656816:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7db7a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba00 expref: 25 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.656823:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7db7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba00 expref: 25 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.656859:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7db7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba00 expref: 25 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147726.656876:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135811c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796460800:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147726.658156:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.659728:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135811c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796460800:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147726.659757:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147726.659868:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967793963648:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3145us (3335us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.659904:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8387 00000100:00100000:0.0:1746147726.662793:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.662863:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793963904 00000100:00100000:1.0:1746147726.662873:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793963904 00002000:00100000:1.0:1746147726.662949:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880135811500 x1830967793963904/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.662965:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135811500 with x1830967793963904 ext(2097152->3145727) 00002000:00010000:1.0:1746147726.662971:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135811500 00000100:00100000:1.0:1746147726.663001:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7367 00000100:00100000:1.0:1746147726.663009:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967793963904:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147726.671863:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.672350:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793964160 00000100:00100000:3.0:1746147726.672361:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793964160 00000100:00100000:2.0:1746147726.672581:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12020 00000100:00100000:2.0:1746147726.672590:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+331:32200:x1830967793964160:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147726.672620:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.672640:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563e00/0xe64d3fbf12a7db88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba0e expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.672761:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7db8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.672775:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7db8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.672786:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7db8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.672798:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.672803:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.672807:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.672993:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563800/0xe64d3fbf12a7db9d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673001:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563800/0xe64d3fbf12a7db9d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673007:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563800/0xe64d3fbf12a7db9d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147726.673015:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147726.673098:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7db8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673105:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7db8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673110:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7db8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673115:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0563a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147726.673120:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7db8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673213:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7db8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673224:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147726.673226:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147726.673230:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7db8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673235:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7db8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673266:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673272:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673303:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673375:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0562600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147726.673378:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673383:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673390:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bd4a400) 00010000:00010000:2.0:1746147726.673391:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147726.673394:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673398:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7db96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.673441:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563e00/0xe64d3fbf12a7db88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba0e expref: 334 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.673451:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563800/0xe64d3fbf12a7db9d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba0e expref: 333 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.673456:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147726.673458:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147726.673460:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0563800, rc 0) 00000100:00100000:1.0:1746147726.673540:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967793963904:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10530us (10756us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147726.673550:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7367 00002000:00100000:1.0:1746147726.673560:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880135811500 x1830967793963904/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.673569:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135811500 with x1830967793963904 ext(2097152->3145727) 00002000:00010000:1.0:1746147726.673575:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135811500 00000100:00100000:2.0:1746147726.673612:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:32200:x1830967793964160:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1022us (1758us total) trans 8589946035 rc 0/0 00000100:00100000:2.0:1746147726.673618:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12020 00000100:00100000:0.0:1746147726.676989:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.677038:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793964416 00000100:00100000:3.0:1746147726.677048:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793964416 00000100:00100000:3.0:1746147726.677095:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5003 00000100:00100000:3.0:1746147726.677103:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:32200:x1830967793964416:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:3.0:1746147726.677316:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:32200:x1830967793964416:12345-192.168.202.10@tcp:35:cat.0 Request processed in 211us (336us total) trans 8589946036 rc 0/0 00000100:00100000:3.0:1746147726.677321:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5003 00000100:00100000:0.0:1746147726.679151:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.679362:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793964544 00000100:00100000:3.0:1746147726.679371:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793964544 00000100:00100000:3.0:1746147726.679432:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16528 00000100:00100000:3.0:1746147726.679440:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32191:x1830967793964544:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.679459:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.679483:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094591a00/0xe64d3fbf12a7dbab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba15 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.679515:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 36 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.679523:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147726.679524:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147726.679527:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094591a00/0xe64d3fbf12a7dbab lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba15 expref: 28 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.679557:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 36 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.679569:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 36 pid: 8184 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.679581:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796460928:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.679670:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.682948:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.683131:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.683163:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.683205:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793964672 00000100:00100000:1.0:1746147726.683215:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793964672 00000100:00100000:0.0:1746147726.683248:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.683251:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793964800 00000100:00100000:1.0:1746147726.683253:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793964800 00000100:00100000:1.0:1746147726.683263:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793964928 00000100:00100000:1.0:1746147726.683264:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793964928 00000100:00100000:1.0:1746147726.683278:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16529 00000100:00100000:1.0:1746147726.683285:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1960:x1830967793964672:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147726.683302:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16530 00010000:00010000:1.0:1746147726.683305:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147726.683309:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1960:x1830967793964800:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147726.683318:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147726.683322:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7dbb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba1c expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.683327:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dbb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba23 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147726.683373:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796461184:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147726.683373:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796461056:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147726.683419:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16531 00000100:00100000:0.0:1746147726.683425:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1960:x1830967793964928:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147726.683431:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147726.683439:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134ede800/0xe64d3fbf12a7dbc0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba2a expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.683448:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.683451:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.683459:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ede800/0xe64d3fbf12a7dbc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba2a expref: 39 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.683471:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134ede800/0xe64d3fbf12a7dbc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba2a expref: 39 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.683481:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ede800, rc 0) 00000100:00100000:2.0:1746147726.683660:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.683697:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796460928:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.683731:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094591a00/0xe64d3fbf12a7dbab lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba15 expref: 28 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.683740:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094591a00, rc 0) 00000100:00100000:2.0:1746147726.683757:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32191:x1830967793964544:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4317us (4615us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.683763:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16528 00000100:00100000:2.0:1746147726.683796:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793965056 00000100:00100000:2.0:1746147726.683799:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793965056 00002000:00100000:2.0:1746147726.683820:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3223551) req@ffff88012ee59880 x1830967793965056/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.683830:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee59880 with x1830967793965056 ext(3145728->3223551) 00010000:00010000:2.0:1746147726.683835:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 39 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.683846:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 39 pid: 8184 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746147726.684123:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1960:x1830967793964928:12345-192.168.202.10@tcp:101:cat.0 Request processed in 697us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.684125:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.684128:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16531 00002000:00010000:2.0:1746147726.684576:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ee59880 00000100:00100000:2.0:1746147726.684599:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1466 00000100:00100000:2.0:1746147726.684606:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1959:x1830967793965056:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:1.0:1746147726.685530:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796461056:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147726.685559:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7dbb2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba1c expref: 38 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.685571:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931cf600/0xe64d3fbf12a7dbb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba1c expref: 38 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.685595:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931cf600, rc 0) 00000100:00100000:1.0:1746147726.685616:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009505ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1960:x1830967793964672:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2331us (2678us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147726.685622:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16529 00000100:00100000:3.0:1746147726.685870:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796461184:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147726.685910:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dbb9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba23 expref: 40 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.685920:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dbb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba23 expref: 40 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.685931:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0563a00, rc 0) 00000100:00100000:3.0:1746147726.685962:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1960:x1830967793964800:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2654us (2831us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147726.686396:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16530 00000100:00100000:2.0:1746147726.689507:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1959:x1830967793965056:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 4888us (6244us total) trans 17179874384 rc 0/0 00000100:00100000:2.0:1746147726.689521:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1466 00002000:00100000:2.0:1746147726.689533:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3223551) req@ffff88012ee59880 x1830967793965056/t17179874384(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/448 e 0 to 0 dl 1746147737 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.689542:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee59880 with x1830967793965056 ext(3145728->3223551) 00010000:00010000:2.0:1746147726.689551:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 39 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.689564:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 39 pid: 8184 timeout: 905 lvb_type: 0 00002000:00010000:2.0:1746147726.689570:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ee59880 00000100:00100000:0.0:1746147726.692596:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.693309:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793965184 00000100:00100000:2.0:1746147726.693320:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793965184 00010000:00010000:2.0:1746147726.693357:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 39 pid: 8184 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.693525:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8388 00000100:00100000:2.0:1746147726.693534:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6670c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1960:x1830967793965184:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147726.693547:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147726.693572:0:7312:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147726 -> 1746147727 00002000:00010000:2.0:1746147726.693575:0:7312:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147726 -> 1746147727 00010000:00010000:2.0:1746147726.693581:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 39 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.693593:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 39 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.693648:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7db81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba07 expref: 39 pid: 8184 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746147726.693718:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147726.693827:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.693830:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.693838:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094591a00/0xe64d3fbf12a7dbab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba15 expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.693847:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094591a00/0xe64d3fbf12a7dbab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba15 expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.693900:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094591a00/0xe64d3fbf12a7dbab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba15 expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147726.693913:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796461312:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147726.693989:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.694005:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793965440 00000100:00100000:2.0:1746147726.694008:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793965440 00002000:00100000:2.0:1746147726.694032:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fd18700 x1830967793965440/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.694040:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18700 with x1830967793965440 ext(0->1048575) 00002000:00010000:2.0:1746147726.694045:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd18700 00000100:00100000:2.0:1746147726.694123:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7368 00000100:00100000:2.0:1746147726.694129:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1957:x1830967793965440:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147726.698546:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796461312:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147726.698568:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147726.698629:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6670c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1960:x1830967793965184:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5096us (6042us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.698640:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8388 00000100:00100000:0.0:1746147726.699689:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.699734:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.699767:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793965696 00000100:00100000:3.0:1746147726.699776:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793965696 00000100:00100000:2.0:1746147726.699816:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793965952 00000100:00100000:2.0:1746147726.699823:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793965952 00002000:00100000:3.0:1746147726.699825:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88012ee58380 x1830967793965696/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.699835:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58380 with x1830967793965696 ext(3145728->4194303) 00002000:00010000:3.0:1746147726.699842:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee58380 00002000:00100000:2.0:1746147726.699857:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88012ee5b100 x1830967793965952/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.699866:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee5b100 with x1830967793965952 ext(3145728->4194303) 00000100:00100000:3.0:1746147726.699870:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7369 00002000:00010000:2.0:1746147726.699870:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee5b100 00000100:00100000:3.0:1746147726.699877:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793965696:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147726.699921:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7370 00000100:00100000:0.0:1746147726.699930:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793965952:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147726.704222:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967793965440:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10082us (10493us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147726.704234:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7368 00002000:00100000:2.0:1746147726.704247:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fd18700 x1830967793965440/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.704254:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18700 with x1830967793965440 ext(0->1048575) 00002000:00010000:2.0:1746147726.704259:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd18700 00000100:00100000:0.0:1746147726.719569:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.720281:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793965696:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20402us (20596us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147726.720293:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7369 00002000:00100000:3.0:1746147726.720305:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88012ee58380 x1830967793965696/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.720320:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58380 with x1830967793965696 ext(3145728->4194303) 00002000:00010000:3.0:1746147726.720326:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee58380 00000100:00100000:0.0:1746147726.720369:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.720438:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793966080 00000100:00100000:2.0:1746147726.720446:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793966080 00000100:00100000:2.0:1746147726.720486:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12021 00000100:00100000:2.0:1746147726.720492:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+10:32201:x1830967793966080:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147726.720519:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.720538:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dbc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba31 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.720596:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dbce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.720609:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dbce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.720620:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dbce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.720632:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dbd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.720637:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.720642:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.720768:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.720778:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ba expref: 333 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.720785:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.720815:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ba expref: 333 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.720830:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ba expref: 333 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.720843:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796461440:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.720918:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147726.721206:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967793965952:12345-192.168.202.10@tcp:3:cat.0 Request processed in 21276us (21470us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147726.721214:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7370 00002000:00100000:1.0:1746147726.721220:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88012ee5b100 x1830967793965952/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.721227:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee5b100 with x1830967793965952 ext(3145728->4194303) 00002000:00010000:1.0:1746147726.721230:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee5b100 00000100:00100000:3.0:1746147726.721733:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793966208 00000100:00100000:3.0:1746147726.721739:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793966208 00000100:00100000:3.0:1746147726.721768:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16532 00000100:00100000:3.0:1746147726.721774:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:32200:x1830967793966208:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.721784:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.721797:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094591c00/0xe64d3fbf12a7dbe3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba38 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.721817:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 25 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.721824:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147726.721825:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147726.721828:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094591c00/0xe64d3fbf12a7dbe3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba38 expref: 38 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.721847:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 25 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.721855:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 25 pid: 8470 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.721864:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796461568:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.721937:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147726.724055:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796461568:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.724088:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094591c00/0xe64d3fbf12a7dbe3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba38 expref: 38 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.724105:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094591c00, rc 0) 00000100:00100000:3.0:1746147726.724148:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:32200:x1830967793966208:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2373us (3778us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.724156:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16532 00000100:00100000:2.0:1746147726.724272:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796461440:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.724287:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:1.0:1746147726.724475:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.724639:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793966464 00000100:00100000:3.0:1746147726.724646:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793966464 00000100:00100000:3.0:1746147726.724683:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5004 00000100:00100000:3.0:1746147726.724690:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:7670:x1830967793966464:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147726.724919:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:7670:x1830967793966464:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 227us (444us total) trans 8589946037 rc 0/0 00000100:00100000:3.0:1746147726.724924:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5004 00000100:00100000:0.0:1746147726.729634:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.729682:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.729774:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.729846:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793966848 00000100:00100000:3.0:1746147726.729856:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793966848 00000100:00100000:3.0:1746147726.729924:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16533 00000100:00100000:3.0:1746147726.729932:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967793966848:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.729952:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.729971:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094591e00/0xe64d3fbf12a7dbea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba3f expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147726.730027:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796461696:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147726.730104:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.730178:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793966720 00000100:00100000:2.0:1746147726.730182:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793966720 00010000:00010000:2.0:1746147726.730203:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ba expref: 335 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.730225:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8389 00000100:00100000:2.0:1746147726.730231:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:1957:x1830967793966720:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147726.730240:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147726.730245:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ba expref: 335 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.730254:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ba expref: 335 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.730273:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935e1600/0xe64d3fbf12a7db2d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9ba expref: 335 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.730293:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147726.730298:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730307:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730313:0:7312:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730330:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147726.730351:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:1957:x1830967793966720:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 121us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.730357:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8389 00010000:00010000:2.0:1746147726.730378:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730384:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147726.730431:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147726.730436:0:14546:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147726.730452:0:14546:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730462:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730470:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dbce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730476:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dbce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730482:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dbce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730487:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0563600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147726.730490:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dbce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730497:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dbce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730504:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147726.730506:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147726.730509:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dbce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730513:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dbce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730522:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730527:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dbd5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730532:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730536:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0562e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147726.730543:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730548:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dbd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730557:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5b4af00) 00010000:00010000:2.0:1746147726.730559:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147726.730561:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dbd5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.730565:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dbd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00000100:00100000:1.0:1746147726.730580:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793966592 00000100:00100000:1.0:1746147726.730585:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793966592 00010000:00010000:2.0:1746147726.730602:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dbc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba31 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.730612:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba31 expref: 11 pid: 14546 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746147726.730613:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1679360->2097151) req@ffff88009aeea300 x1830967793966592/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147726.730618:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147726.730620:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147726.730622:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0562400, rc 0) 00002000:00100000:1.0:1746147726.730627:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeea300 with x1830967793966592 ext(1679360->2097151) 00010000:00010000:1.0:1746147726.730634:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 28 pid: 8470 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147726.730645:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 28 pid: 8470 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.730648:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+11:32201:x1830967793966080:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 10156us (11089us total) trans 0 rc 0/0 00002000:00010000:1.0:1746147726.730651:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aeea300 00000100:00100000:2.0:1746147726.730654:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12021 00000100:00100000:1.0:1746147726.730665:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1467 00000100:00100000:1.0:1746147726.730670:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793966592:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147726.733330:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.733492:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796461696:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147726.733531:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094591e00/0xe64d3fbf12a7dbea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba3f expref: 29 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.733545:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094591e00/0xe64d3fbf12a7dbea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba3f expref: 29 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.733560:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094591e00, rc 0) 00000100:00100000:3.0:1746147726.733599:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793966848:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3668us (3824us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147726.733606:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16533 00000100:00100000:0.0:1746147726.733689:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.733881:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.733919:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793966976 00000100:00100000:3.0:1746147726.733920:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793967232 00000100:00100000:3.0:1746147726.733924:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793967232 00000100:00100000:0.0:1746147726.733924:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793966976 00000100:00100000:1.0:1746147726.733973:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793967104 00000100:00100000:1.0:1746147726.733978:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793967104 00000100:00100000:3.0:1746147726.734034:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16534 00000100:00100000:1.0:1746147726.734039:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16535 00000100:00100000:3.0:1746147726.734041:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967793966976:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:1.0:1746147726.734044:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793967232:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147726.734056:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147726.734056:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.734069:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094591800/0xe64d3fbf12a7dbf8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba46 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.734069:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc30600/0xe64d3fbf12a7dbf1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba54 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.734087:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.734088:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.734096:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094591800/0xe64d3fbf12a7dbf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba46 expref: 9 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.734108:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094591800/0xe64d3fbf12a7dbf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba46 expref: 9 pid: 6715 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147726.734113:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796461824:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147726.734116:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094591800, rc 0) 00000100:00100000:3.0:1746147726.734133:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793966976:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 93us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.734137:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16534 00000100:00100000:3.0:1746147726.734148:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16536 00000100:00100000:3.0:1746147726.734152:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967793967104:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:1.0:1746147726.734154:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147726.734157:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.734164:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094591000/0xe64d3fbf12a7dbff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba4d expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.734173:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.734174:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.734178:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094591000/0xe64d3fbf12a7dbff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba4d expref: 12 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.734186:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094591000/0xe64d3fbf12a7dbff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba4d expref: 12 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.734192:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094591000, rc 0) 00000100:00100000:3.0:1746147726.734205:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967793967104:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 52us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.734210:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16536 00000100:00100000:0.0:1746147726.734235:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.734255:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793967360 00000100:00100000:3.0:1746147726.734258:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793967360 00000100:00100000:0.0:1746147726.734267:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.734330:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.734779:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793967616 00000100:00100000:2.0:1746147726.734783:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793967616 00000100:00100000:2.0:1746147726.734804:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16537 00000100:00100000:2.0:1746147726.734809:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967793967360:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147726.734816:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.734823:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dc06 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba5b expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147726.734854:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796461952:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147726.734899:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.734915:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16538 00000100:00100000:2.0:1746147726.734921:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967793967616:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147726.734927:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.734933:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dc0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba69 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.734944:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.734945:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.734950:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dc0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba69 expref: 13 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.734960:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dc0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba69 expref: 13 pid: 8184 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147726.735452:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793967488 00000100:00100000:3.0:1746147726.735457:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793967488 00000100:00100000:3.0:1746147726.735489:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16539 00000100:00100000:3.0:1746147726.735494:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967793967488:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147726.735504:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.735511:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094590a00/0xe64d3fbf12a7dc14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba62 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.735520:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.735521:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.735529:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094590a00/0xe64d3fbf12a7dc14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba62 expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.735539:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094590a00/0xe64d3fbf12a7dc14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba62 expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.735546:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094590a00, rc 0) 00000100:00100000:3.0:1746147726.735579:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967793967488:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 84us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.735584:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16539 00010000:00010000:2.0:1746147726.735740:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0562800, rc 0) 00000100:00100000:2.0:1746147726.735780:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967793967616:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 859us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.735786:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16538 00000100:00100000:2.0:1746147726.738290:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796461824:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147726.738326:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cc30600/0xe64d3fbf12a7dbf1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba54 expref: 12 pid: 7050 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147726.738339:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796461952:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147726.738340:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc30600/0xe64d3fbf12a7dbf1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba54 expref: 12 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.738357:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc30600, rc 0) 00010000:00010000:3.0:1746147726.738368:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dc06 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba5b expref: 11 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.738376:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dc06 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba5b expref: 11 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.738383:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0562600, rc 0) 00000100:00100000:3.0:1746147726.738398:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793967360:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 3589us (4163us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147726.738398:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967793967232:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 4353us (4709us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147726.738406:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16535 00000100:00100000:3.0:1746147726.738409:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16537 00000100:00100000:1.0:1746147726.740221:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793966592:12345-192.168.202.10@tcp:4:cat.0 Request processed in 9541us (10529us total) trans 21474841610 rc 0/0 00000100:00100000:1.0:1746147726.740234:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1467 00002000:00100000:1.0:1746147726.740245:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1679360->2097151) req@ffff88009aeea300 x1830967793966592/t21474841610(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/448 e 0 to 0 dl 1746147737 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.740255:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeea300 with x1830967793966592 ext(1679360->2097151) 00010000:00010000:1.0:1746147726.740263:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 28 pid: 8470 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147726.740280:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 28 pid: 8470 timeout: 905 lvb_type: 0 00002000:00010000:1.0:1746147726.740286:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aeea300 00000100:00100000:0.0:1746147726.742169:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.742275:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793967872 00000100:00100000:1.0:1746147726.742285:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793967872 00002000:00100000:1.0:1746147726.742329:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009fe3ad80 x1830967793967872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.742338:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe3ad80 with x1830967793967872 ext(4194304->5017599) 00002000:00010000:1.0:1746147726.742343:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe3ad80 00000100:00100000:1.0:1746147726.742543:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7371 00000100:00100000:1.0:1746147726.742551:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793967872:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147726.745023:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.745086:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.745088:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793968000 00000100:00100000:3.0:1746147726.745096:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793968000 00010000:00010000:3.0:1746147726.745130:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 28 pid: 8470 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.745160:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8390 00000100:00100000:3.0:1746147726.745167:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793968000:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.745182:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.745203:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 28 pid: 8470 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.745215:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 28 pid: 8470 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.745240:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fc4c00/0xe64d3fbf12a7db1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9b3 expref: 28 pid: 8470 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.745254:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.745256:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.745263:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094591c00/0xe64d3fbf12a7dbe3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba38 expref: 37 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.745271:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094591c00/0xe64d3fbf12a7dbe3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba38 expref: 37 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.745305:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094591c00/0xe64d3fbf12a7dbe3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba38 expref: 37 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147726.745318:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796462080:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147726.745331:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793968256 00000100:00100000:2.0:1746147726.745336:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793968256 00000100:00100000:2.0:1746147726.745363:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12022 00000100:00100000:2.0:1746147726.745367:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+11:32201:x1830967793968256:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147726.745383:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147726.745386:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f900 going to sleep for 11 seconds 00010000:00010000:2.0:1746147726.745397:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dc1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba70 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.745484:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.745497:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba31 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.745503:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.745522:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba31 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.745531:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba31 expref: 12 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.745539:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796462208:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.745563:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147726.751044:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796462080:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147726.751082:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.751154:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967793968000:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5986us (6137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.751168:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8390 00000100:00100000:3.0:1746147726.751816:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796462208:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.751832:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147726.753244:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.753269:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.753662:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793967872:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11110us (11499us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147726.753675:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7371 00002000:00100000:1.0:1746147726.753687:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009fe3ad80 x1830967793967872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.753696:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe3ad80 with x1830967793967872 ext(4194304->5017599) 00002000:00010000:1.0:1746147726.753711:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe3ad80 00000100:00100000:1.0:1746147726.753736:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793968640 00000100:00100000:1.0:1746147726.753744:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793968640 00002000:00100000:1.0:1746147726.753774:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009b10ad80 x1830967793968640/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.753781:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10ad80 with x1830967793968640 ext(1048576->2097151) 00002000:00010000:1.0:1746147726.753784:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b10ad80 00000100:00100000:1.0:1746147726.753799:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7372 00000100:00100000:1.0:1746147726.753805:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967793968640:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147726.753916:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793968384 00000100:00100000:2.0:1746147726.753920:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793968384 00010000:00010000:2.0:1746147726.753939:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba31 expref: 13 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.753967:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8391 00000100:00100000:2.0:1746147726.753972:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+13:1959:x1830967793968384:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147726.753981:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147726.753987:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba31 expref: 13 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.753996:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba31 expref: 13 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.754016:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562400/0xe64d3fbf12a7dbdc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba31 expref: 13 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.754031:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147726.754035:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.754043:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.754049:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.754065:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147726.754088:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967793968384:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 116us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.754094:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8391 00010000:00010000:3.0:1746147726.754152:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.754159:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:3.0:1746147726.754179:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147726.754598:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dc1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba70 expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.754612:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba70 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.754618:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147726.754620:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147726.754623:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0563600, rc 0) 00000100:00100000:3.0:1746147726.754658:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+12:32201:x1830967793968256:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 9290us (9572us total) trans 8589946038 rc 0/0 00000100:00100000:3.0:1746147726.754664:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12022 00000100:00100000:0.0:1746147726.760479:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.760527:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.760570:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793968768 00000100:00100000:3.0:1746147726.760583:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793968768 00000100:00100000:3.0:1746147726.760655:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12023 00000100:00100000:3.0:1746147726.760663:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+12:32201:x1830967793968768:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147726.760696:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147726.760764:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793968896 00000100:00100000:2.0:1746147726.760768:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793968896 00000100:00100000:2.0:1746147726.760801:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16540 00000100:00100000:2.0:1746147726.760806:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793968896:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147726.760814:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.760825:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0562200/0xe64d3fbf12a7dc37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba7e expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.760855:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.760857:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.760864:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0562200/0xe64d3fbf12a7dc37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba7e expref: 28 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.760880:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0562200/0xe64d3fbf12a7dc37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba7e expref: 28 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.760930:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0562200, rc 0) 00000100:00100000:2.0:1746147726.760982:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793968896:12345-192.168.202.10@tcp:101:cat.0 Request processed in 175us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.760988:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16540 00010000:00010000:3.0:1746147726.761096:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094590e00/0xe64d3fbf12a7dc30 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba77 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.761176:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.761188:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba70 expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.761194:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.761356:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba70 expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.761367:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba70 expref: 13 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.761378:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796462336:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.761452:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147726.764331:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967793968640:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10516us (11050us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147726.764344:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7372 00002000:00100000:1.0:1746147726.764355:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009b10ad80 x1830967793968640/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.764364:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10ad80 with x1830967793968640 ext(1048576->2097151) 00002000:00010000:1.0:1746147726.764370:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b10ad80 00000100:00100000:0.0:1746147726.764468:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.764989:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796462336:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.765016:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:1.0:1746147726.765117:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793969152 00000100:00100000:1.0:1746147726.765123:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793969152 00000100:00100000:1.0:1746147726.765169:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12024 00000100:00100000:1.0:1746147726.765176:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32203:x1830967793969152:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147726.765195:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147726.765212:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc30200/0xe64d3fbf12a7dc45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba85 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.765314:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc30000/0xe64d3fbf12a7dc4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765325:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc30000/0xe64d3fbf12a7dc4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765335:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc30000/0xe64d3fbf12a7dc4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765346:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7dc53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765351:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7dc53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765356:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7dc53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765459:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dc5a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765467:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dc5a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765472:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dc5a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:1.0:1746147726.765480:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147726.765561:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc30000/0xe64d3fbf12a7dc4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765567:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc30000/0xe64d3fbf12a7dc4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765572:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc30000/0xe64d3fbf12a7dc4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765577:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc30000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147726.765581:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc30000/0xe64d3fbf12a7dc4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765587:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc30000/0xe64d3fbf12a7dc4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765597:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147726.765599:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147726.765602:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc30000/0xe64d3fbf12a7dc4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765606:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc30000/0xe64d3fbf12a7dc4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765637:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7dc53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765642:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7dc53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765646:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7dc53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765650:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc31200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147726.765652:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7dc53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765656:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7dc53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765662:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88013632f300) 00010000:00010000:1.0:1746147726.765663:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147726.765665:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7dc53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765670:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7dc53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147726.765716:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc30200/0xe64d3fbf12a7dc45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba85 expref: 16 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.765726:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dc5a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba85 expref: 15 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.765732:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147726.765734:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147726.765736:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.765742:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147726.765748:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc31c00, rc 0) 00000100:00100000:1.0:1746147726.765793:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32203:x1830967793969152:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 616us (1324us total) trans 8589946039 rc 0/0 00000100:00100000:1.0:1746147726.765798:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12024 00000100:00100000:2.0:1746147726.767188:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.767231:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793969280 00000100:00100000:3.0:1746147726.767239:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793969280 00010000:00010000:3.0:1746147726.767268:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba70 expref: 14 pid: 14546 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.767302:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8392 00000100:00100000:3.0:1746147726.767309:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967793969280:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.767321:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.767325:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba70 expref: 14 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.767335:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba70 expref: 14 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.767353:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dc22 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba70 expref: 14 pid: 14546 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.769277:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147726.769289:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.769302:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.769308:0:7312:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147726.769360:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147726.769374:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.769381:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147726.769430:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147726.769435:0:14546:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:3.0:1746147726.769441:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967793969280:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2127us (2251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.769450:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8392 00000004:00010000:2.0:1746147726.769450:0:14546:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.769483:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094590e00/0xe64d3fbf12a7dc30 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba77 expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.769511:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba77 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.769518:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147726.769520:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147726.769523:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094590c00, rc 0) 00000100:00100000:2.0:1746147726.776279:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+12:32201:x1830967793968768:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 15601us (15791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.776291:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12023 00000100:00100000:0.0:1746147726.777672:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.777762:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793969408 00000100:00100000:2.0:1746147726.777771:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793969408 00000100:00100000:2.0:1746147726.777813:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16541 00000100:00100000:2.0:1746147726.777820:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:32200:x1830967793969408:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147726.777841:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.777859:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7dc68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba8c expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.777909:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.777922:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147726.777924:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147726.777927:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7dc68 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba8c expref: 39 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.777959:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.777971:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 27 pid: 8184 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.777983:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796462464:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.778626:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.779915:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.779959:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793969664 00000100:00100000:2.0:1746147726.779966:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793969664 00000100:00100000:2.0:1746147726.780460:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12025 00000100:00100000:2.0:1746147726.780469:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:32205:x1830967793969664:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147726.780497:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.780516:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dc6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba93 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.780627:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dc76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.780640:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dc76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.780654:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dc76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.780668:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563200/0xe64d3fbf12a7dc7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.780673:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563200/0xe64d3fbf12a7dc7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.780679:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563200/0xe64d3fbf12a7dc7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.780854:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562000/0xe64d3fbf12a7dc84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.780862:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562000/0xe64d3fbf12a7dc84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.780868:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562000/0xe64d3fbf12a7dc84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147726.780876:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147726.780987:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dc76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.780994:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dc76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.780999:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dc76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.781004:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0562600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147726.781007:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dc76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.781014:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dc76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.781024:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147726.781027:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147726.781031:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dc76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.781035:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dc76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.781045:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563200/0xe64d3fbf12a7dc7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.781050:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563200/0xe64d3fbf12a7dc7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.781054:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563200/0xe64d3fbf12a7dc7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.781058:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0563200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147726.781060:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563200/0xe64d3fbf12a7dc7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.781065:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563200/0xe64d3fbf12a7dc7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.781070:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fb19e00) 00010000:00010000:2.0:1746147726.781072:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147726.781074:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563200/0xe64d3fbf12a7dc7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.781078:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563200/0xe64d3fbf12a7dc7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.781113:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dc6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba93 expref: 337 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.781123:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562000/0xe64d3fbf12a7dc84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba93 expref: 336 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.781129:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147726.781131:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147726.781134:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0562000, rc 0) 00000100:00100000:2.0:1746147726.781435:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+336:32205:x1830967793969664:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 963us (1550us total) trans 8589946040 rc 0/0 00000100:00100000:2.0:1746147726.781444:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12025 00000100:00100000:0.0:1746147726.781774:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.782034:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.782112:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796462464:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.782135:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7dc68 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba8c expref: 39 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.782150:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0562a00, rc 0) 00000100:00100000:1.0:1746147726.782173:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793969792 00000100:00100000:3.0:1746147726.782175:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:32200:x1830967793969408:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4356us (4508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.782179:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793969792 00000100:00100000:3.0:1746147726.782181:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16541 00000100:00100000:3.0:1746147726.782193:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793969920 00000100:00100000:3.0:1746147726.782195:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793969920 00000100:00100000:1.0:1746147726.782207:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16542 00000100:00100000:3.0:1746147726.782210:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16543 00000100:00100000:1.0:1746147726.782212:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967793969792:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:3.0:1746147726.782214:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793969920:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147726.782223:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147726.782223:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.782234:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094590400/0xe64d3fbf12a7dc92 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbaa1 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.782234:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc31800/0xe64d3fbf12a7dc99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafba9a expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.782247:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.782248:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.782256:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc31800/0xe64d3fbf12a7dc99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba9a expref: 12 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.782265:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cc31800/0xe64d3fbf12a7dc99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba9a expref: 12 pid: 22183 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147726.782269:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796462592:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147726.782272:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc31800, rc 0) 00000100:00100000:1.0:1746147726.782287:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967793969792:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 75us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.782292:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16542 00000100:00100000:3.0:1746147726.782315:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.782937:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.782979:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793970048 00000100:00100000:1.0:1746147726.782982:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793970048 00002000:00100000:1.0:1746147726.783008:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1527807) req@ffff880091633100 x1830967793970048/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.783018:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091633100 with x1830967793970048 ext(1048576->1527807) 00010000:00010000:1.0:1746147726.783025:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 28 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147726.783041:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 28 pid: 8184 timeout: 905 lvb_type: 0 00002000:00010000:1.0:1746147726.783047:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091633100 00000100:00100000:1.0:1746147726.783377:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1468 00000100:00100000:1.0:1746147726.783385:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793970048:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147726.783589:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796462592:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147726.783615:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094590400/0xe64d3fbf12a7dc92 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaa1 expref: 11 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.783626:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094590400/0xe64d3fbf12a7dc92 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaa1 expref: 11 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.783636:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094590400, rc 0) 00000100:00100000:3.0:1746147726.783665:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793969920:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1450us (1631us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147726.783671:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16543 00000100:00100000:0.0:1746147726.786172:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.786247:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793970304 00000100:00100000:2.0:1746147726.786257:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793970304 00000100:00100000:2.0:1746147726.786311:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12026 00000100:00100000:2.0:1746147726.786319:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+12:32201:x1830967793970304:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147726.788599:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.788635:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563000/0xe64d3fbf12a7dca0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbaa8 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.788768:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dca7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.788786:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dca7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.788800:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dca7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.788820:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dca7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.788826:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dca7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.788831:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dca7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.788837:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0563600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147726.788841:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dca7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.788848:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dca7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.788861:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147726.788864:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147726.788868:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dca7 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.788873:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563600/0xe64d3fbf12a7dca7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147726.788946:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563000/0xe64d3fbf12a7dca0 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaa8 expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.788954:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563000/0xe64d3fbf12a7dca0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaa8 expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.788962:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0563000, rc 0) 00000100:00100000:2.0:1746147726.789067:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+12:32201:x1830967793970304:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 2744us (2903us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147726.789077:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12026 00010000:00010000:1.0:1746147726.789541:0:7099:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147726.797905:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.799031:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793970560 00000100:00100000:2.0:1746147726.799046:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793970560 00000100:00100000:2.0:1746147726.799126:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5005 00000100:00100000:2.0:1746147726.799138:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+12:32201:x1830967793970560:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:2.0:1746147726.799382:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+13:32201:x1830967793970560:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 244us (1509us total) trans 8589946041 rc 0/0 00000100:00100000:2.0:1746147726.799389:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5005 00000100:00100000:1.0:1746147726.800964:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1960:x1830967793970048:12345-192.168.202.10@tcp:4:cat.0 Request processed in 17572us (18020us total) trans 17179874385 rc 0/0 00000100:00100000:1.0:1746147726.800976:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1468 00002000:00100000:1.0:1746147726.800988:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1527807) req@ffff880091633100 x1830967793970048/t17179874385(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/448 e 0 to 0 dl 1746147737 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.800998:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091633100 with x1830967793970048 ext(1048576->1527807) 00010000:00010000:1.0:1746147726.801007:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 30 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746147726.801022:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 30 pid: 8184 timeout: 905 lvb_type: 0 00002000:00010000:1.0:1746147726.801029:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091633100 00000100:00100000:0.0:1746147726.807391:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.807507:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793970688 00000100:00100000:3.0:1746147726.807517:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793970688 00010000:00010000:3.0:1746147726.807559:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 30 pid: 8184 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.808832:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8393 00000100:00100000:3.0:1746147726.808847:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967793970688:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.808867:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.808913:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 30 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.808929:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 30 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.808955:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5e00/0xe64d3fbf12a7db49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9cf expref: 30 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.809133:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.809136:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.809144:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7dc68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba8c expref: 38 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.809151:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7dc68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba8c expref: 38 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.809186:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7dc68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba8c expref: 38 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147726.809199:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796462720:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147726.809298:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.817846:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.818111:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793970816 00000100:00100000:3.0:1746147726.818120:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793970816 00000100:00100000:3.0:1746147726.819537:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16544 00000100:00100000:1.0:1746147726.819759:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.819786:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32203:x1830967793970816:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147726.819808:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.819829:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbaaf expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.819859:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7db7a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba00 expref: 29 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.819868:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dc0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba69 expref: 11 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.819874:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134ede800/0xe64d3fbf12a7dbc0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba2a expref: 37 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.819881:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.819900:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.819903:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 6/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2269184->2793471] (req 2269184->2793471) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.819933:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134ede800/0xe64d3fbf12a7dbc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba2a expref: 37 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.819945:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134ede800/0xe64d3fbf12a7dbc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba2a expref: 37 pid: 8468 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.819956:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796462848:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.820032:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dc0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba69 expref: 11 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.820040:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dc0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba69 expref: 11 pid: 8184 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.820048:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796462976:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.820071:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7db7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba00 expref: 29 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.820078:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7db7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba00 expref: 29 pid: 8184 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.820091:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796463104:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.820107:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147726.820141:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796462720:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147726.820158:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.820178:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967793970688:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 11337us (12798us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.820187:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8393 00000100:00100000:2.0:1746147726.821168:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793970944 00000100:00100000:2.0:1746147726.821178:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793970944 00000100:00100000:2.0:1746147726.821227:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16545 00000100:00100000:2.0:1746147726.821234:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:32205:x1830967793970944:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147726.821248:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.821262:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbab6 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.821285:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935e1200/0xe64d3fbf12a7db34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9c1 expref: 28 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.821291:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094591800/0xe64d3fbf12a7dbf8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba46 expref: 9 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.821298:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7db50 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9d6 expref: 40 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.821307:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.821309:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.821311:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [737280->1048575] (req 737280->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 40 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.821330:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7db50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9d6 expref: 40 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.821339:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7db50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9d6 expref: 40 pid: 7050 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.821347:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796463232:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.821418:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094591800/0xe64d3fbf12a7dbf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba46 expref: 9 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.821426:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094591800/0xe64d3fbf12a7dbf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba46 expref: 9 pid: 6715 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.821434:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796463360:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.821457:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800935e1200/0xe64d3fbf12a7db34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9c1 expref: 28 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.821463:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800935e1200/0xe64d3fbf12a7db34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9c1 expref: 28 pid: 8184 timeout: 905 lvb_type: 0 00000100:00100000:2.0:1746147726.821474:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796463488:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.821488:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.824175:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.824213:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.824249:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.824276:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.824323:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793971456 00000100:00100000:1.0:1746147726.824333:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793971456 00002000:00100000:1.0:1746147726.824384:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800951d6d80 x1830967793971456/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.824395:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d6d80 with x1830967793971456 ext(1048576->2097151) 00002000:00010000:1.0:1746147726.824400:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800951d6d80 00000100:00100000:1.0:1746147726.824422:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7373 00000100:00100000:1.0:1746147726.824429:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1960:x1830967793971456:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147726.824533:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796462848:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.824544:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796462976:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.824557:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796463104:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.824592:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2269184->2793471] (req 2269184->2793471) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.824608:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094590400, rc 0) 00000100:00100000:2.0:1746147726.824628:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793971072 00000100:00100000:2.0:1746147726.824632:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793971072 00000100:00100000:3.0:1746147726.824649:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:32203:x1830967793970816:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4873us (6813us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147726.824654:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134ede800/0xe64d3fbf12a7dbc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba2a expref: 38 pid: 8468 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.824657:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16544 00000100:00100000:2.0:1746147726.824676:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793971584 00000100:00100000:2.0:1746147726.824678:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793971584 00000100:00100000:3.0:1746147726.824691:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793971200 00010000:00010000:2.0:1746147726.824691:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7db7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba00 expref: 29 pid: 8184 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.824694:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793971200 00010000:00010000:3.0:1746147726.824717:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dc0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba69 expref: 12 pid: 8184 timeout: 905 lvb_type: 1 00000100:00100000:2.0:1746147726.824720:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8394 00000100:00100000:2.0:1746147726.824728:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1958:x1830967793971072:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147726.824734:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8395 00000100:00100000:3.0:1746147726.824740:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6670450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1958:x1830967793971584:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147726.824742:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.824748:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.824762:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7db7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba00 expref: 29 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.824763:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134ede800/0xe64d3fbf12a7dbc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba2a expref: 38 pid: 8468 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.824772:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7db7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba00 expref: 29 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:2.0:1746147726.824786:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134ede800/0xe64d3fbf12a7dbc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba2a expref: 38 pid: 8468 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.824810:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134ede800/0xe64d3fbf12a7dbc0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba2a expref: 38 pid: 8468 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.824826:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147726.824844:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967793971072:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 117us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.824849:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8394 00000100:00100000:2.0:1746147726.824859:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8396 00000100:00100000:2.0:1746147726.824863:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+12:1958:x1830967793971200:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147726.824868:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147726.824874:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dc0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba69 expref: 12 pid: 8184 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.824881:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dc0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba69 expref: 12 pid: 8184 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.824913:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dc0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba69 expref: 12 pid: 8184 timeout: 905 lvb_type: 1 00010000:00010000:2.0:1746147726.824920:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147726.824933:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967793971200:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 69us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.824937:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8396 00000100:00100000:2.0:1746147726.824984:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796463232:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.824991:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796463360:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.825301:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796463488:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.825323:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [737280->1048575] (req 737280->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 41 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.825341:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0563a00, rc 0) 00000100:00100000:2.0:1746147726.825361:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:32205:x1830967793970944:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4128us (5604us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.825366:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16545 00010000:00010000:3.0:1746147726.825904:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7db7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba00 expref: 29 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.825926:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.825928:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.825935:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2793471) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 28 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.825943:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2793471) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 28 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.825977:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2793471) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 28 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147726.825988:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796463616:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147726.826047:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.827413:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.827453:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.827478:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.827510:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793971840 00000100:00100000:3.0:1746147726.827518:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793971840 00010000:00010000:3.0:1746147726.827550:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800935e1200/0xe64d3fbf12a7db34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9c1 expref: 29 pid: 8184 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746147726.827575:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793971712 00000100:00100000:3.0:1746147726.827577:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793971712 00010000:00010000:3.0:1746147726.827587:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094591800/0xe64d3fbf12a7dbf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba46 expref: 10 pid: 6715 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.827600:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793971968 00000100:00100000:3.0:1746147726.827602:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793971968 00010000:00010000:3.0:1746147726.827611:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7db50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9d6 expref: 41 pid: 7050 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746147726.827623:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8397 00000100:00100000:3.0:1746147726.827629:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967793971840:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.827641:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.827663:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800935e1200/0xe64d3fbf12a7db34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9c1 expref: 29 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.827674:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800935e1200/0xe64d3fbf12a7db34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9c1 expref: 29 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.827696:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935e1200/0xe64d3fbf12a7db34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9c1 expref: 29 pid: 8184 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746147726.827719:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.827753:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793971840:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 124us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.827760:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8397 00000100:00100000:3.0:1746147726.827775:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8398 00000100:00100000:3.0:1746147726.827780:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793971712:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.827786:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.827793:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880094591800/0xe64d3fbf12a7dbf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba46 expref: 10 pid: 6715 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.827800:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094591800/0xe64d3fbf12a7dbf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba46 expref: 10 pid: 6715 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.827809:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094591800/0xe64d3fbf12a7dbf8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba46 expref: 10 pid: 6715 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.827817:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.827831:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793971712:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 50us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.827835:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8398 00000100:00100000:3.0:1746147726.827843:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8399 00000100:00100000:3.0:1746147726.827847:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967793971968:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.827852:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.827857:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7db50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9d6 expref: 42 pid: 7050 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.827865:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7db50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9d6 expref: 42 pid: 7050 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.827874:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931cfa00/0xe64d3fbf12a7db50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb9d6 expref: 42 pid: 7050 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746147726.827904:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.827907:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.827914:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 41 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.827922:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 41 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.827953:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 41 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147726.827964:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796463744:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147726.828000:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147726.828030:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796463616:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147726.828047:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.828062:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6670450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1958:x1830967793971584:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3322us (3813us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.828068:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8395 00000100:00100000:2.0:1746147726.830373:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.830663:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793972224 00000100:00100000:1.0:1746147726.830673:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793972224 00002000:00100000:1.0:1746147726.830727:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x455:0x0] (737280->741375) req@ffff8800956b4700 x1830967793972224/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.830743:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b4700 with x1830967793972224 ext(737280->741375) 00002000:00010000:1.0:1746147726.830748:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b4700 00000100:00100000:1.0:1746147726.831099:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7374 00000100:00100000:1.0:1746147726.831108:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1958:x1830967793972224:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147726.832000:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1958:x1830967793972224:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 889us (1633us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147726.832010:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7374 00002000:00100000:1.0:1746147726.832019:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x455:0x0] (737280->741375) req@ffff8800956b4700 x1830967793972224/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/4536 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.832027:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b4700 with x1830967793972224 ext(737280->741375) 00002000:00010000:1.0:1746147726.832031:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b4700 00000100:00100000:3.0:1746147726.833260:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796463744:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147726.833288:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.833338:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1960:x1830967793971968:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5488us (5857us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.833348:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8399 00000100:00100000:1.0:1746147726.839137:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1960:x1830967793971456:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 14695us (14959us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147726.839150:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7373 00002000:00100000:1.0:1746147726.839162:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800951d6d80 x1830967793971456/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.839171:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d6d80 with x1830967793971456 ext(1048576->2097151) 00002000:00010000:1.0:1746147726.839177:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800951d6d80 00000100:00100000:2.0:1746147726.839272:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.839658:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793972480 00000100:00100000:1.0:1746147726.839666:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793972480 00002000:00100000:1.0:1746147726.839708:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2789376->2793471) req@ffff8800956b7100 x1830967793972480/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.839716:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b7100 with x1830967793972480 ext(2789376->2793471) 00002000:00010000:1.0:1746147726.839720:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800956b7100 00000100:00100000:0.0:1746147726.840312:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.840392:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7375 00000100:00100000:1.0:1746147726.840402:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793972480:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147726.840609:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793972608 00000100:00100000:2.0:1746147726.840614:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793972608 00000100:00100000:2.0:1746147726.840652:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16546 00000100:00100000:2.0:1746147726.840658:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:32205:x1830967793972608:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147726.840669:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147726.840720:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793972480:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 319us (1447us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147726.840726:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7375 00002000:00100000:1.0:1746147726.840733:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2789376->2793471) req@ffff8800956b7100 x1830967793972480/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/4536 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.840741:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b7100 with x1830967793972480 ext(2789376->2793471) 00002000:00010000:1.0:1746147726.840744:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800956b7100 00010000:00010000:2.0:1746147726.840761:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbabd expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.841060:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7daaf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb95f expref: 38 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.841070:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094591000/0xe64d3fbf12a7dbff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba4d expref: 10 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.841075:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7dafc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb990 expref: 27 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.841081:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.841082:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.841086:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 6/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [1048576->1228799] (req 1048576->1228799) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 38 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.841114:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7dafc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb990 expref: 27 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.841125:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7dafc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb990 expref: 27 pid: 21480 timeout: 906 lvb_type: 1 00000100:00100000:2.0:1746147726.841135:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796463872:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.841200:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094591000/0xe64d3fbf12a7dbff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba4d expref: 10 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.841207:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094591000/0xe64d3fbf12a7dbff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba4d expref: 10 pid: 6715 timeout: 906 lvb_type: 1 00000100:00100000:2.0:1746147726.841214:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796464000:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.841231:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7daaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb95f expref: 38 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.841237:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7daaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb95f expref: 38 pid: 9615 timeout: 906 lvb_type: 1 00000100:00100000:2.0:1746147726.841243:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796464128:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.841255:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.848066:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.848121:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.848211:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793972736 00000100:00100000:3.0:1746147726.848222:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793972736 00000100:00100000:3.0:1746147726.848273:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793972864 00000100:00100000:3.0:1746147726.848275:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793972864 00000100:00100000:3.0:1746147726.848293:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16547 00000100:00100000:3.0:1746147726.848300:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1959:x1830967793972736:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.848320:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.848337:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094590000/0xe64d3fbf12a7dcc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbac4 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.848360:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.848363:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147726.848372:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094590000/0xe64d3fbf12a7dcc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbac4 expref: 40 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.848387:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094590000/0xe64d3fbf12a7dcc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbac4 expref: 40 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.848399:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094590000, rc 0) 00000100:00100000:3.0:1746147726.848443:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1959:x1830967793972736:12345-192.168.202.10@tcp:101:cat.0 Request processed in 144us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.848448:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16547 00000100:00100000:3.0:1746147726.848464:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16548 00000100:00100000:3.0:1746147726.848469:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1959:x1830967793972864:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.848476:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.848485:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094590800/0xe64d3fbf12a7dcca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbacb expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147726.848526:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796464256:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147726.848577:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.850233:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.850595:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796463872:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147726.850606:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796464000:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.850620:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793972992 00000100:00100000:3.0:1746147726.850626:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793972992 00010000:00010000:3.0:1746147726.850662:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094591000/0xe64d3fbf12a7dbff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba4d expref: 11 pid: 6715 timeout: 906 lvb_type: 1 00000100:00100000:3.0:1746147726.850687:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8400 00000100:00100000:3.0:1746147726.850694:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967793972992:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147726.850719:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147726.850739:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094591000/0xe64d3fbf12a7dbff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba4d expref: 11 pid: 6715 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147726.850749:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094591000/0xe64d3fbf12a7dbff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba4d expref: 11 pid: 6715 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147726.850770:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094591000/0xe64d3fbf12a7dbff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba4d expref: 11 pid: 6715 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147726.850806:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.850843:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793972992:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 149us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.850849:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8400 00000100:00100000:0.0:1746147726.851079:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.851396:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796464128:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147726.851423:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->1228799] (req 1048576->1228799) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 40 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.851433:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0563400, rc 0) 00000100:00100000:2.0:1746147726.851471:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:32205:x1830967793972608:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 10813us (11171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.851479:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16546 00000100:00100000:0.0:1746147726.852041:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.852098:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793973376 00000100:00100000:1.0:1746147726.852103:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793973376 00010000:00010000:1.0:1746147726.852124:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7dafc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb990 expref: 28 pid: 21480 timeout: 906 lvb_type: 1 00000100:00100000:1.0:1746147726.852144:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8401 00000100:00100000:1.0:1746147726.852149:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967793973376:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147726.852158:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147726.852173:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7dafc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb990 expref: 28 pid: 21480 timeout: 906 lvb_type: 1 00010000:00010000:1.0:1746147726.852182:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7dafc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb990 expref: 28 pid: 21480 timeout: 906 lvb_type: 1 00010000:00010000:1.0:1746147726.852197:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931cf400/0xe64d3fbf12a7dafc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb990 expref: 28 pid: 21480 timeout: 906 lvb_type: 1 00000100:00100000:3.0:1746147726.852212:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793973248 00010000:00010000:1.0:1746147726.852212:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.852216:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793973248 00000100:00100000:1.0:1746147726.852232:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967793973376:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 83us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147726.852237:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8401 00000100:00100000:3.0:1746147726.852240:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5006 00000100:00100000:3.0:1746147726.852244:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32203:x1830967793973248:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147726.852560:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32203:x1830967793973248:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 314us (1481us total) trans 8589946042 rc 0/0 00000100:00100000:3.0:1746147726.852566:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5006 00000100:00100000:3.0:1746147726.853082:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796464256:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147726.853103:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094590800/0xe64d3fbf12a7dcca lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbacb expref: 39 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.853113:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094590800/0xe64d3fbf12a7dcca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbacb expref: 39 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.853121:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094590800, rc 0) 00000100:00100000:3.0:1746147726.853140:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967793972864:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4671us (5019us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147726.853146:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16548 00000100:00100000:0.0:1746147726.853522:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.854088:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793973504 00000100:00100000:2.0:1746147726.854094:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793973504 00010000:00010000:2.0:1746147726.854122:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7daaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb95f expref: 38 pid: 9615 timeout: 906 lvb_type: 1 00000100:00100000:2.0:1746147726.854152:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8402 00000100:00100000:2.0:1746147726.854158:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967793973504:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147726.854169:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147726.854182:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7daaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb95f expref: 38 pid: 9615 timeout: 906 lvb_type: 1 00010000:00010000:2.0:1746147726.854191:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7daaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb95f expref: 38 pid: 9615 timeout: 906 lvb_type: 1 00010000:00010000:2.0:1746147726.854208:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dae9e00/0xe64d3fbf12a7daaf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb95f expref: 38 pid: 9615 timeout: 906 lvb_type: 1 00010000:00010000:2.0:1746147726.854240:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.854242:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.854249:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 37 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.854256:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 37 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.854287:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 37 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147726.854298:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796464384:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147726.854362:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.857541:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796464384:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147726.857563:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147726.857620:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1959:x1830967793973504:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3460us (4096us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147726.857631:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8402 00000100:00100000:0.0:1746147726.858997:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.859086:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793973760 00000100:00100000:1.0:1746147726.859095:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793973760 00002000:00100000:1.0:1746147726.859143:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1224704->1228799) req@ffff880093cd7100 x1830967793973760/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.859154:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd7100 with x1830967793973760 ext(1224704->1228799) 00002000:00010000:1.0:1746147726.859159:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd7100 00000100:00100000:1.0:1746147726.860479:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7376 00000100:00100000:1.0:1746147726.860493:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1960:x1830967793973760:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147726.860714:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1960:x1830967793973760:12345-192.168.202.10@tcp:3:cat.0 Request processed in 225us (1722us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147726.860721:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7376 00002000:00100000:1.0:1746147726.860728:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1224704->1228799) req@ffff880093cd7100 x1830967793973760/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/4536 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147726.860737:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd7100 with x1830967793973760 ext(1224704->1228799) 00002000:00010000:1.0:1746147726.860741:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd7100 00000100:00100000:0.0:1746147726.862815:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.864299:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793974016 00000100:00100000:2.0:1746147726.864312:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793974016 00000100:00100000:0.0:1746147726.864358:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00100000:2.0:1746147726.864361:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880093cd5f80 x1830967793974016/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.864372:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5f80 with x1830967793974016 ext(2097152->3145727) 00002000:00010000:2.0:1746147726.864377:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd5f80 00000100:00100000:2.0:1746147726.864411:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7377 00000100:00100000:2.0:1746147726.864419:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1960:x1830967793974016:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147726.864990:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793974272 00000100:00100000:3.0:1746147726.864994:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793974272 00000100:00100000:3.0:1746147726.865029:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5007 00000100:00100000:3.0:1746147726.865034:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+336:32205:x1830967793974272:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147726.865245:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+337:32205:x1830967793974272:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 210us (891us total) trans 8589946043 rc 0/0 00000100:00100000:3.0:1746147726.865251:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5007 00000100:00100000:2.0:1746147726.878724:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1960:x1830967793974016:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14283us (15898us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147726.878738:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7377 00002000:00100000:2.0:1746147726.878751:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880093cd5f80 x1830967793974016/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.878761:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5f80 with x1830967793974016 ext(2097152->3145727) 00002000:00010000:2.0:1746147726.878766:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd5f80 00000100:00100000:0.0:1746147726.888223:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.888295:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793974400 00000100:00100000:3.0:1746147726.888305:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793974400 00000100:00100000:3.0:1746147726.888365:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16549 00000100:00100000:3.0:1746147726.888374:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:32200:x1830967793974400:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.888396:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.888415:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094590600/0xe64d3fbf12a7dcd1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbad2 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.888447:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2793471) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 26 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.888455:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147726.888457:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147726.888460:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094590600/0xe64d3fbf12a7dcd1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad2 expref: 38 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.888490:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2793471) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 26 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.888503:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2793471) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 26 pid: 7050 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147726.888519:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796464512:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.889264:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.892380:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.892454:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793974528 00000100:00100000:2.0:1746147726.892464:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793974528 00002000:00100000:2.0:1746147726.893336:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2269184->2793471) req@ffff88009fc11180 x1830967793974528/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.893347:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc11180 with x1830967793974528 ext(2269184->2793471) 00010000:00010000:2.0:1746147726.893358:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2793471) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 27 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746147726.893375:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2793471) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 27 pid: 7050 timeout: 906 lvb_type: 0 00002000:00010000:2.0:1746147726.893383:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc11180 00000100:00100000:2.0:1746147726.893423:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1469 00000100:00100000:2.0:1746147726.893433:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967793974528:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:3.0:1746147726.894055:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796464512:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.894086:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094590600/0xe64d3fbf12a7dcd1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad2 expref: 38 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.894102:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094590600, rc 0) 00000100:00100000:3.0:1746147726.894129:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:32200:x1830967793974400:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5757us (5917us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.894137:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16549 00000100:00100000:2.0:1746147726.903086:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1958:x1830967793974528:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 9642us (10704us total) trans 21474841611 rc 0/0 00000100:00100000:2.0:1746147726.903103:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1469 00002000:00100000:2.0:1746147726.903116:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2269184->2793471) req@ffff88009fc11180 x1830967793974528/t21474841611(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:347/0 lens 488/448 e 0 to 0 dl 1746147737 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.903127:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc11180 with x1830967793974528 ext(2269184->2793471) 00010000:00010000:2.0:1746147726.903137:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2793471) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 29 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746147726.903154:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2793471) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 29 pid: 7050 timeout: 906 lvb_type: 0 00002000:00010000:2.0:1746147726.903160:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc11180 00000100:00100000:0.0:1746147726.911862:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.912000:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793974784 00000100:00100000:3.0:1746147726.912010:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793974784 00000100:00100000:0.0:1746147726.912398:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.913233:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12027 00000100:00100000:3.0:1746147726.913250:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32212:x1830967793974784:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.913278:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.913299:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094590200/0xe64d3fbf12a7dcd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbad9 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.913411:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094590e00/0xe64d3fbf12a7dcdf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913423:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094590e00/0xe64d3fbf12a7dcdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913436:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094590e00/0xe64d3fbf12a7dcdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913450:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094591400/0xe64d3fbf12a7dce6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913456:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094591400/0xe64d3fbf12a7dce6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913460:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094591400/0xe64d3fbf12a7dce6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913566:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094591200/0xe64d3fbf12a7dced lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913575:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094591200/0xe64d3fbf12a7dced lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913581:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094591200/0xe64d3fbf12a7dced lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147726.913590:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147726.913678:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094590e00/0xe64d3fbf12a7dcdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913684:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094590e00/0xe64d3fbf12a7dcdf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913689:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094590e00/0xe64d3fbf12a7dcdf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913694:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094590e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147726.913718:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094590e00/0xe64d3fbf12a7dcdf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913725:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094590e00/0xe64d3fbf12a7dcdf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913735:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147726.913738:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147726.913743:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094590e00/0xe64d3fbf12a7dcdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913748:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094590e00/0xe64d3fbf12a7dcdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913778:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094591400/0xe64d3fbf12a7dce6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913783:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094591400/0xe64d3fbf12a7dce6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913791:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094591400/0xe64d3fbf12a7dce6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913795:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094591400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147726.913797:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094591400/0xe64d3fbf12a7dce6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913802:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094591400/0xe64d3fbf12a7dce6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913807:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a024b800) 00010000:00010000:3.0:1746147726.913809:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147726.913811:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094591400/0xe64d3fbf12a7dce6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147726.913815:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094591400/0xe64d3fbf12a7dce6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147726.913895:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793974912 00000100:00100000:2.0:1746147726.913901:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793974912 00010000:00010000:2.0:1746147726.913927:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->2793471) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 29 pid: 7050 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147726.913957:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8403 00000100:00100000:2.0:1746147726.913962:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967793974912:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147726.913972:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147726.913994:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2269184->2793471) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 29 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746147726.914007:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2269184->2793471) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 29 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746147726.914031:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094590400/0xe64d3fbf12a7dcae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2269184->2793471) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaaf expref: 29 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746147726.914056:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.914057:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147726.914064:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094590600/0xe64d3fbf12a7dcd1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad2 expref: 37 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.914070:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094590600/0xe64d3fbf12a7dcd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad2 expref: 37 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147726.914108:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094590600/0xe64d3fbf12a7dcd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad2 expref: 37 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147726.914120:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796464640:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147726.915303:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f600 going to sleep for 11 seconds 00010000:00010000:3.0:1746147726.918923:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094590200/0xe64d3fbf12a7dcd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad9 expref: 19 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.918954:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094591200/0xe64d3fbf12a7dced lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad9 expref: 18 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.918963:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147726.918966:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147726.918969:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094591200, rc 0) 00000100:00100000:3.0:1746147726.919049:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32212:x1830967793974784:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5806us (7197us total) trans 8589946044 rc 0/0 00000100:00100000:3.0:1746147726.919057:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12027 00000100:00100000:3.0:1746147726.919416:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796464640:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147726.919432:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147726.919467:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967793974912:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5504us (7069us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.919475:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8403 00000100:00100000:2.0:1746147726.922368:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.922637:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793975168 00000100:00100000:0.0:1746147726.922646:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793975168 00000100:00100000:0.0:1746147726.922710:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5008 00000100:00100000:0.0:1746147726.922718:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095028c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32212:x1830967793975168:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:1.0:1746147726.924510:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095028c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:32212:x1830967793975168:12345-192.168.202.10@tcp:35:cat.0 Request processed in 1785us (2144us total) trans 8589946045 rc 0/0 00000100:00100000:1.0:1746147726.924520:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5008 00000100:00100000:0.0:1746147726.927415:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.927478:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793975424 00000100:00100000:2.0:1746147726.927489:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793975424 00002000:00100000:2.0:1746147726.927532:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fc11c00 x1830967793975424/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.927542:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc11c00 with x1830967793975424 ext(2097152->3145727) 00002000:00010000:2.0:1746147726.927548:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc11c00 00000100:00100000:2.0:1746147726.927581:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7378 00000100:00100000:2.0:1746147726.927587:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967793975424:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147726.931023:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.931062:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.931092:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.931180:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.931193:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.931215:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793976064 00000100:00100000:0.0:1746147726.931224:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147726.931225:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793976064 00000100:00100000:0.0:1746147726.931240:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793976192 00000100:00100000:0.0:1746147726.931243:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793976192 00000100:00100000:0.0:1746147726.931265:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793976320 00000100:00100000:0.0:1746147726.931267:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793976320 00000100:00100000:2.0:1746147726.931343:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793975808 00000100:00100000:2.0:1746147726.931347:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793975808 00002000:00100000:2.0:1746147726.931384:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fc10e00 x1830967793975808/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.931394:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10e00 with x1830967793975808 ext(3145728->4194303) 00002000:00010000:2.0:1746147726.931400:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc10e00 00000100:00100000:2.0:1746147726.931412:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793975936 00000100:00100000:2.0:1746147726.931414:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793975936 00002000:00100000:2.0:1746147726.931425:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fc11f80 x1830967793975936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.931431:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc11f80 with x1830967793975936 ext(3145728->4194303) 00002000:00010000:2.0:1746147726.931435:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc11f80 00000100:00100000:2.0:1746147726.931446:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7379 00000100:00100000:2.0:1746147726.931454:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1959:x1830967793975808:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147726.932925:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793976448 00000100:00100000:0.0:1746147726.932933:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793976448 00000100:00100000:3.0:1746147726.932937:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16550 00000100:00100000:3.0:1746147726.932949:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967793976192:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.932964:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147726.932965:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16551 00000100:00100000:0.0:1746147726.932972:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967793976064:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147726.932980:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.932982:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094591600/0xe64d3fbf12a7dcfb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbae7 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.932991:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009579e800/0xe64d3fbf12a7dd02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbae0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147726.933034:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796464768:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147726.933034:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796464896:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147726.933102:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.933103:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147726.933124:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16552 00000100:00100000:0.0:1746147726.933130:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1960:x1830967793976320:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147726.933136:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147726.933143:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4e00/0xe64d3fbf12a7dd09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbaee expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.933154:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.933156:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.933164:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4e00/0xe64d3fbf12a7dd09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaee expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.933179:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4e00/0xe64d3fbf12a7dd09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaee expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.933189:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c9f4e00, rc 0) 00000100:00100000:0.0:1746147726.933209:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1960:x1830967793976320:12345-192.168.202.10@tcp:101:cat.0 Request processed in 78us (2014us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.933215:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16552 00000100:00100000:0.0:1746147726.933232:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16553 00000100:00100000:0.0:1746147726.933237:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1960:x1830967793976448:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147726.933242:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147726.933248:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7dd10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbaf5 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147726.933256:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.933257:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147726.933261:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7dd10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaf5 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.933275:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7dd10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaf5 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147726.933282:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c9f5000, rc 0) 00000100:00100000:0.0:1746147726.933297:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1960:x1830967793976448:12345-192.168.202.10@tcp:101:cat.0 Request processed in 60us (2073us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147726.933302:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16553 00000100:00100000:3.0:1746147726.934080:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7380 00000100:00100000:3.0:1746147726.934089:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1960:x1830967793975936:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147726.941956:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1959:x1830967793975424:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14356us (14537us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147726.941969:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7378 00002000:00100000:2.0:1746147726.941981:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fc11c00 x1830967793975424/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.941991:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc11c00 with x1830967793975424 ext(2097152->3145727) 00002000:00010000:2.0:1746147726.941998:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc11c00 00000100:00100000:1.0:1746147726.947162:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796464896:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147726.947202:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009579e800/0xe64d3fbf12a7dd02 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbae0 expref: 30 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.947215:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009579e800/0xe64d3fbf12a7dd02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbae0 expref: 30 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147726.947233:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009579e800, rc 0) 00000100:00100000:1.0:1746147726.947279:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967793976064:12345-192.168.202.10@tcp:101:cat.0 Request processed in 14306us (16184us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147726.947287:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16551 00000100:00100000:2.0:1746147726.947687:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967793975808:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16234us (16674us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147726.947696:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7379 00002000:00100000:2.0:1746147726.947717:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fc10e00 x1830967793975808/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147726.947726:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10e00 with x1830967793975808 ext(3145728->4194303) 00002000:00010000:2.0:1746147726.947731:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc10e00 00002000:00010000:3.0:1746147726.948462:0:7050:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime: 1746147726 -> 1746147727 00002000:00010000:3.0:1746147726.948466:0:7050:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime: 1746147726 -> 1746147727 00002000:00010000:3.0:1746147726.948468:0:7050:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime: 1746147726 -> 1746147727 00000100:00100000:3.0:1746147726.948482:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796464768:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147726.948506:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094591600/0xe64d3fbf12a7dcfb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbae7 expref: 30 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.948517:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094591600/0xe64d3fbf12a7dcfb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbae7 expref: 30 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147726.950308:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094591600, rc 0) 00000100:00100000:3.0:1746147726.950677:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1960:x1830967793975936:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16583us (19608us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147726.950687:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7380 00002000:00100000:3.0:1746147726.950696:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fc11f80 x1830967793975936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.950714:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc11f80 with x1830967793975936 ext(3145728->4194303) 00002000:00010000:3.0:1746147726.950719:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc11f80 00000100:00100000:3.0:1746147726.950752:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967793976192:12345-192.168.202.10@tcp:101:cat.0 Request processed in 17807us (19571us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147726.950757:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16550 00000100:00100000:0.0:1746147726.958233:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.960223:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793976576 00000100:00100000:3.0:1746147726.960237:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793976576 00000100:00100000:3.0:1746147726.960320:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16554 00000100:00100000:3.0:1746147726.960328:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:32212:x1830967793976576:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147726.960350:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147726.960369:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e88600/0xe64d3fbf12a7dd17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbafc expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.960401:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 39 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.960409:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147726.960410:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147726.960415:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e88600/0xe64d3fbf12a7dd17 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbafc expref: 30 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.960450:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 39 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.960462:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 39 pid: 8184 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147726.960475:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796465024:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147726.960583:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147726.961866:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796465024:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147726.961918:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e88600/0xe64d3fbf12a7dd17 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbafc expref: 30 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147726.961935:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e88600, rc 0) 00000100:00100000:3.0:1746147726.961984:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:32212:x1830967793976576:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1656us (3759us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147726.961991:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16554 00000100:00100000:0.0:1746147726.963377:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147726.963542:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793976704 00000100:00100000:3.0:1746147726.963551:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793976704 00002000:00100000:3.0:1746147726.963596:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x455:0x0] (737280->1048575) req@ffff88009fc12680 x1830967793976704/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.963607:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc12680 with x1830967793976704 ext(737280->1048575) 00010000:00010000:3.0:1746147726.963616:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 40 pid: 8184 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147726.963635:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 40 pid: 8184 timeout: 906 lvb_type: 0 00002000:00010000:3.0:1746147726.963642:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc12680 00000100:00100000:3.0:1746147726.963676:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1470 00000100:00100000:3.0:1746147726.963684:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1960:x1830967793976704:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147726.971761:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147726.971811:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793976832 00000100:00100000:2.0:1746147726.971821:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793976832 00000100:00100000:2.0:1746147726.972708:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16555 00000100:00100000:2.0:1746147726.972719:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967793976832:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147726.972738:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147726.972755:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0563e00/0xe64d3fbf12a7dd1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb03 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147726.972807:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796465152:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147726.972901:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147726.974345:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1960:x1830967793976704:12345-192.168.202.10@tcp:4:cat.0 Request processed in 10654us (10967us total) trans 17179874386 rc 0/0 00000100:00100000:3.0:1746147726.974357:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1470 00002000:00100000:3.0:1746147726.974367:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x455:0x0] (737280->1048575) req@ffff88009fc12680 x1830967793976704/t17179874386(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/448 e 0 to 0 dl 1746147737 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147726.974377:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc12680 with x1830967793976704 ext(737280->1048575) 00010000:00010000:3.0:1746147726.974387:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 44 pid: 8184 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147726.974403:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 44 pid: 8184 timeout: 906 lvb_type: 0 00002000:00010000:3.0:1746147726.974410:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc12680 00000100:00100000:0.0:1746147726.983379:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:2.0:1746147726.983528:0:7050:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime: 1746147727 -> 1746147728 00000100:00100000:2.0:1746147726.983559:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796465152:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147726.983591:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0563e00/0xe64d3fbf12a7dd1e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb03 expref: 43 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.983605:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0563e00/0xe64d3fbf12a7dd1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb03 expref: 43 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147726.983641:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0563e00, rc 0) 00000100:00100000:3.0:1746147726.983657:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793976960 00000100:00100000:3.0:1746147726.983665:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793976960 00010000:00010000:3.0:1746147726.983696:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 43 pid: 8184 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147726.983708:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1960:x1830967793976832:12345-192.168.202.10@tcp:101:cat.0 Request processed in 10983us (11951us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147726.983721:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16555 00000100:00100000:1.0:1746147726.986058:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8404 00000100:00100000:1.0:1746147726.986072:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1959:x1830967793976960:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147726.986087:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147726.986113:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 42 pid: 8184 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147726.986125:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 42 pid: 8184 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147726.986145:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0563a00/0xe64d3fbf12a7dcb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbab6 expref: 42 pid: 8184 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147726.986175:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.986177:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147726.986184:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e88600/0xe64d3fbf12a7dd17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbafc expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.986191:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e88600/0xe64d3fbf12a7dd17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbafc expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147726.986221:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093e88600/0xe64d3fbf12a7dd17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbafc expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147726.986231:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796465280:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147726.986313:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147726.993984:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147726.994062:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793977216 00000100:00100000:0.0:1746147726.994072:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793977216 00002000:00100000:0.0:1746147726.994121:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800956b5c00 x1830967793977216/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/0 e 0 to 0 dl 1746147737 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147726.994132:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b5c00 with x1830967793977216 ext(4194304->5017599) 00002000:00010000:0.0:1746147726.994137:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b5c00 00000100:00100000:0.0:1746147726.994157:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7381 00000100:00100000:0.0:1746147726.994163:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1959:x1830967793977216:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147727.002532:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796465280:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147727.002552:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147727.002592:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1959:x1830967793976960:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 16523us (19220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.002604:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8404 00000100:00100000:3.0:1746147727.002690:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.002788:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793977472 00000100:00100000:2.0:1746147727.002794:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793977472 00000100:00100000:2.0:1746147727.002832:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12028 00000100:00100000:2.0:1746147727.002838:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+337:32215:x1830967793977472:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147727.002861:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.002877:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563000/0xe64d3fbf12a7dd25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb0a expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.002985:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147727.002999:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba77 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.003006:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562000/0xe64d3fbf12a7dc84 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba93 expref: 338 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.003012:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094591200/0xe64d3fbf12a7dced lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad9 expref: 18 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.003017:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 6/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147727.003042:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094591200/0xe64d3fbf12a7dced lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad9 expref: 18 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.003052:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094591200/0xe64d3fbf12a7dced lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad9 expref: 18 pid: 5744 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147727.003064:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796465408:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147727.003122:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562000/0xe64d3fbf12a7dc84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba93 expref: 338 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.003129:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562000/0xe64d3fbf12a7dc84 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba93 expref: 338 pid: 14546 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147727.003136:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796465536:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147727.003153:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba77 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.003160:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba77 expref: 12 pid: 14546 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147727.003166:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796465664:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.003177:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147727.004342:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967793977216:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10173us (10365us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147727.004352:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7381 00002000:00100000:2.0:1746147727.004361:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800956b5c00 x1830967793977216/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:347/0 lens 488/440 e 0 to 0 dl 1746147737 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.004370:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b5c00 with x1830967793977216 ext(4194304->5017599) 00002000:00010000:2.0:1746147727.004375:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b5c00 00000100:00100000:0.0:1746147727.009016:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.009153:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793977728 00000100:00100000:2.0:1746147727.009164:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793977728 00002000:00100000:2.0:1746147727.009210:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c9a9f80 x1830967793977728/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.009221:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a9f80 with x1830967793977728 ext(0->1048575) 00002000:00010000:2.0:1746147727.009226:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9a9f80 00000100:00100000:2.0:1746147727.009248:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7382 00000100:00100000:2.0:1746147727.009255:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1960:x1830967793977728:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147727.022057:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.022068:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.022096:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.022097:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793977984 00000100:00100000:1.0:1746147727.022104:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793977984 00000100:00100000:0.0:1746147727.022111:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.022129:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147727.022142:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562000/0xe64d3fbf12a7dc84 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba93 expref: 339 pid: 14546 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746147727.022171:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793977856 00000100:00100000:1.0:1746147727.022173:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793977856 00010000:00010000:1.0:1746147727.022183:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094591200/0xe64d3fbf12a7dced lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad9 expref: 19 pid: 5744 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746147727.022201:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793978112 00000100:00100000:1.0:1746147727.022203:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793978112 00010000:00010000:1.0:1746147727.022214:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba77 expref: 13 pid: 14546 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746147727.022228:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8405 00000100:00100000:1.0:1746147727.022235:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:1959:x1830967793977984:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147727.022249:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147727.022254:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562000/0xe64d3fbf12a7dc84 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba93 expref: 339 pid: 14546 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.022262:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562000/0xe64d3fbf12a7dc84 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba93 expref: 339 pid: 14546 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.022285:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147727.022289:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147727.022297:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147727.022302:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147727.022342:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:1959:x1830967793977984:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.022349:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8405 00000100:00100000:1.0:1746147727.022366:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8406 00000100:00100000:1.0:1746147727.022371:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967793977856:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147727.022377:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147727.022380:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094591200/0xe64d3fbf12a7dced lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad9 expref: 19 pid: 5744 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.022391:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094591200/0xe64d3fbf12a7dced lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad9 expref: 19 pid: 5744 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.022401:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094591200/0xe64d3fbf12a7dced lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad9 expref: 19 pid: 5744 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.022416:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147727.022419:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147727.022423:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147727.022427:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147727.022440:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967793977856:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 70us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.022461:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8406 00000100:00100000:1.0:1746147727.022470:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8407 00000100:00100000:1.0:1746147727.022475:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+13:1959:x1830967793978112:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147727.022481:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147727.022485:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba77 expref: 13 pid: 14546 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.022492:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba77 expref: 13 pid: 14546 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.022503:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147727.022506:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147727.022512:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147727.022519:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147727.022534:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147727.022548:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+13:1959:x1830967793978112:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 73us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.022553:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8407 00000100:00100000:1.0:1746147727.022696:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793978240 00000100:00100000:1.0:1746147727.022710:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793978240 00000100:00100000:3.0:1746147727.022741:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796465408:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147727.022748:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16556 00000100:00100000:1.0:1746147727.022753:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1958:x1830967793978240:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147727.022760:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562000/0xe64d3fbf12a7dc84 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba93 expref: 338 pid: 14546 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.022768:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147727.022776:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796465536:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147727.022781:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dd33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb11 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.022794:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094590c00/0xe64d3fbf12a7dc3e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba77 expref: 12 pid: 14546 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.022799:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147727.022801:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796465664:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147727.022801:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.022809:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dd33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb11 expref: 42 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147727.022823:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147727.022823:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dd33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb11 expref: 42 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147727.022830:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147727.022832:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935e0800, rc 0) 00010000:00010000:3.0:1746147727.022835:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00080000:0.0:1746147727.022838:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00200000:3.0:1746147727.022850:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:1.0:1746147727.022852:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1958:x1830967793978240:12345-192.168.202.10@tcp:101:cat.0 Request processed in 99us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.022857:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16556 00000100:00100000:2.0:1746147727.023076:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793978496 00000100:00100000:2.0:1746147727.023080:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793978496 00000100:00100000:2.0:1746147727.023110:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12029 00000100:00100000:2.0:1746147727.023114:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093623450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32216:x1830967793978496:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147727.023126:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.023133:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7dd41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb18 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.023200:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dd48 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.023208:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dd48 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.023215:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dd48 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147727.023220:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:1.0:1746147727.023243:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1960:x1830967793977728:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13987us (14237us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147727.023250:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7382 00002000:00100000:1.0:1746147727.023257:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c9a9f80 x1830967793977728/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147727.023259:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562c00/0xe64d3fbf12a7dd41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb18 expref: 21 pid: 14546 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746147727.023266:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a9f80 with x1830967793977728 ext(0->1048575) 00002000:00010000:1.0:1746147727.023270:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9a9f80 00010000:00010000:2.0:1746147727.023278:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dd48 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb18 expref: 20 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.023284:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147727.023287:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147727.023289:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0562800, rc 0) 00000100:00100000:2.0:1746147727.023331:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093623450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32216:x1830967793978496:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 215us (1277us total) trans 8589946047 rc 0/0 00000100:00100000:2.0:1746147727.023337:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12029 00010000:00010000:3.0:1746147727.023369:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563000/0xe64d3fbf12a7dd25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb0a expref: 339 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.023379:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb0a expref: 338 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.023384:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147727.023387:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147727.023389:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0562600, rc 0) 00000100:00100000:3.0:1746147727.023404:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+338:32215:x1830967793977472:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 20567us (20715us total) trans 8589946046 rc 0/0 00000100:00100000:3.0:1746147727.023410:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12028 00000100:00100000:0.0:1746147727.052252:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.052363:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793978624 00000100:00100000:1.0:1746147727.052374:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793978624 00000100:00100000:1.0:1746147727.052489:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16557 00000100:00100000:1.0:1746147727.052499:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:32212:x1830967793978624:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147727.052518:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.052536:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb1f expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.052568:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 37 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.052575:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147727.052576:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147727.052580:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 30 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.052609:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 37 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.052623:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 37 pid: 8184 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746147727.052635:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796465792:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147727.053601:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.055067:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796465792:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147727.055090:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 30 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.055104:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935e1c00, rc 0) 00000100:00100000:1.0:1746147727.055145:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:32212:x1830967793978624:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2648us (2903us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.055153:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16557 00000100:00100000:0.0:1746147727.056351:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.057515:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793978752 00000100:00100000:1.0:1746147727.057523:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793978752 00000100:00080000:0.0:1746147727.057576:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1746147727.057586:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1228799) req@ffff88009c9aa680 x1830967793978752/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.057596:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9aa680 with x1830967793978752 ext(1048576->1228799) 00010000:00010000:1.0:1746147727.057604:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 38 pid: 8184 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.057618:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 38 pid: 8184 timeout: 906 lvb_type: 0 00002000:00010000:1.0:1746147727.057630:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c9aa680 00000100:00100000:1.0:1746147727.057657:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1471 00000100:00100000:1.0:1746147727.057665:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967793978752:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147727.061636:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.061926:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793978880 00000100:00100000:2.0:1746147727.061935:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793978880 00000100:00100000:2.0:1746147727.061989:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16558 00000100:00100000:2.0:1746147727.061996:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:32216:x1830967793978880:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147727.062014:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.062035:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb26 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.062072:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094590600/0xe64d3fbf12a7dcd1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad2 expref: 39 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.062084:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7dd10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaf5 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.062090:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.062091:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.062095:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3346432->3772415] (req 3346432->3772415) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.062127:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7dd10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaf5 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.062138:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7dd10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaf5 expref: 31 pid: 8468 timeout: 906 lvb_type: 1 00000100:00100000:2.0:1746147727.062151:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796465920:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147727.062244:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094590600/0xe64d3fbf12a7dcd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad2 expref: 39 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.062253:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094590600/0xe64d3fbf12a7dcd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad2 expref: 39 pid: 7050 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147727.062261:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796466048:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.062285:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.063197:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1957:x1830967793978752:12345-192.168.202.10@tcp:4:cat.0 Request processed in 5529us (6846us total) trans 21474841612 rc 0/0 00000100:00100000:1.0:1746147727.063206:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1471 00002000:00100000:1.0:1746147727.063215:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1228799) req@ffff88009c9aa680 x1830967793978752/t21474841612(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/448 e 0 to 0 dl 1746147738 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.063223:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9aa680 with x1830967793978752 ext(1048576->1228799) 00010000:00010000:1.0:1746147727.063230:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 40 pid: 8184 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.063240:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 40 pid: 8184 timeout: 906 lvb_type: 0 00002000:00010000:1.0:1746147727.063245:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c9aa680 00000100:00100000:0.0:1746147727.070140:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.070205:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793979008 00000100:00100000:2.0:1746147727.070213:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793979008 00000100:00100000:0.0:1746147727.070215:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147727.070249:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 40 pid: 8184 timeout: 906 lvb_type: 0 00000100:00100000:0.0:1746147727.070255:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.070264:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796465920:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.070273:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793979136 00000100:00100000:2.0:1746147727.070275:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793979136 00000100:00100000:3.0:1746147727.070277:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796466048:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147727.070284:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7dd10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaf5 expref: 32 pid: 8468 timeout: 906 lvb_type: 1 00000100:00100000:2.0:1746147727.070296:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793979264 00000100:00100000:2.0:1746147727.070298:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793979264 00010000:00010000:3.0:1746147727.070305:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3346432->3772415] (req 3346432->3772415) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 32 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.070306:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094590600/0xe64d3fbf12a7dcd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad2 expref: 41 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.070322:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0563c00, rc 0) 00000100:00100000:2.0:1746147727.070324:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8408 00000100:00100000:2.0:1746147727.070331:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1958:x1830967793979008:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147727.070343:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147727.070367:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 41 pid: 8184 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.070371:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:32216:x1830967793978880:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 8374us (8743us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147727.070377:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 41 pid: 8184 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.070379:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16558 00010000:00010000:2.0:1746147727.070400:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0563400/0xe64d3fbf12a7dcbc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1228799) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbabd expref: 41 pid: 8184 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.070408:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8409 00000100:00100000:3.0:1746147727.070414:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1959:x1830967793979136:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147727.070415:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.070417:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.070423:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147727.070424:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.070433:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.070436:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7dd10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaf5 expref: 31 pid: 8468 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147727.070445:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7dd10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaf5 expref: 31 pid: 8468 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147727.070457:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7dd10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaf5 expref: 31 pid: 8468 timeout: 906 lvb_type: 1 00010000:00010000:2.0:1746147727.070461:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147727.070473:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796466176:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147727.070476:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147727.070482:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8410 00000100:00100000:1.0:1746147727.070489:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1960:x1830967793979264:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147727.070493:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967793979136:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 79us (278us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147727.070495:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147727.070499:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8409 00010000:00010000:1.0:1746147727.070504:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094590600/0xe64d3fbf12a7dcd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad2 expref: 40 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.070512:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094590600/0xe64d3fbf12a7dcd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad2 expref: 40 pid: 7050 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147727.070518:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f600 going to sleep for 11 seconds 00010000:00010000:1.0:1746147727.070523:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094590600/0xe64d3fbf12a7dcd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbad2 expref: 40 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.070535:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.070536:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.070539:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3772415) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.070546:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3772415) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.070563:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3772415) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.070570:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796466304:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147727.070732:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.074118:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.074214:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796466176:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147727.074235:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147727.074276:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1958:x1830967793979008:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3944us (4144us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.074287:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8408 00000100:00100000:2.0:1746147727.074354:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793979392 00000100:00100000:2.0:1746147727.074361:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793979392 00000100:00100000:2.0:1746147727.074400:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16559 00000100:00100000:2.0:1746147727.074406:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:32215:x1830967793979392:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147727.074424:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.074441:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb2d expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.074476:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.074483:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.074485:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.074488:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1511424->1892351] (req 1511424->1892351) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 40 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.074514:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.074526:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 29 pid: 7050 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147727.074537:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796466432:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.074594:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.076237:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.076238:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796466304:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147727.076252:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147727.076303:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796466432:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147727.076319:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1511424->1892351] (req 1511424->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 40 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.076331:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0562e00, rc 0) 00000100:00100000:2.0:1746147727.076579:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:32215:x1830967793979392:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2171us (2470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.076579:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1960:x1830967793979264:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6089us (6322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.076586:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16559 00000100:00100000:1.0:1746147727.076587:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8410 00000100:00100000:1.0:1746147727.076612:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793979648 00000100:00100000:1.0:1746147727.076616:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793979648 00002000:00100000:1.0:1746147727.076645:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3346432->3350527) req@ffff88009c9a8a80 x1830967793979648/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.076660:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a8a80 with x1830967793979648 ext(3346432->3350527) 00002000:00010000:1.0:1746147727.076664:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9a8a80 00000100:00100000:1.0:1746147727.078116:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7383 00000100:00100000:1.0:1746147727.078127:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967793979648:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147727.079022:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967793979648:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 894us (2784us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147727.079030:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7383 00002000:00100000:1.0:1746147727.079038:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3346432->3350527) req@ffff88009c9a8a80 x1830967793979648/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/4536 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.079047:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a8a80 with x1830967793979648 ext(3346432->3350527) 00002000:00010000:1.0:1746147727.079052:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9a8a80 00000100:00100000:0.0:1746147727.079433:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.079453:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.079504:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.079518:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793980032 00000100:00100000:3.0:1746147727.079525:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793980032 00002000:00100000:3.0:1746147727.079558:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009c9aad80 x1830967793980032/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147727.079559:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793980160 00000100:00100000:1.0:1746147727.079562:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793980160 00002000:00100000:3.0:1746147727.079566:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9aad80 with x1830967793980032 ext(1048576->2097151) 00002000:00010000:3.0:1746147727.079569:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9aad80 00002000:00100000:1.0:1746147727.079578:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009c9aa300 x1830967793980160/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.079585:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9aa300 with x1830967793980160 ext(1048576->2097151) 00000100:00100000:3.0:1746147727.079587:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793980288 00000100:00100000:3.0:1746147727.079589:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793980288 00010000:00010000:1.0:1746147727.079592:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 30 pid: 7050 timeout: 906 lvb_type: 0 00002000:00100000:3.0:1746147727.079598:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009c9a8700 x1830967793980288/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.079605:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a8700 with x1830967793980288 ext(1048576->2097151) 00002000:00010000:3.0:1746147727.079607:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9a8700 00010000:00010000:1.0:1746147727.079607:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 31 pid: 7050 timeout: 906 lvb_type: 0 00002000:00010000:1.0:1746147727.079612:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c9aa300 00000100:00100000:1.0:1746147727.079772:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1472 00000100:00100000:3.0:1746147727.079782:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7384 00000100:00100000:1.0:1746147727.079782:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1958:x1830967793980160:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147727.079790:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1958:x1830967793980032:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147727.079866:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7385 00000100:00100000:2.0:1746147727.079874:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1958:x1830967793980288:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147727.085990:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.086723:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793980672 00000100:00100000:0.0:1746147727.086734:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793980672 00002000:00100000:0.0:1746147727.086782:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3768320->3772415) req@ffff88009fd1ad80 x1830967793980672/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147727.086792:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1ad80 with x1830967793980672 ext(3768320->3772415) 00002000:00010000:0.0:1746147727.086798:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1ad80 00000100:00100000:0.0:1746147727.086836:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7386 00000100:00100000:0.0:1746147727.086843:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1958:x1830967793980672:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147727.087651:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1958:x1830967793980672:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 806us (1671us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147727.087659:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7386 00002000:00100000:1.0:1746147727.087665:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3768320->3772415) req@ffff88009fd1ad80 x1830967793980672/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/4536 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.087672:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1ad80 with x1830967793980672 ext(3768320->3772415) 00002000:00010000:1.0:1746147727.087675:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1ad80 00000100:00100000:2.0:1746147727.098454:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1958:x1830967793980288:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 18568us (18935us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147727.098467:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7385 00002000:00100000:2.0:1746147727.098480:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009c9a8700 x1830967793980288/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.098490:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a8700 with x1830967793980288 ext(1048576->2097151) 00002000:00010000:2.0:1746147727.098496:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9a8700 00000100:00100000:3.0:1746147727.099115:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1958:x1830967793980032:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 19325us (19681us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147727.099124:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7384 00002000:00100000:3.0:1746147727.099131:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009c9aad80 x1830967793980032/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.099144:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9aad80 with x1830967793980032 ext(1048576->2097151) 00002000:00010000:3.0:1746147727.099147:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9aad80 00000100:00100000:2.0:1746147727.105266:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1958:x1830967793980160:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 25472us (25798us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147727.105279:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1472 00002000:00100000:2.0:1746147727.105292:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009c9aa300 x1830967793980160/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.105308:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9aa300 with x1830967793980160 ext(1048576->2097151) 00010000:00010000:2.0:1746147727.105318:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 30 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746147727.105334:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 30 pid: 7050 timeout: 906 lvb_type: 0 00002000:00010000:2.0:1746147727.105340:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c9aa300 00000100:00100000:0.0:1746147727.117104:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.117294:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793980800 00000100:00100000:1.0:1746147727.117304:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793980800 00010000:00010000:1.0:1746147727.117344:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 30 pid: 7050 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746147727.117381:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8411 00000100:00100000:1.0:1746147727.117388:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967793980800:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147727.117404:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147727.117427:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 30 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.117438:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 30 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.117460:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935e1c00/0xe64d3fbf12a7dd56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb1f expref: 30 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.117495:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.117497:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.117505:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1892351) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 38 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.117512:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1892351) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 38 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.117543:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 38 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.117555:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796466560:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147727.117707:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.120440:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.120550:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796466560:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147727.120573:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147727.120617:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967793980800:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3228us (3523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.120628:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8411 00000100:00100000:2.0:1746147727.120727:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793981056 00000100:00100000:2.0:1746147727.120734:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793981056 00002000:00100000:2.0:1746147727.120778:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1511424->1515519) req@ffff88009c9a8e00 x1830967793981056/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.120787:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a8e00 with x1830967793981056 ext(1511424->1515519) 00002000:00010000:2.0:1746147727.120792:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9a8e00 00000100:00100000:2.0:1746147727.120820:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7387 00000100:00100000:2.0:1746147727.120826:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1959:x1830967793981056:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147727.121003:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1959:x1830967793981056:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 177us (574us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147727.121009:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7387 00002000:00100000:2.0:1746147727.121014:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1511424->1515519) req@ffff88009c9a8e00 x1830967793981056/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/4536 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.121021:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a8e00 with x1830967793981056 ext(1511424->1515519) 00002000:00010000:2.0:1746147727.121024:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9a8e00 00000100:00100000:1.0:1746147727.123836:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.123878:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.123943:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.123969:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793981312 00000100:00100000:3.0:1746147727.123979:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793981312 00000100:00100000:2.0:1746147727.124011:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793981568 00000100:00100000:2.0:1746147727.124015:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793981568 00002000:00100000:3.0:1746147727.124028:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009fd1aa00 x1830967793981312/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.124037:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fd18000 x1830967793981568/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.124039:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1aa00 with x1830967793981312 ext(2097152->3145727) 00002000:00010000:3.0:1746147727.124045:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd1aa00 00002000:00100000:2.0:1746147727.124045:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18000 with x1830967793981568 ext(2097152->3145727) 00002000:00010000:2.0:1746147727.124049:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd18000 00000100:00100000:3.0:1746147727.124060:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793981824 00000100:00100000:3.0:1746147727.124062:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793981824 00000100:00100000:2.0:1746147727.124067:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7388 00002000:00100000:3.0:1746147727.124074:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fd1a680 x1830967793981824/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 504/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147727.124074:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1958:x1830967793981312:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:3.0:1746147727.124080:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1a680 with x1830967793981824 ext(3145728->4194303) 00002000:00010000:3.0:1746147727.124083:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1a680 00000100:00100000:3.0:1746147727.124093:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7389 00000100:00100000:3.0:1746147727.124099:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1958:x1830967793981568:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147727.125387:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7390 00000100:00100000:0.0:1746147727.127273:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.127325:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793982080 00000100:00100000:2.0:1746147727.127335:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793982080 00002000:00100000:2.0:1746147727.127380:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1888256->1892351) req@ffff88009c9aaa00 x1830967793982080/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.127390:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9aaa00 with x1830967793982080 ext(1888256->1892351) 00002000:00010000:2.0:1746147727.127396:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9aaa00 00000100:00100000:3.0:1746147727.128802:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1958:x1830967793981824:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147727.128840:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7391 00000100:00100000:2.0:1746147727.128851:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1960:x1830967793982080:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147727.129021:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1960:x1830967793982080:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 171us (1761us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147727.129028:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7391 00002000:00100000:2.0:1746147727.129035:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1888256->1892351) req@ffff88009c9aaa00 x1830967793982080/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/4536 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.129043:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9aaa00 with x1830967793982080 ext(1888256->1892351) 00002000:00010000:2.0:1746147727.129047:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9aaa00 00000100:00100000:3.0:1746147727.139876:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1958:x1830967793981568:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15764us (15985us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147727.139918:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7389 00002000:00100000:3.0:1746147727.139930:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fd18000 x1830967793981568/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.139947:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18000 with x1830967793981568 ext(2097152->3145727) 00002000:00010000:3.0:1746147727.139952:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd18000 00000100:00100000:2.0:1746147727.146394:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1958:x1830967793981312:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22306us (22555us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147727.146406:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7388 00002000:00100000:2.0:1746147727.146420:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009fd1aa00 x1830967793981312/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.146429:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1aa00 with x1830967793981312 ext(2097152->3145727) 00002000:00010000:2.0:1746147727.146434:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd1aa00 00000100:00100000:3.0:1746147727.149207:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1958:x1830967793981824:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20410us (25253us total) trans 0 rc 622592/622592 00000100:00100000:3.0:1746147727.149220:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7390 00002000:00100000:3.0:1746147727.149231:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fd1a680 x1830967793981824/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 504/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 622592/622592 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.149241:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1a680 with x1830967793981824 ext(3145728->4194303) 00002000:00010000:3.0:1746147727.149246:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1a680 00000100:00100000:0.0:1746147727.159148:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.159635:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793982208 00000100:00100000:3.0:1746147727.159644:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793982208 00000100:00100000:3.0:1746147727.159693:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16560 00000100:00100000:3.0:1746147727.159719:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1958:x1830967793982208:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147727.159740:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147727.159761:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5c00/0xe64d3fbf12a7dd6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb34 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147727.159817:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796466688:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147727.165906:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fc00 going to sleep for 11 seconds 00002000:00010000:2.0:1746147727.173279:0:7050:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime: 1746147727 -> 1746147728 00002000:00010000:2.0:1746147727.173288:0:7050:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime: 1746147727 -> 1746147728 00002000:00010000:2.0:1746147727.173290:0:7050:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime: 1746147727 -> 1746147728 00000100:00100000:2.0:1746147727.173315:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796466688:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147727.173357:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5c00/0xe64d3fbf12a7dd6b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb34 expref: 30 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.173374:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5c00/0xe64d3fbf12a7dd6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb34 expref: 30 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.173390:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c9f5c00, rc 0) 00000100:00100000:2.0:1746147727.173452:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1958:x1830967793982208:12345-192.168.202.10@tcp:101:cat.0 Request processed in 13736us (14315us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147727.173461:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16560 00000100:00100000:1.0:1746147727.185107:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.185146:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793982336 00000100:00100000:1.0:1746147727.185155:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793982336 00000100:00100000:1.0:1746147727.185202:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16561 00000100:00100000:1.0:1746147727.185209:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1957:x1830967793982336:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147727.185228:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.185247:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935e0400/0xe64d3fbf12a7dd72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb3b expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.185304:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796466816:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147727.185376:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a03600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.191524:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796466816:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147727.191560:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935e0400/0xe64d3fbf12a7dd72 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb3b expref: 30 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.191575:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935e0400/0xe64d3fbf12a7dd72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb3b expref: 30 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.191590:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935e0400, rc 0) 00000100:00100000:1.0:1746147727.191635:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1957:x1830967793982336:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6426us (6538us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147727.191644:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16561 00000100:00100000:0.0:1746147727.199503:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.200270:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793982464 00000100:00100000:0.0:1746147727.200280:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793982464 00000100:00100000:0.0:1746147727.200330:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16562 00000100:00100000:0.0:1746147727.200338:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1958:x1830967793982464:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147727.200355:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.200373:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f819800/0xe64d3fbf12a7dd79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb42 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147727.200425:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796466944:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147727.200493:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a22019c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.205818:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:0.0:1746147727.205829:0:7050:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime: 1746147727 -> 1746147728 00002000:00010000:0.0:1746147727.205833:0:7050:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime: 1746147727 -> 1746147728 00002000:00010000:0.0:1746147727.205835:0:7050:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime: 1746147727 -> 1746147728 00000100:00100000:0.0:1746147727.205858:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796466944:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147727.206324:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f819800/0xe64d3fbf12a7dd79 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb42 expref: 40 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.206340:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f819800/0xe64d3fbf12a7dd79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb42 expref: 40 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.206348:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f819800, rc 0) 00000100:00100000:0.0:1746147727.206394:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1958:x1830967793982464:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6057us (6903us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147727.206403:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16562 00000100:00100000:0.0:1746147727.206428:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793982592 00000100:00100000:0.0:1746147727.206434:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793982592 00000100:00100000:0.0:1746147727.206459:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16563 00000100:00100000:0.0:1746147727.206465:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1957:x1830967793982592:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147727.206480:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.206493:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7dd80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb49 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147727.206539:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796467072:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147727.206588:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a22019c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.210111:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796467072:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147727.210152:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7dd80 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb49 expref: 30 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.210166:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f819400/0xe64d3fbf12a7dd80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb49 expref: 30 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.210177:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f819400, rc 0) 00000100:00100000:0.0:1746147727.210219:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1957:x1830967793982592:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3753us (4408us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147727.210228:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16563 00000100:00100000:0.0:1746147727.221231:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.221262:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.222853:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793982848 00000100:00100000:3.0:1746147727.222867:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793982848 00002000:00100000:3.0:1746147727.222930:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c9a9880 x1830967793982848/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.222938:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a9880 with x1830967793982848 ext(0->1048575) 00002000:00010000:3.0:1746147727.222944:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9a9880 00000100:00100000:3.0:1746147727.222972:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793983104 00000100:00100000:3.0:1746147727.222975:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793983104 00002000:00100000:3.0:1746147727.222989:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880091119880 x1830967793983104/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 504/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.222995:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091119880 with x1830967793983104 ext(1048576->2097151) 00002000:00010000:3.0:1746147727.222999:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091119880 00000100:00100000:0.0:1746147727.223005:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7392 00000100:00100000:0.0:1746147727.223019:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1958:x1830967793982848:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147727.223416:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7393 00000100:00100000:3.0:1746147727.223423:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1958:x1830967793983104:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147727.239947:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1958:x1830967793982848:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16919us (18712us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147727.239959:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7392 00002000:00100000:0.0:1746147727.239972:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c9a9880 x1830967793982848/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147727.239983:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a9880 with x1830967793982848 ext(0->1048575) 00002000:00010000:0.0:1746147727.239989:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9a9880 00000100:00100000:3.0:1746147727.243193:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1958:x1830967793983104:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19762us (21921us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746147727.243204:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7393 00002000:00100000:3.0:1746147727.243218:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880091119880 x1830967793983104/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 504/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.243227:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091119880 with x1830967793983104 ext(1048576->2097151) 00002000:00010000:3.0:1746147727.243233:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091119880 00000100:00100000:0.0:1746147727.262016:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.263764:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793983232 00000100:00100000:2.0:1746147727.263776:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793983232 00000100:00100000:2.0:1746147727.263845:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16564 00000100:00100000:2.0:1746147727.263854:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:32222:x1830967793983232:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147727.263873:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.263914:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7dd87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb50 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.263944:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3772415) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 28 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.263952:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147727.263953:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147727.263956:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7dd87 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb50 expref: 40 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.263987:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3772415) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 28 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.263997:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3772415) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 28 pid: 7050 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147727.264008:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796467200:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.264111:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a917a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.267623:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796467200:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147727.267662:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7dd87 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb50 expref: 40 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.267684:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a008da00, rc 0) 00000100:00100000:1.0:1746147727.267735:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:32222:x1830967793983232:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3882us (5731us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.267748:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16564 00000100:00100000:0.0:1746147727.271251:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.271930:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793983360 00000100:00100000:3.0:1746147727.271941:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793983360 00002000:00100000:3.0:1746147727.271992:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3346432->3772415) req@ffff88009111b480 x1830967793983360/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.272005:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111b480 with x1830967793983360 ext(3346432->3772415) 00010000:00010000:3.0:1746147727.272014:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 29 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.272029:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 29 pid: 7050 timeout: 906 lvb_type: 0 00002000:00010000:3.0:1746147727.272037:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009111b480 00000100:00100000:3.0:1746147727.272059:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1473 00000100:00100000:3.0:1746147727.272066:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967793983360:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147727.310358:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1959:x1830967793983360:12345-192.168.202.10@tcp:4:cat.0 Request processed in 38276us (39103us total) trans 21474841613 rc 0/0 00000100:00100000:2.0:1746147727.310376:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1473 00002000:00100000:2.0:1746147727.310392:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3346432->3772415) req@ffff88009111b480 x1830967793983360/t21474841613(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/448 e 0 to 0 dl 1746147738 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.310404:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111b480 with x1830967793983360 ext(3346432->3772415) 00010000:00010000:2.0:1746147727.310416:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 31 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746147727.310442:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 31 pid: 7050 timeout: 906 lvb_type: 0 00002000:00010000:2.0:1746147727.310449:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009111b480 00000100:00100000:1.0:1746147727.328421:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.328455:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.330970:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793983616 00000100:00100000:1.0:1746147727.330983:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793983616 00010000:00010000:1.0:1746147727.331313:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 31 pid: 7050 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746147727.331357:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8412 00000100:00100000:1.0:1746147727.331366:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1960:x1830967793983616:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147727.331379:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147727.331401:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3346432->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 31 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.331414:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3346432->3772415) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 31 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.331438:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0563c00/0xe64d3fbf12a7dd5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3346432->3772415) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb26 expref: 31 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.331454:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.331455:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.331463:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7dd87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb50 expref: 39 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.331471:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7dd87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb50 expref: 39 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.331503:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7dd87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb50 expref: 39 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.331514:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796467328:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147727.331598:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.336556:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793983488 00000100:00100000:3.0:1746147727.336570:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793983488 00000100:00100000:3.0:1746147727.336637:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12030 00000100:00100000:3.0:1746147727.336647:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+12:32224:x1830967793983488:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147727.336677:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147727.336712:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7dd8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb57 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.336784:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4e00/0xe64d3fbf12a7dd95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.336798:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4e00/0xe64d3fbf12a7dd95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.336810:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4e00/0xe64d3fbf12a7dd95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.336825:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4a00/0xe64d3fbf12a7dd9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.336832:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4a00/0xe64d3fbf12a7dd9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.336837:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4a00/0xe64d3fbf12a7dd9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.337219:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.337234:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb0a expref: 337 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.337244:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dd48 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb18 expref: 19 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.337251:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.337289:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dd48 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb18 expref: 19 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.337303:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dd48 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb18 expref: 19 pid: 14546 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.337316:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796467456:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147727.337448:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb0a expref: 337 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.337459:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb0a expref: 337 pid: 5744 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.337467:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796467584:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147727.337484:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.337536:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.337592:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.337709:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793983872 00000100:00100000:3.0:1746147727.337714:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793983872 00000100:00100000:1.0:1746147727.337734:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796467328:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147727.337738:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793983744 00000100:00100000:3.0:1746147727.337740:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793983744 00010000:00010000:1.0:1746147727.337749:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.337754:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16565 00000100:00100000:3.0:1746147727.337759:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1959:x1830967793983872:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147727.337770:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147727.337775:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1960:x1830967793983616:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6411us (9319us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147727.337781:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b1ebe00/0xe64d3fbf12a7ddaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb65 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.337783:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8412 00010000:00010000:3.0:1746147727.337796:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.337798:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.337805:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b1ebe00/0xe64d3fbf12a7ddaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb65 expref: 32 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147727.337816:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b1ebe00/0xe64d3fbf12a7ddaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb65 expref: 32 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147727.337825:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b1ebe00, rc 0) 00000100:00100000:3.0:1746147727.337842:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1959:x1830967793983872:12345-192.168.202.10@tcp:101:cat.0 Request processed in 83us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.337847:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16565 00000100:00100000:3.0:1746147727.337859:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16566 00000100:00100000:3.0:1746147727.337864:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1960:x1830967793983744:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147727.337869:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147727.337874:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b1eae00/0xe64d3fbf12a7ddb1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb5e expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147727.337921:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796467712:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147727.337948:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f8780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.341668:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.341691:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.341731:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.344825:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793984128 00000100:00100000:3.0:1746147727.344837:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793984128 00002000:00100000:3.0:1746147727.344901:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fd1b480 x1830967793984128/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.344911:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1b480 with x1830967793984128 ext(2097152->3145727) 00002000:00010000:3.0:1746147727.344917:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1b480 00000100:00100000:3.0:1746147727.344934:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793984256 00000100:00100000:3.0:1746147727.344937:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793984256 00002000:00100000:3.0:1746147727.344948:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fd1bb80 x1830967793984256/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.344954:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1bb80 with x1830967793984256 ext(3145728->4194303) 00002000:00010000:3.0:1746147727.344956:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1bb80 00000100:00100000:3.0:1746147727.344969:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7394 00000100:00100000:3.0:1746147727.344976:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967793984128:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147727.345937:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7395 00000100:00100000:3.0:1746147727.345948:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967793984256:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147727.347009:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.347459:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793984512 00000100:00100000:1.0:1746147727.347465:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793984512 00000100:00100000:1.0:1746147727.347501:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16567 00000100:00100000:1.0:1746147727.347506:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:32228:x1830967793984512:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147727.347520:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.347536:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb6c expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.347564:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094591c00/0xe64d3fbf12a7dbe3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba38 expref: 41 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.347573:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cc31800/0xe64d3fbf12a7dc99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba9a expref: 9 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.347580:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562200/0xe64d3fbf12a7dc37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba7e expref: 34 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.347586:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.347588:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.347591:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1921024->2097151] (req 1921024->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 34 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.347619:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0562200/0xe64d3fbf12a7dc37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba7e expref: 34 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.347629:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0562200/0xe64d3fbf12a7dc37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba7e expref: 34 pid: 7050 timeout: 906 lvb_type: 1 00000100:00100000:1.0:1746147727.347641:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796467840:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147727.347726:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cc31800/0xe64d3fbf12a7dc99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba9a expref: 9 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.347734:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cc31800/0xe64d3fbf12a7dc99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba9a expref: 9 pid: 22183 timeout: 906 lvb_type: 1 00000100:00100000:1.0:1746147727.347741:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796467968:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147727.347767:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094591c00/0xe64d3fbf12a7dbe3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba38 expref: 41 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.347779:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094591c00/0xe64d3fbf12a7dbe3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba38 expref: 41 pid: 6715 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746147727.347787:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796468096:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147727.347802:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.349091:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796467584:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147727.349123:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793984768 00000100:00100000:3.0:1746147727.349129:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793984768 00000100:00100000:3.0:1746147727.349177:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5009 00000100:00100000:3.0:1746147727.349186:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+338:7669:x1830967793984768:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147727.349483:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:7669:x1830967793984768:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 298us (2475us total) trans 8589946048 rc 0/0 00000100:00100000:3.0:1746147727.349489:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5009 00000100:00100000:0.0:1746147727.350487:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.350532:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.350576:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796467712:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147727.350603:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b1eae00/0xe64d3fbf12a7ddb1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb5e expref: 34 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.350614:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b1eae00/0xe64d3fbf12a7ddb1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb5e expref: 34 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.350628:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b1eae00, rc 0) 00000100:00100000:0.0:1746147727.350649:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:1960:x1830967793983744:12345-192.168.202.10@tcp:101:cat.0 Request processed in 12785us (13056us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147727.350655:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16566 00000100:00100000:0.0:1746147727.350676:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793984896 00000100:00100000:0.0:1746147727.350679:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793984896 00010000:00010000:0.0:1746147727.350709:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dd48 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb18 expref: 20 pid: 14546 timeout: 906 lvb_type: 0 00000100:00100000:0.0:1746147727.350725:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793985024 00000100:00100000:0.0:1746147727.350727:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793985024 00010000:00010000:0.0:1746147727.350736:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc31800/0xe64d3fbf12a7dc99 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba9a expref: 10 pid: 22183 timeout: 906 lvb_type: 1 00000100:00100000:0.0:1746147727.350753:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8413 00000100:00100000:0.0:1746147727.350758:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1958:x1830967793984896:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147727.350766:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147727.350770:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dd48 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb18 expref: 20 pid: 14546 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746147727.350779:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dd48 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb18 expref: 20 pid: 14546 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746147727.350795:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147727.350799:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.350807:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.350811:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.350816:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147727.350828:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1958:x1830967793984896:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 71us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147727.350833:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8413 00000100:00100000:0.0:1746147727.350844:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8414 00000100:00100000:0.0:1746147727.350848:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967793985024:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147727.350854:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147727.350864:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cc31800/0xe64d3fbf12a7dc99 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba9a expref: 10 pid: 22183 timeout: 906 lvb_type: 1 00010000:00010000:0.0:1746147727.350871:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cc31800/0xe64d3fbf12a7dc99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba9a expref: 10 pid: 22183 timeout: 906 lvb_type: 1 00010000:00010000:0.0:1746147727.350902:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147727.350915:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967793985024:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 66us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147727.350920:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8414 00000100:00100000:0.0:1746147727.358188:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.358211:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.358226:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.358276:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793985152 00000100:00100000:0.0:1746147727.358285:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793985152 00010000:00010000:0.0:1746147727.358321:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094591c00/0xe64d3fbf12a7dbe3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba38 expref: 44 pid: 6715 timeout: 906 lvb_type: 0 00000100:00100000:0.0:1746147727.358347:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793985280 00000100:00100000:0.0:1746147727.358349:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793985280 00010000:00010000:0.0:1746147727.358359:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0562200/0xe64d3fbf12a7dc37 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba7e expref: 33 pid: 7050 timeout: 906 lvb_type: 1 00000100:00100000:0.0:1746147727.358372:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793985408 00000100:00100000:0.0:1746147727.358374:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793985408 00010000:00010000:0.0:1746147727.358384:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb0a expref: 339 pid: 5744 timeout: 906 lvb_type: 0 00000100:00100000:0.0:1746147727.358400:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8415 00000100:00100000:0.0:1746147727.358407:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1960:x1830967793985152:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147727.358420:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147727.358445:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094591c00/0xe64d3fbf12a7dbe3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba38 expref: 44 pid: 6715 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746147727.358456:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094591c00/0xe64d3fbf12a7dbe3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba38 expref: 44 pid: 6715 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746147727.358483:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147727.358525:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1960:x1830967793985152:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 118us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147727.358532:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8415 00000100:00100000:0.0:1746147727.358548:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8416 00000100:00100000:0.0:1746147727.358553:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:1957:x1830967793985280:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147727.358559:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147727.358566:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0562200/0xe64d3fbf12a7dc37 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba7e expref: 33 pid: 7050 timeout: 906 lvb_type: 1 00010000:00010000:0.0:1746147727.358574:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0562200/0xe64d3fbf12a7dc37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba7e expref: 33 pid: 7050 timeout: 906 lvb_type: 1 00010000:00010000:0.0:1746147727.358585:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.358587:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.358594:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 33 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.358601:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 33 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.358638:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 33 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147727.358652:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009111aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796468224:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147727.358721:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.358748:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8417 00000100:00100000:0.0:1746147727.358757:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:1960:x1830967793985408:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147727.358771:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147727.358780:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb0a expref: 339 pid: 5744 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746147727.358791:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb0a expref: 339 pid: 5744 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746147727.358810:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562600/0xe64d3fbf12a7dd2c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb0a expref: 339 pid: 5744 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746147727.358828:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147727.358835:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.358846:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.358853:0:7096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.358874:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147727.358932:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+338:1960:x1830967793985408:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 175us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147727.358938:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8417 00010000:00010000:0.0:1746147727.359122:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562200/0xe64d3fbf12a7dc37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba7e expref: 33 pid: 7050 timeout: 906 lvb_type: 1 00000100:00100000:0.0:1746147727.359137:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796467840:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147727.359155:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc31800/0xe64d3fbf12a7dc99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba9a expref: 9 pid: 22183 timeout: 906 lvb_type: 1 00000100:00100000:0.0:1746147727.359167:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796467968:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147727.359182:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094591c00/0xe64d3fbf12a7dbe3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba38 expref: 43 pid: 6715 timeout: 906 lvb_type: 0 00000100:00100000:0.0:1746147727.359193:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796468096:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147727.359225:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 32 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.359236:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009456a400, rc 0) 00000100:00100000:0.0:1746147727.359276:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:32228:x1830967793984512:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 11766us (17541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147727.359285:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16567 00010000:00010000:3.0:1746147727.361622:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0562800/0xe64d3fbf12a7dd48 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb18 expref: 19 pid: 14546 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.361641:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796467456:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147727.361670:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361679:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361685:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147727.361742:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:3.0:1746147727.361748:0:5744:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147727.361766:0:5744:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361779:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361789:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4e00/0xe64d3fbf12a7dd95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361796:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4e00/0xe64d3fbf12a7dd95 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361803:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4e00/0xe64d3fbf12a7dd95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361809:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cef4e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147727.361813:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4e00/0xe64d3fbf12a7dd95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361820:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4e00/0xe64d3fbf12a7dd95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361832:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147727.361835:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147727.361839:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4e00/0xe64d3fbf12a7dd95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361844:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4e00/0xe64d3fbf12a7dd95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361854:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4a00/0xe64d3fbf12a7dd9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361860:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4a00/0xe64d3fbf12a7dd9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361864:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4a00/0xe64d3fbf12a7dd9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361868:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cef4a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147727.361870:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4a00/0xe64d3fbf12a7dd9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361874:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4a00/0xe64d3fbf12a7dd9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361880:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a024b700) 00010000:00010000:3.0:1746147727.361905:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147727.361908:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4a00/0xe64d3fbf12a7dd9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361913:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef4a00/0xe64d3fbf12a7dd9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.361948:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7dd8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb57 expref: 14 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.361960:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb57 expref: 13 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.361967:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147727.361969:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147727.361971:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cef5e00, rc 0) 00000100:00100000:3.0:1746147727.362019:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+13:32224:x1830967793983488:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 25373us (33605us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.362026:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12030 00000100:00100000:3.0:1746147727.364058:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967793984128:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19071us (22391us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147727.364070:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7394 00002000:00100000:3.0:1746147727.364082:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fd1b480 x1830967793984128/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.364092:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1b480 with x1830967793984128 ext(2097152->3145727) 00002000:00010000:3.0:1746147727.364097:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1b480 00000100:00100000:3.0:1746147727.364227:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.364264:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009111aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796468224:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147727.364286:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.364308:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1957:x1830967793985280:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5755us (6096us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.364317:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8416 00000100:00100000:3.0:1746147727.364412:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793985664 00000100:00100000:3.0:1746147727.364419:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793985664 00002000:00100000:3.0:1746147727.364447:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1921024->1925119) req@ffff880094ef9500 x1830967793985664/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.364454:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef9500 with x1830967793985664 ext(1921024->1925119) 00002000:00010000:3.0:1746147727.364458:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ef9500 00000100:00100000:3.0:1746147727.364472:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7396 00000100:00100000:3.0:1746147727.364478:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1957:x1830967793985664:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147727.364605:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1957:x1830967793985664:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 127us (378us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147727.364611:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7396 00002000:00100000:3.0:1746147727.364616:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1921024->1925119) req@ffff880094ef9500 x1830967793985664/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/4536 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.364623:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef9500 with x1830967793985664 ext(1921024->1925119) 00002000:00010000:3.0:1746147727.364625:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ef9500 00000100:00100000:3.0:1746147727.370744:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.371368:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1959:x1830967793984256:12345-192.168.202.10@tcp:3:cat.0 Request processed in 25418us (29671us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147727.371379:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7395 00002000:00100000:3.0:1746147727.371391:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fd1bb80 x1830967793984256/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.371405:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1bb80 with x1830967793984256 ext(3145728->4194303) 00002000:00010000:3.0:1746147727.371411:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1bb80 00000100:00100000:3.0:1746147727.371457:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.371533:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793985792 00000100:00100000:1.0:1746147727.371541:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793985792 00000100:00100000:1.0:1746147727.371570:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793986432 00000100:00100000:1.0:1746147727.371572:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793986432 00000100:00100000:1.0:1746147727.371587:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16568 00000100:00100000:1.0:1746147727.371593:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:32229:x1830967793985792:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147727.371606:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.371623:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffe00/0xe64d3fbf12a7ddbf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb73 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.371650:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 38 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.371657:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147727.371659:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147727.371663:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffe00/0xe64d3fbf12a7ddbf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb73 expref: 32 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.371693:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1892351) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 38 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.371721:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1892351) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 38 pid: 7050 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746147727.371733:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796468352:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147727.371781:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.371799:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16569 00000100:00100000:1.0:1746147727.371804:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:32228:x1830967793986432:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147727.371812:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.371821:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb96 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.371836:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7dc68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba8c expref: 41 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.371842:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4e00/0xe64d3fbf12a7dd09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaee expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.371847:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.371848:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.371850:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1163263] (req 1048576->1163263) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 31 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.371864:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4e00/0xe64d3fbf12a7dd09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaee expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.371876:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4e00/0xe64d3fbf12a7dd09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaee expref: 31 pid: 8468 timeout: 906 lvb_type: 1 00000100:00100000:1.0:1746147727.371906:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796468480:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147727.371935:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7dc68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba8c expref: 41 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.371943:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7dc68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba8c expref: 41 pid: 7050 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746147727.371951:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796468608:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147727.371972:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.374983:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.375008:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.375022:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.375036:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.375048:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.375115:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793986048 00000100:00100000:0.0:1746147727.375124:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793986048 00000100:00100000:0.0:1746147727.375806:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793985920 00000100:00100000:0.0:1746147727.375810:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793985920 00000100:00100000:0.0:1746147727.375825:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793986304 00000100:00100000:0.0:1746147727.375826:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793986304 00000100:00100000:0.0:1746147727.375835:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793986176 00000100:00100000:0.0:1746147727.375837:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793986176 00000100:00100000:0.0:1746147727.375845:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793986560 00000100:00100000:0.0:1746147727.375847:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793986560 00000100:00100000:0.0:1746147727.375862:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16570 00000100:00100000:0.0:1746147727.375869:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967793986048:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147727.375905:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.375924:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7ddcd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb81 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147727.375976:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009111b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796468736:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147727.376239:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796468480:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147727.376249:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796468608:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147727.376274:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1163263] (req 1048576->1163263) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 31 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.376285:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00fe000, rc 0) 00000100:00100000:2.0:1746147727.376500:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16571 00000100:00100000:2.0:1746147727.376509:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967793985920:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147727.376517:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.376527:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a7ddd4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb7a expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.376539:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.376541:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.376550:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a7ddd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb7a expref: 11 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.376562:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a7ddd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb7a expref: 11 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.376569:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090aba400, rc 0) 00000100:00100000:0.0:1746147727.377180:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.377206:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16572 00000100:00100000:0.0:1746147727.377214:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967793986304:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147727.377223:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.377231:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7dddb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb8f expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.377242:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.377250:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7dddb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb8f expref: 12 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.377257:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348e5400/0xe64d3fbf12a7dddb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb8f expref: 12 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.377266:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e5400, rc 0) 00000100:00100000:1.0:1746147727.377311:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:32228:x1830967793986432:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5504us (5851us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.377318:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16569 00000100:00100000:1.0:1746147727.377458:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16573 00000100:00100000:1.0:1746147727.377465:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967793986176:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147727.377474:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.377484:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7dde2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb88 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.377516:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796468864:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147727.377541:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.377564:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796468352:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147727.377578:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffe00/0xe64d3fbf12a7ddbf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb73 expref: 32 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.377586:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00ffe00, rc 0) 00000100:00100000:1.0:1746147727.377600:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:32229:x1830967793985792:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6008us (6866us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.377605:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16568 00000100:00100000:1.0:1746147727.377617:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16574 00000100:00100000:1.0:1746147727.377622:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967793986560:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147727.377627:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.377633:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe800/0xe64d3fbf12a7dde9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbb9d expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.377641:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.377643:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.377647:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe800/0xe64d3fbf12a7dde9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb9d expref: 14 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.377656:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe800/0xe64d3fbf12a7dde9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb9d expref: 14 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.377662:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00fe800, rc 0) 00000100:00100000:1.0:1746147727.377673:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967793986560:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 52us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.377678:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16574 00000100:00100000:2.0:1746147727.377742:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967793985920:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 1233us (2731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.377747:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16571 00000100:00100000:0.0:1746147727.378147:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793986304:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 934us (3122us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147727.378153:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16572 00000100:00100000:0.0:1746147727.380255:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.380537:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.380560:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.380619:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793986688 00000100:00100000:3.0:1746147727.380628:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793986688 00002000:00100000:3.0:1746147727.380671:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (1511424->1892351) req@ffff880091119c00 x1830967793986688/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.380681:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091119c00 with x1830967793986688 ext(1511424->1892351) 00010000:00010000:3.0:1746147727.380691:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 39 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.380715:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 39 pid: 7050 timeout: 906 lvb_type: 0 00002000:00010000:3.0:1746147727.380722:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091119c00 00000100:00100000:3.0:1746147727.380742:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1474 00000100:00100000:3.0:1746147727.380750:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1957:x1830967793986688:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147727.381969:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793986816 00000100:00100000:3.0:1746147727.381975:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793986816 00010000:00010000:3.0:1746147727.382002:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4e00/0xe64d3fbf12a7dd09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaee expref: 31 pid: 8468 timeout: 906 lvb_type: 1 00000100:00100000:3.0:1746147727.382276:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793986944 00000100:00100000:3.0:1746147727.382279:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793986944 00010000:00010000:3.0:1746147727.382291:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7dc68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba8c expref: 42 pid: 7050 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.382305:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8418 00000100:00100000:3.0:1746147727.382311:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1959:x1830967793986816:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147727.382323:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147727.382343:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4e00/0xe64d3fbf12a7dd09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaee expref: 31 pid: 8468 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147727.382353:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4e00/0xe64d3fbf12a7dd09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaee expref: 31 pid: 8468 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147727.382374:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4e00/0xe64d3fbf12a7dd09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbaee expref: 31 pid: 8468 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147727.382389:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147727.382406:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8419 00000100:00100000:0.0:1746147727.382413:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1959:x1830967793986944:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147727.382418:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967793986816:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 107us (1881us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147727.382420:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147727.382424:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8418 00010000:00010000:0.0:1746147727.382427:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7dc68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba8c expref: 42 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746147727.382434:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7dc68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba8c expref: 42 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746147727.382446:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7dc68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba8c expref: 42 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746147727.382454:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.382456:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.382463:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.382471:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.382499:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147727.382510:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796468992:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147727.382556:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.384250:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009111b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796468736:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147727.384290:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7ddcd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb81 expref: 13 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.384312:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7ddcd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb81 expref: 13 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.384323:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e5a00, rc 0) 00000100:00100000:0.0:1746147727.384378:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967793986048:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 8509us (9404us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147727.384386:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16570 00000001:00080000:3.0:1746147727.387930:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841599 is committed 00000001:00080000:3.0:1746147727.387954:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841591 is committed 00000001:00080000:3.0:1746147727.387963:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841612 is committed 00000001:00080000:3.0:1746147727.387973:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841610 is committed 00000001:00080000:3.0:1746147727.388042:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841611 is committed 00000001:00080000:3.0:1746147727.388050:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841607 is committed 00000100:00100000:1.0:1746147727.390241:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.390276:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.390288:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.390331:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.390348:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796468992:192.168.202.10@tcp:105: 00002000:00010000:1.0:1746147727.390374:0:6715:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime: 1746147727 -> 1746147728 00010000:00010000:2.0:1746147727.390375:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1746147727.390377:0:6715:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime: 1746147727 -> 1746147728 00002000:00010000:1.0:1746147727.390379:0:6715:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime: 1746147727 -> 1746147728 00000100:00100000:1.0:1746147727.390397:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796468864:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147727.390417:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967793986944:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 8004us (9855us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147727.390420:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7dde2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb88 expref: 8 pid: 6715 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147727.390428:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8419 00010000:00010000:1.0:1746147727.390433:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7dde2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb88 expref: 8 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.390443:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00fea00, rc 0) 00000100:00100000:1.0:1746147727.390459:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967793986176:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 12995us (15421us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147727.390465:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16573 00000100:00100000:3.0:1746147727.390507:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793987584 00000100:00100000:3.0:1746147727.390514:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793987584 00002000:00100000:3.0:1746147727.390549:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1159168->1163263) req@ffff880093cd4a80 x1830967793987584/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.390563:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4a80 with x1830967793987584 ext(1159168->1163263) 00002000:00010000:3.0:1746147727.390567:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd4a80 00000100:00100000:3.0:1746147727.390582:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7397 00000100:00100000:3.0:1746147727.390588:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967793987584:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147727.390740:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967793987584:12345-192.168.202.10@tcp:3:cat.0 Request processed in 151us (407us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147727.390745:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7397 00002000:00100000:3.0:1746147727.390750:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1159168->1163263) req@ffff880093cd4a80 x1830967793987584/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/4536 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.390755:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4a80 with x1830967793987584 ext(1159168->1163263) 00002000:00010000:3.0:1746147727.390758:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd4a80 00000100:00100000:3.0:1746147727.390968:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.391069:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793987072 00000100:00100000:1.0:1746147727.391074:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793987072 00000100:00100000:1.0:1746147727.391092:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793987200 00000100:00100000:1.0:1746147727.391094:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793987200 00000100:00100000:1.0:1746147727.391103:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793987328 00000100:00100000:1.0:1746147727.391105:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793987328 00000100:00100000:1.0:1746147727.391116:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16575 00000100:00100000:1.0:1746147727.391122:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1960:x1830967793987072:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147727.391131:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.391146:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe400/0xe64d3fbf12a7ddf0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbba4 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.391190:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796469120:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147727.391237:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.391252:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16576 00000100:00100000:1.0:1746147727.391257:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967793987200:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147727.391263:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.391270:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00ff400/0xe64d3fbf12a7ddf7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbbab expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.391289:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796469248:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147727.391308:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.391323:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16577 00000100:00100000:1.0:1746147727.391328:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967793987328:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147727.391334:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.391343:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7ddfe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbbb2 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.391366:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796469376:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147727.391384:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147727.392422:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793987840 00000100:00100000:2.0:1746147727.392430:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793987840 00000100:00100000:2.0:1746147727.392463:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12031 00000100:00100000:2.0:1746147727.392468:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+338:32231:x1830967793987840:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147727.392485:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.392499:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090abac00/0xe64d3fbf12a7de05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbbb9 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.392583:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147727.392596:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb57 expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.392603:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147727.392626:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb57 expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.392637:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb57 expref: 12 pid: 5744 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147727.392647:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796469504:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.392705:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.394363:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967793986688:12345-192.168.202.10@tcp:4:cat.0 Request processed in 13609us (14108us total) trans 21474841614 rc 0/0 00000100:00100000:3.0:1746147727.394374:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1474 00002000:00100000:3.0:1746147727.394384:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (1511424->1892351) req@ffff880091119c00 x1830967793986688/t21474841614(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/448 e 0 to 0 dl 1746147738 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.394394:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091119c00 with x1830967793986688 ext(1511424->1892351) 00010000:00010000:3.0:1746147727.394402:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 21 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.394414:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 21 pid: 7050 timeout: 906 lvb_type: 0 00002000:00010000:3.0:1746147727.394425:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091119c00 00000100:00100000:1.0:1746147727.395010:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.395053:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.395119:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793988352 00000100:00100000:3.0:1746147727.395126:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793988352 00000100:00100000:1.0:1746147727.395156:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796469248:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147727.395160:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5010 00000100:00100000:3.0:1746147727.395167:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:32228:x1830967793988352:12345-192.168.202.10@tcp:35:multiop.0 00010000:00010000:1.0:1746147727.395185:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00ff400/0xe64d3fbf12a7ddf7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbab expref: 20 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.395198:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00ff400/0xe64d3fbf12a7ddf7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbab expref: 20 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.395206:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00ff400, rc 0) 00000100:00100000:1.0:1746147727.395231:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967793987200:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3973us (4954us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147727.395238:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16576 00000100:00100000:0.0:1746147727.395270:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796469120:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147727.395287:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe400/0xe64d3fbf12a7ddf0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbba4 expref: 18 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.395299:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe400/0xe64d3fbf12a7ddf0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbba4 expref: 18 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.395306:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00fe400, rc 0) 00000100:00100000:3.0:1746147727.395316:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32228:x1830967793988352:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 149us (262us total) trans 8589946049 rc 0/0 00000100:00100000:0.0:1746147727.395320:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1960:x1830967793987072:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4199us (5088us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147727.395322:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5010 00000100:00100000:0.0:1746147727.395325:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16575 00000100:00100000:3.0:1746147727.395339:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793988096 00000100:00100000:3.0:1746147727.395342:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793988096 00002000:00010000:1.0:1746147727.395356:0:8184:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime: 1746147727 -> 1746147728 00000100:00100000:3.0:1746147727.395360:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12032 00002000:00010000:1.0:1746147727.395360:0:8184:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime: 1746147727 -> 1746147728 00002000:00010000:1.0:1746147727.395362:0:8184:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime: 1746147727 -> 1746147728 00000100:00100000:3.0:1746147727.395364:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+13:32224:x1830967793988096:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147727.395371:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147727.395374:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796469376:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147727.395385:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7de13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbbc0 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.395388:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7ddfe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbb2 expref: 42 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.395398:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7ddfe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbb2 expref: 42 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.395405:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5715a00, rc 0) 00000100:00100000:1.0:1746147727.395426:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967793987328:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4097us (5136us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147727.395432:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16577 00010000:00010000:3.0:1746147727.395442:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a002da00/0xe64d3fbf12a7de1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147727.395455:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a002da00/0xe64d3fbf12a7de1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147727.395482:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a002da00/0xe64d3fbf12a7de1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147727.404781:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.404801:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.404815:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.404829:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.404920:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.404946:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793988864 00000100:00100000:0.0:1746147727.404946:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793988480 00000100:00100000:1.0:1746147727.404954:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793988864 00000100:00100000:0.0:1746147727.404954:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793988480 00010000:00010000:0.0:1746147727.404988:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb57 expref: 15 pid: 5744 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746147727.404990:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793988736 00000100:00100000:1.0:1746147727.404991:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793988736 00000100:00100000:1.0:1746147727.405000:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793988992 00000100:00100000:1.0:1746147727.405001:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793988992 00000100:00100000:1.0:1746147727.405016:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16578 00000100:00100000:1.0:1746147727.405024:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1959:x1830967793988864:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147727.405044:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.405060:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7de21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbbce expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.405113:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796469632:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147727.405271:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.405357:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796469504:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147727.405380:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147727.405389:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793988608 00000100:00100000:0.0:1746147727.405392:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793988608 00010000:00010000:0.0:1746147727.405403:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 20 pid: 7050 timeout: 906 lvb_type: 0 00000100:00100000:0.0:1746147727.405417:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8420 00000100:00100000:0.0:1746147727.405422:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+15:1958:x1830967793988480:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147727.405431:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147727.405437:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb57 expref: 15 pid: 5744 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.405440:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8421 00000100:00100000:3.0:1746147727.405445:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1958:x1830967793988608:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147727.405446:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb57 expref: 15 pid: 5744 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.405451:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147727.405465:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cef5e00/0xe64d3fbf12a7dda3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb57 expref: 15 pid: 5744 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.405472:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 20 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.405480:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1892351) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 20 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746147727.405480:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147727.405484:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.405493:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0562e00/0xe64d3fbf12a7dd64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1892351) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb2d expref: 20 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746147727.405494:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.405500:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.405502:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.405504:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.405506:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a002da00/0xe64d3fbf12a7de1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147727.405509:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffe00/0xe64d3fbf12a7ddbf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb73 expref: 9 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.405511:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a002da00/0xe64d3fbf12a7de1a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147727.405516:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffe00/0xe64d3fbf12a7ddbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb73 expref: 9 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.405516:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a002da00/0xe64d3fbf12a7de1a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147727.405528:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147727.405534:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffe00/0xe64d3fbf12a7ddbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb73 expref: 9 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147727.405541:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796469760:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147727.405544:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+14:1958:x1830967793988480:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 122us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147727.405549:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8420 00000100:00100000:3.0:1746147727.405558:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93903c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.405574:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16579 00000100:00100000:0.0:1746147727.405579:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1959:x1830967793988736:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147727.405585:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.405590:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7de28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbbc7 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.405599:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.405600:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.405604:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7de28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbc7 expref: 20 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147727.405608:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a002da00/0xe64d3fbf12a7de1a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147727.405614:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a002da00/0xe64d3fbf12a7de1a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147727.405614:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7de28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbc7 expref: 20 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.405621:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cef5400, rc 0) 00000004:00200000:3.0:1746147727.405632:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:0.0:1746147727.405636:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1959:x1830967793988736:12345-192.168.202.10@tcp:101:cat.0 Request processed in 57us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147727.405640:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16579 00000100:00100000:0.0:1746147727.405654:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16580 00000100:00100000:0.0:1746147727.405658:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967793988992:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147727.405665:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.405674:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cef5800/0xe64d3fbf12a7de36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbbd5 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147727.405707:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796469888:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147727.405726:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00010000:00010000:3.0:1746147727.405769:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7de13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbc0 expref: 15 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.405780:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a002da00/0xe64d3fbf12a7de1a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbc0 expref: 14 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.405785:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147727.405787:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147727.405789:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a002da00, rc 0) 00000100:00100000:3.0:1746147727.405808:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+14:32224:x1830967793988096:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 10443us (10800us total) trans 8589946050 rc 0/0 00000100:00100000:3.0:1746147727.405813:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12032 00010000:00010000:3.0:1746147727.407365:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.407377:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147727.407396:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147727.407502:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090abac00/0xe64d3fbf12a7de05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbb9 expref: 341 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.407515:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbb9 expref: 340 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.407527:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147727.407530:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147727.407533:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090abbc00, rc 0) 00000100:00100000:3.0:1746147727.408044:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+340:32231:x1830967793987840:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 15573us (17073us total) trans 8589946051 rc 0/0 00000100:00100000:3.0:1746147727.408051:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12031 00000100:00100000:3.0:1746147727.408228:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796469760:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147727.408245:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.408268:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1958:x1830967793988608:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2822us (3465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.408276:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8421 00000100:00100000:1.0:1746147727.408396:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796469632:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147727.408416:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7de21 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbce expref: 18 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.408427:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7de21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbce expref: 18 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.408434:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5715200, rc 0) 00000100:00100000:1.0:1746147727.408454:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1959:x1830967793988864:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3432us (3637us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147727.408461:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16578 00000100:00100000:0.0:1746147727.411915:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.411965:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793989248 00000100:00100000:2.0:1746147727.411975:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793989248 00000100:00100000:2.0:1746147727.412014:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12033 00000100:00100000:2.0:1746147727.412021:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+14:32224:x1830967793989248:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147727.412041:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.412045:0:5744:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147727.412071:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a002da00/0xe64d3fbf12a7de1a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbc0 expref: 14 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.412085:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147727.412089:0:5744:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147727.412098:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051ae00/0xe64d3fbf12a7de44 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbbdc expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.412183:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147727.412196:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbb9 expref: 339 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.412203:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 4/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147727.412231:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbb9 expref: 339 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.412242:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbb9 expref: 339 pid: 5744 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147727.412254:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796470016:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.412313:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8a036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.412546:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796469888:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147727.412571:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cef5800/0xe64d3fbf12a7de36 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbd5 expref: 42 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.412581:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cef5800/0xe64d3fbf12a7de36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbd5 expref: 42 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.412589:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cef5800, rc 0) 00000100:00100000:1.0:1746147727.412616:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967793988992:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6957us (7699us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147727.412624:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16580 00000100:00100000:2.0:1746147727.416379:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.416508:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.416611:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.416659:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796470016:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147727.416683:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147727.416757:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793989504 00000100:00100000:1.0:1746147727.416763:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793989504 00000100:00100000:1.0:1746147727.416805:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16581 00000100:00100000:1.0:1746147727.416812:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1959:x1830967793989504:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147727.416828:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.416845:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffa00/0xe64d3fbf12a7de52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbbe3 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.416917:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796470144:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147727.416986:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.417093:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793989376 00000100:00100000:3.0:1746147727.417097:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793989376 00010000:00010000:3.0:1746147727.417116:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbb9 expref: 340 pid: 5744 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.417134:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8422 00000100:00100000:3.0:1746147727.417139:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+340:1958:x1830967793989376:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147727.417149:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147727.417153:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbb9 expref: 340 pid: 5744 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.417163:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbb9 expref: 340 pid: 5744 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.417190:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090abbc00/0xe64d3fbf12a7de0c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbb9 expref: 340 pid: 5744 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.417202:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147727.417207:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.417216:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.417223:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147727.417238:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.417262:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:1958:x1830967793989376:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 122us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.417268:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8422 00000100:00100000:3.0:1746147727.417291:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793989760 00000100:00100000:3.0:1746147727.417294:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793989760 00002000:00100000:3.0:1746147727.417317:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800951d6a00 x1830967793989760/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.417326:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d6a00 with x1830967793989760 ext(1048576->2097151) 00002000:00010000:3.0:1746147727.417330:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d6a00 00000100:00100000:3.0:1746147727.417343:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7398 00000100:00100000:3.0:1746147727.417348:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967793989760:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:0.0:1746147727.417864:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.417871:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.417907:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.417913:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.417919:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.417925:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a051b600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147727.417928:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.417934:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.417943:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147727.417945:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147727.417949:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.417953:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de4b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147727.417984:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051ae00/0xe64d3fbf12a7de44 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbdc expref: 14 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.417991:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051ae00/0xe64d3fbf12a7de44 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbdc expref: 14 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.417999:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a051ae00, rc 0) 00000100:00100000:0.0:1746147727.418024:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+13:32224:x1830967793989248:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 6003us (6117us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147727.418029:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12033 00000100:00100000:1.0:1746147727.419049:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.419068:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.419084:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.419098:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.419201:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796470144:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147727.419225:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffa00/0xe64d3fbf12a7de52 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbe3 expref: 18 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.419236:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffa00/0xe64d3fbf12a7de52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbe3 expref: 18 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.419244:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00ffa00, rc 0) 00000100:00100000:1.0:1746147727.419267:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1959:x1830967793989504:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2455us (2759us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147727.419273:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16581 00000100:00100000:1.0:1746147727.419289:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793990400 00000100:00100000:1.0:1746147727.419293:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793990400 00000100:00100000:1.0:1746147727.419310:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793990528 00000100:00100000:1.0:1746147727.419311:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793990528 00000100:00100000:1.0:1746147727.419321:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16582 00000100:00100000:1.0:1746147727.419326:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967793990400:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147727.419336:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.419348:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00ffc00/0xe64d3fbf12a7de59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbbea expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.419384:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796470272:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147727.419416:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.419476:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16583 00000100:00100000:1.0:1746147727.419481:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:32231:x1830967793990528:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147727.419486:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.419492:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbbf1 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.419507:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e88600/0xe64d3fbf12a7dd17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbafc expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.419514:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a7ddd4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb7a expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.419520:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dd33 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb11 expref: 44 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.419525:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.419526:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.419529:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [876544->1048575] (req 876544->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 44 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.419546:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dd33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb11 expref: 44 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.419555:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dd33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb11 expref: 44 pid: 22183 timeout: 906 lvb_type: 1 00000100:00100000:1.0:1746147727.419563:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796470400:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147727.419588:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a7ddd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb7a expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.419595:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a7ddd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb7a expref: 9 pid: 9615 timeout: 906 lvb_type: 1 00000100:00100000:1.0:1746147727.419607:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe42d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796470528:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147727.419622:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093e88600/0xe64d3fbf12a7dd17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbafc expref: 29 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.419628:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093e88600/0xe64d3fbf12a7dd17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbafc expref: 29 pid: 7050 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746147727.419634:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe41c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796470656:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147727.419644:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147727.419719:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793990016 00000100:00100000:2.0:1746147727.419723:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793990016 00002000:00100000:2.0:1746147727.419745:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1921023) req@ffff880093cd5880 x1830967793990016/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.419753:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5880 with x1830967793990016 ext(1048576->1921023) 00002000:00010000:2.0:1746147727.419757:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd5880 00000100:00100000:2.0:1746147727.419768:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793990272 00000100:00100000:2.0:1746147727.419770:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793990272 00002000:00100000:2.0:1746147727.419778:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1163264->2097151) req@ffff880093cd6a00 x1830967793990272/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.419784:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd6a00 with x1830967793990272 ext(1163264->2097151) 00002000:00010000:2.0:1746147727.419786:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd6a00 00000100:00100000:2.0:1746147727.419794:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7399 00000100:00100000:2.0:1746147727.419799:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967793990016:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147727.421049:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7400 00000100:00100000:3.0:1746147727.421060:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1960:x1830967793990272:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147727.422047:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.423208:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793990784 00000100:00100000:3.0:1746147727.423220:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793990784 00000100:00100000:3.0:1746147727.423272:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5011 00000100:00100000:3.0:1746147727.423280:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+13:32224:x1830967793990784:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147727.423458:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796470272:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147727.423471:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+14:32224:x1830967793990784:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 191us (1429us total) trans 8589946052 rc 0/0 00000100:00100000:3.0:1746147727.423477:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5011 00010000:00010000:1.0:1746147727.423489:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00ffc00/0xe64d3fbf12a7de59 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbea expref: 44 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.423565:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00ffc00/0xe64d3fbf12a7de59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbea expref: 44 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.423578:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00ffc00, rc 0) 00000100:00100000:1.0:1746147727.423632:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1960:x1830967793990400:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4304us (4545us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147727.423639:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16582 00000100:00100000:1.0:1746147727.423681:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796470400:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147727.428596:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.428628:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.428648:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793990912 00000100:00100000:3.0:1746147727.428655:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793990912 00010000:00010000:3.0:1746147727.428689:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dd33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb11 expref: 43 pid: 22183 timeout: 906 lvb_type: 1 00000100:00100000:0.0:1746147727.428749:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe42d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796470528:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147727.428760:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe41c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796470656:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147727.428789:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [876544->1048575] (req 876544->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 43 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.428804:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00fea00, rc 0) 00000100:00100000:0.0:1746147727.428835:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:32231:x1830967793990528:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 9354us (9735us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147727.428843:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16583 00000100:00100000:0.0:1746147727.428873:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793991040 00000100:00100000:0.0:1746147727.428876:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793991040 00000100:00100000:3.0:1746147727.428974:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8423 00000100:00100000:3.0:1746147727.428981:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1959:x1830967793990912:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147727.428992:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147727.429009:0:15900:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 1951 -> 1991 00010000:00010000:3.0:1746147727.429014:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dd33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb11 expref: 42 pid: 22183 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147727.429024:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dd33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb11 expref: 42 pid: 22183 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147727.429045:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935e0800/0xe64d3fbf12a7dd33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb11 expref: 42 pid: 22183 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147727.429059:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.429078:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967793990912:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 99us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.429083:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8423 00010000:00010000:0.0:1746147727.429402:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a7ddd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb7a expref: 10 pid: 9615 timeout: 906 lvb_type: 1 00000100:00100000:0.0:1746147727.429424:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8424 00000100:00100000:0.0:1746147727.429429:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967793991040:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147727.429435:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147727.429443:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a7ddd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb7a expref: 10 pid: 9615 timeout: 906 lvb_type: 1 00010000:00010000:0.0:1746147727.429455:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a7ddd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb7a expref: 10 pid: 9615 timeout: 906 lvb_type: 1 00010000:00010000:0.0:1746147727.429466:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a7ddd4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb7a expref: 10 pid: 9615 timeout: 906 lvb_type: 1 00010000:00010000:0.0:1746147727.429472:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147727.429487:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967793991040:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 58us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147727.429492:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8424 00000100:00100000:3.0:1746147727.433143:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.433767:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967793989760:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16415us (17152us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147727.433906:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793991168 00000100:00100000:1.0:1746147727.433914:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793991168 00010000:00010000:1.0:1746147727.433945:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093e88600/0xe64d3fbf12a7dd17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbafc expref: 32 pid: 7050 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746147727.433972:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8425 00000100:00100000:1.0:1746147727.433977:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1957:x1830967793991168:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147727.433989:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147727.434007:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093e88600/0xe64d3fbf12a7dd17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbafc expref: 32 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.434017:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093e88600/0xe64d3fbf12a7dd17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbafc expref: 32 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.434037:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e88600/0xe64d3fbf12a7dd17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbafc expref: 32 pid: 7050 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.434049:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.434051:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147727.434058:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 40 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.434065:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 40 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.434093:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 40 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.434103:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe41500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796470784:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147727.434144:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147727.434329:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7398 00002000:00100000:2.0:1746147727.434337:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800951d6a00 x1830967793989760/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.434351:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d6a00 with x1830967793989760 ext(1048576->2097151) 00002000:00010000:2.0:1746147727.434355:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d6a00 00000100:00100000:3.0:1746147727.437110:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1960:x1830967793990272:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16039us (18026us total) trans 0 rc 933888/933888 00000100:00100000:3.0:1746147727.437123:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7400 00002000:00100000:3.0:1746147727.437135:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1163264->2097151) req@ffff880093cd6a00 x1830967793990272/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 933888/933888 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.437144:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd6a00 with x1830967793990272 ext(1163264->2097151) 00002000:00010000:3.0:1746147727.437149:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd6a00 00000100:00100000:3.0:1746147727.439172:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967793990016:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19360us (20114us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746147727.439183:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7399 00002000:00100000:3.0:1746147727.439194:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1921023) req@ffff880093cd5880 x1830967793990016/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.439202:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5880 with x1830967793990016 ext(1048576->1921023) 00002000:00010000:3.0:1746147727.439207:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd5880 00000100:00100000:1.0:1746147727.442360:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.442416:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793991424 00000100:00100000:1.0:1746147727.442420:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe41500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796470784:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147727.442422:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793991424 00010000:00010000:1.0:1746147727.442436:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746147727.442462:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (876544->880639) req@ffff88009fe41f80 x1830967793991424/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.442476:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41f80 with x1830967793991424 ext(876544->880639) 00002000:00010000:3.0:1746147727.442480:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe41f80 00000100:00100000:1.0:1746147727.442481:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1957:x1830967793991168:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 8503us (9346us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.442489:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8425 00000100:00100000:3.0:1746147727.442502:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7401 00000100:00100000:3.0:1746147727.442508:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1957:x1830967793991424:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147727.442673:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1957:x1830967793991424:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 164us (323us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147727.442678:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7401 00002000:00100000:3.0:1746147727.442684:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x455:0x0] (876544->880639) req@ffff88009fe41f80 x1830967793991424/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/4536 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.442690:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41f80 with x1830967793991424 ext(876544->880639) 00002000:00010000:3.0:1746147727.442693:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe41f80 00000001:00080000:3.0:1746147727.443780:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874380 is committed 00000001:00080000:3.0:1746147727.443791:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874363 is committed 00000001:00080000:3.0:1746147727.443832:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874385 is committed 00000001:00080000:3.0:1746147727.443851:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874330 is committed 00000001:00080000:3.0:1746147727.443869:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874384 is committed 00000001:00080000:3.0:1746147727.443880:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874381 is committed 00000001:00080000:3.0:1746147727.443975:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874386 is committed 00000100:00100000:1.0:1746147727.448668:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.448780:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793991552 00000100:00100000:0.0:1746147727.448791:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793991552 00000100:00100000:0.0:1746147727.448836:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16584 00000100:00100000:0.0:1746147727.448844:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:32231:x1830967793991552:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147727.448864:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.448903:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbbf8 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.448935:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffe00/0xe64d3fbf12a7ddbf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb73 expref: 9 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.448944:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7de28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbc7 expref: 18 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.448951:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.448954:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.448958:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 18 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.448989:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7de28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbc7 expref: 18 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.449000:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7de28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbc7 expref: 18 pid: 8184 timeout: 906 lvb_type: 1 00000100:00100000:0.0:1746147727.449013:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796470912:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147727.449164:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffe00/0xe64d3fbf12a7ddbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb73 expref: 9 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.449173:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffe00/0xe64d3fbf12a7ddbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb73 expref: 9 pid: 22183 timeout: 906 lvb_type: 0 00000100:00100000:0.0:1746147727.449182:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796471040:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147727.449200:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.454008:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.454088:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.454308:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793991680 00000100:00100000:1.0:1746147727.454317:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793991680 00010000:00010000:1.0:1746147727.454349:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7de28 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbc7 expref: 19 pid: 8184 timeout: 906 lvb_type: 1 00000100:00100000:2.0:1746147727.454608:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796470912:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.454620:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796471040:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147727.454650:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->1069055] (req 1048576->1069055) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.454668:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a029b400, rc 0) 00000100:00100000:1.0:1746147727.454712:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793991808 00000100:00100000:1.0:1746147727.454717:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793991808 00010000:00010000:1.0:1746147727.454729:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffe00/0xe64d3fbf12a7ddbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb73 expref: 10 pid: 22183 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147727.454730:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:32231:x1830967793991552:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5885us (6072us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.454738:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16584 00000100:00100000:1.0:1746147727.454862:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8426 00000100:00100000:1.0:1746147727.454870:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1959:x1830967793991680:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147727.454910:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147727.454930:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7de28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbc7 expref: 18 pid: 8184 timeout: 906 lvb_type: 1 00010000:00010000:1.0:1746147727.454941:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7de28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbc7 expref: 18 pid: 8184 timeout: 906 lvb_type: 1 00010000:00010000:1.0:1746147727.454967:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7de28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbc7 expref: 18 pid: 8184 timeout: 906 lvb_type: 1 00010000:00010000:1.0:1746147727.454993:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147727.455040:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1959:x1830967793991680:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 171us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.455110:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8427 00000100:00100000:3.0:1746147727.455117:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967793991808:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147727.455124:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147727.455133:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffe00/0xe64d3fbf12a7ddbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb73 expref: 10 pid: 22183 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.455147:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffe00/0xe64d3fbf12a7ddbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb73 expref: 10 pid: 22183 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746147727.455149:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8426 00010000:00010000:3.0:1746147727.455159:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffe00/0xe64d3fbf12a7ddbf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb73 expref: 10 pid: 22183 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.455169:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.455170:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.455175:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 16 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.455183:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 16 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.455215:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 16 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147727.455228:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796471168:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147727.455296:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.457771:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796471168:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147727.457789:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.457836:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793991808:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2718us (3746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.457844:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8427 00000100:00100000:0.0:1746147727.458305:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.458584:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793992064 00000100:00100000:3.0:1746147727.458592:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793992064 00002000:00100000:3.0:1746147727.458633:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x454:0x0] (1064960->1069055) req@ffff8800956b5180 x1830967793992064/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.458644:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b5180 with x1830967793992064 ext(1064960->1069055) 00002000:00010000:3.0:1746147727.458648:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800956b5180 00000100:00100000:3.0:1746147727.458666:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7402 00000100:00100000:3.0:1746147727.458673:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1958:x1830967793992064:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147727.458846:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1958:x1830967793992064:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 172us (547us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147727.458851:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7402 00002000:00100000:3.0:1746147727.458856:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x454:0x0] (1064960->1069055) req@ffff8800956b5180 x1830967793992064/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/4536 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.458863:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b5180 with x1830967793992064 ext(1064960->1069055) 00002000:00010000:3.0:1746147727.458866:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800956b5180 00000100:00100000:0.0:1746147727.461745:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.462328:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793992320 00000100:00100000:2.0:1746147727.462336:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793992320 00002000:00100000:2.0:1746147727.462371:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800956b6a00 x1830967793992320/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.462380:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b6a00 with x1830967793992320 ext(2097152->3145727) 00002000:00010000:2.0:1746147727.462385:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800956b6a00 00000100:00100000:2.0:1746147727.462401:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7403 00000100:00100000:2.0:1746147727.462407:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967793992320:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147727.463169:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.463237:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.464388:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793992576 00000100:00100000:3.0:1746147727.464400:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793992576 00000100:00100000:3.0:1746147727.464464:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5012 00000100:00100000:3.0:1746147727.464472:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:32231:x1830967793992576:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147727.464882:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+340:32231:x1830967793992576:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 409us (1713us total) trans 8589946053 rc 0/0 00000100:00100000:3.0:1746147727.464918:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5012 00000100:00100000:3.0:1746147727.464961:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793992704 00000100:00100000:3.0:1746147727.464965:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793992704 00002000:00100000:3.0:1746147727.464985:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fe41c00 x1830967793992704/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.465001:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41c00 with x1830967793992704 ext(3145728->4194303) 00002000:00010000:3.0:1746147727.465006:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe41c00 00000100:00100000:3.0:1746147727.465028:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7404 00000100:00100000:3.0:1746147727.465032:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967793992704:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147727.477823:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967793992320:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15408us (16076us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147727.477833:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7403 00002000:00100000:2.0:1746147727.477844:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800956b6a00 x1830967793992320/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.477854:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b6a00 with x1830967793992320 ext(2097152->3145727) 00002000:00010000:2.0:1746147727.477859:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800956b6a00 00000100:00100000:3.0:1746147727.480000:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793992704:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14956us (16751us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147727.480011:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7404 00002000:00100000:3.0:1746147727.480022:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fe41c00 x1830967793992704/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.480030:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41c00 with x1830967793992704 ext(3145728->4194303) 00002000:00010000:3.0:1746147727.480036:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe41c00 00000100:00100000:1.0:1746147727.488491:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.488554:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.488605:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793992960 00000100:00100000:0.0:1746147727.488614:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793992960 00000100:00100000:0.0:1746147727.488644:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793993088 00000100:00100000:0.0:1746147727.488645:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793993088 00000100:00100000:0.0:1746147727.488661:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16585 00000100:00100000:0.0:1746147727.488668:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1958:x1830967793992960:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147727.488681:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.488706:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a029b600/0xe64d3fbf12a7de6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbbff expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147727.488749:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796471296:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147727.488802:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.488819:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16586 00000100:00100000:0.0:1746147727.488823:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1958:x1830967793993088:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147727.488829:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.488837:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a029b000/0xe64d3fbf12a7de75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc06 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147727.488856:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796471424:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147727.488870:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b000 going to sleep for 11 seconds 00002000:00010000:2.0:1746147727.490325:0:8184:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime: 1746147727 -> 1746147728 00002000:00010000:2.0:1746147727.490330:0:8184:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime: 1746147727 -> 1746147728 00000100:00100000:2.0:1746147727.490346:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796471296:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147727.490366:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a029b600/0xe64d3fbf12a7de6e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbff expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.490376:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a029b600/0xe64d3fbf12a7de6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbff expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.490396:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a029b600, rc 0) 00000100:00100000:1.0:1746147727.491125:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796471424:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147727.491140:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a029b000/0xe64d3fbf12a7de75 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc06 expref: 10 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.491149:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a029b000/0xe64d3fbf12a7de75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc06 expref: 10 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.491169:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a029b000, rc 0) 00000100:00100000:2.0:1746147727.491218:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1958:x1830967793992960:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2548us (2732us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147727.491224:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16585 00000100:00100000:1.0:1746147727.491450:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1958:x1830967793993088:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2625us (2895us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147727.491454:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16586 00000100:00100000:0.0:1746147727.500050:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.500091:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.500777:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793993216 00000100:00100000:1.0:1746147727.500777:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793993344 00000100:00100000:2.0:1746147727.500784:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793993216 00000100:00100000:1.0:1746147727.500784:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793993344 00000100:00100000:2.0:1746147727.500829:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16587 00000100:00100000:2.0:1746147727.500835:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1959:x1830967793993216:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147727.500844:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16588 00010000:00010000:2.0:1746147727.500851:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147727.500851:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793993344:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147727.500859:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.500864:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a051a200/0xe64d3fbf12a7de7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc0d expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.500869:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1051a00/0xe64d3fbf12a7de83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc14 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147727.500923:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796471680:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147727.500923:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796471552:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147727.501078:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147727.501085:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.502615:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796471552:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147727.502637:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1051a00/0xe64d3fbf12a7de83 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc14 expref: 10 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.502648:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1051a00/0xe64d3fbf12a7de83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc14 expref: 10 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.502675:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1051a00, rc 0) 00000100:00100000:1.0:1746147727.502716:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793993344:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1865us (2623us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147727.502722:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16588 00000100:00100000:2.0:1746147727.502754:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796471680:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147727.502769:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a051a200/0xe64d3fbf12a7de7c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc0d expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.503598:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a051a200/0xe64d3fbf12a7de7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc0d expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.503622:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a051a200, rc 0) 00000100:00100000:2.0:1746147727.503656:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1959:x1830967793993216:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2820us (3612us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147727.503661:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16587 00000100:00100000:0.0:1746147727.507533:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.507577:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.507799:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793993472 00000100:00100000:2.0:1746147727.507807:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793993472 00000100:00100000:2.0:1746147727.507937:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793993600 00000100:00100000:2.0:1746147727.507940:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793993600 00000100:00100000:2.0:1746147727.507965:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16589 00000100:00100000:2.0:1746147727.507972:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1959:x1830967793993472:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147727.507972:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16590 00000100:00100000:1.0:1746147727.507980:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793993600:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147727.507986:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.507988:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.507999:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a051ba00/0xe64d3fbf12a7de8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc1b expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.507999:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7de91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc22 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.508038:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796471808:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147727.508039:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796471936:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147727.508104:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.508428:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147727.509995:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796471936:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147727.510015:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a051ba00/0xe64d3fbf12a7de8a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc1b expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.510030:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a051ba00/0xe64d3fbf12a7de8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc1b expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.510049:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a051ba00, rc 0) 00000100:00100000:1.0:1746147727.510062:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796471808:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147727.510077:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1959:x1830967793993472:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2106us (2551us total) trans 0 rc 301/301 00010000:00010000:1.0:1746147727.510077:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7de91 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc22 expref: 10 pid: 20619 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147727.510084:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16589 00010000:00010000:1.0:1746147727.510087:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7de91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc22 expref: 10 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.510107:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1050e00, rc 0) 00000100:00100000:1.0:1746147727.510125:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793993600:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2146us (2548us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147727.510130:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16590 00000100:00100000:0.0:1746147727.562766:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.562852:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.562953:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793993728 00000100:00100000:2.0:1746147727.562960:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793993728 00000100:00100000:2.0:1746147727.563009:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793993856 00000100:00100000:2.0:1746147727.563011:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793993856 00000100:00100000:2.0:1746147727.563026:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16591 00000100:00100000:2.0:1746147727.563033:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1960:x1830967793993728:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147727.563048:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.563063:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc29 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147727.563107:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796472064:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147727.563177:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.563499:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16592 00000100:00100000:0.0:1746147727.563507:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967793993856:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147727.563515:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.563525:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7de9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc30 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147727.563552:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796472192:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147727.563577:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.566753:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796472192:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147727.566785:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7de9f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc30 expref: 20 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.566797:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7de9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc30 expref: 20 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.566825:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a029a000, rc 0) 00000100:00100000:1.0:1746147727.566862:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967793993856:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3357us (4010us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147727.566868:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16592 00000100:00100000:2.0:1746147727.567152:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796472064:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147727.567169:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de98 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc29 expref: 18 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.567179:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a051b600/0xe64d3fbf12a7de98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc29 expref: 18 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.567193:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a051b600, rc 0) 00000100:00100000:2.0:1746147727.567226:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1960:x1830967793993728:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4193us (4467us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147727.567232:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16591 00000100:00100000:0.0:1746147727.580171:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.580210:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.582766:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793994112 00000100:00100000:3.0:1746147727.582778:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793994112 00002000:00100000:3.0:1746147727.582822:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x455:0x0] (0->876543) req@ffff88009fe3bb80 x1830967793994112/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.582832:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe3bb80 with x1830967793994112 ext(0->876543) 00002000:00010000:3.0:1746147727.582837:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe3bb80 00000100:00100000:3.0:1746147727.582868:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793994368 00000100:00100000:3.0:1746147727.582871:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793994368 00002000:00100000:3.0:1746147727.582903:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1069056->2097151) req@ffff88009fe38700 x1830967793994368/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.582911:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe38700 with x1830967793994368 ext(1069056->2097151) 00002000:00010000:3.0:1746147727.582914:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe38700 00000100:00100000:0.0:1746147727.582922:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7405 00000100:00100000:3.0:1746147727.582927:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7406 00000100:00100000:3.0:1746147727.582930:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1958:x1830967793994368:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147727.582931:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1957:x1830967793994112:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147727.595378:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1958:x1830967793994368:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12437us (15159us total) trans 0 rc 1028096/1028096 00000100:00100000:3.0:1746147727.595389:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7406 00002000:00100000:3.0:1746147727.595399:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1069056->2097151) req@ffff88009fe38700 x1830967793994368/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1028096/1028096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.595408:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe38700 with x1830967793994368 ext(1069056->2097151) 00002000:00010000:3.0:1746147727.595412:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe38700 00000100:00100000:1.0:1746147727.595588:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1957:x1830967793994112:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12658us (15423us total) trans 0 rc 876544/876544 00000100:00100000:1.0:1746147727.595597:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7405 00002000:00100000:1.0:1746147727.595602:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (0->876543) req@ffff88009fe3bb80 x1830967793994112/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 876544/876544 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.595609:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe3bb80 with x1830967793994112 ext(0->876543) 00002000:00010000:1.0:1746147727.595612:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe3bb80 00000100:00100000:0.0:1746147727.602389:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.603073:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793994496 00000100:00100000:2.0:1746147727.603082:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793994496 00000100:00100000:2.0:1746147727.603140:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16593 00000100:00100000:2.0:1746147727.603147:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:32239:x1830967793994496:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147727.603162:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.603179:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7dea6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc37 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.603205:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 8 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.603216:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147727.603218:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147727.603221:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7dea6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc37 expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.603253:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 8 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.603265:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 8 pid: 22183 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147727.603281:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796472320:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.603372:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.605423:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.605493:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793994624 00000100:00100000:1.0:1746147727.605499:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793994624 00002000:00100000:1.0:1746147727.605531:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x455:0x0] (1921024->2097151) req@ffff88009b10a300 x1830967793994624/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.605539:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10a300 with x1830967793994624 ext(1921024->2097151) 00010000:00010000:1.0:1746147727.605547:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 9 pid: 22183 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.605558:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 9 pid: 22183 timeout: 906 lvb_type: 0 00002000:00010000:1.0:1746147727.605563:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b10a300 00000100:00100000:1.0:1746147727.605592:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1475 00000100:00100000:1.0:1746147727.605598:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967793994624:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147727.606121:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796472320:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147727.606140:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7dea6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc37 expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.606152:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090abaa00, rc 0) 00000100:00100000:2.0:1746147727.606190:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:32239:x1830967793994496:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3044us (3810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.606197:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16593 00000100:00100000:1.0:1746147727.612878:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967793994624:12345-192.168.202.10@tcp:4:cat.0 Request processed in 7271us (7452us total) trans 21474841615 rc 0/0 00000100:00100000:1.0:1746147727.612907:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1475 00002000:00100000:1.0:1746147727.612917:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x455:0x0] (1921024->2097151) req@ffff88009b10a300 x1830967793994624/t21474841615(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/448 e 0 to 0 dl 1746147738 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.612931:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10a300 with x1830967793994624 ext(1921024->2097151) 00010000:00010000:1.0:1746147727.612940:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 11 pid: 22183 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.612953:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 11 pid: 22183 timeout: 906 lvb_type: 0 00002000:00010000:1.0:1746147727.612959:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b10a300 00000100:00100000:0.0:1746147727.617280:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.617588:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793994752 00000100:00100000:3.0:1746147727.617595:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793994752 00010000:00010000:3.0:1746147727.617625:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 11 pid: 22183 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.617658:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8428 00000100:00100000:3.0:1746147727.617663:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967793994752:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147727.617675:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147727.617703:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 11 pid: 22183 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.617714:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 11 pid: 22183 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.617734:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009456a400/0xe64d3fbf12a7ddb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb6c expref: 11 pid: 22183 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.617766:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.617768:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.617774:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7dea6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc37 expref: 17 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.617781:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7dea6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc37 expref: 17 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.617807:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7dea6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc37 expref: 17 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147727.617819:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796472448:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147727.618661:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.619846:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796472448:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147727.619862:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.619906:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1957:x1830967793994752:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2241us (2633us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.619915:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8428 00000100:00100000:0.0:1746147727.623212:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.623495:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.623538:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793995136 00000100:00100000:2.0:1746147727.623544:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793995136 00000100:00100000:2.0:1746147727.623595:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12034 00000100:00100000:2.0:1746147727.623602:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32241:x1830967793995136:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147727.623621:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.623635:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7dead lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc3e expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.623724:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abba00/0xe64d3fbf12a7deb4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147727.623735:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090abba00/0xe64d3fbf12a7deb4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147727.623743:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090abba00/0xe64d3fbf12a7deb4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:2.0:1746147727.623752:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147727.623846:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb200/0xe64d3fbf12a7dead lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc3e expref: 23 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.623870:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abba00/0xe64d3fbf12a7deb4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc3e expref: 22 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.623878:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147727.623880:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147727.623900:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090abba00, rc 0) 00000100:00100000:2.0:1746147727.623931:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32241:x1830967793995136:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 330us (437us total) trans 8589946054 rc 0/0 00000100:00100000:2.0:1746147727.623935:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12034 00000100:00100000:1.0:1746147727.625774:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793995264 00000100:00100000:1.0:1746147727.625781:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793995264 00002000:00100000:1.0:1746147727.625812:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009b109180 x1830967793995264/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.625820:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b109180 with x1830967793995264 ext(1048576->2097151) 00002000:00010000:1.0:1746147727.625824:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b109180 00000100:00100000:1.0:1746147727.625848:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7407 00000100:00100000:1.0:1746147727.625854:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1960:x1830967793995264:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147727.638306:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1960:x1830967793995264:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12442us (15092us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147727.638317:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7407 00002000:00100000:1.0:1746147727.638327:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009b109180 x1830967793995264/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.638336:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b109180 with x1830967793995264 ext(1048576->2097151) 00002000:00010000:1.0:1746147727.638341:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b109180 00000100:00100000:2.0:1746147727.650624:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.650663:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793995392 00000100:00100000:3.0:1746147727.650672:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793995392 00000100:00100000:3.0:1746147727.650717:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16594 00000100:00100000:3.0:1746147727.650723:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:32239:x1830967793995392:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147727.650737:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147727.650751:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff8200/0xe64d3fbf12a7dec2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc45 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.650777:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 6 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.650782:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147727.650783:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147727.650786:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8200/0xe64d3fbf12a7dec2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc45 expref: 20 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.650811:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 6 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.650820:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 6 pid: 6715 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.650829:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796472576:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.650846:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.651440:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147727.651778:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.652093:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793995520 00000100:00100000:1.0:1746147727.652098:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793995520 00000100:00100000:1.0:1746147727.652125:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16595 00000100:00100000:1.0:1746147727.652130:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1959:x1830967793995520:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147727.652139:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.652147:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0258e00/0xe64d3fbf12a7dec9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc4c expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.652176:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796472704:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147727.652216:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147727.652267:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.653138:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793995648 00000100:00100000:0.0:1746147727.653143:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793995648 00000100:00100000:3.0:1746147727.654806:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793995776 00000100:00100000:3.0:1746147727.654812:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793995776 00000100:00100000:1.0:1746147727.654847:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16596 00000100:00100000:3.0:1746147727.654853:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16597 00000100:00100000:1.0:1746147727.654855:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793995648:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147727.654859:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793995776:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147727.654868:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.654868:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147727.654881:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ded0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc5a expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.654881:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0258600/0xe64d3fbf12a7ded7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc53 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.654909:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.654911:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.654919:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ded0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc5a expref: 13 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147727.654931:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ded0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc5a expref: 13 pid: 10613 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147727.654931:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796472832:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147727.654940:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8c00, rc 0) 00000100:00100000:3.0:1746147727.654974:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967793995776:12345-192.168.202.10@tcp:101:cat.0 Request processed in 115us (2707us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.654980:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16597 00000100:00100000:1.0:1746147727.654982:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c9809c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.657180:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.657206:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796472576:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147727.657226:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8200/0xe64d3fbf12a7dec2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc45 expref: 20 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.657227:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793995904 00000100:00100000:1.0:1746147727.657232:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793995904 00010000:00010000:3.0:1746147727.657239:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8200, rc 0) 00002000:00100000:1.0:1746147727.657262:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1163263) req@ffff88009b109f80 x1830967793995904/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.657270:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b109f80 with x1830967793995904 ext(1048576->1163263) 00010000:00010000:1.0:1746147727.657275:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 9 pid: 6715 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.657282:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:32239:x1830967793995392:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6558us (6663us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.657289:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16594 00010000:00010000:1.0:1746147727.657291:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 9 pid: 6715 timeout: 906 lvb_type: 0 00002000:00010000:1.0:1746147727.657298:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b109f80 00000100:00100000:1.0:1746147727.657313:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1476 00000100:00100000:1.0:1746147727.657319:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967793995904:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147727.657526:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796472832:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147727.657543:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0258600/0xe64d3fbf12a7ded7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc53 expref: 12 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.657552:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0258600/0xe64d3fbf12a7ded7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc53 expref: 12 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.657572:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0258600, rc 0) 00000100:00100000:1.0:1746147727.657600:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793995648:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2746us (5822us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147727.657606:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16596 00000100:00100000:1.0:1746147727.659029:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796472704:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147727.659050:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0258e00/0xe64d3fbf12a7dec9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc4c expref: 10 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.659058:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0258e00/0xe64d3fbf12a7dec9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc4c expref: 10 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147727.659070:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0258e00, rc 0) 00000100:00100000:1.0:1746147727.659114:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793995520:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6982us (8266us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147727.659120:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16595 00000100:00100000:1.0:1746147727.660254:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967793995904:12345-192.168.202.10@tcp:4:cat.0 Request processed in 2933us (3076us total) trans 17179874387 rc 0/0 00000100:00100000:1.0:1746147727.660261:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1476 00002000:00100000:1.0:1746147727.660269:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1163263) req@ffff88009b109f80 x1830967793995904/t17179874387(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/448 e 0 to 0 dl 1746147738 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.660276:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b109f80 with x1830967793995904 ext(1048576->1163263) 00010000:00010000:1.0:1746147727.660283:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 9 pid: 6715 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.660293:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 9 pid: 6715 timeout: 906 lvb_type: 0 00002000:00010000:1.0:1746147727.660298:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b109f80 00000100:00100000:2.0:1746147727.664704:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.665670:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793996032 00000100:00100000:1.0:1746147727.665678:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793996032 00000100:00100000:1.0:1746147727.665724:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16598 00000100:00100000:1.0:1746147727.665731:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32244:x1830967793996032:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147727.665744:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.665759:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1051800/0xe64d3fbf12a7dede lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc61 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.665788:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.665794:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147727.665796:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147727.665799:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1051800/0xe64d3fbf12a7dede lrc: 4/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc61 expref: 10 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.665829:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.665838:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 19 pid: 10613 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746147727.665849:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796472960:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147727.666734:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.667877:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796472960:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147727.667951:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1051800/0xe64d3fbf12a7dede lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc61 expref: 10 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.667965:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1051800, rc 0) 00000100:00100000:1.0:1746147727.668007:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32244:x1830967793996032:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2275us (3318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.668013:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16598 00000100:00100000:0.0:1746147727.669159:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.669196:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.669256:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793996160 00000100:00100000:1.0:1746147727.669263:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793996160 00002000:00100000:1.0:1746147727.669290:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (876544->1048575) req@ffff88009b108700 x1830967793996160/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.669314:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b108700 with x1830967793996160 ext(876544->1048575) 00010000:00010000:1.0:1746147727.669320:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 20 pid: 10613 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.669330:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 20 pid: 10613 timeout: 906 lvb_type: 0 00002000:00010000:1.0:1746147727.669336:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b108700 00000100:00100000:1.0:1746147727.669357:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1477 00000100:00100000:1.0:1746147727.669362:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1957:x1830967793996160:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147727.670039:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793996288 00000100:00100000:3.0:1746147727.670043:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793996288 00010000:00010000:3.0:1746147727.670060:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 10 pid: 6715 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.671108:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8429 00000100:00100000:3.0:1746147727.671116:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967793996288:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147727.671126:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147727.671145:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 10 pid: 6715 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.671154:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 10 pid: 6715 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.671423:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a7ddc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb96 expref: 10 pid: 6715 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.671441:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.671443:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.671449:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8200/0xe64d3fbf12a7dec2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc45 expref: 20 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.671456:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8200/0xe64d3fbf12a7dec2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc45 expref: 20 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.671484:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8200/0xe64d3fbf12a7dec2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc45 expref: 20 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147727.671494:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796473088:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147727.672277:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.675984:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796473088:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147727.676002:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.676051:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967793996288:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4934us (6853us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.676061:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8429 00000100:00100000:1.0:1746147727.676386:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967793996160:12345-192.168.202.10@tcp:4:cat.0 Request processed in 7023us (7229us total) trans 17179874388 rc 0/0 00000100:00100000:1.0:1746147727.676395:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1477 00002000:00100000:1.0:1746147727.676403:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (876544->1048575) req@ffff88009b108700 x1830967793996160/t17179874388(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/448 e 0 to 0 dl 1746147738 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.676412:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b108700 with x1830967793996160 ext(876544->1048575) 00010000:00010000:1.0:1746147727.676420:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 22 pid: 10613 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746147727.676432:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 22 pid: 10613 timeout: 906 lvb_type: 0 00002000:00010000:1.0:1746147727.676592:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b108700 00000100:00100000:0.0:1746147727.677348:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.677455:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793996544 00000100:00100000:1.0:1746147727.677461:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793996544 00002000:00100000:1.0:1746147727.677485:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009b10a680 x1830967793996544/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.677492:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10a680 with x1830967793996544 ext(1048576->2097151) 00002000:00010000:1.0:1746147727.677496:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b10a680 00000100:00100000:1.0:1746147727.677521:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7408 00000100:00100000:1.0:1746147727.677527:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967793996544:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147727.685351:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.685869:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793996672 00000100:00100000:3.0:1746147727.685877:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793996672 00010000:00010000:3.0:1746147727.685937:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 24 pid: 10613 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.685964:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8430 00000100:00100000:3.0:1746147727.685972:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967793996672:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147727.685983:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147727.686001:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 24 pid: 10613 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.686012:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 24 pid: 10613 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.686031:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00fea00/0xe64d3fbf12a7de60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf1 expref: 24 pid: 10613 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.686063:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.686065:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.686072:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1051800/0xe64d3fbf12a7dede lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc61 expref: 8 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.686081:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1051800/0xe64d3fbf12a7dede lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc61 expref: 8 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.686111:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1051800/0xe64d3fbf12a7dede lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc61 expref: 8 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147727.686126:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796473216:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147727.687121:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.688521:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967793996544:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10989us (11170us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147727.688531:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7408 00002000:00100000:1.0:1746147727.688541:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009b10a680 x1830967793996544/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.688548:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10a680 with x1830967793996544 ext(1048576->2097151) 00002000:00010000:1.0:1746147727.688553:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b10a680 00000100:00100000:3.0:1746147727.690403:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796473216:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147727.690421:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.690458:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967793996672:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4486us (5113us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.690467:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8430 00000100:00100000:2.0:1746147727.707021:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.707089:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793997184 00000100:00100000:3.0:1746147727.707097:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793997184 00000100:00100000:2.0:1746147727.707366:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12035 00000100:00100000:2.0:1746147727.707375:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+340:32246:x1830967793997184:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147727.707396:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.707411:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7dee5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc68 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147727.707504:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.707545:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793996928 00000100:00100000:0.0:1746147727.707549:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793996928 00002000:00100000:0.0:1746147727.707573:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fe40e00 x1830967793996928/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147727.707582:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe40e00 with x1830967793996928 ext(0->1048575) 00002000:00010000:0.0:1746147727.707586:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe40e00 00000100:00100000:0.0:1746147727.707598:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7409 00000100:00100000:0.0:1746147727.707602:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967793996928:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:2.0:1746147727.708602:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7deec lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.708615:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7deec lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.708624:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7deec lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147727.708633:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147727.708738:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb600/0xe64d3fbf12a7dee5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc68 expref: 343 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.708767:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7deec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc68 expref: 342 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.708774:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147727.708776:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147727.708779:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090abb400, rc 0) 00000100:00100000:2.0:1746147727.708819:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+342:32246:x1830967793997184:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1445us (1805us total) trans 8589946055 rc 0/0 00000100:00100000:2.0:1746147727.708825:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12035 00000100:00100000:1.0:1746147727.718503:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.718564:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793997312 00000100:00100000:0.0:1746147727.718572:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793997312 00000100:00100000:0.0:1746147727.718617:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16599 00000100:00100000:0.0:1746147727.718625:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967793997312:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147727.718638:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.718652:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7defa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc6f expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.718670:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.718672:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.718679:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7defa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc6f expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.718703:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7defa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc6f expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.718713:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a029a000, rc 0) 00000100:00100000:0.0:1746147727.718746:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967793997312:12345-192.168.202.10@tcp:101:cat.0 Request processed in 123us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147727.718751:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16599 00000100:00100000:2.0:1746147727.724781:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967793996928:12345-192.168.202.10@tcp:3:cat.0 Request processed in 17168us (17268us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147727.724792:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7409 00002000:00100000:2.0:1746147727.724802:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fe40e00 x1830967793996928/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.724810:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe40e00 with x1830967793996928 ext(0->1048575) 00002000:00010000:2.0:1746147727.724816:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe40e00 00000100:00100000:0.0:1746147727.739732:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.739854:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793997440 00000100:00100000:2.0:1746147727.739861:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793997440 00000100:00100000:2.0:1746147727.739924:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16600 00000100:00100000:2.0:1746147727.739931:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32244:x1830967793997440:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147727.739946:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.739959:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5529000/0xe64d3fbf12a7df01 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc76 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.739983:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.739989:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147727.739991:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147727.739994:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5529000/0xe64d3fbf12a7df01 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc76 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.740015:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.740024:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 17 pid: 10613 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147727.740034:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796473344:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.740230:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147727.741395:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796473344:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147727.741413:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5529000/0xe64d3fbf12a7df01 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc76 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.741427:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5529000, rc 0) 00000100:00100000:2.0:1746147727.741461:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32244:x1830967793997440:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1531us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.741467:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16600 00000100:00100000:0.0:1746147727.742147:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.742203:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793997568 00000100:00100000:2.0:1746147727.742207:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793997568 00002000:00100000:2.0:1746147727.742231:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1069055) req@ffff88009b10b800 x1830967793997568/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.742238:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10b800 with x1830967793997568 ext(1048576->1069055) 00010000:00010000:2.0:1746147727.742244:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 18 pid: 10613 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746147727.742252:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 18 pid: 10613 timeout: 906 lvb_type: 0 00002000:00010000:2.0:1746147727.742257:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b10b800 00000100:00100000:2.0:1746147727.742284:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1478 00000100:00100000:2.0:1746147727.742290:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1960:x1830967793997568:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147727.747617:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967793997568:12345-192.168.202.10@tcp:4:cat.0 Request processed in 5319us (5463us total) trans 21474841616 rc 0/0 00000100:00100000:2.0:1746147727.747628:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1478 00002000:00100000:2.0:1746147727.747638:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1069055) req@ffff88009b10b800 x1830967793997568/t21474841616(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/448 e 0 to 0 dl 1746147738 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.747653:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b10b800 with x1830967793997568 ext(1048576->1069055) 00010000:00010000:2.0:1746147727.747662:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 20 pid: 10613 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746147727.747677:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 20 pid: 10613 timeout: 906 lvb_type: 0 00002000:00010000:2.0:1746147727.747684:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b10b800 00000100:00100000:0.0:1746147727.755845:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.756065:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793997696 00000100:00100000:3.0:1746147727.756079:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793997696 00010000:00010000:3.0:1746147727.756109:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 20 pid: 10613 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.756146:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8431 00000100:00100000:3.0:1746147727.756153:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1959:x1830967793997696:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147727.756163:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147727.756182:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 20 pid: 10613 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.756194:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 20 pid: 10613 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.756214:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7de67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbbf8 expref: 20 pid: 10613 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.756234:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.756236:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.756242:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5529000/0xe64d3fbf12a7df01 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc76 expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.756249:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5529000/0xe64d3fbf12a7df01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc76 expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.756274:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5529000/0xe64d3fbf12a7df01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc76 expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147727.756285:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796473472:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147727.756357:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.764367:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.764404:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.764540:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796473472:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147727.764559:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.764595:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1959:x1830967793997696:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 8442us (8757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.764605:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8431 00000100:00100000:3.0:1746147727.764636:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793997952 00000100:00100000:3.0:1746147727.764641:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793997952 00002000:00100000:3.0:1746147727.764670:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880091630e00 x1830967793997952/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.764678:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091630e00 with x1830967793997952 ext(1048576->2097151) 00002000:00010000:3.0:1746147727.764682:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091630e00 00000100:00100000:3.0:1746147727.764708:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793998208 00000100:00100000:3.0:1746147727.764710:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793998208 00002000:00100000:3.0:1746147727.764720:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880091631500 x1830967793998208/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.764726:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091631500 with x1830967793998208 ext(1048576->2097151) 00002000:00010000:3.0:1746147727.764729:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091631500 00000100:00100000:3.0:1746147727.764753:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7410 00000100:00100000:3.0:1746147727.764758:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967793997952:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147727.764877:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7411 00000100:00100000:1.0:1746147727.764904:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967793998208:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147727.788150:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967793998208:12345-192.168.202.10@tcp:3:cat.0 Request processed in 23258us (23737us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147727.788161:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7411 00002000:00100000:1.0:1746147727.788171:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880091631500 x1830967793998208/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.788185:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091631500 with x1830967793998208 ext(1048576->2097151) 00002000:00010000:1.0:1746147727.788190:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091631500 00000100:00100000:3.0:1746147727.788915:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967793997952:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24155us (24553us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147727.788922:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7410 00002000:00100000:3.0:1746147727.788927:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880091630e00 x1830967793997952/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.788935:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091630e00 with x1830967793997952 ext(1048576->2097151) 00002000:00010000:3.0:1746147727.788938:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091630e00 00010000:00010000:1.0:1746147727.791152:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147727.804390:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.804522:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793998336 00000100:00100000:2.0:1746147727.804531:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793998336 00000100:00100000:2.0:1746147727.804582:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16601 00000100:00100000:2.0:1746147727.804590:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32244:x1830967793998336:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147727.804605:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.804621:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5528600/0xe64d3fbf12a7df08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc7d expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.804643:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.804644:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.804651:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5528600/0xe64d3fbf12a7df08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc7d expref: 10 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.804663:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5528600/0xe64d3fbf12a7df08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc7d expref: 10 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.804673:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5528600, rc 0) 00000100:00100000:2.0:1746147727.804737:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32244:x1830967793998336:12345-192.168.202.10@tcp:101:cat.0 Request processed in 148us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.804744:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16601 00000100:00100000:0.0:1746147727.808486:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.808632:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793998592 00000100:00100000:3.0:1746147727.808641:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793998592 00002000:00100000:3.0:1746147727.808684:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880091631880 x1830967793998592/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.808708:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091631880 with x1830967793998592 ext(1048576->2097151) 00002000:00010000:3.0:1746147727.808714:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091631880 00000100:00100000:3.0:1746147727.808760:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7412 00000100:00100000:3.0:1746147727.808769:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967793998592:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147727.817938:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967793998592:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9161us (9452us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147727.817952:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7412 00002000:00100000:3.0:1746147727.817962:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880091631880 x1830967793998592/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.817971:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091631880 with x1830967793998592 ext(1048576->2097151) 00002000:00010000:3.0:1746147727.817976:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091631880 00000100:00100000:0.0:1746147727.820329:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.820386:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793998720 00000100:00100000:2.0:1746147727.820393:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793998720 00000100:00100000:2.0:1746147727.820436:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16602 00000100:00100000:2.0:1746147727.820443:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32241:x1830967793998720:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147727.820456:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.820468:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc84 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.820491:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094591a00/0xe64d3fbf12a7dbab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba15 expref: 11 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.820498:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094590000/0xe64d3fbf12a7dcc3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbac4 expref: 21 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.820505:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094590a00/0xe64d3fbf12a7dc14 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba62 expref: 5 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.820509:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.820510:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.820513:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 11 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.820534:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094590a00/0xe64d3fbf12a7dc14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba62 expref: 5 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.820542:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094590a00/0xe64d3fbf12a7dc14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba62 expref: 5 pid: 8470 timeout: 906 lvb_type: 1 00000100:00100000:2.0:1746147727.820551:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796473600:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147727.820657:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094590000/0xe64d3fbf12a7dcc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbac4 expref: 21 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.820665:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094590000/0xe64d3fbf12a7dcc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbac4 expref: 21 pid: 7050 timeout: 906 lvb_type: 1 00000100:00100000:2.0:1746147727.820673:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796473728:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147727.820865:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094591a00/0xe64d3fbf12a7dbab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba15 expref: 11 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.820873:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094591a00/0xe64d3fbf12a7dbab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba15 expref: 11 pid: 8184 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746147727.820881:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796473856:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.821154:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147727.822859:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796473600:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.822873:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796473728:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.822934:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796473856:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147727.822961:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 11 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147727.823154:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147727.823665:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5529400, rc 0) 00000100:00100000:2.0:1746147727.823717:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32241:x1830967793998720:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3273us (3392us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.823725:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16602 00000100:00100000:3.0:1746147727.823949:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793998848 00000100:00100000:3.0:1746147727.823955:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793998848 00010000:00010000:3.0:1746147727.823978:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094590a00/0xe64d3fbf12a7dc14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba62 expref: 6 pid: 8470 timeout: 906 lvb_type: 1 00000100:00100000:3.0:1746147727.824014:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8432 00000100:00100000:3.0:1746147727.824020:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967793998848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147727.824030:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147727.824049:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094590a00/0xe64d3fbf12a7dc14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba62 expref: 6 pid: 8470 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147727.824058:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094590a00/0xe64d3fbf12a7dc14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba62 expref: 6 pid: 8470 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147727.824075:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094590a00/0xe64d3fbf12a7dc14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba62 expref: 6 pid: 8470 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147727.824100:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.824130:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+5:1957:x1830967793998848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 110us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.824138:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8432 00000100:00100000:0.0:1746147727.825752:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.825928:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793998976 00000100:00100000:2.0:1746147727.825933:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793998976 00000100:00100000:2.0:1746147727.825957:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16603 00000100:00100000:2.0:1746147727.825962:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32244:x1830967793998976:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147727.825973:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.825984:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7df16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc8b expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.825999:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.826000:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.826006:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7df16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc8b expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.826017:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7df16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc8b expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.826026:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc1e600, rc 0) 00000100:00100000:2.0:1746147727.826062:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32244:x1830967793998976:12345-192.168.202.10@tcp:101:cat.0 Request processed in 100us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.826067:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16603 00000100:00100000:0.0:1746147727.828682:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.828832:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.829080:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793999232 00000100:00100000:3.0:1746147727.829086:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793999232 00010000:00010000:3.0:1746147727.829111:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094591a00/0xe64d3fbf12a7dbab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba15 expref: 12 pid: 8184 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746147727.829140:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793999104 00000100:00100000:3.0:1746147727.829142:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793999104 00010000:00010000:3.0:1746147727.829152:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094590000/0xe64d3fbf12a7dcc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbac4 expref: 22 pid: 7050 timeout: 906 lvb_type: 1 00000100:00100000:3.0:1746147727.829171:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8433 00000100:00100000:3.0:1746147727.829177:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967793999232:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147727.829187:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147727.829205:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880094591a00/0xe64d3fbf12a7dbab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba15 expref: 12 pid: 8184 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.829214:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094591a00/0xe64d3fbf12a7dbab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba15 expref: 12 pid: 8184 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.829230:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094591a00/0xe64d3fbf12a7dbab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba15 expref: 12 pid: 8184 timeout: 906 lvb_type: 0 00010000:00010000:3.0:1746147727.829244:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.829273:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793999232:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 96us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.829282:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8433 00000100:00100000:3.0:1746147727.829294:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8434 00000100:00100000:3.0:1746147727.829298:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967793999104:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147727.829303:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147727.829310:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880094590000/0xe64d3fbf12a7dcc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbac4 expref: 22 pid: 7050 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147727.829318:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094590000/0xe64d3fbf12a7dcc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbac4 expref: 22 pid: 7050 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147727.829329:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094590000/0xe64d3fbf12a7dcc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbac4 expref: 22 pid: 7050 timeout: 906 lvb_type: 1 00010000:00010000:3.0:1746147727.829336:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.829338:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.829342:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3883008->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 10 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.829349:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3883008->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 10 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.829373:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3883008->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 10 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147727.829383:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796473984:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147727.829435:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.830027:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.830209:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793999488 00000100:00100000:2.0:1746147727.830213:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793999488 00002000:00100000:2.0:1746147727.830244:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800943c5180 x1830967793999488/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.830252:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5180 with x1830967793999488 ext(2097152->3145727) 00002000:00010000:2.0:1746147727.830256:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c5180 00000100:00100000:2.0:1746147727.830428:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7413 00000100:00100000:2.0:1746147727.830434:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793999488:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147727.831400:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.831419:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793999616 00000100:00100000:0.0:1746147727.831423:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793999616 00000100:00100000:0.0:1746147727.831458:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16604 00000100:00100000:0.0:1746147727.831464:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:32246:x1830967793999616:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147727.831473:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.831486:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc92 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.831505:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7dd87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb50 expref: 20 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.831513:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe800/0xe64d3fbf12a7dde9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb9d expref: 6 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.831521:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b1ebe00/0xe64d3fbf12a7ddaa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb65 expref: 11 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.831526:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.831528:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.831530:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 6/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3469312->4173823] (req 3469312->4173823) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 20 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.831559:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b1ebe00/0xe64d3fbf12a7ddaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb65 expref: 11 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.831569:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b1ebe00/0xe64d3fbf12a7ddaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb65 expref: 11 pid: 7050 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746147727.831578:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796474112:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147727.831639:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe800/0xe64d3fbf12a7dde9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb9d expref: 6 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.831647:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe800/0xe64d3fbf12a7dde9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb9d expref: 6 pid: 22183 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746147727.831655:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796474240:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147727.831676:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7dd87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb50 expref: 20 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.831683:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7dd87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb50 expref: 20 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746147727.831701:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796474368:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147727.831720:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.831975:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796473984:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147727.831990:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.832012:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967793999104:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2714us (3181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.832019:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8434 00000100:00100000:1.0:1746147727.833508:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.833529:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967793999872 00000100:00100000:1.0:1746147727.833533:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967793999872 00002000:00100000:1.0:1746147727.833557:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3883008->3887103) req@ffff88009fe42d80 x1830967793999872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.833566:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe42d80 with x1830967793999872 ext(3883008->3887103) 00002000:00010000:1.0:1746147727.833570:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe42d80 00000100:00100000:1.0:1746147727.834779:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7414 00000100:00100000:1.0:1746147727.834788:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967793999872:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147727.834919:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967793999872:12345-192.168.202.10@tcp:3:cat.0 Request processed in 131us (1413us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147727.834925:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7414 00002000:00100000:1.0:1746147727.834931:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3883008->3887103) req@ffff88009fe42d80 x1830967793999872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/4536 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.834937:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe42d80 with x1830967793999872 ext(3883008->3887103) 00002000:00010000:1.0:1746147727.834941:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe42d80 00000100:00100000:1.0:1746147727.836059:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796474112:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147727.836068:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796474240:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147727.836074:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796474368:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147727.836103:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3469312->4173823] (req 3469312->4173823) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 20 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.836115:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a029a200, rc 0) 00000100:00100000:1.0:1746147727.836151:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:32246:x1830967793999616:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4687us (4751us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.836157:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16604 00000100:00100000:0.0:1746147727.840555:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.840598:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.840677:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794000128 00000100:00100000:3.0:1746147727.840685:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794000128 00010000:00010000:3.0:1746147727.840742:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7dd87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb50 expref: 20 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147727.840763:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794000000 00000100:00100000:3.0:1746147727.840765:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794000000 00010000:00010000:3.0:1746147727.840773:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe800/0xe64d3fbf12a7dde9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb9d expref: 7 pid: 22183 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746147727.840797:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8435 00000100:00100000:3.0:1746147727.840804:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1959:x1830967794000128:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147727.840818:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147727.840825:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8436 00000100:00100000:2.0:1746147727.840834:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794000000:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147727.840836:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7dd87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb50 expref: 20 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147727.840842:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147727.840844:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7dd87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb50 expref: 20 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147727.842295:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7dd87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb50 expref: 20 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147727.842365:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe800/0xe64d3fbf12a7dde9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb9d expref: 7 pid: 22183 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147727.842376:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe800/0xe64d3fbf12a7dde9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb9d expref: 7 pid: 22183 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147727.842391:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe800/0xe64d3fbf12a7dde9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb9d expref: 7 pid: 22183 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147727.842409:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147727.842467:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794000000:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1633us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.842474:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8436 00010000:00010000:3.0:1746147727.842536:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.842556:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1959:x1830967794000128:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1752us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.842562:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8435 00000100:00100000:3.0:1746147727.843424:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.843494:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794000256 00000100:00100000:0.0:1746147727.843500:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794000256 00010000:00010000:0.0:1746147727.843521:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b1ebe00/0xe64d3fbf12a7ddaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb65 expref: 12 pid: 7050 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746147727.843551:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8437 00000100:00100000:0.0:1746147727.843556:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794000256:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147727.843566:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147727.843582:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b1ebe00/0xe64d3fbf12a7ddaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb65 expref: 12 pid: 7050 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746147727.843591:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b1ebe00/0xe64d3fbf12a7ddaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb65 expref: 12 pid: 7050 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746147727.843603:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b1ebe00/0xe64d3fbf12a7ddaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbb65 expref: 12 pid: 7050 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746147727.843625:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.843627:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.843633:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 18 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.843641:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 18 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.843667:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 18 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147727.843684:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796474496:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147727.843947:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147727.845467:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796474496:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147727.845483:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147727.845823:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794000256:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2264us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.845833:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8437 00000100:00100000:3.0:1746147727.850804:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.850850:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.851051:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794000512 00000100:00100000:1.0:1746147727.851058:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794000512 00002000:00100000:1.0:1746147727.851096:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3469312->3473407) req@ffff880094ef9180 x1830967794000512/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.851104:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef9180 with x1830967794000512 ext(3469312->3473407) 00002000:00010000:1.0:1746147727.851108:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ef9180 00000100:00100000:1.0:1746147727.851134:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7415 00000100:00100000:1.0:1746147727.851139:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794000512:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147727.853495:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794000512:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 2346us (2690us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147727.853506:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7415 00002000:00100000:1.0:1746147727.853516:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3469312->3473407) req@ffff880094ef9180 x1830967794000512/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/4536 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.853524:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef9180 with x1830967794000512 ext(3469312->3473407) 00002000:00010000:1.0:1746147727.853529:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ef9180 00000100:00100000:2.0:1746147727.853593:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967793999488:12345-192.168.202.10@tcp:3:cat.0 Request processed in 23158us (23566us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147727.853601:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7413 00002000:00100000:2.0:1746147727.853607:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800943c5180 x1830967793999488/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.853613:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5180 with x1830967793999488 ext(2097152->3145727) 00002000:00010000:2.0:1746147727.853616:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c5180 00000100:00100000:0.0:1746147727.853798:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794000640 00000100:00100000:0.0:1746147727.853805:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794000640 00000100:00100000:0.0:1746147727.853835:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16605 00000100:00100000:0.0:1746147727.853842:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32241:x1830967794000640:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147727.853854:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.853869:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbc99 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.853906:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 18 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.853913:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147727.853915:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147727.853917:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->3878911] (req 3145728->3878911) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.853953:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 18 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.853963:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 18 pid: 4591 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746147727.853973:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796474624:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147727.854024:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147727.857217:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796474624:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147727.857243:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->3878911] (req 3145728->3878911) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.857258:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5545800, rc 0) 00000100:00100000:1.0:1746147727.857310:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32241:x1830967794000640:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3467us (6458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.857317:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16605 00000100:00100000:0.0:1746147727.860780:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.860840:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794000768 00000100:00100000:1.0:1746147727.860847:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794000768 00000100:00100000:1.0:1746147727.861057:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16606 00000100:00100000:1.0:1746147727.861066:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32244:x1830967794000768:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147727.861082:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147727.861096:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941ba200/0xe64d3fbf12a7df2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbca0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.861119:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147727.862018:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147727.862025:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941ba200/0xe64d3fbf12a7df2b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca0 expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.862037:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941ba200/0xe64d3fbf12a7df2b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca0 expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147727.862047:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941ba200, rc 0) 00000100:00100000:1.0:1746147727.862091:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32244:x1830967794000768:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1027us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147727.862097:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16606 00000100:00100000:0.0:1746147727.863705:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.863758:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794001024 00000100:00100000:3.0:1746147727.863765:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794001024 00002000:00100000:3.0:1746147727.863798:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (4169728->4173823) req@ffff8800943c7800 x1830967794001024/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.863807:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c7800 with x1830967794001024 ext(4169728->4173823) 00010000:00010000:3.0:1746147727.863814:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 19 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147727.863826:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 19 pid: 4591 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746147727.863833:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800943c7800 00000100:00100000:3.0:1746147727.863866:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1479 00000100:00100000:3.0:1746147727.863873:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794001024:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147727.864068:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794001024:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 194us (377us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147727.864073:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1479 00002000:00100000:3.0:1746147727.864078:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (4169728->4173823) req@ffff8800943c7800 x1830967794001024/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/4536 e 0 to 0 dl 1746147738 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.864084:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c7800 with x1830967794001024 ext(4169728->4173823) 00010000:00010000:3.0:1746147727.864089:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 19 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147727.864097:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 19 pid: 4591 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746147727.864102:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800943c7800 00000100:00100000:0.0:1746147727.869051:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.869157:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794001280 00000100:00100000:2.0:1746147727.869164:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794001280 00002000:00100000:2.0:1746147727.869202:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3469312->4173823) req@ffff8800943c4700 x1830967794001280/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.869210:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4700 with x1830967794001280 ext(3469312->4173823) 00010000:00010000:2.0:1746147727.869218:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 19 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147727.869233:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 19 pid: 4591 timeout: 907 lvb_type: 0 00002000:00010000:2.0:1746147727.869239:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800943c4700 00000100:00100000:2.0:1746147727.869272:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1480 00000100:00100000:2.0:1746147727.869279:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1959:x1830967794001280:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:2.0:1746147727.886261:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794001280:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 16974us (17208us total) trans 21474841617 rc 0/0 00000100:00100000:2.0:1746147727.886274:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1480 00002000:00100000:2.0:1746147727.886284:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3469312->4173823) req@ffff8800943c4700 x1830967794001280/t21474841617(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/448 e 0 to 0 dl 1746147738 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.886293:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4700 with x1830967794001280 ext(3469312->4173823) 00010000:00010000:2.0:1746147727.886302:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 21 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147727.886316:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 21 pid: 4591 timeout: 907 lvb_type: 0 00002000:00010000:2.0:1746147727.886323:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800943c4700 00000100:00100000:0.0:1746147727.889668:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.889769:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794001408 00000100:00100000:2.0:1746147727.889776:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794001408 00010000:00010000:2.0:1746147727.889805:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 21 pid: 4591 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147727.889829:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8438 00000100:00100000:2.0:1746147727.889835:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967794001408:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147727.889847:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147727.889864:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 21 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147727.889874:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 21 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147727.889918:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7df1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3469312->4173823) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc92 expref: 21 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147727.889945:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.889947:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.889953:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3878911) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.889960:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3878911) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.889967:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.889968:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.889971:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941ba200/0xe64d3fbf12a7df2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca0 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.889977:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941ba200/0xe64d3fbf12a7df2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca0 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.890006:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941ba200/0xe64d3fbf12a7df2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca0 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147727.890015:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc11500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796474752:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147727.890860:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3878911) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147727.890876:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796474880:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147727.890922:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.892929:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc11500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796474752:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147727.897327:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.897437:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796474880:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147727.897455:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.897489:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1958:x1830967794001408:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7653us (7826us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.897499:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8438 00000100:00100000:0.0:1746147727.897609:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794001664 00000100:00100000:0.0:1746147727.897615:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794001664 00002000:00100000:0.0:1746147727.897646:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fc10700 x1830967794001664/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147727.897654:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10700 with x1830967794001664 ext(2097152->3145727) 00002000:00010000:0.0:1746147727.897658:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc10700 00000100:00100000:0.0:1746147727.897680:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7416 00000100:00100000:0.0:1746147727.897686:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794001664:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147727.904564:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.905592:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794001920 00000100:00100000:0.0:1746147727.905600:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794001920 00002000:00100000:0.0:1746147727.905635:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3874816->3878911) req@ffff88009fc10a80 x1830967794001920/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147727.905645:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10a80 with x1830967794001920 ext(3874816->3878911) 00002000:00010000:0.0:1746147727.905649:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc10a80 00000100:00100000:0.0:1746147727.905684:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7417 00000100:00100000:0.0:1746147727.905701:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794001920:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147727.905850:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794001920:12345-192.168.202.10@tcp:3:cat.0 Request processed in 160us (1293us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147727.905856:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7417 00002000:00100000:0.0:1746147727.905861:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3874816->3878911) req@ffff88009fc10a80 x1830967794001920/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/4536 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147727.905868:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10a80 with x1830967794001920 ext(3874816->3878911) 00002000:00010000:0.0:1746147727.905870:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc10a80 00000100:00100000:1.0:1746147727.912861:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794001664:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15166us (15532us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147727.912873:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7416 00002000:00100000:1.0:1746147727.912917:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fc10700 x1830967794001664/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.912928:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10700 with x1830967794001664 ext(2097152->3145727) 00002000:00010000:1.0:1746147727.912933:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc10700 00000100:00100000:2.0:1746147727.922020:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.922055:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794002048 00000100:00100000:3.0:1746147727.922066:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794002048 00000100:00100000:3.0:1746147727.922124:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16607 00000100:00100000:3.0:1746147727.922131:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32244:x1830967794002048:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147727.922146:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147727.922223:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5715600/0xe64d3fbf12a7df32 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbca7 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.922248:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3883008->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.922259:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147727.922261:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147727.922264:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5715600/0xe64d3fbf12a7df32 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca7 expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.922287:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3883008->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.922297:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3883008->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147727.922307:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796475008:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147727.922425:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.925422:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796475008:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147727.925444:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5715600/0xe64d3fbf12a7df32 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca7 expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.925457:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5715600, rc 0) 00000100:00100000:3.0:1746147727.925517:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32244:x1830967794002048:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3385us (3508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.925524:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16607 00000100:00100000:0.0:1746147727.925774:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147727.926163:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794002176 00000100:00100000:1.0:1746147727.926171:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794002176 00002000:00100000:1.0:1746147727.926211:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3883008->4194303) req@ffff8800943c7480 x1830967794002176/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147727.926221:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c7480 with x1830967794002176 ext(3883008->4194303) 00010000:00010000:1.0:1746147727.926229:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3883008->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147727.926243:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3883008->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00002000:00010000:1.0:1746147727.926249:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800943c7480 00000100:00100000:1.0:1746147727.926277:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1481 00000100:00100000:1.0:1746147727.926283:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794002176:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147727.933355:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967794002176:12345-192.168.202.10@tcp:4:cat.0 Request processed in 7063us (7579us total) trans 17179874389 rc 0/0 00000100:00100000:2.0:1746147727.933366:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1481 00002000:00100000:2.0:1746147727.933376:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3883008->4194303) req@ffff8800943c7480 x1830967794002176/t17179874389(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/448 e 0 to 0 dl 1746147738 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.933384:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c7480 with x1830967794002176 ext(3883008->4194303) 00010000:00010000:2.0:1746147727.933398:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3883008->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147727.933411:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3883008->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00002000:00010000:2.0:1746147727.933418:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800943c7480 00000100:00100000:0.0:1746147727.938367:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.940075:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794002304 00000100:00100000:3.0:1746147727.940085:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794002304 00010000:00010000:3.0:1746147727.940118:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3883008->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147727.940153:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8439 00000100:00100000:3.0:1746147727.940161:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967794002304:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147727.940174:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147727.940189:0:15900:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147727 -> 1746147728 00002000:00010000:3.0:1746147727.940192:0:15900:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147726 -> 1746147728 00002000:00010000:3.0:1746147727.940194:0:15900:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147727 -> 1746147728 00010000:00010000:3.0:1746147727.940199:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3883008->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147727.940209:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3883008->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147727.940230:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7df0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3883008->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc84 expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147727.940258:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.940260:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.940266:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5715600/0xe64d3fbf12a7df32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca7 expref: 13 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.940273:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5715600/0xe64d3fbf12a7df32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca7 expref: 13 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.940301:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5715600/0xe64d3fbf12a7df32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca7 expref: 13 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147727.940316:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796475136:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147727.940400:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.944375:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796475136:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147727.944391:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147727.944428:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794002304:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4267us (6067us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.944442:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8439 00000100:00100000:0.0:1746147727.946945:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.947000:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.947071:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794002688 00000100:00100000:3.0:1746147727.947082:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794002688 00000100:00100000:2.0:1746147727.947090:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794002816 00000100:00100000:2.0:1746147727.947097:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794002816 00002000:00100000:3.0:1746147727.947124:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3878912->4194303) req@ffff8800943c6d80 x1830967794002688/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.947131:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800943c7100 x1830967794002816/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.947133:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c6d80 with x1830967794002688 ext(3878912->4194303) 00002000:00010000:3.0:1746147727.947137:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c6d80 00002000:00100000:2.0:1746147727.947141:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c7100 with x1830967794002816 ext(3145728->4194303) 00002000:00010000:2.0:1746147727.947146:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c7100 00000100:00100000:3.0:1746147727.947159:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7418 00000100:00100000:3.0:1746147727.947165:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794002688:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147727.947173:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7419 00000100:00100000:2.0:1746147727.947180:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794002816:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147727.950464:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.950567:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794002944 00000100:00100000:0.0:1746147727.950579:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794002944 00000100:00100000:0.0:1746147727.950638:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12036 00000100:00100000:0.0:1746147727.950645:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+14:32251:x1830967794002944:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147727.950671:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.950703:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5544c00/0xe64d3fbf12a7df39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbcae expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.950763:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7df40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147727.950775:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7df40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147727.950788:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7df40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147727.950802:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5800/0xe64d3fbf12a7df47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147727.950808:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5800/0xe64d3fbf12a7df47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147727.950813:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5800/0xe64d3fbf12a7df47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147727.951353:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147727.951368:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090abba00/0xe64d3fbf12a7deb4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc3e expref: 21 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.951376:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7deec lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc68 expref: 341 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.951382:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 5/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147727.951412:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7deec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc68 expref: 341 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.951423:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7deec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc68 expref: 341 pid: 14546 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746147727.951435:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796475264:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147727.953548:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090abba00/0xe64d3fbf12a7deb4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc3e expref: 21 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.953560:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090abba00/0xe64d3fbf12a7deb4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc3e expref: 21 pid: 5744 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746147727.953570:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796475392:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147727.953607:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.953932:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794002688:12345-192.168.202.10@tcp:3:cat.0 Request processed in 6765us (6997us total) trans 0 rc 315392/315392 00000100:00100000:3.0:1746147727.953942:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7418 00002000:00100000:3.0:1746147727.953951:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3878912->4194303) req@ffff8800943c6d80 x1830967794002688/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 315392/315392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.953959:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c6d80 with x1830967794002688 ext(3878912->4194303) 00002000:00010000:3.0:1746147727.953963:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c6d80 00000100:00100000:0.0:1746147727.956767:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.956810:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.957614:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796475264:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147727.957625:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796475392:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147727.957648:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:3.0:1746147727.957724:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794003328 00000100:00100000:3.0:1746147727.957731:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794003328 00000100:00100000:3.0:1746147727.957761:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794003456 00000100:00100000:3.0:1746147727.957763:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794003456 00000100:00100000:3.0:1746147727.957788:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5013 00000100:00100000:3.0:1746147727.957794:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:27451:x1830967794003328:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147727.958008:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:27451:x1830967794003328:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 213us (1245us total) trans 8589946056 rc 0/0 00000100:00100000:3.0:1746147727.958014:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5013 00000100:00100000:3.0:1746147727.958027:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5014 00000100:00100000:3.0:1746147727.958032:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095029450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+342:7670:x1830967794003456:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147727.958087:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095029450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+343:7670:x1830967794003456:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 54us (1279us total) trans 8589946057 rc 0/0 00000100:00100000:3.0:1746147727.958094:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5014 00000100:00100000:0.0:1746147727.960810:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.960853:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.960923:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.961016:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794003584 00000100:00100000:2.0:1746147727.961027:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794003584 00000100:00100000:2.0:1746147727.961067:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794003712 00000100:00100000:2.0:1746147727.961069:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794003712 00000100:00100000:2.0:1746147727.961082:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794003840 00000100:00100000:2.0:1746147727.961084:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794003840 00000100:00100000:2.0:1746147727.961103:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16608 00000100:00100000:2.0:1746147727.961110:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794003584:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147727.961123:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.961142:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7df55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbcb5 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.961161:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.961163:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.961170:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7df55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcb5 expref: 22 pid: 8184 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147727.961183:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16609 00010000:00010000:2.0:1746147727.961183:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7df55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcb5 expref: 22 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.961193:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e5200, rc 0) 00000100:00100000:3.0:1746147727.961196:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794003712:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147727.961212:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147727.961228:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7df5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbcbc expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147727.961233:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794003584:12345-192.168.202.10@tcp:101:cat.0 Request processed in 123us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.961239:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16608 00010000:00010000:3.0:1746147727.961248:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.961250:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147727.961253:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16610 00010000:00010000:3.0:1746147727.961257:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7df5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcbc expref: 22 pid: 10613 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147727.961258:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794003840:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147727.961264:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.961269:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5c00/0xe64d3fbf12a7df63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbcc3 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.961270:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7df5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcbc expref: 22 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147727.961281:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5715a00, rc 0) 00000100:00100000:2.0:1746147727.961300:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796475520:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147727.961313:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794003712:12345-192.168.202.10@tcp:101:cat.0 Request processed in 121us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.961320:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16609 00000100:00100000:2.0:1746147727.961349:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.962580:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794002816:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15396us (15575us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147727.962588:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7419 00002000:00100000:0.0:1746147727.962597:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800943c7100 x1830967794002816/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147727.962606:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c7100 with x1830967794002816 ext(3145728->4194303) 00002000:00010000:0.0:1746147727.962610:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c7100 00000100:00100000:3.0:1746147727.962993:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.963053:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794003968 00000100:00100000:2.0:1746147727.963060:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794003968 00000100:00100000:3.0:1746147727.963089:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147727.963327:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090abba00/0xe64d3fbf12a7deb4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc3e expref: 23 pid: 5744 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147727.963365:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794004096 00000100:00100000:2.0:1746147727.963368:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794004096 00010000:00010000:2.0:1746147727.963381:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7deec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc68 expref: 343 pid: 14546 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746147727.963399:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8440 00000100:00100000:1.0:1746147727.963411:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967794003968:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147727.963426:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147727.963436:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090abba00/0xe64d3fbf12a7deb4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc3e expref: 23 pid: 5744 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147727.963448:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090abba00/0xe64d3fbf12a7deb4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc3e expref: 23 pid: 5744 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147727.963474:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090abba00/0xe64d3fbf12a7deb4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc3e expref: 23 pid: 5744 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147727.963502:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147727.963507:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147727.963515:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147727.963519:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147727.963523:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147727.963552:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967794003968:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 145us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.964026:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8441 00000100:00100000:1.0:1746147727.964034:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8440 00000100:00100000:2.0:1746147727.964035:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+343:1960:x1830967794004096:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147727.964046:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147727.964052:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7deec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc68 expref: 343 pid: 14546 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147727.964071:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7deec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc68 expref: 343 pid: 14546 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147727.964179:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090abb400/0xe64d3fbf12a7deec lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc68 expref: 343 pid: 14546 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147727.964182:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796475520:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147727.964205:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147727.964207:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5c00/0xe64d3fbf12a7df63 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcc3 expref: 22 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.964209:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147727.964218:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5c00/0xe64d3fbf12a7df63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcc3 expref: 22 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.964218:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964223:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147727.964232:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e5c00, rc 0) 00010000:00010000:2.0:1746147727.964242:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147727.964274:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+342:1960:x1830967794004096:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 241us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.964281:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8441 00010000:00010000:2.0:1746147727.964303:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964310:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147727.964345:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147727.964349:0:14546:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147727.964363:0:14546:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:3.0:1746147727.964370:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794003840:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3111us (3446us total) trans 0 rc 301/301 00010000:00010000:2.0:1746147727.964375:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00000100:00100000:3.0:1746147727.964377:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16610 00010000:00010000:2.0:1746147727.964382:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7df40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964387:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7df40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964393:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7df40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964397:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5545c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147727.964400:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7df40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964406:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7df40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964412:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147727.964415:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147727.964417:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7df40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964422:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545c00/0xe64d3fbf12a7df40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964430:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5800/0xe64d3fbf12a7df47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964434:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5800/0xe64d3fbf12a7df47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964438:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5800/0xe64d3fbf12a7df47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964442:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800915e5800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147727.964444:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5800/0xe64d3fbf12a7df47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964449:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5800/0xe64d3fbf12a7df47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964453:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcc4000) 00010000:00010000:2.0:1746147727.964455:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147727.964457:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5800/0xe64d3fbf12a7df47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.964461:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5800/0xe64d3fbf12a7df47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.965413:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5544c00/0xe64d3fbf12a7df39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcae expref: 16 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.965426:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcae expref: 15 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.965620:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147727.965622:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147727.965624:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915e5c00, rc 0) 00000100:00100000:2.0:1746147727.965666:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+15:32251:x1830967794002944:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 15021us (15206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.967337:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12036 00000100:00100000:0.0:1746147727.969656:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.969704:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.970416:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.970858:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.970876:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794004224 00000100:00100000:3.0:1746147727.970893:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794004224 00000100:00100000:0.0:1746147727.971993:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.972116:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794004480 00000100:00100000:3.0:1746147727.972121:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794004480 00000100:00100000:3.0:1746147727.972139:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794004736 00000100:00100000:3.0:1746147727.972141:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794004736 00000100:00100000:3.0:1746147727.972152:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794004992 00000100:00100000:3.0:1746147727.972153:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794004992 00000100:00100000:3.0:1746147727.972171:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16611 00000100:00100000:3.0:1746147727.972178:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794004224:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147727.972193:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147727.972208:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7df6a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbcca expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147727.972251:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796475648:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147727.972308:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.972327:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16612 00000100:00100000:3.0:1746147727.972332:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794004480:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147727.972338:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147727.972345:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a002c400/0xe64d3fbf12a7df71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbcd8 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.972355:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.972357:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.972365:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a002c400/0xe64d3fbf12a7df71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd8 expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147727.972377:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a002c400/0xe64d3fbf12a7df71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd8 expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147727.972386:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a002c400, rc 0) 00000100:00100000:3.0:1746147727.972405:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794004480:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 72us (2701us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.972410:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16612 00000100:00100000:3.0:1746147727.972424:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16613 00000100:00100000:3.0:1746147727.972429:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+5:1959:x1830967794004736:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147727.972435:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147727.972443:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a002ca00/0xe64d3fbf12a7df78 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbce6 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.972452:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.972454:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147727.972458:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a002ca00/0xe64d3fbf12a7df78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbce6 expref: 6 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147727.972466:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a002ca00/0xe64d3fbf12a7df78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbce6 expref: 6 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147727.972473:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a002ca00, rc 0) 00000100:00100000:3.0:1746147727.972485:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794004736:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 56us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147727.972490:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16613 00000100:00100000:3.0:1746147727.972497:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16614 00000100:00100000:3.0:1746147727.972501:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794004992:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147727.972507:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147727.972511:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a002ce00/0xe64d3fbf12a7df7f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbcf4 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147727.972528:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796475776:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147727.972544:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147727.973347:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794004352 00000100:00100000:0.0:1746147727.973352:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794004352 00000100:00100000:0.0:1746147727.973371:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16615 00000100:00100000:0.0:1746147727.973376:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794004352:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147727.973382:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147727.973389:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0486600/0xe64d3fbf12a7df86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbcd1 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147727.973399:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.973400:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147727.973405:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0486600/0xe64d3fbf12a7df86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd1 expref: 7 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.973413:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0486600/0xe64d3fbf12a7df86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd1 expref: 7 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147727.973419:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0486600, rc 0) 00000100:00100000:0.0:1746147727.973435:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794004352:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 60us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147727.973444:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16615 00000100:00100000:2.0:1746147727.973612:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.973629:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794004608 00000100:00100000:2.0:1746147727.973633:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794004608 00000100:00100000:2.0:1746147727.973649:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16616 00000100:00100000:2.0:1746147727.973654:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794004608:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147727.973660:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.973668:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4000/0xe64d3fbf12a7df8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbcdf expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.973678:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.973680:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.973684:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4000/0xe64d3fbf12a7df8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcdf expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.973703:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4000/0xe64d3fbf12a7df8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcdf expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.973710:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e4000, rc 0) 00000100:00100000:2.0:1746147727.973724:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794004608:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 71us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.973730:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16616 00000100:00100000:2.0:1746147727.973764:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.973775:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794004864 00000100:00100000:2.0:1746147727.973777:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794004864 00000100:00100000:2.0:1746147727.973790:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16617 00000100:00100000:2.0:1746147727.973794:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794004864:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147727.973800:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147727.973806:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7df94 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbced expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147727.973820:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.973821:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147727.973825:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7df94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbced expref: 8 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.973834:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7df94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbced expref: 8 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.973840:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e4600, rc 0) 00000100:00100000:2.0:1746147727.973854:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794004864:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 60us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.973859:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16617 00000100:00100000:2.0:1746147727.975297:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.975316:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:2.0:1746147727.975397:0:8184:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime: 1746147728 -> 1746147729 00000100:00100000:2.0:1746147727.975416:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796475648:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147727.975437:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7df6a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcca expref: 14 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.975447:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7df6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcca expref: 14 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147727.975455:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a002cc00, rc 0) 00000100:00100000:2.0:1746147727.975479:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794004224:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3301us (5827us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147727.975488:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16611 00000100:00100000:3.0:1746147727.975500:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794005376 00000100:00100000:3.0:1746147727.975504:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794005376 00000100:00100000:2.0:1746147727.975517:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796475776:192.168.202.10@tcp:106: 00002000:00100000:3.0:1746147727.975528:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fc13800 x1830967794005376/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147727.975529:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a002ce00/0xe64d3fbf12a7df7f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcf4 expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746147727.975536:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13800 with x1830967794005376 ext(0->1048575) 00010000:00010000:2.0:1746147727.975537:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a002ce00/0xe64d3fbf12a7df7f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcf4 expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746147727.975540:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc13800 00010000:00010000:2.0:1746147727.975543:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a002ce00, rc 0) 00000100:00100000:3.0:1746147727.975551:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794005504 00000100:00100000:3.0:1746147727.975553:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794005504 00000100:00100000:2.0:1746147727.975558:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794004992:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 3056us (4700us total) trans 0 rc 301/301 00002000:00100000:3.0:1746147727.975562:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009fc10000 x1830967794005504/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147727.975563:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16614 00002000:00100000:3.0:1746147727.975568:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10000 with x1830967794005504 ext(1048576->2097151) 00002000:00010000:3.0:1746147727.975571:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc10000 00000100:00100000:3.0:1746147727.975580:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7420 00000100:00100000:2.0:1746147727.975583:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7421 00000100:00100000:3.0:1746147727.975585:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794005376:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147727.975588:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794005504:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147727.983278:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147727.983323:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147727.983336:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794005760 00000100:00100000:3.0:1746147727.983343:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794005760 00000100:00100000:3.0:1746147727.983388:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12037 00000100:00100000:3.0:1746147727.983394:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+15:32251:x1830967794005760:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147727.983409:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147727.983416:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794006016 00000100:00100000:2.0:1746147727.983420:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794006016 00010000:00010000:3.0:1746147727.983426:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7df9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbcfb expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147727.983445:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800949d6d80 x1830967794006016/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/0 e 0 to 0 dl 1746147738 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.983454:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d6d80 with x1830967794006016 ext(4194304->5017599) 00002000:00010000:2.0:1746147727.983457:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d6d80 00000100:00100000:2.0:1746147727.983478:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7422 00000100:00100000:2.0:1746147727.983483:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794006016:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:3.0:1746147727.983505:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7dfa2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147727.984257:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcae expref: 16 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.984268:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7dfa2 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147727.984294:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcae expref: 16 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.984303:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcae expref: 16 pid: 14546 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147727.984314:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796475904:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147727.984384:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147727.988303:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794005376:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12710us (13002us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147727.988313:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7420 00002000:00100000:3.0:1746147727.988322:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fc13800 x1830967794005376/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147727.988330:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13800 with x1830967794005376 ext(0->1048575) 00002000:00010000:3.0:1746147727.988334:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc13800 00000100:00100000:3.0:1746147727.989132:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796475904:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147727.989149:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7dfa2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:2.0:1746147727.991009:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794005504:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15416us (15687us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147727.991020:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7421 00002000:00100000:2.0:1746147727.991029:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009fc10000 x1830967794005504/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.991037:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10000 with x1830967794005504 ext(1048576->2097151) 00002000:00010000:2.0:1746147727.991041:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc10000 00000100:00100000:0.0:1746147727.991634:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147727.991675:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794006144 00000100:00100000:2.0:1746147727.991680:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794006144 00010000:00010000:2.0:1746147727.991715:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcae expref: 17 pid: 14546 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147727.991741:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8442 00000100:00100000:2.0:1746147727.991748:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+17:1959:x1830967794006144:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147727.991758:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147727.991763:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcae expref: 17 pid: 14546 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147727.991772:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcae expref: 17 pid: 14546 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147727.991789:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e5c00/0xe64d3fbf12a7df4e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcae expref: 17 pid: 14546 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147727.991834:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147727.991839:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7dfa2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.991848:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7dfa2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.991854:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7dfa2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147727.991882:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147727.991949:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7dfa2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147727.991955:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7dfa2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:2.0:1746147727.991995:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+16:1959:x1830967794006144:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 247us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147727.992000:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8442 00000004:00200000:3.0:1746147727.992040:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147727.992159:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7df9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcfb expref: 17 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.992184:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7dfa2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcfb expref: 16 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147727.992190:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147727.992193:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147727.992226:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d2a00, rc 0) 00000100:00100000:3.0:1746147727.992285:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+16:32251:x1830967794005760:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 8890us (9013us total) trans 8589946058 rc 0/0 00000100:00100000:3.0:1746147727.992291:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12037 00000100:00100000:2.0:1746147727.997000:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794006016:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13509us (13668us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147727.997011:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7422 00002000:00100000:2.0:1746147727.997021:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800949d6d80 x1830967794006016/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:348/0 lens 488/440 e 0 to 0 dl 1746147738 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147727.997030:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d6d80 with x1830967794006016 ext(4194304->5017599) 00002000:00010000:2.0:1746147727.997035:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d6d80 00000100:00100000:0.0:1746147728.000814:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.000930:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794006400 00000100:00100000:3.0:1746147728.000937:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794006400 00000100:00100000:0.0:1746147728.001114:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.001157:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.001227:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794006784 00000100:00100000:2.0:1746147728.001235:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794006784 00000100:00100000:3.0:1746147728.001247:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12038 00000100:00100000:3.0:1746147728.001256:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+16:32251:x1830967794006400:12345-192.168.202.10@tcp:101:mirror_io.0 00000100:00100000:2.0:1746147728.001261:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16618 00000100:00100000:2.0:1746147728.001267:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794006784:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147728.001275:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.001275:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147728.001279:0:14546:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147728.001291:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7dfb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd09 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.001299:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7dfa2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcfb expref: 16 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.001312:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147728.001316:0:14546:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147728.001323:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7dfb7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd02 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.001336:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796476032:192.168.202.10@tcp:106: 00000100:00080000:1.0:1746147728.001399:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746147728.001403:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7dfbe lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00000100:00080000:1.0:1746147728.001403:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147728.001413:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7dfbe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147728.001419:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7dfbe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:3.0:1746147728.001428:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147728.001517:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7dfb7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd02 expref: 18 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.001527:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7dfbe lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd02 expref: 17 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.001532:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147728.001535:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147728.001536:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d2800, rc 0) 00000100:00100000:3.0:1746147728.001560:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+17:32251:x1830967794006400:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 306us (753us total) trans 8589946059 rc 0/0 00000100:00100000:3.0:1746147728.001566:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12038 00000100:00100000:2.0:1746147728.001824:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147728.001843:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794006656 00000100:00100000:2.0:1746147728.001847:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794006656 00002000:00100000:2.0:1746147728.001869:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800949d4a80 x1830967794006656/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.001878:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d4a80 with x1830967794006656 ext(2097152->3145727) 00002000:00010000:2.0:1746147728.001882:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d4a80 00000100:00100000:2.0:1746147728.001913:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7423 00000100:00100000:2.0:1746147728.001918:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794006656:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147728.003166:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796476032:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147728.003188:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7dfb0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd09 expref: 14 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.003198:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7dfb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd09 expref: 14 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.003216:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e5e00, rc 0) 00000100:00100000:3.0:1746147728.003253:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794006784:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1986us (2095us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147728.003259:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16618 00000100:00100000:0.0:1746147728.006349:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.007100:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.007179:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794007040 00000100:00100000:2.0:1746147728.007186:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794007040 00000100:00100000:2.0:1746147728.007221:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16619 00000100:00100000:2.0:1746147728.007228:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794007040:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.007242:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.007258:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7dfcc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd17 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147728.007288:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794006912 00000100:00100000:3.0:1746147728.007292:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794006912 00000100:00100000:2.0:1746147728.007303:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796476160:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147728.007317:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12039 00000100:00100000:3.0:1746147728.007321:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+17:32251:x1830967794006912:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147728.007333:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147728.007343:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7dfd3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd10 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.007355:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f900 going to sleep for 11 seconds 00010000:00010000:3.0:1746147728.007387:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7dfd3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd10 expref: 18 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.007404:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7dfd3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd10 expref: 18 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.007424:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147728.007426:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147728.007428:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d3600, rc 0) 00000100:00100000:3.0:1746147728.007472:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+18:32251:x1830967794006912:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 150us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.007478:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12039 00000100:00100000:2.0:1746147728.009632:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796476160:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147728.009660:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7dfcc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd17 expref: 14 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.009672:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4200/0xe64d3fbf12a7dfcc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd17 expref: 14 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.009704:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e4200, rc 0) 00000100:00100000:2.0:1746147728.009737:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794007040:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2509us (2636us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147728.009744:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16619 00000100:00100000:3.0:1746147728.011441:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794006656:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9516us (10321us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147728.011454:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7423 00002000:00100000:3.0:1746147728.011463:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800949d4a80 x1830967794006656/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.011471:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d4a80 with x1830967794006656 ext(2097152->3145727) 00002000:00010000:3.0:1746147728.011476:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d4a80 00000100:00100000:0.0:1746147728.011643:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.011698:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.011713:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794007296 00000100:00100000:0.0:1746147728.011718:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794007296 00000100:00100000:0.0:1746147728.011746:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794007552 00000100:00100000:0.0:1746147728.011748:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794007552 00000100:00100000:0.0:1746147728.011760:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16620 00000100:00100000:0.0:1746147728.011765:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794007296:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147728.011791:0:8184:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7dfda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.011808:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5529000/0xe64d3fbf12a7df01 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc76 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.011816:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a002c400/0xe64d3fbf12a7df71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd8 expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147728.011822:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7df55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcb5 expref: 20 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147728.011827:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147728.011829:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147728.011832:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7dfda lrc: 6/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.011855:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7df55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcb5 expref: 20 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147728.011865:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7df55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcb5 expref: 20 pid: 8184 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746147728.011876:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d26300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796476288:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147728.011948:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a002c400/0xe64d3fbf12a7df71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd8 expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147728.011956:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a002c400/0xe64d3fbf12a7df71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd8 expref: 8 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746147728.011968:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d25500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796476416:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147728.011988:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5529000/0xe64d3fbf12a7df01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc76 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.011994:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5529000/0xe64d3fbf12a7df01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc76 expref: 12 pid: 4591 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746147728.012000:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d27800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796476544:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147728.012010:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.012025:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16621 00000100:00100000:0.0:1746147728.012029:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794007552:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147728.012044:0:4592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800941bb000/0xe64d3fbf12a7dfe1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.012053:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8200/0xe64d3fbf12a7dec2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc45 expref: 21 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.012059:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a002ca00/0xe64d3fbf12a7df78 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbce6 expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147728.012064:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5528600/0xe64d3fbf12a7df08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc7d expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.012068:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147728.012070:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147728.012072:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941bb000/0xe64d3fbf12a7dfe1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.012084:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5528600/0xe64d3fbf12a7df08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc7d expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.012090:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5528600/0xe64d3fbf12a7df08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc7d expref: 12 pid: 4591 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746147728.012097:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d26680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796476672:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147728.012114:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a002ca00/0xe64d3fbf12a7df78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbce6 expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147728.012120:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a002ca00/0xe64d3fbf12a7df78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbce6 expref: 8 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746147728.012125:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796476800:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147728.012140:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8200/0xe64d3fbf12a7dec2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc45 expref: 21 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.012141:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147728.012146:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8200/0xe64d3fbf12a7dec2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc45 expref: 21 pid: 8184 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746147728.012151:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d24000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796476928:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147728.012161:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147728.012173:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.012221:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794007808 00000100:00100000:3.0:1746147728.012225:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794007808 00000100:00080000:1.0:1746147728.012230:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746147728.012234:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147728.012876:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794007168 00000100:00100000:3.0:1746147728.012880:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794007168 00000100:00100000:1.0:1746147728.012897:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16622 00000100:00100000:1.0:1746147728.012906:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967794007808:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147728.012924:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.012935:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3878911) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.012943:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941ba200/0xe64d3fbf12a7df2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca0 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.012948:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147728.012950:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147728.012952:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.012967:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941ba200/0xe64d3fbf12a7df2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca0 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147728.012971:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16623 00010000:00010000:1.0:1746147728.012975:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941ba200/0xe64d3fbf12a7df2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca0 expref: 12 pid: 4591 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147728.012976:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967794007168:12345-192.168.202.10@tcp:1:mirror_io.0 00000100:00100000:1.0:1746147728.012984:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe41180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796477056:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.012992:0:10613:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7dfef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.013002:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1051800/0xe64d3fbf12a7dede lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc61 expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.013008:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0486600/0xe64d3fbf12a7df86 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd1 expref: 9 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.013014:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7defa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc6f expref: 21 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.013019:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.013021:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.013021:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3878911) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.013022:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7dfef lrc: 6/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.013028:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3878911) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 12 pid: 4591 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746147728.013035:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796477184:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.013038:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7defa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc6f expref: 21 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.013046:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7defa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc6f expref: 21 pid: 7050 timeout: 907 lvb_type: 1 00000100:00100000:1.0:1746147728.013051:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147728.013054:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796477312:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.013082:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0486600/0xe64d3fbf12a7df86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd1 expref: 9 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.013089:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0486600/0xe64d3fbf12a7df86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd1 expref: 9 pid: 4592 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746147728.013096:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796477440:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.013619:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.013631:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794007424 00000100:00100000:2.0:1746147728.013634:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794007424 00000100:00100000:2.0:1746147728.013650:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16624 00000100:00100000:2.0:1746147728.013655:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967794007424:12345-192.168.202.10@tcp:1:mirror_io.0 00000100:00100000:0.0:1746147728.013664:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147728.013670:0:21480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7dff6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.013681:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7dea6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc37 expref: 20 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.013700:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4000/0xe64d3fbf12a7df8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcdf expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.013708:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ded0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc5a expref: 12 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.013714:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.013715:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.013717:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7dff6 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.013732:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ded0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc5a expref: 12 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.013741:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ded0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc5a expref: 12 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746147728.013750:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796477568:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.013775:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1051800/0xe64d3fbf12a7dede lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc61 expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.013780:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4000/0xe64d3fbf12a7df8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcdf expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.013784:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a1051800/0xe64d3fbf12a7dede lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc61 expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.013788:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4000/0xe64d3fbf12a7df8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcdf expref: 10 pid: 21480 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746147728.013790:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796477696:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.013796:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796477824:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147728.013809:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746147728.013817:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7dea6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc37 expref: 20 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147728.013821:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794007680 00000100:00100000:3.0:1746147728.013823:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794007680 00010000:00010000:2.0:1746147728.013825:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7dea6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc37 expref: 20 pid: 8184 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.013833:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135811c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796477952:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147728.013842:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16625 00000100:00100000:2.0:1746147728.013844:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147728.013847:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967794007680:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147728.013861:0:7050:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7dffd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.013870:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7df16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc8b expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.013876:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5715600/0xe64d3fbf12a7df32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca7 expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.013896:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7df94 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbced expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.013903:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7df5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcbc expref: 21 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.013908:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147728.013909:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147728.013911:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7dffd lrc: 7/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.013924:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7df5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcbc expref: 21 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.013931:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7df5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcbc expref: 21 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746147728.013943:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796478080:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.013989:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7df94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbced expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.013997:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7df94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbced expref: 10 pid: 21480 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746147728.014005:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796478208:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.014026:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5715600/0xe64d3fbf12a7df32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca7 expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.014033:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5715600/0xe64d3fbf12a7df32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca7 expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147728.014040:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796478336:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.014059:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7df16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc8b expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.014065:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7df16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc8b expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147728.014071:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796478464:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147728.014083:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.014460:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d26300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796476288:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.015007:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d25500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796476416:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147728.017308:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe41180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796477056:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147728.017311:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796476800:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147728.017319:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796477184:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.017320:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d27800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796476544:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147728.017338:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d26680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796476672:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147728.017339:0:20619:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.017343:0:8184:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7dfda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147728.017357:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d24000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796476928:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147728.017373:0:4592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800941bb000/0xe64d3fbf12a7dfe1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.017552:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796477568:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147728.017555:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796478080:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.017560:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796477824:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147728.017563:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796478208:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.017567:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135811c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796477952:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147728.017568:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796478336:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147728.017573:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796478464:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.017589:0:7050:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7dffd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147728.017604:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796477312:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147728.017610:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796477440:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147728.017615:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796477696:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.017624:0:10613:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7dfef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.017674:0:21480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7dff6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147728.018115:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.018142:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.018164:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.018812:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794008064 00000100:00100000:2.0:1746147728.018818:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794008064 00000100:00100000:0.0:1746147728.018828:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.018844:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147728.018845:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a002c400/0xe64d3fbf12a7df71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd8 expref: 11 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746147728.018858:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794008576 00000100:00100000:0.0:1746147728.018861:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794008576 00000100:00100000:2.0:1746147728.018879:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794007936 00000100:00100000:2.0:1746147728.018881:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794007936 00000100:00100000:3.0:1746147728.018909:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794008320 00000100:00100000:3.0:1746147728.018912:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794008320 00010000:00010000:2.0:1746147728.018914:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7df55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcb5 expref: 21 pid: 8184 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746147728.018924:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794009216 00010000:00010000:3.0:1746147728.018926:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941ba200/0xe64d3fbf12a7df2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca0 expref: 13 pid: 4591 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.018926:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794009216 00010000:00010000:2.0:1746147728.018932:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4000/0xe64d3fbf12a7df8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcdf expref: 12 pid: 21480 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746147728.018940:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8443 00000100:00100000:2.0:1746147728.018944:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8444 00000100:00100000:3.0:1746147728.018946:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+12:1958:x1830967794008064:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147728.018949:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967794007936:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147728.018957:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147728.018958:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147728.018976:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a002c400/0xe64d3fbf12a7df71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd8 expref: 12 pid: 10613 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.018976:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7df55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcb5 expref: 21 pid: 8184 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.018984:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7df55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcb5 expref: 21 pid: 8184 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746147728.019033:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5528600/0xe64d3fbf12a7df08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc7d expref: 13 pid: 4591 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746147728.019045:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8445 00000100:00100000:0.0:1746147728.019050:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794008320:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147728.019055:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147728.019065:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941ba200/0xe64d3fbf12a7df2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca0 expref: 13 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746147728.019072:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941ba200/0xe64d3fbf12a7df2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca0 expref: 13 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746147728.019090:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941ba200/0xe64d3fbf12a7df2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca0 expref: 13 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746147728.019105:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147728.019137:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1958:x1830967794008320:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 86us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147728.019142:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8445 00000100:00100000:0.0:1746147728.019153:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8446 00000100:00100000:0.0:1746147728.019158:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+12:1958:x1830967794009216:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147728.019163:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147728.019170:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4000/0xe64d3fbf12a7df8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcdf expref: 12 pid: 21480 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746147728.019177:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4000/0xe64d3fbf12a7df8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcdf expref: 12 pid: 21480 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746147728.019186:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e4000/0xe64d3fbf12a7df8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcdf expref: 12 pid: 21480 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746147728.019198:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147728.019212:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967794009216:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 54us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147728.019216:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8446 00000100:00100000:0.0:1746147728.019226:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8447 00000100:00100000:0.0:1746147728.019230:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794008576:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147728.019237:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147728.019248:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5528600/0xe64d3fbf12a7df08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc7d expref: 13 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746147728.019254:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5528600/0xe64d3fbf12a7df08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc7d expref: 13 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746147728.019265:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5528600/0xe64d3fbf12a7df08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc7d expref: 13 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746147728.019272:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147728.019283:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1958:x1830967794008576:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 53us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147728.019287:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8447 00000100:00100000:0.0:1746147728.019359:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.019374:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794009088 00000100:00100000:0.0:1746147728.019376:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794009088 00010000:00010000:0.0:1746147728.019387:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7defa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc6f expref: 22 pid: 7050 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746147728.019397:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8448 00000100:00100000:0.0:1746147728.019401:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967794009088:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147728.019407:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147728.019414:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7defa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc6f expref: 22 pid: 7050 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746147728.019425:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7defa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc6f expref: 22 pid: 7050 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746147728.019435:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a029a000/0xe64d3fbf12a7defa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc6f expref: 22 pid: 7050 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746147728.019443:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147728.019455:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967794009088:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 53us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147728.019459:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8448 00010000:00010000:3.0:1746147728.020029:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a002c400/0xe64d3fbf12a7df71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd8 expref: 10 pid: 10613 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.020041:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a002c400/0xe64d3fbf12a7df71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd8 expref: 10 pid: 10613 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.020051:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1746147728.020119:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746147728.020203:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7df55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcb5 expref: 21 pid: 8184 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.020215:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147728.021102:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967794008064:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2151us (2984us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.021109:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8443 00000100:00100000:2.0:1746147728.021125:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1958:x1830967794007936:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2173us (2957us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.021132:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8444 00000100:00100000:0.0:1746147728.021208:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.021247:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.021472:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794009472 00000100:00100000:3.0:1746147728.021476:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794009472 00010000:00010000:3.0:1746147728.021494:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7df94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbced expref: 11 pid: 21480 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746147728.021519:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794009344 00000100:00100000:3.0:1746147728.021521:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794009344 00010000:00010000:3.0:1746147728.021532:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7dea6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc37 expref: 20 pid: 8184 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147728.021543:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8449 00000100:00100000:3.0:1746147728.021548:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967794009472:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147728.021548:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8450 00010000:00010000:3.0:1746147728.021554:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147728.021556:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1958:x1830967794009344:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147728.021565:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147728.021567:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7df94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbced expref: 11 pid: 21480 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.021578:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7df94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbced expref: 11 pid: 21480 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746147728.021578:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7dea6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc37 expref: 20 pid: 8184 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.021588:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7dea6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc37 expref: 20 pid: 8184 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.021602:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090abaa00/0xe64d3fbf12a7dea6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc37 expref: 20 pid: 8184 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.021618:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.021638:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1958:x1830967794009344:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 83us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.021644:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8450 00010000:00010000:3.0:1746147728.022113:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7df94 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbced expref: 11 pid: 21480 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.022124:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147728.022141:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967794009472:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 593us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.022146:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8449 00000100:00100000:0.0:1746147728.022194:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.022273:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794009856 00000100:00100000:3.0:1746147728.022276:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794009856 00010000:00010000:3.0:1746147728.022288:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5715600/0xe64d3fbf12a7df32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca7 expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147728.022571:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8451 00000100:00100000:3.0:1746147728.022577:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1958:x1830967794009856:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147728.022583:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147728.022592:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5715600/0xe64d3fbf12a7df32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca7 expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.022598:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5715600/0xe64d3fbf12a7df32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca7 expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.022608:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5715600/0xe64d3fbf12a7df32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbca7 expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.022616:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147728.022643:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967794009856:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 66us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.025437:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.025456:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.025477:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.025494:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794008448 00000100:00100000:1.0:1746147728.025499:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794008448 00000100:00100000:2.0:1746147728.025501:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794008832 00000100:00100000:2.0:1746147728.025504:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794008832 00010000:00010000:2.0:1746147728.025519:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0486600/0xe64d3fbf12a7df86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd1 expref: 11 pid: 4592 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746147728.025519:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a002ca00/0xe64d3fbf12a7df78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbce6 expref: 11 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746147728.025538:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8452 00000100:00100000:2.0:1746147728.025544:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794008832:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147728.025547:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8453 00000100:00100000:0.0:1746147728.025548:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794009984 00000100:00100000:1.0:1746147728.025551:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794008448:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147728.025552:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794009984 00010000:00010000:2.0:1746147728.025553:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147728.025555:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147728.025568:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0486600/0xe64d3fbf12a7df86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd1 expref: 11 pid: 4592 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746147728.025568:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a002ca00/0xe64d3fbf12a7df78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbce6 expref: 11 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746147728.025576:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16626 00010000:00010000:2.0:1746147728.025577:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0486600/0xe64d3fbf12a7df86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd1 expref: 11 pid: 4592 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746147728.025577:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a002ca00/0xe64d3fbf12a7df78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbce6 expref: 11 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746147728.025582:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:32254:x1830967794009984:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.025592:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0486600/0xe64d3fbf12a7df86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcd1 expref: 11 pid: 4592 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746147728.025592:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a002ca00/0xe64d3fbf12a7df78 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbce6 expref: 11 pid: 10613 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746147728.025593:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.025602:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147728.025602:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147728.025604:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0264600/0xe64d3fbf12a7e004 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd1e expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.025619:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147728.025622:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147728.025628:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794008448:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 76us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.025633:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8453 00010000:00010000:0.0:1746147728.025633:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147728.025638:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0264600/0xe64d3fbf12a7e004 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd1e expref: 20 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.025651:0:4591:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.025662:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0264600/0xe64d3fbf12a7e004 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd1e expref: 20 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147728.025666:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147728.025670:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0264600, rc 0) 00000100:00100000:1.0:1746147728.025676:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794009600 00000100:00100000:1.0:1746147728.025679:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794009600 00010000:00010000:1.0:1746147728.025698:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ded0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc5a expref: 12 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746147728.025699:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:32254:x1830967794009984:12345-192.168.202.10@tcp:101:cat.0 Request processed in 107us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147728.025704:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16626 00000100:00100000:2.0:1746147728.025715:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794008832:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 171us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.025716:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8454 00000100:00100000:2.0:1746147728.025720:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8452 00000100:00100000:1.0:1746147728.025720:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794009600:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147728.025725:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147728.025737:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ded0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc5a expref: 12 pid: 10613 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746147728.025745:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ded0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc5a expref: 12 pid: 10613 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746147728.025756:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ded0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc5a expref: 12 pid: 10613 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746147728.025764:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.025765:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.025768:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7dff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.025775:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7dff6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147728.025803:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8451 00010000:00010000:1.0:1746147728.025804:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.025818:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794009600:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 97us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.025823:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8454 00000100:00100000:1.0:1746147728.025867:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147728.025923:0:21480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7dff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.025930:0:21480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7dff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.025948:0:21480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7dff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147728.025949:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794008192 00000100:00100000:3.0:1746147728.025953:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794008192 00010000:00010000:2.0:1746147728.025955:0:21480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7dff6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.025961:0:21480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7dff6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.025966:0:21480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a002d800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147728.025969:0:21480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7dff6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147728.025975:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (3145728->3878911) req@ffff880093cd7800 x1830967794008192/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147728.025979:0:21480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7dff6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147728.025983:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd7800 with x1830967794008192 ext(3145728->3878911) 00010000:00010000:2.0:1746147728.025987:0:21480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7dff6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.025989:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 11 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.025991:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a002d800/0xe64d3fbf12a7dff6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.025997:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 11 pid: 4591 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746147728.026002:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cd7800 00000100:00100000:3.0:1746147728.026016:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1482 00000100:00100000:3.0:1746147728.026021:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794008192:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147728.026023:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794007424:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 12367us (12405us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.026028:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16624 00000100:00100000:1.0:1746147728.026085:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.026120:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.026134:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.026142:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794008704 00000100:00100000:1.0:1746147728.026144:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794008704 00010000:00010000:1.0:1746147728.026154:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8200/0xe64d3fbf12a7dec2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc45 expref: 21 pid: 8184 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746147728.026164:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794008960 00000100:00100000:1.0:1746147728.026166:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794008960 00010000:00010000:1.0:1746147728.026173:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5529000/0xe64d3fbf12a7df01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc76 expref: 12 pid: 4591 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746147728.026181:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794009728 00000100:00100000:1.0:1746147728.026182:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794009728 00010000:00010000:1.0:1746147728.026189:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1051800/0xe64d3fbf12a7dede lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc61 expref: 11 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746147728.026199:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8455 00000100:00100000:1.0:1746147728.026203:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794008704:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147728.026208:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147728.026215:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fff8200/0xe64d3fbf12a7dec2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc45 expref: 21 pid: 8184 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.026222:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fff8200/0xe64d3fbf12a7dec2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc45 expref: 21 pid: 8184 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.026232:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8200/0xe64d3fbf12a7dec2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc45 expref: 21 pid: 8184 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.026239:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.026240:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.026243:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941bb000/0xe64d3fbf12a7dfe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.026249:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941bb000/0xe64d3fbf12a7dfe1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.026260:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.026273:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794008704:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.026278:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8455 00000100:00100000:1.0:1746147728.026287:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8456 00000100:00100000:1.0:1746147728.026291:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794008960:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147728.026296:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147728.026303:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5529000/0xe64d3fbf12a7df01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc76 expref: 12 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.026310:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5529000/0xe64d3fbf12a7df01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc76 expref: 12 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.026319:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5529000/0xe64d3fbf12a7df01 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc76 expref: 12 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.026326:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.026328:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.026330:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7dfda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.026335:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7dfda lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.026346:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.026358:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794008960:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 66us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.026362:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8456 00000100:00100000:1.0:1746147728.026372:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8457 00000100:00100000:1.0:1746147728.026376:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794009728:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147728.026381:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147728.026388:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a1051800/0xe64d3fbf12a7dede lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc61 expref: 11 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.026394:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a1051800/0xe64d3fbf12a7dede lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc61 expref: 11 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.026404:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1051800/0xe64d3fbf12a7dede lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc61 expref: 11 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.026412:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.026413:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.026416:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7dfef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.026430:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7dfef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.026446:0:8184:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7dfda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.026448:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147728.026453:0:8184:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7dfda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.026459:0:10613:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7dfef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147728.026461:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794009728:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 85us (326us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147728.026465:0:8184:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7dfda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.026466:0:10613:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7dfef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147728.026466:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8457 00010000:00010000:2.0:1746147728.026470:0:8184:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7dfda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.026476:0:8184:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7dfda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.026479:0:10613:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7dfef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.026484:0:10613:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7dfef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.026485:0:8184:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941bb600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147728.026488:0:8184:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7dfda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147728.026489:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147728.026490:0:10613:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7dfef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.026493:0:8184:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7dfda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.026494:0:10613:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d2c00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147728.026497:0:10613:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7dfef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147728.026497:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794010112 00000100:00100000:1.0:1746147728.026499:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794010112 00010000:00010000:3.0:1746147728.026502:0:10613:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7dfef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.026502:0:8184:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7dfda lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.026507:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7dfda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.026507:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7df16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc8b expref: 10 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.026511:0:10613:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7dfef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.026516:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7dfef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147728.026518:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8458 00000100:00100000:1.0:1746147728.026521:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794010112:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147728.026527:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147728.026534:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7df16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc8b expref: 10 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.026537:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+7:1958:x1830967794007296:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 14772us (14895us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147728.026541:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7df16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc8b expref: 10 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.026542:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16620 00000100:00100000:3.0:1746147728.026549:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+7:1958:x1830967794007168:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 13572us (14375us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147728.026550:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7df16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc8b expref: 10 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147728.026554:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16623 00010000:00010000:1.0:1746147728.026559:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.026571:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967794010112:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 49us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.026576:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8458 00000100:00100000:1.0:1746147728.026624:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.026634:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794010240 00000100:00100000:1.0:1746147728.026637:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794010240 00010000:00010000:1.0:1746147728.026647:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7df5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcbc expref: 20 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:1.0:1746147728.026671:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8459 00000100:00100000:1.0:1746147728.026675:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794010240:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147728.026681:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147728.026720:0:4592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800941bb000/0xe64d3fbf12a7dfe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.026728:0:4592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941bb000/0xe64d3fbf12a7dfe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.026740:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7df5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcbc expref: 20 pid: 10613 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746147728.026741:0:4592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800941bb000/0xe64d3fbf12a7dfe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.026747:0:4592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800941bb000/0xe64d3fbf12a7dfe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.026750:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7df5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcbc expref: 20 pid: 10613 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746147728.026753:0:4592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800941bb000/0xe64d3fbf12a7dfe1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.026760:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7df5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbcbc expref: 20 pid: 10613 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746147728.026762:0:4592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941bb000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147728.026764:0:4592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800941bb000/0xe64d3fbf12a7dfe1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.026767:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.026768:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147728.026770:0:4592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800941bb000/0xe64d3fbf12a7dfe1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.026771:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7dffd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.026777:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7dffd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.026778:0:4592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800941bb000/0xe64d3fbf12a7dfe1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.026782:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941bb000/0xe64d3fbf12a7dfe1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.026793:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147728.026808:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+6:1958:x1830967794007552:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 14778us (15118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.026809:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794010240:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 133us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.026813:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8459 00000100:00100000:0.0:1746147728.026814:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16621 00010000:00010000:3.0:1746147728.026901:0:7050:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7dffd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.026908:0:7050:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7dffd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.026920:0:7050:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7dffd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.026925:0:7050:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7dffd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.026930:0:7050:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7dffd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.026935:0:7050:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d2600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147728.026937:0:7050:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7dffd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.026942:0:7050:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7dffd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.026949:0:7050:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7dffd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.026961:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2600/0xe64d3fbf12a7dffd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147728.026990:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+5:1958:x1830967794007680:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 13142us (13327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.026995:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16625 00000100:00100000:3.0:1746147728.041648:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794008192:12345-192.168.202.10@tcp:4:cat.0 Request processed in 15618us (15771us total) trans 21474841618 rc 0/0 00000100:00100000:3.0:1746147728.041659:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1482 00002000:00100000:3.0:1746147728.041669:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (3145728->3878911) req@ffff880093cd7800 x1830967794008192/t21474841618(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/448 e 0 to 0 dl 1746147739 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.041677:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd7800 with x1830967794008192 ext(3145728->3878911) 00010000:00010000:3.0:1746147728.041685:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 12 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.041707:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 12 pid: 4591 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746147728.041713:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cd7800 00000100:00100000:2.0:1746147728.044139:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.044634:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794010496 00000100:00100000:3.0:1746147728.044642:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794010496 00000100:00080000:1.0:1746147728.044713:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147728.044823:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12040 00000100:00100000:3.0:1746147728.044830:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32257:x1830967794010496:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147728.044851:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147728.044867:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0235400/0xe64d3fbf12a7e00b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd25 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147728.044922:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147728.044965:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147728.044977:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7dfbe lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd02 expref: 17 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.044983:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147728.045006:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7dfbe lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd02 expref: 17 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.045015:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7dfbe lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd02 expref: 17 pid: 14546 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147728.045025:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796478592:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147728.045082:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.045145:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794010624 00000100:00100000:0.0:1746147728.045149:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794010624 00010000:00010000:0.0:1746147728.045167:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 12 pid: 4591 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746147728.045190:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8460 00000100:00100000:0.0:1746147728.045196:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794010624:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147728.045204:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147728.045219:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 12 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746147728.045229:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3878911) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 12 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746147728.045244:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5545800/0xe64d3fbf12a7df24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3878911) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbc99 expref: 12 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746147728.045255:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147728.045257:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147728.045260:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.045267:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.045283:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147728.045302:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794010624:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 106us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147728.045309:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8460 00010000:00010000:1.0:1746147728.045354:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.045361:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.045376:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.045382:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.045388:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.045394:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e98200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147728.045397:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.045403:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.045412:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.045413:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.045418:0:20619:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0264600/0xe64d3fbf12a7e004 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd1e expref: 19 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.045425:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0264600/0xe64d3fbf12a7e004 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd1e expref: 19 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.045444:0:20619:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0264600/0xe64d3fbf12a7e004 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd1e expref: 19 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147728.045452:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796478720:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147728.045488:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.049260:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.049296:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796478592:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.049378:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147728.049577:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.049652:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796478720:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147728.049670:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.049679:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e98200/0xe64d3fbf12a7dfe8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147728.049912:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794011008 00000100:00100000:3.0:1746147728.049917:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794011008 00000100:00100000:2.0:1746147728.049934:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794010752 00000100:00100000:2.0:1746147728.049938:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794010752 00002000:00100000:3.0:1746147728.049952:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880130d26d80 x1830967794011008/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147728.049956:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7dfbe lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd02 expref: 18 pid: 14546 timeout: 907 lvb_type: 0 00002000:00100000:3.0:1746147728.049959:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d26d80 with x1830967794011008 ext(2097152->3145727) 00002000:00010000:3.0:1746147728.049963:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d26d80 00000100:00100000:2.0:1746147728.049976:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8461 00000100:00100000:2.0:1746147728.049982:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+18:1959:x1830967794010752:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147728.049983:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7424 00000100:00100000:3.0:1746147728.049988:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794011008:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:2.0:1746147728.049992:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147728.049998:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7dfbe lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd02 expref: 18 pid: 14546 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.050008:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7dfbe lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd02 expref: 18 pid: 14546 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.050026:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7dfbe lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd02 expref: 18 pid: 14546 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.050040:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147728.050045:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147728.050053:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147728.050060:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147728.050078:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.050171:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+6:1958:x1830967794007808:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 37266us (38029us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.050179:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16622 00000100:00100000:2.0:1746147728.050239:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+17:1959:x1830967794010752:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 256us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.050245:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8461 00000100:00100000:0.0:1746147728.051359:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147728.051418:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147728.051426:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147728.051442:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147728.051561:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0235400/0xe64d3fbf12a7e00b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd25 expref: 25 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.051580:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd25 expref: 24 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.051586:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147728.051589:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147728.051591:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0db400, rc 0) 00000100:00100000:2.0:1746147728.051618:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:32257:x1830967794010496:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 6788us (7486us total) trans 8589946060 rc 0/0 00000100:00100000:2.0:1746147728.051630:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12040 00000100:00100000:2.0:1746147728.051647:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794011264 00000100:00100000:2.0:1746147728.051650:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794011264 00000100:00100000:2.0:1746147728.051670:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12041 00000100:00100000:2.0:1746147728.051675:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+17:32251:x1830967794011264:12345-192.168.202.10@tcp:36:mirror_io.0 00010000:00010000:2.0:1746147728.051713:0:14546:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147728.051727:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7dfd3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd10 expref: 17 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.051735:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147728.051737:0:14546:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147728.051763:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41587371-240a-4781-aecb-638f17200fbd+16:32251:x1830967794011264:12345-192.168.202.10@tcp:36:mirror_io.0 Request processed in 88us (407us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746147728.051768:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12041 00000100:00100000:0.0:1746147728.054132:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.054226:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794011520 00000100:00100000:1.0:1746147728.054233:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794011520 00000100:00100000:1.0:1746147728.054269:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5015 00000100:00100000:1.0:1746147728.054275:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+16:32251:x1830967794011520:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147728.054467:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+17:32251:x1830967794011520:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 191us (340us total) trans 8589946061 rc 0/0 00000100:00100000:1.0:1746147728.054473:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5015 00000100:00100000:2.0:1746147728.060583:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.060623:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794011776 00000100:00100000:3.0:1746147728.060632:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794011776 00000100:00100000:3.0:1746147728.060680:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5016 00000100:00100000:3.0:1746147728.060687:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+17:32251:x1830967794011776:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147728.060875:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+18:32251:x1830967794011776:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 188us (298us total) trans 8589946062 rc 0/0 00000100:00100000:3.0:1746147728.060899:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5016 00000100:00100000:3.0:1746147728.061363:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794011008:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11373us (11785us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147728.061371:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7424 00002000:00100000:3.0:1746147728.061378:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880130d26d80 x1830967794011008/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.061388:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d26d80 with x1830967794011008 ext(2097152->3145727) 00002000:00010000:3.0:1746147728.061393:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d26d80 00000100:00100000:0.0:1746147728.072547:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.077418:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794011904 00000100:00100000:2.0:1746147728.077430:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794011904 00000100:00100000:2.0:1746147728.077472:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16627 00000100:00100000:2.0:1746147728.077479:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:32254:x1830967794011904:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.077493:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.077509:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7e020 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd2c expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147728.077530:0:20619:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x458:0x0] initial LVB size: 5013696, mtime: 0x68141990, atime: 0x68141990, ctime: 0x68141990, blocks: 0x1691 00010000:00010000:2.0:1746147728.077548:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.077550:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.077556:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7e020 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd2c expref: 20 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.077567:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7e020 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd2c expref: 20 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.077576:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02e5200, rc 0) 00000100:00100000:2.0:1746147728.077626:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:32254:x1830967794011904:12345-192.168.202.10@tcp:101:cat.0 Request processed in 147us (5087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.077632:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16627 00000100:00100000:0.0:1746147728.091437:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.092851:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.092929:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794012288 00000100:00100000:2.0:1746147728.092937:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794012288 00002000:00100000:2.0:1746147728.092971:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880130d25500 x1830967794012288/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.092980:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d25500 with x1830967794012288 ext(3145728->4194303) 00002000:00010000:2.0:1746147728.092984:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d25500 00000100:00100000:2.0:1746147728.093007:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794012416 00000100:00100000:2.0:1746147728.093008:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794012416 00002000:00100000:2.0:1746147728.093020:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880093cd6680 x1830967794012416/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.093026:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd6680 with x1830967794012416 ext(3145728->4194303) 00002000:00010000:2.0:1746147728.093029:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd6680 00000100:00100000:2.0:1746147728.093038:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7425 00000100:00100000:2.0:1746147728.093044:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794012288:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147728.093139:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7426 00000100:00100000:0.0:1746147728.093146:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1959:x1830967794012416:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147728.101643:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.101746:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794012672 00000100:00100000:2.0:1746147728.101755:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794012672 00000100:00100000:2.0:1746147728.101829:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12042 00000100:00100000:2.0:1746147728.101837:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+342:32260:x1830967794012672:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147728.101857:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.101873:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38dc00/0xe64d3fbf12a7e027 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd33 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.101978:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38ca00/0xe64d3fbf12a7e02e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147728.101990:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38ca00/0xe64d3fbf12a7e02e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147728.101998:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38ca00/0xe64d3fbf12a7e02e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746147728.102007:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147728.102106:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38dc00/0xe64d3fbf12a7e027 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd33 expref: 345 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.102136:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38ca00/0xe64d3fbf12a7e02e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd33 expref: 344 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.102148:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147728.102150:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147728.102153:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e38ca00, rc 0) 00000100:00100000:2.0:1746147728.102190:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+344:32260:x1830967794012672:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 355us (556us total) trans 8589946063 rc 0/0 00000100:00100000:2.0:1746147728.102196:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12042 00000100:00080000:1.0:1746147728.102433:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147728.104553:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1959:x1830967794012416:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11403us (11698us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147728.104563:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7426 00002000:00100000:1.0:1746147728.104571:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880093cd6680 x1830967794012416/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.104580:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd6680 with x1830967794012416 ext(3145728->4194303) 00002000:00010000:1.0:1746147728.104585:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd6680 00000100:00100000:2.0:1746147728.104672:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794012288:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11626us (13241us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147728.104679:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7425 00002000:00100000:2.0:1746147728.104684:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880130d25500 x1830967794012288/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.104701:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d25500 with x1830967794012288 ext(3145728->4194303) 00002000:00010000:2.0:1746147728.104704:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d25500 00000100:00100000:0.0:1746147728.113139:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.113171:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.113192:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.113225:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.113236:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794012800 00000100:00100000:3.0:1746147728.113244:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794012800 00000100:00100000:3.0:1746147728.113281:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794012928 00000100:00100000:3.0:1746147728.113283:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794012928 00000100:00100000:3.0:1746147728.113292:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794013056 00000100:00100000:3.0:1746147728.113294:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794013056 00000100:00100000:3.0:1746147728.113301:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794013184 00000100:00100000:3.0:1746147728.113303:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794013184 00000100:00100000:3.0:1746147728.113316:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16628 00000100:00100000:3.0:1746147728.113322:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794012800:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147728.113336:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147728.113352:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c0db200/0xe64d3fbf12a7e03c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd3a expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147728.113372:0:7050:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x68141990, atime: 0x68141990, ctime: 0x68141990, blocks: 0x7c7 00010000:00010000:3.0:1746147728.113387:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.113389:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.113397:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0db200/0xe64d3fbf12a7e03c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd3a expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.113413:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c0db200/0xe64d3fbf12a7e03c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd3a expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.113421:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0db200, rc 0) 00000100:00100000:3.0:1746147728.113458:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794012800:12345-192.168.202.10@tcp:101:cat.0 Request processed in 136us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.113464:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16628 00000100:00100000:3.0:1746147728.113478:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16629 00000100:00100000:3.0:1746147728.113482:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794012928:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147728.113489:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147728.113498:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c0dac00/0xe64d3fbf12a7e043 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd41 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147728.113511:0:7050:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x68141990, atime: 0x68141990, ctime: 0x68141990, blocks: 0x81f 00010000:00010000:3.0:1746147728.113518:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.113519:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.113523:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0dac00/0xe64d3fbf12a7e043 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd41 expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.113531:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c0dac00/0xe64d3fbf12a7e043 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd41 expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.113538:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0dac00, rc 0) 00000100:00100000:3.0:1746147728.113552:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794012928:12345-192.168.202.10@tcp:101:cat.0 Request processed in 70us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.113559:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16629 00000100:00100000:3.0:1746147728.113567:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16630 00000100:00100000:3.0:1746147728.113571:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794013056:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147728.113577:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147728.113582:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7e04a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd48 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147728.113591:0:7050:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x68141990, atime: 0x68141990, ctime: 0x68141990, blocks: 0x81d 00010000:00010000:3.0:1746147728.113597:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.113598:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.113602:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7e04a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd48 expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.113609:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7e04a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd48 expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.113615:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0db600, rc 0) 00000100:00100000:3.0:1746147728.113628:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794013056:12345-192.168.202.10@tcp:101:cat.0 Request processed in 56us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.113632:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16630 00000100:00100000:2.0:1746147728.113640:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16631 00000100:00100000:2.0:1746147728.113650:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794013184:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.113660:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.113671:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e38da00/0xe64d3fbf12a7e051 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd4f expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147728.113685:0:20619:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x68141990, atime: 0x68141990, ctime: 0x68141990, blocks: 0x821 00010000:00010000:2.0:1746147728.113709:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.113711:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.113717:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e38da00/0xe64d3fbf12a7e051 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd4f expref: 22 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.113734:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e38da00/0xe64d3fbf12a7e051 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd4f expref: 22 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.113742:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e38da00, rc 0) 00000100:00100000:2.0:1746147728.113769:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794013184:12345-192.168.202.10@tcp:101:cat.0 Request processed in 120us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.113775:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16631 00000100:00100000:0.0:1746147728.118371:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.118493:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794013440 00000100:00100000:2.0:1746147728.118500:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794013440 00002000:00100000:2.0:1746147728.118536:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88012e385f80 x1830967794013440/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.118546:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e385f80 with x1830967794013440 ext(4194304->5017599) 00002000:00010000:2.0:1746147728.118551:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e385f80 00000100:00100000:2.0:1746147728.119189:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7427 00000100:00100000:2.0:1746147728.119197:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967794013440:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147728.125445:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967794013440:12345-192.168.202.10@tcp:3:cat.0 Request processed in 6239us (7072us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147728.125457:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7427 00002000:00100000:2.0:1746147728.125467:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88012e385f80 x1830967794013440/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.125475:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e385f80 with x1830967794013440 ext(4194304->5017599) 00002000:00010000:2.0:1746147728.125480:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e385f80 00000100:00100000:0.0:1746147728.251534:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.251573:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.251600:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794013568 00000100:00100000:2.0:1746147728.251607:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794013568 00000100:00100000:2.0:1746147728.251638:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794013696 00000100:00100000:2.0:1746147728.251640:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794013696 00000100:00100000:0.0:1746147728.251648:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.251654:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794013824 00000100:00100000:2.0:1746147728.251655:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794013824 00000100:00100000:2.0:1746147728.251667:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16632 00000100:00100000:2.0:1746147728.251673:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967794013568:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.251697:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.251711:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e38c600/0xe64d3fbf12a7e058 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd56 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.251731:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.251733:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.251740:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e38c600/0xe64d3fbf12a7e058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd56 expref: 10 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.251757:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e38c600/0xe64d3fbf12a7e058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd56 expref: 10 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.251766:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e38c600, rc 0) 00000100:00100000:2.0:1746147728.251814:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794013568:12345-192.168.202.10@tcp:101:cat.0 Request processed in 140us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.251819:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16632 00000100:00100000:2.0:1746147728.251832:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16633 00000100:00100000:2.0:1746147728.251837:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794013696:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.251844:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.251853:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e38dc00/0xe64d3fbf12a7e05f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd5d expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.251867:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.251868:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.251872:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e38dc00/0xe64d3fbf12a7e05f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd5d expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.251881:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e38dc00/0xe64d3fbf12a7e05f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd5d expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.251911:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e38dc00, rc 0) 00000100:00100000:2.0:1746147728.251927:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794013696:12345-192.168.202.10@tcp:101:cat.0 Request processed in 90us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.251932:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16633 00000100:00100000:2.0:1746147728.251941:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16634 00000100:00100000:2.0:1746147728.251945:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794013824:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.251950:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.251956:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e38c800/0xe64d3fbf12a7e066 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd64 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.251964:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.251965:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.251968:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e38c800/0xe64d3fbf12a7e066 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd64 expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.251976:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e38c800/0xe64d3fbf12a7e066 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd64 expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.251983:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e38c800, rc 0) 00000100:00100000:2.0:1746147728.251993:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794013824:12345-192.168.202.10@tcp:101:cat.0 Request processed in 48us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.251996:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16634 00000100:00100000:0.0:1746147728.254963:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.255002:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.255103:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794013952 00000100:00100000:0.0:1746147728.255108:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.255110:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794013952 00000100:00100000:0.0:1746147728.255134:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794014080 00000100:00100000:0.0:1746147728.255136:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794014080 00000100:00100000:3.0:1746147728.255138:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794014208 00000100:00100000:3.0:1746147728.255140:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794014208 00000100:00100000:0.0:1746147728.255152:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16635 00000100:00100000:3.0:1746147728.255156:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16636 00000100:00100000:0.0:1746147728.255158:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794013952:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147728.255160:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794014080:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147728.255174:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16637 00000100:00100000:3.0:1746147728.255178:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794014208:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147728.255187:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147728.255187:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147728.255201:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c0da800/0xe64d3fbf12a7e074 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd79 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.255201:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915e5800/0xe64d3fbf12a7e06d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd6b expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.255217:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147728.255217:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.255219:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147728.255219:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.255226:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0da800/0xe64d3fbf12a7e074 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd79 expref: 14 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147728.255226:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800915e5800/0xe64d3fbf12a7e06d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd6b expref: 12 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.255237:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c0da800/0xe64d3fbf12a7e074 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd79 expref: 14 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147728.255237:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915e5800/0xe64d3fbf12a7e06d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd6b expref: 12 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.255246:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0da800, rc 0) 00010000:00010000:0.0:1746147728.255248:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915e5800, rc 0) 00000100:00100000:3.0:1746147728.255275:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967794014208:12345-192.168.202.10@tcp:101:cat.0 Request processed in 95us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147728.255275:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794013952:12345-192.168.202.10@tcp:101:cat.0 Request processed in 117us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147728.255280:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16635 00000100:00100000:3.0:1746147728.255282:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16637 00010000:00010000:1.0:1746147728.255447:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147728.255455:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd72 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.255465:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.255467:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.255471:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 12 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.255480:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 12 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.255486:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e98200, rc 0) 00000100:00100000:1.0:1746147728.255512:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794014080:12345-192.168.202.10@tcp:101:cat.0 Request processed in 351us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.255517:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16636 00000100:00100000:0.0:1746147728.258102:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.258226:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794014336 00000100:00100000:2.0:1746147728.258232:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794014336 00000100:00100000:2.0:1746147728.258478:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16638 00000100:00100000:2.0:1746147728.258485:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32257:x1830967794014336:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147728.258499:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.258514:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd80 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.258538:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0264600/0xe64d3fbf12a7e004 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd1e expref: 21 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.258546:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c0da800/0xe64d3fbf12a7e074 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd79 expref: 15 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.258552:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.258553:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.258556:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2322432->3145727] (req 2322432->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.258580:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c0da800/0xe64d3fbf12a7e074 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd79 expref: 15 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.258595:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c0da800/0xe64d3fbf12a7e074 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd79 expref: 15 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746147728.258605:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796478848:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147728.259671:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0264600/0xe64d3fbf12a7e004 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd1e expref: 21 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.259681:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0264600/0xe64d3fbf12a7e004 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd1e expref: 21 pid: 4591 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.259698:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135811f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796478976:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.259734:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.265346:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.265567:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.265657:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794014464 00000100:00100000:1.0:1746147728.265667:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794014464 00010000:00010000:1.0:1746147728.265712:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0da800/0xe64d3fbf12a7e074 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd79 expref: 16 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:1.0:1746147728.265740:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794014592 00000100:00100000:1.0:1746147728.265742:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794014592 00010000:00010000:1.0:1746147728.265751:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0264600/0xe64d3fbf12a7e004 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd1e expref: 22 pid: 4591 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746147728.265783:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8462 00000100:00100000:1.0:1746147728.265789:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794014464:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147728.265801:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147728.265818:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8463 00010000:00010000:1.0:1746147728.265821:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c0da800/0xe64d3fbf12a7e074 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd79 expref: 16 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746147728.265828:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967794014592:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147728.265831:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c0da800/0xe64d3fbf12a7e074 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd79 expref: 16 pid: 10613 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.265842:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147728.265851:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147728.265861:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0264600/0xe64d3fbf12a7e004 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd1e expref: 22 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.265873:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0264600/0xe64d3fbf12a7e004 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd1e expref: 22 pid: 4591 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.265919:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.265921:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147728.265926:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794014464:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 136us (591us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147728.265929:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147728.265933:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8462 00010000:00010000:2.0:1746147728.265938:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.265971:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.265984:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135812a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796479104:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147728.266048:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe240 going to sleep for 11 seconds 00010000:00010000:2.0:1746147728.266091:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c0da800/0xe64d3fbf12a7e074 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd79 expref: 15 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746147728.267495:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796478848:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147728.267518:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0264600/0xe64d3fbf12a7e004 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd1e expref: 22 pid: 4591 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.267530:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135811f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796478976:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147728.267558:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 14 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.267568:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e38d400, rc 0) 00000100:00100000:2.0:1746147728.267610:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32257:x1830967794014336:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 9125us (9514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.267618:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16638 00000100:00100000:0.0:1746147728.270409:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.270445:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.270469:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.270481:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.270484:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794014848 00000100:00100000:3.0:1746147728.270534:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794015104 00000100:00100000:3.0:1746147728.270550:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794015104 00002000:00100000:3.0:1746147728.270601:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a548b800 x1830967794015104/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.270611:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548b800 with x1830967794015104 ext(1048576->2097151) 00002000:00010000:3.0:1746147728.270617:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a548b800 00000100:00100000:3.0:1746147728.270636:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794015360 00000100:00100000:3.0:1746147728.270638:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794015360 00002000:00100000:3.0:1746147728.270651:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a5489500 x1830967794015360/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.270658:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5489500 with x1830967794015360 ext(1048576->2097151) 00002000:00010000:3.0:1746147728.270661:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5489500 00000100:00100000:3.0:1746147728.270678:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794015616 00000100:00100000:3.0:1746147728.270681:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794015616 00002000:00100000:3.0:1746147728.270710:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a5488000 x1830967794015616/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.270716:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5488000 with x1830967794015616 ext(1048576->2097151) 00002000:00010000:3.0:1746147728.270719:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5488000 00000100:00100000:3.0:1746147728.270733:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7428 00000100:00100000:3.0:1746147728.270741:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794015104:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147728.270767:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7429 00000100:00100000:0.0:1746147728.270778:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794015360:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147728.270783:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7430 00000100:00100000:1.0:1746147728.270791:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794015616:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147728.271089:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135812a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796479104:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147728.271108:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.271156:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967794014592:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5330us (5587us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.271164:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8463 00000100:00100000:2.0:1746147728.272362:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794014848 00002000:00100000:2.0:1746147728.272405:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a548b480 x1830967794014848/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.272413:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548b480 with x1830967794014848 ext(0->1048575) 00002000:00010000:2.0:1746147728.272418:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a548b480 00000100:00100000:2.0:1746147728.272456:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7431 00000100:00100000:2.0:1746147728.272463:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794014848:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147728.277527:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.278512:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.278634:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794016000 00000100:00100000:2.0:1746147728.278643:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794016000 00000100:00100000:2.0:1746147728.278684:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16639 00000100:00100000:2.0:1746147728.278704:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794016000:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.278720:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.278738:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e38d000/0xe64d3fbf12a7e089 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd87 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.278785:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135811f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796479232:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147728.278862:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147728.280033:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794015872 00000100:00100000:3.0:1746147728.280042:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794015872 00002000:00100000:3.0:1746147728.280081:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2322432->2326527) req@ffff8800a548a680 x1830967794015872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.280091:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548a680 with x1830967794015872 ext(2322432->2326527) 00002000:00010000:3.0:1746147728.280096:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a548a680 00000100:00100000:3.0:1746147728.280117:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7432 00000100:00100000:3.0:1746147728.280123:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794015872:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147728.280282:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794015872:12345-192.168.202.10@tcp:3:cat.0 Request processed in 158us (2768us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147728.280289:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7432 00002000:00100000:3.0:1746147728.280295:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2322432->2326527) req@ffff8800a548a680 x1830967794015872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/4536 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.280302:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548a680 with x1830967794015872 ext(2322432->2326527) 00002000:00010000:3.0:1746147728.280305:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a548a680 00002000:00010000:3.0:1746147728.285763:0:7050:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime: 1746147728 -> 1746147729 00002000:00010000:3.0:1746147728.285770:0:7050:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime: 1746147728 -> 1746147729 00000100:00100000:3.0:1746147728.285797:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135811f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796479232:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147728.285832:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e38d000/0xe64d3fbf12a7e089 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd87 expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.285846:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e38d000/0xe64d3fbf12a7e089 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd87 expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.285862:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e38d000, rc 0) 00000100:00100000:3.0:1746147728.286348:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794016000:12345-192.168.202.10@tcp:101:cat.0 Request processed in 7643us (7835us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147728.286357:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16639 00000100:00100000:2.0:1746147728.287600:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794015616:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16806us (17113us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147728.287609:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7430 00002000:00100000:2.0:1746147728.287618:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a5488000 x1830967794015616/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.287627:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5488000 with x1830967794015616 ext(1048576->2097151) 00002000:00010000:2.0:1746147728.287633:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5488000 00000100:00100000:3.0:1746147728.295249:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794015104:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24496us (24790us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147728.295263:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7428 00002000:00100000:3.0:1746147728.295276:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a548b800 x1830967794015104/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.295286:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548b800 with x1830967794015104 ext(1048576->2097151) 00002000:00010000:3.0:1746147728.295292:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a548b800 00000100:00100000:1.0:1746147728.296965:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794015360:12345-192.168.202.10@tcp:3:cat.0 Request processed in 26183us (26488us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147728.296978:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7429 00002000:00100000:1.0:1746147728.296988:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a5489500 x1830967794015360/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.296997:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5489500 with x1830967794015360 ext(1048576->2097151) 00002000:00010000:1.0:1746147728.297002:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5489500 00000100:00100000:3.0:1746147728.302648:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794014848:12345-192.168.202.10@tcp:3:cat.0 Request processed in 30174us (32235us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147728.302663:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7431 00000100:00100000:1.0:1746147728.302674:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00100000:3.0:1746147728.302675:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a548b480 x1830967794014848/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.302684:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548b480 with x1830967794014848 ext(0->1048575) 00002000:00010000:3.0:1746147728.302696:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a548b480 00000100:00100000:3.0:1746147728.302720:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794016256 00000100:00100000:3.0:1746147728.302726:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794016256 00000100:00100000:1.0:1746147728.302780:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.302804:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.302825:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.302840:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794016640 00000100:00100000:1.0:1746147728.302843:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794016640 00002000:00100000:1.0:1746147728.302860:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880093cd4e00 x1830967794016640/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.302867:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4e00 with x1830967794016640 ext(1048576->2097151) 00002000:00010000:1.0:1746147728.302870:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd4e00 00000100:00100000:1.0:1746147728.302897:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794016768 00000100:00100000:1.0:1746147728.302900:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794016768 00002000:00100000:1.0:1746147728.302912:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880093cd5500 x1830967794016768/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.302918:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5500 with x1830967794016768 ext(1048576->2097151) 00002000:00010000:1.0:1746147728.302921:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd5500 00000100:00100000:1.0:1746147728.302930:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794016896 00000100:00100000:1.0:1746147728.302931:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794016896 00002000:00100000:1.0:1746147728.302940:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880093cd7480 x1830967794016896/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.302946:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd7480 with x1830967794016896 ext(1048576->2097151) 00002000:00010000:1.0:1746147728.302948:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd7480 00000100:00100000:1.0:1746147728.302963:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7433 00000100:00100000:1.0:1746147728.302969:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794016640:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147728.303032:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7434 00000100:00100000:0.0:1746147728.303042:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794016768:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147728.303218:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7435 00000100:00100000:2.0:1746147728.303226:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794016896:12345-192.168.202.10@tcp:3:multiop.0 00002000:00100000:3.0:1746147728.303327:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880093cd4000 x1830967794016256/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.303335:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4000 with x1830967794016256 ext(0->1048575) 00002000:00010000:3.0:1746147728.303338:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd4000 00000100:00100000:1.0:1746147728.303353:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7436 00000100:00100000:1.0:1746147728.303359:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794016256:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147728.312574:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.313108:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794017152 00000100:00100000:2.0:1746147728.313119:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794017152 00000100:00100000:2.0:1746147728.313167:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16640 00000100:00100000:2.0:1746147728.313174:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32257:x1830967794017152:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147728.313194:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.313214:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd8e expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.313242:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7e020 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd2c expref: 25 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.313252:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 13 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.313259:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.313260:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.313263:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->3256319] (req 3145728->3256319) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 13 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.313292:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 13 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.313305:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 13 pid: 8468 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746147728.313320:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796479360:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147728.313401:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7e020 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd2c expref: 25 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.313409:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7e020 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd2c expref: 25 pid: 20619 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.313417:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135813800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796479488:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.313433:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.322515:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.322861:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794017408 00000100:00100000:3.0:1746147728.322872:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794017408 00000100:00100000:0.0:1746147728.322948:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00100000:3.0:1746147728.322954:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a548ad80 x1830967794017408/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.322965:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548ad80 with x1830967794017408 ext(2097152->3145727) 00010000:00010000:3.0:1746147728.322974:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 14 pid: 8468 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746147728.322974:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147728.322988:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 14 pid: 8468 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746147728.322989:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:3.0:1746147728.322995:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a548ad80 00000100:00100000:3.0:1746147728.323020:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794017792 00000100:00100000:3.0:1746147728.323023:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794017792 00002000:00100000:3.0:1746147728.323037:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a5488380 x1830967794017792/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.323044:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5488380 with x1830967794017792 ext(3145728->4194303) 00010000:00010000:3.0:1746147728.323048:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 15 pid: 8468 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.323055:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 15 pid: 8468 timeout: 907 lvb_type: 1 00002000:00010000:3.0:1746147728.323061:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5488380 00000100:00100000:3.0:1746147728.323077:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794017920 00000100:00100000:3.0:1746147728.323079:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794017920 00002000:00100000:3.0:1746147728.323092:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3969023) req@ffff8800a5489180 x1830967794017920/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 504/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147728.323094:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794018176 00002000:00100000:3.0:1746147728.323098:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5489180 with x1830967794017920 ext(2097152->3969023) 00002000:00010000:3.0:1746147728.323101:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5489180 00000100:00100000:0.0:1746147728.323101:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794018176 00000100:00100000:3.0:1746147728.323123:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1483 00000100:00100000:3.0:1746147728.323131:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1958:x1830967794017408:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:0.0:1746147728.323138:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (3969024->4194303) req@ffff8800a5489c00 x1830967794018176/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147728.323148:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5489c00 with x1830967794018176 ext(3969024->4194303) 00002000:00010000:0.0:1746147728.323152:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5489c00 00000100:00100000:0.0:1746147728.323173:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1484 00000100:00100000:0.0:1746147728.323181:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1957:x1830967794017792:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147728.323451:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7437 00000100:00100000:1.0:1746147728.323460:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1958:x1830967794017920:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147728.323552:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7438 00000100:00100000:1.0:1746147728.323558:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1957:x1830967794018176:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147728.324438:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796479360:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.324451:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135813800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796479488:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147728.324482:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->3256319] (req 3145728->3256319) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 17 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.324498:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd17200, rc 0) 00000100:00100000:2.0:1746147728.324529:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32257:x1830967794017152:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 11355us (11965us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.324536:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16640 00000100:00100000:3.0:1746147728.327361:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794016896:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 24129us (24528us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147728.327373:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7435 00002000:00100000:3.0:1746147728.327383:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880093cd7480 x1830967794016896/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746147728.327391:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00100000:3.0:1746147728.327393:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd7480 with x1830967794016896 ext(1048576->2097151) 00002000:00010000:3.0:1746147728.327399:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd7480 00000100:00100000:1.0:1746147728.327486:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794018304 00000100:00100000:1.0:1746147728.327494:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794018304 00010000:00010000:1.0:1746147728.327521:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7e020 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd2c expref: 26 pid: 20619 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746147728.327561:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8464 00000100:00100000:1.0:1746147728.327567:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967794018304:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147728.327579:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147728.327599:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7e020 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd2c expref: 26 pid: 20619 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.327609:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7e020 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd2c expref: 26 pid: 20619 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.327632:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5200/0xe64d3fbf12a7e020 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd2c expref: 26 pid: 20619 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.327649:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.327677:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794018304:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 110us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.327683:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8464 00000100:00100000:1.0:1746147728.331074:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794016768:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 28025us (28260us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147728.331085:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7434 00002000:00100000:1.0:1746147728.331097:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880093cd5500 x1830967794016768/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.331104:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5500 with x1830967794016768 ext(1048576->2097151) 00002000:00010000:1.0:1746147728.331110:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd5500 00000100:00100000:2.0:1746147728.333446:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1957:x1830967794018176:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9875us (10442us total) trans 0 rc 225280/225280 00000100:00100000:2.0:1746147728.333458:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7438 00002000:00100000:2.0:1746147728.333469:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3969024->4194303) req@ffff8800a5489c00 x1830967794018176/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 225280/225280 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147728.333473:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794016640:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 30495us (30684us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147728.333484:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7433 00002000:00100000:2.0:1746147728.333485:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5489c00 with x1830967794018176 ext(3969024->4194303) 00002000:00010000:2.0:1746147728.333490:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5489c00 00002000:00100000:1.0:1746147728.333494:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880093cd4e00 x1830967794016640/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.333503:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4e00 with x1830967794016640 ext(1048576->2097151) 00002000:00010000:1.0:1746147728.333507:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd4e00 00000100:00100000:3.0:1746147728.333778:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794016256:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 30417us (31103us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147728.333785:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7436 00002000:00100000:3.0:1746147728.333791:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880093cd4000 x1830967794016256/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.333799:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4000 with x1830967794016256 ext(0->1048575) 00002000:00010000:3.0:1746147728.333803:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd4000 00000100:00100000:3.0:1746147728.336622:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1958:x1830967794017408:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13482us (14106us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147728.336634:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1483 00002000:00100000:3.0:1746147728.336645:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a548ad80 x1830967794017408/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.336653:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548ad80 with x1830967794017408 ext(2097152->3145727) 00010000:00010000:3.0:1746147728.336662:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 15 pid: 8468 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.336677:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 15 pid: 8468 timeout: 907 lvb_type: 1 00002000:00010000:3.0:1746147728.336684:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a548ad80 00000100:00100000:1.0:1746147728.340086:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794017920:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16614us (17097us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147728.340101:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7437 00002000:00100000:1.0:1746147728.340115:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3969023) req@ffff8800a5489180 x1830967794017920/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 504/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.340127:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5489180 with x1830967794017920 ext(2097152->3969023) 00002000:00010000:1.0:1746147728.340135:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5489180 00000100:00100000:1.0:1746147728.343352:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967794017792:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20159us (20399us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147728.343365:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1484 00002000:00100000:1.0:1746147728.343376:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a5488380 x1830967794017792/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.343386:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5488380 with x1830967794017792 ext(3145728->4194303) 00010000:00010000:1.0:1746147728.343396:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 13 pid: 8468 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746147728.343411:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 13 pid: 8468 timeout: 907 lvb_type: 1 00002000:00010000:1.0:1746147728.343420:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5488380 00000100:00100000:0.0:1746147728.344955:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.345021:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794018432 00000100:00100000:2.0:1746147728.345031:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794018432 00000100:00100000:2.0:1746147728.345080:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16641 00000100:00100000:2.0:1746147728.345092:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32264:x1830967794018432:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.345110:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.345128:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013013a000/0xe64d3fbf12a7e097 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd95 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.345154:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.345159:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->3256319] (req 3145728->3256319) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 14 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.345165:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147728.345169:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013013a000/0xe64d3fbf12a7e097 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd95 expref: 14 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.345208:0:7050:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->3256319] (req 3145728->3256319) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 14 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.345222:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013013a000/0xe64d3fbf12a7e097 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd95 expref: 14 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.345232:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013a000, rc 0) 00000100:00100000:2.0:1746147728.345278:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32264:x1830967794018432:12345-192.168.202.10@tcp:101:cat.0 Request processed in 187us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.345284:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16641 00000100:00100000:0.0:1746147728.345933:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.345991:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794018560 00000100:00100000:2.0:1746147728.345995:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794018560 00000100:00100000:2.0:1746147728.346066:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16642 00000100:00100000:2.0:1746147728.346072:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32260:x1830967794018560:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147728.346081:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.346091:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbd9c expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.346107:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c0db200/0xe64d3fbf12a7e03c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd3a expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.346115:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e38c600/0xe64d3fbf12a7e058 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd56 expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.346119:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.346120:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.346123:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [86016->1048575] (req 86016->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 22 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.346138:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e38c600/0xe64d3fbf12a7e058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd56 expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.346148:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e38c600/0xe64d3fbf12a7e058 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd56 expref: 13 pid: 20619 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746147728.346160:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135813800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796479744:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147728.346244:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c0db200/0xe64d3fbf12a7e03c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd3a expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.346252:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c0db200/0xe64d3fbf12a7e03c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd3a expref: 22 pid: 7050 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746147728.346259:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796479872:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.346279:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147728.352655:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135813800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796479744:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.352668:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796479872:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147728.352713:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [86016->1048575] (req 86016->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 22 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.352734:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013bc00, rc 0) 00000100:00100000:2.0:1746147728.352979:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:32260:x1830967794018560:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 6905us (7045us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.352988:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16642 00000100:00100000:0.0:1746147728.353927:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.353990:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.354252:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.354275:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794018944 00000100:00100000:0.0:1746147728.354281:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794018944 00010000:00010000:0.0:1746147728.354314:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0db200/0xe64d3fbf12a7e03c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd3a expref: 22 pid: 7050 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746147728.354880:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794018688 00000100:00100000:0.0:1746147728.354907:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794018688 00010000:00010000:0.0:1746147728.354922:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 14 pid: 8468 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746147728.355028:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794018816 00000100:00100000:3.0:1746147728.355032:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794018816 00010000:00010000:3.0:1746147728.355048:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e38c600/0xe64d3fbf12a7e058 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd56 expref: 15 pid: 20619 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746147728.355077:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8465 00000100:00100000:3.0:1746147728.355086:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967794018944:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147728.355098:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147728.355123:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c0db200/0xe64d3fbf12a7e03c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd3a expref: 22 pid: 7050 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.355133:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c0db200/0xe64d3fbf12a7e03c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd3a expref: 22 pid: 7050 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.355159:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c0db200/0xe64d3fbf12a7e03c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd3a expref: 22 pid: 7050 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.355182:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147728.355224:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967794018944:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 139us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.355230:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8465 00000100:00100000:3.0:1746147728.355285:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8466 00000100:00100000:3.0:1746147728.355289:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1958:x1830967794018688:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147728.355295:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147728.355307:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 15 pid: 8468 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.355316:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 15 pid: 8468 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.355328:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e98200/0xe64d3fbf12a7e07b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd72 expref: 15 pid: 8468 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.355343:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.355345:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.355352:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 14 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.355360:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 14 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.355393:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 14 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.355402:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147728.355414:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796480000:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147728.355424:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8467 00000100:00100000:2.0:1746147728.355432:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967794018816:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147728.355439:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147728.355447:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e38c600/0xe64d3fbf12a7e058 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd56 expref: 14 pid: 20619 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.355454:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e38c600/0xe64d3fbf12a7e058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd56 expref: 14 pid: 20619 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.355466:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e38c600/0xe64d3fbf12a7e058 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd56 expref: 14 pid: 20619 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.355478:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.355480:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.355484:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 20 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.355490:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 20 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.355507:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 20 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.355515:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796480128:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147728.355669:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.355699:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794019072 00000100:00100000:2.0:1746147728.355703:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794019072 00000100:00100000:2.0:1746147728.355724:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16643 00000100:00100000:2.0:1746147728.355729:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794019072:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147728.356388:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.356436:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fee40 going to sleep for 11 seconds 00010000:00010000:2.0:1746147728.356485:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.356502:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013013a400/0xe64d3fbf12a7e0a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbda3 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.356534:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135812680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796480256:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147728.357407:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147728.357618:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.357661:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.357722:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794019200 00000100:00100000:3.0:1746147728.357729:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794019200 00000100:00100000:3.0:1746147728.357773:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794019328 00000100:00100000:3.0:1746147728.357776:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794019328 00000100:00100000:3.0:1746147728.357794:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16644 00000100:00100000:3.0:1746147728.357800:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794019200:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147728.357811:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147728.357823:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f818c00/0xe64d3fbf12a7e0ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbdaa expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147728.357864:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796480384:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147728.357935:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147728.357990:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16645 00000100:00100000:2.0:1746147728.357997:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794019328:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.358006:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.358017:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbdb1 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.358042:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135811f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796480512:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147728.358087:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe6c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746147728.359271:0:7050:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime: 1746147728 -> 1746147729 00002000:00010000:2.0:1746147728.359277:0:7050:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime: 1746147728 -> 1746147729 00002000:00010000:2.0:1746147728.359279:0:7050:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime: 1746147728 -> 1746147729 00000100:00100000:2.0:1746147728.359301:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135812680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796480256:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147728.359328:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013013a400/0xe64d3fbf12a7e0a5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbda3 expref: 24 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.359341:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013013a400/0xe64d3fbf12a7e0a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbda3 expref: 24 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.359351:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013a400, rc 0) 00000100:00100000:2.0:1746147728.359381:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794019072:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3651us (3711us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147728.359389:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16643 00000100:00100000:3.0:1746147728.359464:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796480000:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147728.359475:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147728.359494:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794018688:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4204us (5503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.359503:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8466 00000100:00100000:0.0:1746147728.360164:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.360214:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796480128:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147728.360225:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.360260:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794018816:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4829us (6008us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.360267:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8467 00000100:00100000:1.0:1746147728.360296:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794019584 00000100:00100000:1.0:1746147728.360554:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794019584 00002000:00100000:1.0:1746147728.360663:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (86016->90111) req@ffff880094693480 x1830967794019584/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.360714:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094693480 with x1830967794019584 ext(86016->90111) 00002000:00010000:1.0:1746147728.360795:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094693480 00002000:00010000:3.0:1746147728.360875:0:21480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime: 1746147728 -> 1746147729 00002000:00010000:3.0:1746147728.360880:0:21480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147728 -> 1746147729 00000100:00100000:2.0:1746147728.360880:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135811f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796480512:192.168.202.10@tcp:106: 00002000:00010000:3.0:1746147728.360899:0:21480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime: 1746147728 -> 1746147729 00000100:00100000:3.0:1746147728.360913:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796480384:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147728.360928:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0b3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdb1 expref: 22 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.360929:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f818c00/0xe64d3fbf12a7e0ac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdaa expref: 23 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.360939:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f818c00/0xe64d3fbf12a7e0ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdaa expref: 23 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.360939:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdb1 expref: 22 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.360949:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f818c00, rc 0) 00010000:00010000:2.0:1746147728.360949:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013b600, rc 0) 00000100:00100000:3.0:1746147728.360972:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794019200:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3172us (3355us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147728.360978:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16644 00000100:00100000:1.0:1746147728.360982:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7439 00000100:00100000:1.0:1746147728.360988:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794019584:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147728.361294:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794019328:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3297us (3632us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147728.361300:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16645 00000100:00100000:1.0:1746147728.361591:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794019584:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 602us (1428us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147728.361598:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7439 00002000:00100000:1.0:1746147728.361603:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (86016->90111) req@ffff880094693480 x1830967794019584/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/4536 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.361610:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094693480 with x1830967794019584 ext(86016->90111) 00002000:00010000:1.0:1746147728.361614:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094693480 00000100:00100000:0.0:1746147728.361756:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.361864:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794019840 00000100:00100000:1.0:1746147728.361869:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794019840 00002000:00100000:1.0:1746147728.362002:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3252224->3256319) req@ffff880094692d80 x1830967794019840/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.362010:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094692d80 with x1830967794019840 ext(3252224->3256319) 00010000:00010000:1.0:1746147728.362017:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.362029:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00002000:00010000:1.0:1746147728.362035:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094692d80 00000100:00100000:1.0:1746147728.362049:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1485 00000100:00100000:1.0:1746147728.362054:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794019840:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147728.362183:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794019840:12345-192.168.202.10@tcp:3:cat.0 Request processed in 129us (427us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147728.362189:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1485 00002000:00100000:1.0:1746147728.362194:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3252224->3256319) req@ffff880094692d80 x1830967794019840/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/4536 e 0 to 0 dl 1746147739 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.362201:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094692d80 with x1830967794019840 ext(3252224->3256319) 00010000:00010000:1.0:1746147728.362206:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.362215:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00002000:00010000:1.0:1746147728.362226:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094692d80 00000100:00100000:0.0:1746147728.364115:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.364414:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794019968 00000100:00100000:2.0:1746147728.364422:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794019968 00000100:00100000:2.0:1746147728.364477:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16646 00000100:00100000:2.0:1746147728.364485:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32267:x1830967794019968:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.364503:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.364632:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7e0ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbdb8 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.364666:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147728.364668:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147728.364675:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7e0ba lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdb8 expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.364695:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7e0ba lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdb8 expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.364708:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55e8400, rc 0) 00000100:00100000:2.0:1746147728.364813:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:32267:x1830967794019968:12345-192.168.202.10@tcp:101:cat.0 Request processed in 278us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.364826:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16646 00000100:00100000:0.0:1746147728.367604:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.368377:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.368400:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794020224 00000100:00100000:2.0:1746147728.368411:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794020224 00002000:00100000:2.0:1746147728.368456:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3256319) req@ffff880094690a80 x1830967794020224/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.368466:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094690a80 with x1830967794020224 ext(3145728->3256319) 00010000:00010000:2.0:1746147728.368475:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.368491:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 12 pid: 7050 timeout: 907 lvb_type: 0 00002000:00010000:2.0:1746147728.368497:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094690a80 00000100:00100000:2.0:1746147728.368537:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1486 00000100:00100000:2.0:1746147728.368545:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794020224:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147728.369122:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794020352 00000100:00100000:3.0:1746147728.369127:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794020352 00000100:00100000:3.0:1746147728.369217:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16647 00000100:00100000:3.0:1746147728.369224:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32260:x1830967794020352:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147728.369234:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147728.369252:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbdbf expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.369278:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c0dac00/0xe64d3fbf12a7e043 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd41 expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.369287:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e38dc00/0xe64d3fbf12a7e05f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd5d expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.369292:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.369294:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.369297:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.369477:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e38dc00/0xe64d3fbf12a7e05f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd5d expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.369488:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e38dc00/0xe64d3fbf12a7e05f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd5d expref: 13 pid: 20619 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746147728.369499:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796480640:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.369853:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c0dac00/0xe64d3fbf12a7e043 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd41 expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.369861:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c0dac00/0xe64d3fbf12a7e043 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd41 expref: 22 pid: 7050 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746147728.369870:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796480768:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147728.370216:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147728.372351:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796480640:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.373023:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.373070:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794020480 00000100:00100000:1.0:1746147728.373076:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794020480 00010000:00010000:1.0:1746147728.373110:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e38dc00/0xe64d3fbf12a7e05f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd5d expref: 14 pid: 20619 timeout: 907 lvb_type: 1 00000100:00100000:1.0:1746147728.373311:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8468 00000100:00100000:1.0:1746147728.373319:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794020480:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147728.373331:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147728.373351:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e38dc00/0xe64d3fbf12a7e05f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd5d expref: 14 pid: 20619 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746147728.373361:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e38dc00/0xe64d3fbf12a7e05f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd5d expref: 14 pid: 20619 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746147728.373381:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e38dc00/0xe64d3fbf12a7e05f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd5d expref: 14 pid: 20619 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746147728.373397:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.373447:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794020480:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 129us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.373453:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8468 00000100:00100000:1.0:1746147728.374136:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967794020224:12345-192.168.202.10@tcp:4:cat.0 Request processed in 5591us (8252us total) trans 17179874390 rc 0/0 00000100:00100000:1.0:1746147728.374145:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1486 00002000:00100000:1.0:1746147728.374155:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3256319) req@ffff880094690a80 x1830967794020224/t17179874390(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/448 e 0 to 0 dl 1746147739 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.374164:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094690a80 with x1830967794020224 ext(3145728->3256319) 00010000:00010000:1.0:1746147728.374171:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.374181:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00002000:00010000:1.0:1746147728.374186:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094690a80 00000100:00100000:3.0:1746147728.374285:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796480768:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.374312:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.374324:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f818e00, rc 0) 00000100:00100000:3.0:1746147728.374350:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:32260:x1830967794020352:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5127us (5975us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.374357:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16647 00000100:00100000:0.0:1746147728.374647:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.374857:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794020608 00000100:00100000:3.0:1746147728.374862:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794020608 00010000:00010000:3.0:1746147728.374877:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0dac00/0xe64d3fbf12a7e043 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd41 expref: 22 pid: 7050 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746147728.374914:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8469 00000100:00100000:3.0:1746147728.374919:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794020608:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147728.374928:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147728.374939:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c0dac00/0xe64d3fbf12a7e043 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd41 expref: 22 pid: 7050 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.374946:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c0dac00/0xe64d3fbf12a7e043 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd41 expref: 22 pid: 7050 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.374963:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c0dac00/0xe64d3fbf12a7e043 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd41 expref: 22 pid: 7050 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746147728.374972:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.374974:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.374980:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.374988:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.375011:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147728.375021:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796480896:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147728.375059:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147728.376349:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796480896:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147728.376369:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147728.376973:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794020608:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2051us (2324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.376984:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8469 00000100:00100000:2.0:1746147728.377198:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.377331:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794020736 00000100:00100000:3.0:1746147728.377336:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794020736 00010000:00010000:3.0:1746147728.377357:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147728.377381:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8470 00000100:00100000:3.0:1746147728.377387:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967794020736:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147728.377398:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147728.377417:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.377428:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.377459:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd17200/0xe64d3fbf12a7e090 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd8e expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746147728.377469:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147728.377473:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.377474:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.377480:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013013a000/0xe64d3fbf12a7e097 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd95 expref: 13 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.377486:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013013a000/0xe64d3fbf12a7e097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd95 expref: 13 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147728.377486:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794020992 00000100:00100000:1.0:1746147728.377488:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794020992 00010000:00010000:3.0:1746147728.377493:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.377494:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.377497:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7e0ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdb8 expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.377502:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7e0ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdb8 expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746147728.377514:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1060864->1064959) req@ffff88009fe41500 x1830967794020992/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.377522:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41500 with x1830967794020992 ext(1060864->1064959) 00010000:00010000:3.0:1746147728.377525:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7e0ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdb8 expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147728.377525:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe41500 00000100:00100000:1.0:1746147728.377536:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7440 00000100:00100000:3.0:1746147728.377537:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796481024:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147728.377541:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794020992:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:3.0:1746147728.377581:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013013a000/0xe64d3fbf12a7e097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd95 expref: 13 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147728.377588:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796481152:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147728.377601:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147728.377672:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794020992:12345-192.168.202.10@tcp:3:cat.0 Request processed in 130us (202us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147728.377678:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7440 00002000:00100000:1.0:1746147728.377683:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1060864->1064959) req@ffff88009fe41500 x1830967794020992/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/4536 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.377701:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41500 with x1830967794020992 ext(1060864->1064959) 00002000:00010000:1.0:1746147728.377705:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe41500 00000100:00100000:3.0:1746147728.380770:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796481024:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147728.380786:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796481152:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147728.380808:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147728.380876:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794020736:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3487us (3676us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.380906:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8470 00000100:00100000:2.0:1746147728.383822:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.383868:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.383934:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794021248 00000100:00100000:0.0:1746147728.383943:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794021248 00002000:00100000:0.0:1746147728.383985:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880135812a00 x1830967794021248/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147728.383994:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812a00 with x1830967794021248 ext(2097152->3145727) 00002000:00010000:0.0:1746147728.383999:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135812a00 00000100:00100000:0.0:1746147728.384020:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794021504 00000100:00100000:0.0:1746147728.384022:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794021504 00002000:00100000:0.0:1746147728.384032:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880135810700 x1830967794021504/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147728.384038:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135810700 with x1830967794021504 ext(3145728->4194303) 00002000:00010000:0.0:1746147728.384040:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135810700 00000100:00100000:0.0:1746147728.384051:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7441 00000100:00100000:0.0:1746147728.384056:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794021248:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147728.384115:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7442 00000100:00100000:3.0:1746147728.384122:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794021504:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147728.396621:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794021248:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12551us (12795us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147728.396634:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7441 00002000:00100000:2.0:1746147728.396646:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880135812a00 x1830967794021248/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.396663:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812a00 with x1830967794021248 ext(2097152->3145727) 00002000:00010000:2.0:1746147728.396669:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135812a00 00000100:00100000:3.0:1746147728.396724:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794021504:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12600us (12853us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147728.396732:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7442 00002000:00100000:3.0:1746147728.396738:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880135810700 x1830967794021504/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.396752:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135810700 with x1830967794021504 ext(3145728->4194303) 00002000:00010000:3.0:1746147728.396756:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135810700 00000100:00100000:0.0:1746147728.407048:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.407085:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.407182:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.407303:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794021632 00000100:00100000:2.0:1746147728.407313:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794021632 00000100:00100000:2.0:1746147728.407353:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794021760 00000100:00100000:2.0:1746147728.407356:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794021760 00000100:00100000:2.0:1746147728.407385:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794021888 00000100:00100000:2.0:1746147728.407387:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794021888 00000100:00100000:2.0:1746147728.407406:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16648 00000100:00100000:2.0:1746147728.407413:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32267:x1830967794021632:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.407431:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147728.407437:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16649 00000100:00100000:0.0:1746147728.407444:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794021760:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.407451:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbdc6 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.407452:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147728.407463:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095234600/0xe64d3fbf12a7e0cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbdcd expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.407481:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 13 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.407488:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147728.407489:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147728.407493:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0c8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdc6 expref: 22 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147728.407506:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796481280:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147728.407514:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 13 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.407525:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 13 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.407538:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796481408:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.407573:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16650 00000100:00100000:2.0:1746147728.407578:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794021888:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.407585:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.407592:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013013a600/0xe64d3fbf12a7e0d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbdd4 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.407615:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796481536:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147728.407860:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147728.408030:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147728.408085:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147728.410554:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796481408:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.410589:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0c8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdc6 expref: 22 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.410608:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013b600, rc 0) 00000100:00100000:3.0:1746147728.410652:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:32267:x1830967794021632:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3238us (3615us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.410660:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16648 00002000:00010000:2.0:1746147728.410776:0:20619:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime: 1746147728 -> 1746147729 00002000:00010000:2.0:1746147728.410779:0:20619:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime: 1746147728 -> 1746147729 00002000:00010000:2.0:1746147728.410781:0:20619:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime: 1746147728 -> 1746147729 00000100:00100000:2.0:1746147728.410801:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796481536:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147728.410824:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013013a600/0xe64d3fbf12a7e0d6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdd4 expref: 14 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.410834:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013013a600/0xe64d3fbf12a7e0d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdd4 expref: 14 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.410849:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013a600, rc 0) 00000100:00100000:2.0:1746147728.410868:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794021888:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3290us (3686us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147728.410874:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16650 00000100:00100000:1.0:1746147728.411026:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796481280:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147728.411046:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095234600/0xe64d3fbf12a7e0cf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdcd expref: 14 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.411054:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095234600/0xe64d3fbf12a7e0cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdcd expref: 14 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.411064:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095234600, rc 0) 00000100:00100000:1.0:1746147728.411082:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794021760:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3639us (3996us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147728.411087:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16649 00000100:00100000:0.0:1746147728.411468:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.411600:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794022016 00000100:00100000:3.0:1746147728.411607:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794022016 00002000:00100000:3.0:1746147728.411645:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2322432->3145727) req@ffff8800a02ace00 x1830967794022016/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.411654:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ace00 with x1830967794022016 ext(2322432->3145727) 00010000:00010000:3.0:1746147728.411661:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 13 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.411673:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 13 pid: 7050 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746147728.411680:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a02ace00 00000100:00100000:3.0:1746147728.411713:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1487 00000100:00100000:3.0:1746147728.411720:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794022016:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147728.418710:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.418878:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794022272 00000100:00100000:2.0:1746147728.418916:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794022272 00002000:00100000:2.0:1746147728.418959:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009172dc00 x1830967794022272/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.418969:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172dc00 with x1830967794022272 ext(4194304->5017599) 00002000:00010000:2.0:1746147728.418975:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172dc00 00000100:00100000:2.0:1746147728.419000:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7443 00000100:00100000:2.0:1746147728.419008:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794022272:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147728.432344:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794022272:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13330us (13637us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147728.432357:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7443 00002000:00100000:2.0:1746147728.432369:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009172dc00 x1830967794022272/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.432379:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172dc00 with x1830967794022272 ext(4194304->5017599) 00002000:00010000:2.0:1746147728.432384:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172dc00 00000100:00100000:1.0:1746147728.440225:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.440255:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.440302:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.440486:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794022528 00000100:00100000:0.0:1746147728.440494:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794022528 00000100:00100000:2.0:1746147728.440497:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794022400 00000100:00100000:2.0:1746147728.440502:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794022400 00000100:00100000:2.0:1746147728.440563:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794022656 00000100:00100000:2.0:1746147728.440566:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794022656 00000100:00100000:0.0:1746147728.441056:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16651 00000100:00100000:0.0:1746147728.441066:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794022400:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147728.441084:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147728.441103:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095234c00/0xe64d3fbf12a7e0dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbddb expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147728.441231:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796481664:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147728.441627:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147728.441902:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16652 00000100:00100000:2.0:1746147728.441911:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794022528:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.441922:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.441934:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7e0e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbde2 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.441964:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796481792:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147728.441993:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147728.442202:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16653 00000100:00100000:1.0:1746147728.442210:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794022656:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147728.442218:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147728.442226:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009359ac00/0xe64d3fbf12a7e0eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbde9 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147728.442253:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796481920:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147728.442287:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147728.444351:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0436680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796481920:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147728.444381:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009359ac00/0xe64d3fbf12a7e0eb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbde9 expref: 18 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.444395:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009359ac00/0xe64d3fbf12a7e0eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbde9 expref: 18 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.444409:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009359ac00, rc 0) 00000100:00100000:1.0:1746147728.444443:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794022656:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2234us (4140us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147728.444449:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16653 00000100:00100000:0.0:1746147728.444803:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796481664:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147728.444806:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796481792:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147728.444822:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095234c00/0xe64d3fbf12a7e0dd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbddb expref: 14 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.444825:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7e0e4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbde2 expref: 16 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147728.444832:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095234c00/0xe64d3fbf12a7e0dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbddb expref: 14 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.444836:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013013b200/0xe64d3fbf12a7e0e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbde2 expref: 16 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147728.444845:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095234c00, rc 0) 00010000:00010000:2.0:1746147728.444857:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013b200, rc 0) 00000100:00100000:0.0:1746147728.444862:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794022400:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3799us (4606us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147728.444867:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16651 00000100:00100000:2.0:1746147728.444878:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794022528:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2968us (4665us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147728.444907:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16652 00000100:00100000:3.0:1746147728.446708:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794022016:12345-192.168.202.10@tcp:4:cat.0 Request processed in 34981us (35234us total) trans 21474841619 rc 0/0 00000100:00100000:3.0:1746147728.446719:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1487 00002000:00100000:3.0:1746147728.446729:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2322432->3145727) req@ffff8800a02ace00 x1830967794022016/t21474841619(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/448 e 0 to 0 dl 1746147739 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.446737:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02ace00 with x1830967794022016 ext(2322432->3145727) 00010000:00010000:3.0:1746147728.446745:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 15 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.446760:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 15 pid: 7050 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746147728.446765:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a02ace00 00000100:00100000:0.0:1746147728.447202:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.447267:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.447403:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794022784 00000100:00100000:2.0:1746147728.447412:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794022784 00000100:00100000:1.0:1746147728.447469:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794022912 00000100:00100000:1.0:1746147728.447472:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794022912 00000100:00100000:1.0:1746147728.447516:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16654 00000100:00100000:1.0:1746147728.447525:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794022912:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147728.447541:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147728.447558:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009359a600/0xe64d3fbf12a7e0f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbdf7 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147728.447607:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796482048:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147728.447682:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147728.447748:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16655 00000100:00100000:2.0:1746147728.447754:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794022784:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.447761:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.447771:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013013b800/0xe64d3fbf12a7e0f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbdf0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.447799:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796482176:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147728.447825:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.450011:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.450304:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794023040 00000100:00100000:3.0:1746147728.450312:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794023040 00000100:00100000:3.0:1746147728.450354:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16656 00000100:00100000:3.0:1746147728.450361:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794023040:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147728.450376:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147728.450392:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943c9400/0xe64d3fbf12a7e100 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbdfe expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147728.450392:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0436680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796482048:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147728.450415:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009359a600/0xe64d3fbf12a7e0f2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdf7 expref: 18 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.450426:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009359a600/0xe64d3fbf12a7e0f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdf7 expref: 18 pid: 8184 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147728.450437:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796482304:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147728.450444:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009359a600, rc 0) 00000100:00100000:1.0:1746147728.450476:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794022912:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2952us (3208us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147728.450482:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16654 00000100:00100000:3.0:1746147728.450500:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147728.450711:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796482176:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147728.450730:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013013b800/0xe64d3fbf12a7e0f9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdf0 expref: 14 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.450739:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013013b800/0xe64d3fbf12a7e0f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdf0 expref: 14 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.450762:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013b800, rc 0) 00000100:00100000:3.0:1746147728.450789:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794022784:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3035us (3594us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147728.450795:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16655 00000100:00100000:1.0:1746147728.451132:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.451186:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794023168 00000100:00100000:3.0:1746147728.451190:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794023168 00010000:00010000:3.0:1746147728.451207:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 17 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147728.451551:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8471 00000100:00100000:3.0:1746147728.451558:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794023168:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147728.451567:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147728.451579:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 17 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.451589:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 17 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.451607:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.451609:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.451616:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdc6 expref: 21 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.451628:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdc6 expref: 21 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.451647:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdc6 expref: 21 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147728.451655:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796482432:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147728.451715:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8bc00 going to sleep for 11 seconds 00010000:00010000:3.0:1746147728.452053:0:10613:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.10@tcp) returned -22 from glimpse AST (req@ffff8800956b4000 x1830967796482304) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 17 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.452068:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e38d400/0xe64d3fbf12a7e082 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2322432->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd80 expref: 17 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147728.452077:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796482304:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147728.452092:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800943c9400/0xe64d3fbf12a7e100 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdfe expref: 16 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.452100:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943c9400/0xe64d3fbf12a7e100 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdfe expref: 16 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.452106:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943c9400, rc 0) 00000100:00100000:3.0:1746147728.452140:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794023040:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1779us (2139us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147728.452149:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16656 00000100:00100000:3.0:1746147728.455025:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796482432:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147728.455048:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147728.455103:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794023168:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3544us (3970us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.455114:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8471 00000100:00100000:0.0:1746147728.464858:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.465115:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794023424 00000100:00100000:3.0:1746147728.465125:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794023424 00002000:00100000:3.0:1746147728.465171:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009172c000 x1830967794023424/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.465182:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172c000 with x1830967794023424 ext(2097152->3145727) 00002000:00010000:3.0:1746147728.465188:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009172c000 00000100:00100000:3.0:1746147728.465217:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7444 00000100:00100000:3.0:1746147728.465224:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794023424:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147728.466636:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.466977:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.467039:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794023808 00000100:00100000:0.0:1746147728.467046:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794023808 00002000:00100000:0.0:1746147728.467083:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009172ca80 x1830967794023808/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147728.467092:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172ca80 with x1830967794023808 ext(3145728->4194303) 00002000:00010000:0.0:1746147728.467097:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009172ca80 00000100:00100000:0.0:1746147728.467127:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794023936 00000100:00100000:0.0:1746147728.467129:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794023936 00002000:00100000:0.0:1746147728.467142:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a0437480 x1830967794023936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147728.467147:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0437480 with x1830967794023936 ext(3145728->4194303) 00002000:00010000:0.0:1746147728.467151:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0437480 00000100:00100000:0.0:1746147728.467162:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7445 00000100:00100000:0.0:1746147728.467168:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794023808:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147728.470122:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7446 00000100:00100000:2.0:1746147728.470140:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794023936:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147728.484867:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794023424:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19631us (20006us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147728.484895:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7444 00002000:00100000:3.0:1746147728.484911:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009172c000 x1830967794023424/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.484920:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172c000 with x1830967794023424 ext(2097152->3145727) 00002000:00010000:3.0:1746147728.484927:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009172c000 00000100:00100000:1.0:1746147728.485574:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794023808:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18404us (18943us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147728.485582:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7445 00002000:00100000:1.0:1746147728.485588:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009172ca80 x1830967794023808/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.485595:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172ca80 with x1830967794023808 ext(3145728->4194303) 00002000:00010000:1.0:1746147728.485599:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009172ca80 00000100:00100000:2.0:1746147728.492225:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794023936:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22079us (25236us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147728.492239:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7446 00002000:00100000:2.0:1746147728.492251:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a0437480 x1830967794023936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.492260:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0437480 with x1830967794023936 ext(3145728->4194303) 00002000:00010000:2.0:1746147728.492267:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0437480 00000100:00100000:0.0:1746147728.506779:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.506848:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794024192 00000100:00100000:2.0:1746147728.506858:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794024192 00002000:00100000:2.0:1746147728.506940:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009172ea00 x1830967794024192/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.506951:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172ea00 with x1830967794024192 ext(4194304->5017599) 00002000:00010000:2.0:1746147728.506957:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172ea00 00000100:00100000:2.0:1746147728.508018:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7447 00000100:00100000:2.0:1746147728.508036:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794024192:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147728.518225:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794024192:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10182us (11446us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147728.518236:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7447 00002000:00100000:2.0:1746147728.518247:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009172ea00 x1830967794024192/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.518257:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172ea00 with x1830967794024192 ext(4194304->5017599) 00002000:00010000:2.0:1746147728.518263:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172ea00 00000100:00100000:0.0:1746147728.584606:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.584674:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794024320 00000100:00100000:3.0:1746147728.584694:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794024320 00000100:00100000:0.0:1746147728.584718:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.584949:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794024448 00000100:00100000:3.0:1746147728.584952:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794024448 00000100:00100000:3.0:1746147728.584973:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16657 00000100:00100000:0.0:1746147728.584975:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.584981:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967794024320:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147728.585001:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147728.585007:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794024576 00000100:00100000:0.0:1746147728.585010:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794024576 00010000:00010000:3.0:1746147728.585018:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7e107 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe05 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147728.585031:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16658 00000100:00100000:0.0:1746147728.585036:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1957:x1830967794024448:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147728.585045:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147728.585057:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd84400/0xe64d3fbf12a7e10e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe0c expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147728.585075:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796482560:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147728.585084:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796482688:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147728.585180:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16659 00000100:00100000:1.0:1746147728.585189:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794024576:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147728.585197:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147728.585205:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e115 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe13 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.585218:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.585220:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.585229:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e115 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe13 expref: 17 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.585247:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e115 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe13 expref: 17 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.585258:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce2d200, rc 0) 00000100:00100000:1.0:1746147728.586138:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794024576:12345-192.168.202.10@tcp:101:cat.0 Request processed in 945us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.586146:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16659 00000100:00100000:3.0:1746147728.586167:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.586173:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.586438:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.586531:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794024704 00000100:00100000:1.0:1746147728.586537:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794024704 00000100:00100000:1.0:1746147728.586568:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12043 00000100:00100000:1.0:1746147728.586573:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+18:32275:x1830967794024704:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147728.586766:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147728.586781:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2c200/0xe64d3fbf12a7e11c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe1a expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.586839:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2c000/0xe64d3fbf12a7e123 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.586851:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2c000/0xe64d3fbf12a7e123 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.586860:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2c000/0xe64d3fbf12a7e123 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.586873:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2d800/0xe64d3fbf12a7e12a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.586879:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2d800/0xe64d3fbf12a7e12a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.587212:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2d800/0xe64d3fbf12a7e12a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.587328:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.587339:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd25 expref: 23 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.587346:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38ca00/0xe64d3fbf12a7e02e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd33 expref: 343 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.587353:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.587381:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38ca00/0xe64d3fbf12a7e02e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd33 expref: 343 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.587393:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38ca00/0xe64d3fbf12a7e02e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd33 expref: 343 pid: 14547 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746147728.587405:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796482816:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147728.587499:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd25 expref: 23 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.587506:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd25 expref: 23 pid: 14546 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746147728.587514:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796482944:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147728.587534:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.591729:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.591848:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796482816:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147728.591863:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796482944:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147728.591921:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147728.592090:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796482688:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147728.592120:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd84400/0xe64d3fbf12a7e10e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe0c expref: 16 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.592136:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd84400/0xe64d3fbf12a7e10e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe0c expref: 16 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.592154:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd84400, rc 0) 00000100:00100000:1.0:1746147728.592215:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1957:x1830967794024448:12345-192.168.202.10@tcp:101:cat.0 Request processed in 7175us (7493us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147728.592223:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16658 00000100:00100000:3.0:1746147728.592447:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796482560:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147728.592455:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794024960 00000100:00100000:2.0:1746147728.592463:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794024960 00010000:00010000:3.0:1746147728.592466:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7e107 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe05 expref: 14 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.592476:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7e107 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe05 expref: 14 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.592489:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0301c00, rc 0) 00000100:00100000:2.0:1746147728.592507:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5017 00000100:00100000:3.0:1746147728.592511:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967794024320:12345-192.168.202.10@tcp:101:cat.0 Request processed in 7531us (7916us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147728.592516:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+344:7670:x1830967794024960:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147728.592517:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16657 00000100:00100000:2.0:1746147728.592819:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+345:7670:x1830967794024960:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 302us (1101us total) trans 8589946064 rc 0/0 00000100:00100000:2.0:1746147728.592826:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5017 00000100:00100000:0.0:1746147728.595053:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.595295:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794025088 00000100:00100000:3.0:1746147728.595304:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794025088 00010000:00010000:3.0:1746147728.595339:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd25 expref: 24 pid: 14546 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147728.596356:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8472 00000100:00100000:3.0:1746147728.596369:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794025088:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147728.596388:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147728.596398:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd25 expref: 24 pid: 14546 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.596410:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd25 expref: 24 pid: 14546 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.596431:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0db400/0xe64d3fbf12a7e012 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd25 expref: 24 pid: 14546 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.596444:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147728.596449:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.596457:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.596461:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.596465:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147728.596513:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967794025088:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 148us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.596518:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8472 00000100:00100000:0.0:1746147728.597351:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.597428:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794025216 00000100:00100000:3.0:1746147728.597435:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794025216 00010000:00010000:3.0:1746147728.597456:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38ca00/0xe64d3fbf12a7e02e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd33 expref: 345 pid: 14547 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746147728.598680:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.598819:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8473 00000100:00100000:3.0:1746147728.598830:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+345:1958:x1830967794025216:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147728.598847:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147728.598854:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38ca00/0xe64d3fbf12a7e02e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd33 expref: 345 pid: 14547 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.598867:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38ca00/0xe64d3fbf12a7e02e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd33 expref: 345 pid: 14547 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.598905:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e38ca00/0xe64d3fbf12a7e02e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd33 expref: 345 pid: 14547 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.598918:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147728.598923:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.598931:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.598937:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.598956:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147728.599000:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+344:1958:x1830967794025216:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 173us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.599006:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8473 00010000:00010000:3.0:1746147728.599113:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599120:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147728.599336:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794025344 00000100:00100000:2.0:1746147728.599343:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794025344 00000100:00100000:2.0:1746147728.599370:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16660 00000100:00100000:2.0:1746147728.599375:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32277:x1830967794025344:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.599390:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.599404:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013013ba00/0xe64d3fbf12a7e138 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe21 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.599427:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 21 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.599434:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147728.599436:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147728.599439:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013013ba00/0xe64d3fbf12a7e138 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe21 expref: 14 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.599464:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 21 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.599476:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 21 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.599487:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796483072:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.599547:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe3c0 going to sleep for 11 seconds 00000004:00200000:3.0:1746147728.599679:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:3.0:1746147728.599693:0:5744:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147728.599712:0:5744:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599722:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599732:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2c000/0xe64d3fbf12a7e123 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599737:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2c000/0xe64d3fbf12a7e123 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599742:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2c000/0xe64d3fbf12a7e123 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599747:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ce2c000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147728.599751:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2c000/0xe64d3fbf12a7e123 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599757:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2c000/0xe64d3fbf12a7e123 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599765:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147728.599768:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147728.599771:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2c000/0xe64d3fbf12a7e123 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599776:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2c000/0xe64d3fbf12a7e123 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599789:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2d800/0xe64d3fbf12a7e12a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599795:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2d800/0xe64d3fbf12a7e12a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599800:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2d800/0xe64d3fbf12a7e12a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599803:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ce2d800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147728.599806:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2d800/0xe64d3fbf12a7e12a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599810:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2d800/0xe64d3fbf12a7e12a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599816:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fb79200) 00010000:00010000:3.0:1746147728.599818:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147728.599819:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2d800/0xe64d3fbf12a7e12a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599824:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2d800/0xe64d3fbf12a7e12a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.599853:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2c200/0xe64d3fbf12a7e11c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe1a expref: 20 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.599864:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe1a expref: 19 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.599870:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147728.599871:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147728.599873:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce2da00, rc 0) 00000100:00100000:3.0:1746147728.599924:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+19:32275:x1830967794024704:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 13349us (13486us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.599931:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12043 00000100:00100000:0.0:1746147728.602613:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.602922:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794025472 00000100:00100000:3.0:1746147728.602932:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794025472 00002000:00100000:3.0:1746147728.602981:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (86016->1048575) req@ffff88009fc13100 x1830967794025472/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.602991:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13100 with x1830967794025472 ext(86016->1048575) 00010000:00010000:3.0:1746147728.603000:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 22 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.603015:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 22 pid: 7050 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746147728.603021:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc13100 00000100:00100000:3.0:1746147728.603055:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1488 00000100:00100000:3.0:1746147728.603062:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794025472:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147728.603552:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796483072:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147728.603578:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013013ba00/0xe64d3fbf12a7e138 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe21 expref: 14 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.603594:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013ba00, rc 0) 00000100:00100000:2.0:1746147728.603645:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32277:x1830967794025344:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4269us (4970us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.603651:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16660 00000100:00100000:1.0:1746147728.604608:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.605596:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794025728 00000100:00100000:2.0:1746147728.605608:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794025728 00000100:00100000:0.0:1746147728.605628:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.605653:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.605670:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.605830:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12044 00000100:00100000:2.0:1746147728.605839:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+344:32279:x1830967794025728:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147728.605867:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.605896:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a800/0xe64d3fbf12a7e13f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe28 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.605994:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.606008:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe1a expref: 18 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.606013:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.606042:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe1a expref: 18 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.606057:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe1a expref: 18 pid: 5744 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.606069:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796483200:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.606183:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.606250:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.606798:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794025984 00000100:00100000:2.0:1746147728.606798:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794026240 00000100:00100000:3.0:1746147728.606804:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794025984 00000100:00100000:2.0:1746147728.606804:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794026240 00000100:00100000:1.0:1746147728.606810:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794026496 00000100:00100000:1.0:1746147728.606814:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794026496 00000100:00100000:3.0:1746147728.606831:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794025856 00000100:00100000:3.0:1746147728.606833:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794025856 00000100:00100000:2.0:1746147728.606839:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16661 00000100:00100000:2.0:1746147728.606845:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967794025984:12345-192.168.202.10@tcp:101:mirror_io.0 00000100:00100000:1.0:1746147728.606845:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16662 00000100:00100000:3.0:1746147728.606851:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16663 00000100:00100000:1.0:1746147728.606851:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967794026240:12345-192.168.202.10@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147728.606856:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967794026496:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147728.606856:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147728.606858:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147728.606864:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.606870:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c42f600/0xe64d3fbf12a7e154 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe36 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.606870:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7e14d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe44 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.606873:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a922fe00/0xe64d3fbf12a7e15b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe52 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.606903:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.606905:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.606911:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.606913:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.606914:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7e14d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe44 expref: 7 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.606919:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a922fe00/0xe64d3fbf12a7e15b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe52 expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147728.606923:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796483328:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147728.606928:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7e14d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe44 expref: 7 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.606929:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a922fe00/0xe64d3fbf12a7e15b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe52 expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.606938:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a922fe00, rc 0) 00010000:00010000:1.0:1746147728.606938:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800956d5c00, rc 0) 00000100:00100000:3.0:1746147728.606959:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794026496:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 103us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.606960:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147728.606962:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967794026240:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 111us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.606965:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16663 00000100:00100000:1.0:1746147728.606968:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16662 00000100:00100000:2.0:1746147728.606977:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16664 00000100:00100000:2.0:1746147728.606982:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967794025856:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147728.606988:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.606995:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7e162 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe2f expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.607023:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796483456:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147728.607045:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147728.608439:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.608492:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.608929:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794026112 00000100:00100000:2.0:1746147728.608938:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794026112 00000100:00100000:2.0:1746147728.608973:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794026368 00000100:00100000:2.0:1746147728.608975:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794026368 00000100:00100000:2.0:1746147728.608994:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16665 00000100:00100000:2.0:1746147728.609001:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794026112:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147728.609018:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.609037:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7e169 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe3d expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.609058:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.609060:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.609068:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7e169 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe3d expref: 10 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.609082:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7e169 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe3d expref: 10 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.609092:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5642a00, rc 0) 00000100:00100000:2.0:1746147728.609125:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967794026112:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 124us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.609130:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16665 00000100:00100000:2.0:1746147728.609142:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16666 00000100:00100000:2.0:1746147728.609146:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794026368:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147728.609153:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.609161:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5643600/0xe64d3fbf12a7e170 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe4b expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.609171:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.609173:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.609177:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5643600/0xe64d3fbf12a7e170 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe4b expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.609186:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5643600/0xe64d3fbf12a7e170 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe4b expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.609191:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5643600, rc 0) 00000100:00100000:2.0:1746147728.609206:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794026368:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 59us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.609210:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16666 00000100:00100000:0.0:1746147728.611414:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.611501:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794026624 00000100:00100000:1.0:1746147728.611510:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794026624 00010000:00010000:1.0:1746147728.611542:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe1a expref: 19 pid: 5744 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746147728.611582:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8474 00000100:00100000:1.0:1746147728.611590:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+19:1960:x1830967794026624:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147728.611602:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147728.611608:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe1a expref: 19 pid: 5744 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.611617:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe1a expref: 19 pid: 5744 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.611649:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147728.611654:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.611663:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.611673:0:7096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.611707:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.611756:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+19:1960:x1830967794026624:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 167us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.611762:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8474 00010000:00010000:2.0:1746147728.611964:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e131 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe1a expref: 18 pid: 5744 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.611983:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796483200:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147728.612002:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.612009:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.612014:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:2.0:1746147728.612032:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147728.612182:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013a800/0xe64d3fbf12a7e13f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe28 expref: 347 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.612194:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe28 expref: 346 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.612205:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147728.612207:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147728.612209:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013ae00, rc 0) 00000100:00100000:2.0:1746147728.612235:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+346:32279:x1830967794025728:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 6398us (7631us total) trans 8589946065 rc 0/0 00000100:00100000:2.0:1746147728.612241:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12044 00000100:00100000:3.0:1746147728.613851:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796483328:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147728.613908:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c42f600/0xe64d3fbf12a7e154 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe36 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.613922:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c42f600/0xe64d3fbf12a7e154 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe36 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.613948:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c42f600, rc 0) 00000100:00100000:3.0:1746147728.613982:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794025984:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 7136us (8357us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147728.613989:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16661 00000100:00100000:2.0:1746147728.614294:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796483456:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147728.614312:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7e162 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe2f expref: 8 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.614321:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7e162 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe2f expref: 8 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.614329:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c42ee00, rc 0) 00000100:00100000:2.0:1746147728.614347:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967794025856:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 7365us (8098us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147728.614353:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16664 00000100:00100000:0.0:1746147728.619981:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.620333:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794026752 00000100:00100000:2.0:1746147728.620343:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794026752 00000100:00100000:2.0:1746147728.620605:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12045 00000100:00100000:2.0:1746147728.620617:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+18:32275:x1830967794026752:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147728.620641:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.620661:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5642000/0xe64d3fbf12a7e17e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe59 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.620736:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5642000/0xe64d3fbf12a7e17e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe59 expref: 19 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.620748:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5642000/0xe64d3fbf12a7e17e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe59 expref: 19 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.620765:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147728.620767:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147728.620771:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5642000, rc 0) 00000100:00100000:2.0:1746147728.620834:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+19:32275:x1830967794026752:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 220us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.621438:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12045 00000100:00100000:2.0:1746147728.623232:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.623259:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794026880 00000100:00100000:2.0:1746147728.623267:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794026880 00000100:00100000:2.0:1746147728.623311:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16667 00000100:00100000:2.0:1746147728.623319:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32272:x1830967794026880:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147728.623337:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.623355:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe60 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.623383:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013013a000/0xe64d3fbf12a7e097 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd95 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.623391:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5643600/0xe64d3fbf12a7e170 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe4b expref: 6 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.623402:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7e0ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdb8 expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.623408:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.623410:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.623413:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3534848->4194303] (req 3534848->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.623441:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7e0ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdb8 expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.623452:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7e0ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdb8 expref: 23 pid: 8468 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.623463:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796483584:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147728.623541:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5643600/0xe64d3fbf12a7e170 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe4b expref: 6 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.623549:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5643600/0xe64d3fbf12a7e170 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe4b expref: 6 pid: 20619 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746147728.623556:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796483712:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147728.623581:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013013a000/0xe64d3fbf12a7e097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd95 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.623592:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013013a000/0xe64d3fbf12a7e097 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd95 expref: 15 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.623599:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796483840:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.623614:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.625579:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.628565:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796483584:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.628578:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796483712:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.628586:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796483840:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147728.628621:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3534848->4194303] (req 3534848->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.628639:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa10200, rc 0) 00000100:00100000:2.0:1746147728.628701:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32272:x1830967794026880:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5382us (5875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.628710:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16667 00000100:00100000:2.0:1746147728.628750:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794027136 00000100:00100000:2.0:1746147728.628756:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794027136 00000100:00100000:2.0:1746147728.628799:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12046 00000100:00100000:2.0:1746147728.628806:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+19:32275:x1830967794027136:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147728.628822:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.628838:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f6e00/0xe64d3fbf12a7e18c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe67 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147728.628864:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.628917:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794027264 00000100:00100000:0.0:1746147728.628920:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794027264 00010000:00010000:0.0:1746147728.628937:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5643600/0xe64d3fbf12a7e170 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe4b expref: 7 pid: 20619 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.628961:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e193 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147728.628962:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.628966:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8475 00000100:00100000:0.0:1746147728.628971:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794027264:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147728.628973:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e193 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147728.628976:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794027392 00000100:00100000:1.0:1746147728.628978:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794027392 00010000:00010000:0.0:1746147728.628980:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147728.628983:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e193 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.628989:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013013a000/0xe64d3fbf12a7e097 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd95 expref: 15 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.628996:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7e00/0xe64d3fbf12a7e19a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147728.628998:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5643600/0xe64d3fbf12a7e170 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe4b expref: 7 pid: 20619 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.629001:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7e00/0xe64d3fbf12a7e19a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147728.629003:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8476 00010000:00010000:2.0:1746147728.629006:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7e00/0xe64d3fbf12a7e19a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147728.629007:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794027392:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147728.629007:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5643600/0xe64d3fbf12a7e170 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe4b expref: 7 pid: 20619 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746147728.629012:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147728.629024:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5643600/0xe64d3fbf12a7e170 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe4b expref: 7 pid: 20619 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.629103:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f6200/0xe64d3fbf12a7e1a1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629111:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f6200/0xe64d3fbf12a7e1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629117:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f6200/0xe64d3fbf12a7e1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.629119:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013013a000/0xe64d3fbf12a7e097 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd95 expref: 15 pid: 7050 timeout: 907 lvb_type: 0 00000004:00200000:2.0:1746147728.629125:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147728.629127:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013013a000/0xe64d3fbf12a7e097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd95 expref: 15 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.629140:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013013a000/0xe64d3fbf12a7e097 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd95 expref: 15 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.629154:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.629182:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794027392:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 173us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.629191:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8476 00010000:00010000:2.0:1746147728.629203:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e193 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629210:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e193 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629220:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e193 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629226:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00f7000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147728.629230:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e193 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629237:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e193 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629245:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147728.629248:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147728.629251:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e193 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629254:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e193 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629262:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7e00/0xe64d3fbf12a7e19a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629266:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7e00/0xe64d3fbf12a7e19a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629270:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7e00/0xe64d3fbf12a7e19a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629274:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00f7e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147728.629276:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7e00/0xe64d3fbf12a7e19a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629281:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7e00/0xe64d3fbf12a7e19a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629289:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130b32400) 00010000:00010000:2.0:1746147728.629291:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147728.629292:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7e00/0xe64d3fbf12a7e19a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629296:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7e00/0xe64d3fbf12a7e19a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.629330:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f6e00/0xe64d3fbf12a7e18c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe67 expref: 22 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.629339:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f6200/0xe64d3fbf12a7e1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe67 expref: 21 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.629343:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147728.629345:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147728.629347:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00f6200, rc 0) 00000100:00100000:2.0:1746147728.629368:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+21:32275:x1830967794027136:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 563us (3797us total) trans 8589946066 rc 0/0 00000100:00100000:2.0:1746147728.629373:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12046 00010000:00010000:0.0:1746147728.636852:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.636979:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967794027264:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7997us (8106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.636993:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8475 00000100:00100000:1.0:1746147728.637088:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.641190:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794025472:12345-192.168.202.10@tcp:4:cat.0 Request processed in 38121us (38578us total) trans 17179874391 rc 0/0 00000100:00100000:3.0:1746147728.641201:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1488 00002000:00100000:3.0:1746147728.641211:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (86016->1048575) req@ffff88009fc13100 x1830967794025472/t17179874391(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/448 e 0 to 0 dl 1746147739 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.641220:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13100 with x1830967794025472 ext(86016->1048575) 00010000:00010000:3.0:1746147728.641228:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 24 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.641238:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 24 pid: 7050 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746147728.641244:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc13100 00000100:00100000:0.0:1746147728.641548:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794027520 00000100:00100000:0.0:1746147728.641561:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794027520 00010000:00010000:0.0:1746147728.641605:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7e0ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdb8 expref: 24 pid: 8468 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746147728.641667:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8477 00000100:00100000:0.0:1746147728.641677:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794027520:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147728.641702:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147728.641722:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7e0ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdb8 expref: 24 pid: 8468 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746147728.641733:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7e0ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdb8 expref: 24 pid: 8468 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746147728.641758:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7e0ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdb8 expref: 24 pid: 8468 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746147728.641774:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147728.641776:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147728.641783:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 13 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.641791:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 13 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147728.641824:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 13 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147728.641836:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796483968:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147728.641925:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.652127:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.652252:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794027776 00000100:00100000:2.0:1746147728.652263:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794027776 00000100:00100000:2.0:1746147728.652835:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12047 00000100:00100000:2.0:1746147728.652843:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+21:32275:x1830967794027776:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147728.652864:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.652880:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7a00/0xe64d3fbf12a7e1af lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe6e expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.653452:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.653464:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe28 expref: 345 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.653469:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.653494:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe28 expref: 345 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.653502:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe28 expref: 345 pid: 5744 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.653511:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796484096:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.653591:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.653782:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.653829:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794027904 00000100:00100000:3.0:1746147728.653833:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794027904 00010000:00010000:3.0:1746147728.653852:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 24 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147728.653874:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8478 00000100:00100000:3.0:1746147728.653879:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794027904:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147728.653900:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147728.653914:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 86016->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 24 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.653923:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 86016->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 24 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.653937:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013013bc00/0xe64d3fbf12a7e09e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 86016->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd9c expref: 24 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.653959:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.653962:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.653968:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013013ba00/0xe64d3fbf12a7e138 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe21 expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.653974:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013013ba00/0xe64d3fbf12a7e138 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe21 expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.653992:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013013ba00/0xe64d3fbf12a7e138 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe21 expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147728.653999:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796484224:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147728.654027:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.654682:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.654755:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794028160 00000100:00100000:2.0:1746147728.654760:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794028160 00002000:00100000:2.0:1746147728.654786:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3534848->3538943) req@ffff8800951d5f80 x1830967794028160/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.654794:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d5f80 with x1830967794028160 ext(3534848->3538943) 00002000:00010000:2.0:1746147728.654797:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800951d5f80 00000100:00100000:1.0:1746147728.654810:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796483968:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147728.654821:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7448 00000100:00100000:2.0:1746147728.654826:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967794028160:12345-192.168.202.10@tcp:3:multiop.0 00010000:00010000:1.0:1746147728.654826:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.654848:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794027520:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 13173us (17759us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.654855:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8477 00000100:00100000:2.0:1746147728.655189:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967794028160:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 361us (506us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147728.655195:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7448 00002000:00100000:2.0:1746147728.655201:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3534848->3538943) req@ffff8800951d5f80 x1830967794028160/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/4536 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.655208:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d5f80 with x1830967794028160 ext(3534848->3538943) 00002000:00010000:2.0:1746147728.655210:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800951d5f80 00000100:00100000:0.0:1746147728.659445:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.659478:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796484096:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147728.659497:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147728.659516:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794028288 00000100:00100000:1.0:1746147728.659521:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794028288 00000100:00100000:3.0:1746147728.659534:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796484224:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147728.659546:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147728.659549:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe28 expref: 346 pid: 5744 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746147728.659578:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8479 00000100:00100000:1.0:1746147728.659584:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+346:1958:x1830967794028288:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147728.659590:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794027904:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5709us (5807us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147728.659595:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147728.659597:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8478 00010000:00010000:1.0:1746147728.659601:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe28 expref: 346 pid: 5744 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.659610:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe28 expref: 346 pid: 5744 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.659627:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013ae00/0xe64d3fbf12a7e146 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe28 expref: 346 pid: 5744 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.659753:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147728.659757:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.659765:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.659770:0:7096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147728.659792:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147728.659823:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+345:1958:x1830967794028288:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 238us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.659828:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8479 00010000:00010000:2.0:1746147728.659903:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.659910:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.659925:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.659930:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.659936:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.659941:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00f7600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147728.659944:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.659950:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.659960:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147728.659962:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147728.659965:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.659969:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1b6 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.660135:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7a00/0xe64d3fbf12a7e1af lrc: 1/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe6e expref: 22 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.660143:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7a00/0xe64d3fbf12a7e1af lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe6e expref: 22 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.660150:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00f7a00, rc 0) 00000100:00100000:2.0:1746147728.660183:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+21:32275:x1830967794027776:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 7340us (8068us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147728.660193:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12047 00000100:00100000:0.0:1746147728.666451:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.666493:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.666532:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.666563:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794028544 00000100:00100000:2.0:1746147728.666570:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794028544 00002000:00100000:2.0:1746147728.666608:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1351680->1355775) req@ffff8800951d4700 x1830967794028544/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746147728.666613:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794028672 00002000:00100000:2.0:1746147728.666617:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d4700 with x1830967794028544 ext(1351680->1355775) 00000100:00100000:3.0:1746147728.666618:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794028672 00002000:00010000:2.0:1746147728.666622:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d4700 00000100:00100000:2.0:1746147728.666636:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794028928 00000100:00100000:2.0:1746147728.666638:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794028928 00000100:00100000:3.0:1746147728.666642:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16668 00000100:00100000:3.0:1746147728.666649:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32272:x1830967794028672:12345-192.168.202.10@tcp:101:multiop.0 00002000:00100000:2.0:1746147728.666649:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800951d7800 x1830967794028928/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.666660:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d7800 with x1830967794028928 ext(0->1048575) 00010000:00010000:3.0:1746147728.666661:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746147728.666663:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800951d7800 00000100:00100000:2.0:1746147728.666672:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7449 00010000:00010000:3.0:1746147728.666674:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe75 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.666677:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794028544:12345-192.168.202.10@tcp:3:multiop.0 00010000:00010000:3.0:1746147728.666708:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdc6 expref: 22 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.666722:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a922fe00/0xe64d3fbf12a7e15b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe52 expref: 7 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.666730:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e115 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe13 expref: 16 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.666736:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.666738:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147728.666742:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 6/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3145728->3354623] (req 3145728->3354623) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.666769:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e115 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe13 expref: 16 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147728.666780:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e115 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe13 expref: 16 pid: 21480 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746147728.666791:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796484352:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.666846:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794028544:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 167us (403us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147728.666852:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7449 00002000:00100000:2.0:1746147728.666857:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1351680->1355775) req@ffff8800951d4700 x1830967794028544/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/4536 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746147728.666860:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a922fe00/0xe64d3fbf12a7e15b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe52 expref: 7 pid: 10613 timeout: 0 lvb_type: 1 00002000:00100000:2.0:1746147728.666863:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d4700 with x1830967794028544 ext(1351680->1355775) 00002000:00010000:2.0:1746147728.666866:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d4700 00000100:00100000:1.0:1746147728.666867:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7450 00010000:00010000:3.0:1746147728.666868:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a922fe00/0xe64d3fbf12a7e15b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe52 expref: 7 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:1.0:1746147728.666874:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794028928:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147728.666876:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796484480:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.666930:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdc6 expref: 21 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.666937:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdc6 expref: 21 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746147728.666944:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796484608:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147728.666959:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147728.670512:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.670616:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794029184 00000100:00100000:2.0:1746147728.670623:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794029184 00000100:00100000:2.0:1746147728.670663:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5018 00000100:00100000:2.0:1746147728.670670:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+21:32275:x1830967794029184:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147728.671391:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+22:32275:x1830967794029184:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 720us (885us total) trans 8589946067 rc 0/0 00000100:00100000:2.0:1746147728.671398:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5018 00000100:00100000:2.0:1746147728.675037:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796484352:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.678097:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796484480:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147728.678528:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.678553:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.678567:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.678694:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796484608:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147728.678722:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3145728->3354623] (req 3145728->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.678738:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3c600, rc 0) 00000100:00100000:2.0:1746147728.678771:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32272:x1830967794028672:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 12122us (12277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.678779:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16668 00000100:00100000:2.0:1746147728.678813:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794029440 00000100:00100000:2.0:1746147728.678818:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794029440 00010000:00010000:2.0:1746147728.678838:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a922fe00/0xe64d3fbf12a7e15b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe52 expref: 8 pid: 10613 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746147728.678853:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794029312 00000100:00100000:2.0:1746147728.678855:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794029312 00010000:00010000:2.0:1746147728.678862:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e115 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe13 expref: 16 pid: 21480 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746147728.678872:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794029568 00000100:00100000:2.0:1746147728.678874:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794029568 00010000:00010000:2.0:1746147728.678880:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdc6 expref: 22 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.678919:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8480 00000100:00100000:2.0:1746147728.678925:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794029440:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147728.678934:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147728.678951:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a922fe00/0xe64d3fbf12a7e15b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe52 expref: 8 pid: 10613 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.678959:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a922fe00/0xe64d3fbf12a7e15b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe52 expref: 8 pid: 10613 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.678977:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a922fe00/0xe64d3fbf12a7e15b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe52 expref: 8 pid: 10613 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.678986:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147728.678999:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794029440:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 75us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.679004:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8480 00000100:00100000:2.0:1746147728.679013:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8481 00000100:00100000:2.0:1746147728.679017:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794029312:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147728.679022:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147728.679028:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e115 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe13 expref: 16 pid: 21480 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.679035:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e115 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe13 expref: 16 pid: 21480 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.679044:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e115 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe13 expref: 16 pid: 21480 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746147728.679051:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147728.679062:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794029312:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 45us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.679067:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8481 00000100:00100000:2.0:1746147728.679074:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8482 00000100:00100000:2.0:1746147728.679078:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794029568:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147728.679083:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147728.679088:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdc6 expref: 22 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.679095:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdc6 expref: 22 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.679104:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013013b600/0xe64d3fbf12a7e0c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdc6 expref: 22 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.679112:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.679114:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.679119:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 14 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.679126:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 14 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.679148:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 14 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.679158:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796484736:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147728.679202:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147728.679786:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.679847:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794029824 00000100:00100000:1.0:1746147728.679851:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794029824 00002000:00100000:1.0:1746147728.679876:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1851392->1855487) req@ffff88012ee59f80 x1830967794029824/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.679908:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee59f80 with x1830967794029824 ext(1851392->1855487) 00002000:00010000:1.0:1746147728.679912:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee59f80 00000100:00100000:1.0:1746147728.679940:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7451 00000100:00100000:1.0:1746147728.679946:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794029824:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147728.681947:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794028928:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 15069us (15409us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147728.681957:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7450 00002000:00100000:2.0:1746147728.681966:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800951d7800 x1830967794028928/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.681973:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d7800 with x1830967794028928 ext(0->1048575) 00000100:00100000:1.0:1746147728.682815:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794029824:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 2866us (3027us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147728.682824:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7451 00002000:00100000:1.0:1746147728.682830:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1851392->1855487) req@ffff88012ee59f80 x1830967794029824/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/4536 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.682837:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee59f80 with x1830967794029824 ext(1851392->1855487) 00002000:00010000:2.0:1746147728.682838:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800951d7800 00002000:00010000:1.0:1746147728.682841:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee59f80 00000100:00100000:2.0:1746147728.683878:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796484736:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147728.683913:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147728.683942:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794029568:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4863us (5374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.683950:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8482 00000100:00100000:0.0:1746147728.687785:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.687837:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.688103:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794030080 00000100:00100000:2.0:1746147728.688110:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794030080 00000100:00100000:2.0:1746147728.688146:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5019 00000100:00100000:2.0:1746147728.688152:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+345:32279:x1830967794030080:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:1.0:1746147728.688306:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794030336 00000100:00100000:1.0:1746147728.688310:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794030336 00002000:00100000:1.0:1746147728.688333:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3350528->3354623) req@ffff88012ee5a680 x1830967794030336/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.688341:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee5a680 with x1830967794030336 ext(3350528->3354623) 00000100:00100000:2.0:1746147728.688344:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+346:32279:x1830967794030080:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 190us (565us total) trans 8589946068 rc 0/0 00002000:00010000:1.0:1746147728.688346:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee5a680 00000100:00100000:2.0:1746147728.688351:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5019 00000100:00100000:1.0:1746147728.688359:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7452 00000100:00100000:1.0:1746147728.688364:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794030336:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147728.688464:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794030336:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 98us (626us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147728.688469:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7452 00002000:00100000:1.0:1746147728.688474:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3350528->3354623) req@ffff88012ee5a680 x1830967794030336/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/4536 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.688481:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee5a680 with x1830967794030336 ext(3350528->3354623) 00002000:00010000:1.0:1746147728.688483:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee5a680 00000100:00100000:0.0:1746147728.689557:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.689879:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794030464 00000100:00100000:2.0:1746147728.689996:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794030464 00000100:00100000:2.0:1746147728.690313:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16669 00000100:00100000:2.0:1746147728.690321:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32277:x1830967794030464:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.690334:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.690348:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6a00/0xe64d3fbf12a7e1c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe7c expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.690369:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 20 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.690376:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147728.690378:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147728.690381:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6a00/0xe64d3fbf12a7e1c4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe7c expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147728.690385:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147728.690403:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 20 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.690413:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 20 pid: 8468 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.690423:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796484864:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147728.690484:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20feb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147728.690915:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794030720 00000100:00100000:1.0:1746147728.690918:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794030720 00000100:00100000:1.0:1746147728.690957:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5020 00000100:00100000:1.0:1746147728.690963:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095029850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:32272:x1830967794030720:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:1.0:1746147728.691956:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095029850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:32272:x1830967794030720:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 989us (1566us total) trans 8589946069 rc 0/0 00000100:00100000:1.0:1746147728.691964:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5020 00000100:00100000:3.0:1746147728.692539:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796484864:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147728.692561:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6a00/0xe64d3fbf12a7e1c4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe7c expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.692572:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00f6a00, rc 0) 00000100:00100000:3.0:1746147728.692611:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32277:x1830967794030464:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2291us (3056us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147728.692617:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16669 00000100:00100000:0.0:1746147728.693135:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.693214:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794030848 00000100:00100000:1.0:1746147728.693219:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794030848 00002000:00100000:1.0:1746147728.693247:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1855487) req@ffff88012ee59c00 x1830967794030848/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 504/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.693254:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee59c00 with x1830967794030848 ext(1048576->1855487) 00010000:00010000:1.0:1746147728.693260:0:31359:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 21 pid: 8468 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.693269:0:31359:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 21 pid: 8468 timeout: 907 lvb_type: 0 00002000:00010000:1.0:1746147728.693275:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ee59c00 00000100:00100000:1.0:1746147728.693332:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1489 00000100:00100000:1.0:1746147728.693338:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794030848:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:1.0:1746147728.699479:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794030848:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 6133us (6337us total) trans 21474841620 rc 0/0 00000100:00100000:1.0:1746147728.699490:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1489 00002000:00100000:1.0:1746147728.699500:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1855487) req@ffff88012ee59c00 x1830967794030848/t21474841620(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 504/448 e 0 to 0 dl 1746147739 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.699507:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee59c00 with x1830967794030848 ext(1048576->1855487) 00010000:00010000:1.0:1746147728.699516:0:31359:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 23 pid: 8468 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746147728.699530:0:31359:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 23 pid: 8468 timeout: 907 lvb_type: 0 00002000:00010000:1.0:1746147728.699535:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ee59c00 00000100:00100000:0.0:1746147728.701525:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.701601:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794030976 00000100:00100000:2.0:1746147728.701607:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794030976 00010000:00010000:2.0:1746147728.701632:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 23 pid: 8468 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.701665:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8483 00000100:00100000:2.0:1746147728.701673:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794030976:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147728.701694:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147728.701712:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 23 pid: 8468 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.701721:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 23 pid: 8468 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.701739:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f818e00/0xe64d3fbf12a7e0c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbdbf expref: 23 pid: 8468 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.701758:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.701760:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.701768:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6a00/0xe64d3fbf12a7e1c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe7c expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.701775:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6a00/0xe64d3fbf12a7e1c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe7c expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.701803:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6a00/0xe64d3fbf12a7e1c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe7c expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.701812:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796484992:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147728.702019:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147728.705502:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796484992:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147728.705522:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147728.705558:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794030976:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3885us (4037us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.705567:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8483 00000100:00100000:0.0:1746147728.707047:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.707142:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794031232 00000100:00100000:1.0:1746147728.707148:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794031232 00002000:00100000:1.0:1746147728.707177:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009aeeb480 x1830967794031232/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.707186:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeeb480 with x1830967794031232 ext(1048576->2097151) 00002000:00010000:1.0:1746147728.707190:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aeeb480 00000100:00100000:1.0:1746147728.707216:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7453 00000100:00100000:1.0:1746147728.707221:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1957:x1830967794031232:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147728.713554:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.713783:0:14541:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794031360 00000100:00100000:2.0:1746147728.713791:0:14541:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794031360 00000100:00100000:1.0:1746147728.714760:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1957:x1830967794031232:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 7536us (7714us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147728.714769:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7453 00002000:00100000:1.0:1746147728.714777:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009aeeb480 x1830967794031232/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.714786:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeeb480 with x1830967794031232 ext(1048576->2097151) 00002000:00010000:1.0:1746147728.714790:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aeeb480 00000100:00100000:2.0:1746147728.715000:0:14541:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 220 00000100:00100000:2.0:1746147728.715008:0:14541:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:febf1b7c-e040-48da-83a3-5da159ba5e63+15:1960:x1830967794031360:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1746147728.715047:0:14541:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:febf1b7c-e040-48da-83a3-5da159ba5e63+15:1960:x1830967794031360:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 40us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.715051:0:14541:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 220 00000100:00100000:0.0:1746147728.728625:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.728977:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.729288:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.730159:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.730351:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794031744 00000100:00100000:1.0:1746147728.730359:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794031744 00000100:00100000:3.0:1746147728.730375:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794031872 00000100:00100000:3.0:1746147728.730380:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794031872 00002000:00100000:1.0:1746147728.730396:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009aeea680 x1830967794031744/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.730398:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3534847) req@ffff88009aeeaa00 x1830967794031872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.730406:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeeaa00 with x1830967794031872 ext(3145728->3534847) 00002000:00100000:1.0:1746147728.730409:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeea680 with x1830967794031744 ext(2097152->3145727) 00002000:00010000:3.0:1746147728.730411:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeeaa00 00002000:00010000:1.0:1746147728.730412:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeea680 00000100:00100000:3.0:1746147728.730441:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794032256 00000100:00100000:3.0:1746147728.730444:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794032256 00002000:00100000:3.0:1746147728.730459:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3354624->4194303) req@ffff88009ce62680 x1830967794032256/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.730471:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce62680 with x1830967794032256 ext(3354624->4194303) 00002000:00010000:3.0:1746147728.730474:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce62680 00000100:00100000:3.0:1746147728.730485:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794032128 00000100:00100000:3.0:1746147728.730487:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794032128 00000100:00100000:1.0:1746147728.730493:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7454 00002000:00100000:3.0:1746147728.730496:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009ce63100 x1830967794032128/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147728.730501:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794031872:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:3.0:1746147728.730502:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63100 with x1830967794032128 ext(2097152->3145727) 00002000:00010000:3.0:1746147728.730504:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce63100 00000100:00100000:2.0:1746147728.730507:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7455 00000100:00100000:3.0:1746147728.730518:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7456 00000100:00100000:2.0:1746147728.730522:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7457 00000100:00100000:3.0:1746147728.730523:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794032256:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147728.730527:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794032128:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147728.730553:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794031744:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147728.739140:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794031872:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8256us (9779us total) trans 0 rc 389120/389120 00000100:00100000:1.0:1746147728.739153:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7454 00002000:00100000:1.0:1746147728.739173:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3534847) req@ffff88009aeeaa00 x1830967794031872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 389120/389120 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.739182:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeeaa00 with x1830967794031872 ext(3145728->3534847) 00002000:00010000:1.0:1746147728.739191:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeeaa00 00000100:00100000:3.0:1746147728.742963:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794032256:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12432us (13668us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746147728.742973:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7456 00002000:00100000:3.0:1746147728.742982:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3354624->4194303) req@ffff88009ce62680 x1830967794032256/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.742989:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce62680 with x1830967794032256 ext(3354624->4194303) 00002000:00010000:3.0:1746147728.742994:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce62680 00000100:00100000:2.0:1746147728.744706:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794032128:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14172us (14541us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147728.744715:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7457 00002000:00100000:2.0:1746147728.744721:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009ce63100 x1830967794032128/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.744730:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63100 with x1830967794032128 ext(2097152->3145727) 00002000:00010000:2.0:1746147728.744734:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce63100 00000100:00100000:3.0:1746147728.745288:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967794031744:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14774us (16669us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147728.745295:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7455 00002000:00100000:3.0:1746147728.745301:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009aeea680 x1830967794031744/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.745308:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeea680 with x1830967794031744 ext(2097152->3145727) 00002000:00010000:3.0:1746147728.745312:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeea680 00000100:00100000:0.0:1746147728.750256:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.750303:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.750437:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794032512 00000100:00100000:2.0:1746147728.750444:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794032512 00000100:00100000:2.0:1746147728.750493:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794032640 00000100:00100000:2.0:1746147728.750496:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794032640 00000100:00100000:2.0:1746147728.750510:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16670 00000100:00100000:2.0:1746147728.750517:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794032512:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.750531:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.750544:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e1cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe83 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.750568:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.750570:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.750577:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e1cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe83 expref: 23 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.750590:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e1cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe83 expref: 23 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.750599:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00f7000, rc 0) 00000100:00100000:2.0:1746147728.750650:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794032512:12345-192.168.202.10@tcp:101:cat.0 Request processed in 132us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.750656:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16670 00000100:00100000:2.0:1746147728.750670:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16671 00000100:00100000:2.0:1746147728.750675:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794032640:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.750691:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.750701:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe8a expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.750711:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.750712:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.750716:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe8a expref: 23 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.750725:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe8a expref: 23 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.750736:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00f7600, rc 0) 00000100:00100000:2.0:1746147728.750753:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794032640:12345-192.168.202.10@tcp:101:cat.0 Request processed in 79us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.750758:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16671 00000100:00100000:0.0:1746147728.751958:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.752615:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.752669:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794032896 00000100:00100000:1.0:1746147728.752675:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794032896 00000100:00100000:2.0:1746147728.752689:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794032768 00000100:00100000:2.0:1746147728.752693:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794032768 00000100:00100000:1.0:1746147728.752722:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16672 00000100:00100000:1.0:1746147728.752728:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794032896:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147728.752739:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16673 00010000:00010000:1.0:1746147728.752739:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147728.752744:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794032768:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.752750:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147728.752750:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1db800/0xe64d3fbf12a7e1d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe98 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.752758:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00f7400/0xe64d3fbf12a7e1e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe91 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.752786:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796485248:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147728.752787:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796485120:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147728.752861:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20feb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147728.752865:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147728.755668:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796485120:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147728.755705:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e1db800/0xe64d3fbf12a7e1d9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe98 expref: 24 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.755718:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1db800/0xe64d3fbf12a7e1d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe98 expref: 24 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.755730:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1db800, rc 0) 00000100:00100000:1.0:1746147728.755763:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794032896:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3034us (3806us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147728.755770:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16672 00000100:00100000:2.0:1746147728.755909:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796485248:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147728.755927:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00f7400/0xe64d3fbf12a7e1e0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe91 expref: 24 pid: 8184 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147728.756251:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.756310:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794033152 00000100:00100000:3.0:1746147728.756315:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794033152 00002000:00100000:3.0:1746147728.756344:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009d0dfb80 x1830967794033152/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.756352:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dfb80 with x1830967794033152 ext(4194304->5017599) 00002000:00010000:3.0:1746147728.756356:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d0dfb80 00000100:00100000:3.0:1746147728.756371:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7458 00000100:00100000:3.0:1746147728.756376:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794033152:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:2.0:1746147728.757532:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00f7400/0xe64d3fbf12a7e1e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe91 expref: 24 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.757556:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00f7400, rc 0) 00000100:00100000:2.0:1746147728.757588:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794032768:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4843us (4972us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147728.757598:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16673 00000100:00100000:0.0:1746147728.765419:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.765656:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794033408 00000100:00100000:2.0:1746147728.765664:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794033408 00000100:00100000:0.0:1746147728.765702:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00100000:2.0:1746147728.765709:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009d0dd880 x1830967794033408/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.765717:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dd880 with x1830967794033408 ext(0->1048575) 00002000:00010000:2.0:1746147728.765721:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d0dd880 00000100:00100000:3.0:1746147728.765731:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794033664 00000100:00100000:3.0:1746147728.765735:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794033664 00002000:00100000:3.0:1746147728.765754:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009d0dd180 x1830967794033664/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.765761:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dd180 with x1830967794033664 ext(1048576->2097151) 00002000:00010000:3.0:1746147728.765764:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0dd180 00000100:00100000:2.0:1746147728.766098:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7459 00000100:00100000:2.0:1746147728.766128:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794033408:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147728.766131:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7460 00000100:00100000:3.0:1746147728.766138:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794033664:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147728.767517:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794033152:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11138us (11264us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147728.767525:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7458 00002000:00100000:2.0:1746147728.767532:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009d0dfb80 x1830967794033152/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.767540:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dfb80 with x1830967794033152 ext(4194304->5017599) 00002000:00010000:2.0:1746147728.767544:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d0dfb80 00000100:00100000:2.0:1746147728.775348:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794033408:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9234us (9927us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147728.775359:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7459 00002000:00100000:2.0:1746147728.775370:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009d0dd880 x1830967794033408/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.775381:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dd880 with x1830967794033408 ext(0->1048575) 00002000:00010000:2.0:1746147728.775386:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d0dd880 00000100:00100000:3.0:1746147728.776288:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794033664:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10148us (10585us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147728.776295:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7460 00002000:00100000:3.0:1746147728.776300:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009d0dd180 x1830967794033664/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.776307:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dd180 with x1830967794033664 ext(1048576->2097151) 00002000:00010000:3.0:1746147728.776311:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0dd180 00000100:00100000:0.0:1746147728.789250:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.789300:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.789323:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794033792 00000100:00100000:2.0:1746147728.789330:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794033792 00000100:00100000:1.0:1746147728.789352:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794033920 00000100:00100000:1.0:1746147728.789357:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794033920 00000100:00100000:2.0:1746147728.789380:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16674 00000100:00100000:1.0:1746147728.789391:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16675 00000100:00100000:1.0:1746147728.789397:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794033920:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147728.789407:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794033792:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147728.789412:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.789416:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.789426:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00f6600/0xe64d3fbf12a7e1ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbe9f expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.789426:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55fe400/0xe64d3fbf12a7e1e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbea6 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.789470:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796485376:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147728.789470:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796485504:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147728.789572:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147728.789709:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20feb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147728.790748:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796485376:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147728.790770:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00f6600/0xe64d3fbf12a7e1ee lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe9f expref: 24 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.790792:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00f6600/0xe64d3fbf12a7e1ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe9f expref: 24 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.790815:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00f6600, rc 0) 00000100:00100000:2.0:1746147728.790841:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794033792:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1454us (1597us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147728.790847:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16674 00000100:00100000:1.0:1746147728.790928:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796485504:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147728.790954:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55fe400/0xe64d3fbf12a7e1e7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbea6 expref: 24 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.790963:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55fe400/0xe64d3fbf12a7e1e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbea6 expref: 24 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.790979:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55fe400, rc 0) 00000100:00100000:1.0:1746147728.790996:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794033920:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1599us (1695us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147728.791001:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16675 00000100:00100000:0.0:1746147728.792825:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.792872:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794034048 00000100:00100000:1.0:1746147728.792878:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794034048 00000100:00100000:1.0:1746147728.793052:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16676 00010000:00010000:2.0:1746147728.793053:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147728.793059:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32285:x1830967794034048:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147728.793072:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147728.793082:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7e1f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbead expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.793104:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 13 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.793110:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147728.793112:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147728.793115:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7e1f5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbead expref: 24 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.793138:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 13 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.793148:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 13 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746147728.793162:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796485632:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147728.793233:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147728.795103:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796485632:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147728.795123:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7e1f5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbead expref: 24 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.795136:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55fe600, rc 0) 00000100:00100000:1.0:1746147728.795164:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32285:x1830967794034048:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2105us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.795170:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16676 00000100:00100000:0.0:1746147728.795737:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.795814:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794034176 00000100:00100000:3.0:1746147728.795820:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794034176 00002000:00100000:3.0:1746147728.795848:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3534848->4194303) req@ffff88013584a680 x1830967794034176/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.795856:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584a680 with x1830967794034176 ext(3534848->4194303) 00010000:00010000:3.0:1746147728.795861:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.795872:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 14 pid: 7050 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746147728.795878:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013584a680 00000100:00100000:3.0:1746147728.795952:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1490 00000100:00100000:3.0:1746147728.795958:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794034176:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147728.803183:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794034176:12345-192.168.202.10@tcp:4:cat.0 Request processed in 7215us (7437us total) trans 17179874392 rc 0/0 00000100:00100000:3.0:1746147728.803195:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1490 00002000:00100000:3.0:1746147728.803205:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3534848->4194303) req@ffff88013584a680 x1830967794034176/t17179874392(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/448 e 0 to 0 dl 1746147739 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.803214:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584a680 with x1830967794034176 ext(3534848->4194303) 00010000:00010000:3.0:1746147728.803222:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 16 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746147728.803234:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 16 pid: 7050 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746147728.803244:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013584a680 00000100:00100000:0.0:1746147728.812288:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.813830:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794034304 00000100:00100000:2.0:1746147728.813840:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794034304 00010000:00010000:2.0:1746147728.813876:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 16 pid: 7050 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746147728.813952:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8484 00000100:00100000:2.0:1746147728.813959:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794034304:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147728.813971:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147728.813990:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3534848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 16 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.814001:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3534848->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 16 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.814020:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009aa10200/0xe64d3fbf12a7e185 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3534848->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe60 expref: 16 pid: 7050 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746147728.814050:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.814052:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.814058:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7e1f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbead expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.814065:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7e1f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbead expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.814093:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7e1f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbead expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.814103:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796485760:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147728.814184:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20feb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147728.819387:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796485760:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147728.819407:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147728.819429:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.819445:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794034304:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5486us (7163us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.819455:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8484 00000100:00100000:3.0:1746147728.820101:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794034560 00000100:00100000:3.0:1746147728.820108:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794034560 00002000:00100000:3.0:1746147728.820138:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880135849880 x1830967794034560/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.820147:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849880 with x1830967794034560 ext(2097152->3145727) 00002000:00010000:3.0:1746147728.820151:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135849880 00000100:00100000:3.0:1746147728.820592:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7461 00000100:00100000:3.0:1746147728.820599:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794034560:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147728.821978:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.822145:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794034816 00000100:00100000:2.0:1746147728.822151:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794034816 00000100:00100000:2.0:1746147728.822181:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12048 00000100:00100000:2.0:1746147728.822186:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:32288:x1830967794034816:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147728.822206:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.822222:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f6c00/0xe64d3fbf12a7e1fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbeb4 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.822813:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7a00/0xe64d3fbf12a7e203 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.822826:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7a00/0xe64d3fbf12a7e203 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147728.822835:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7a00/0xe64d3fbf12a7e203 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:2.0:1746147728.822844:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147728.823228:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f6c00/0xe64d3fbf12a7e1fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeb4 expref: 27 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.823261:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7a00/0xe64d3fbf12a7e203 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeb4 expref: 26 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.823268:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147728.823271:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147728.823274:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00f7a00, rc 0) 00000100:00100000:2.0:1746147728.823299:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32288:x1830967794034816:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1112us (1323us total) trans 8589946070 rc 0/0 00000100:00100000:2.0:1746147728.823305:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12048 00000100:00100000:3.0:1746147728.832380:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794034560:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11774us (12944us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147728.832392:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7461 00002000:00100000:3.0:1746147728.832403:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880135849880 x1830967794034560/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.832411:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849880 with x1830967794034560 ext(2097152->3145727) 00002000:00010000:3.0:1746147728.832416:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135849880 00000100:00100000:0.0:1746147728.841143:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.841381:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794034944 00000100:00100000:1.0:1746147728.841388:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794034944 00000100:00100000:1.0:1746147728.841433:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16677 00000100:00100000:1.0:1746147728.841439:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32285:x1830967794034944:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147728.841455:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147728.841470:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7e211 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbebb expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.841502:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.841509:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147728.841511:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147728.841514:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7e211 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbebb expref: 24 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.841552:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.841563:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 15 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746147728.841574:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796485888:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147728.841663:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147728.843787:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796485888:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147728.843811:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7e211 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbebb expref: 24 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.843825:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55ffa00, rc 0) 00000100:00100000:1.0:1746147728.843866:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32285:x1830967794034944:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2427us (2730us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.843873:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16677 00000100:00100000:0.0:1746147728.845535:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.846013:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794035072 00000100:00100000:3.0:1746147728.846020:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794035072 00002000:00100000:3.0:1746147728.846056:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->3354623) req@ffff880135849c00 x1830967794035072/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.846064:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849c00 with x1830967794035072 ext(3145728->3354623) 00010000:00010000:3.0:1746147728.846072:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 16 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147728.846090:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 16 pid: 7050 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746147728.846097:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135849c00 00000100:00100000:3.0:1746147728.846130:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1491 00000100:00100000:3.0:1746147728.846137:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794035072:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147728.851706:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794035072:12345-192.168.202.10@tcp:4:cat.0 Request processed in 5562us (6167us total) trans 21474841621 rc 0/0 00000100:00100000:3.0:1746147728.851717:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1491 00002000:00100000:3.0:1746147728.851726:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->3354623) req@ffff880135849c00 x1830967794035072/t21474841621(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/448 e 0 to 0 dl 1746147739 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.851734:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849c00 with x1830967794035072 ext(3145728->3354623) 00010000:00010000:3.0:1746147728.851741:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 18 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147728.851754:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 18 pid: 7050 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746147728.851760:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135849c00 00000100:00100000:0.0:1746147728.859499:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147728.859568:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794035200 00000100:00100000:2.0:1746147728.859576:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794035200 00010000:00010000:2.0:1746147728.859609:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 18 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147728.859649:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8485 00000100:00100000:2.0:1746147728.859657:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794035200:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147728.859670:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147728.859720:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 18 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147728.859842:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 18 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147728.859866:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7e1bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe75 expref: 18 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147728.859923:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.859925:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.859932:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7e211 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbebb expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.859940:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7e211 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbebb expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147728.859968:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7e211 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbebb expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.859978:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796486016:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147728.860057:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20feb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147728.866460:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796486016:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147728.866482:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147728.866521:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794035200:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6863us (7028us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.866531:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8485 00000100:00100000:0.0:1746147728.871229:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.871261:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.871293:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.871421:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794035584 00000100:00100000:3.0:1746147728.871428:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794035584 00002000:00100000:3.0:1746147728.871463:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88013584a300 x1830967794035584/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.871472:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584a300 with x1830967794035584 ext(3145728->4194303) 00002000:00010000:3.0:1746147728.871477:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584a300 00000100:00100000:3.0:1746147728.871504:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794035712 00000100:00100000:3.0:1746147728.871507:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794035712 00002000:00100000:3.0:1746147728.871519:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88013584bb80 x1830967794035712/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.871525:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584bb80 with x1830967794035712 ext(2097152->3145727) 00002000:00010000:3.0:1746147728.871528:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013584bb80 00000100:00100000:3.0:1746147728.871536:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794035840 00000100:00100000:3.0:1746147728.871537:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794035840 00002000:00100000:3.0:1746147728.871545:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880135848000 x1830967794035840/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.871551:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848000 with x1830967794035840 ext(3145728->4194303) 00002000:00010000:3.0:1746147728.871553:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135848000 00000100:00100000:3.0:1746147728.871563:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7462 00000100:00100000:3.0:1746147728.871568:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794035584:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147728.871828:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7463 00000100:00100000:2.0:1746147728.871836:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794035712:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147728.873164:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7464 00000100:00100000:2.0:1746147728.873172:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967794035840:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147728.893522:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794035584:12345-192.168.202.10@tcp:3:cat.0 Request processed in 21944us (22289us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147728.893532:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7462 00002000:00100000:3.0:1746147728.893542:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88013584a300 x1830967794035584/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.893551:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584a300 with x1830967794035584 ext(3145728->4194303) 00002000:00010000:3.0:1746147728.893555:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584a300 00000100:00100000:1.0:1746147728.894063:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967794035712:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22226us (22798us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147728.894070:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7463 00002000:00100000:1.0:1746147728.894075:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88013584bb80 x1830967794035712/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.894082:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584bb80 with x1830967794035712 ext(2097152->3145727) 00002000:00010000:1.0:1746147728.894085:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013584bb80 00000100:00100000:2.0:1746147728.894961:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794035840:12345-192.168.202.10@tcp:3:cat.0 Request processed in 21787us (23663us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147728.894969:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7464 00002000:00100000:2.0:1746147728.894975:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880135848000 x1830967794035840/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.894982:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848000 with x1830967794035840 ext(3145728->4194303) 00002000:00010000:2.0:1746147728.894985:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135848000 00000100:00100000:0.0:1746147728.899192:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.899239:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.899352:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794036096 00000100:00100000:1.0:1746147728.899359:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794036096 00000100:00100000:1.0:1746147728.899694:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794036224 00000100:00100000:1.0:1746147728.899698:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794036224 00000100:00100000:1.0:1746147728.899744:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16678 00000100:00100000:1.0:1746147728.899749:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794036096:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147728.899765:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147728.899779:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dae9000/0xe64d3fbf12a7e218 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbec2 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147728.899804:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16679 00000100:00100000:2.0:1746147728.899813:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794036224:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147728.899821:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147728.899831:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6e00/0xe64d3fbf12a7e21f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbec9 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.899853:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.899855:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.899862:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae9000/0xe64d3fbf12a7e218 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec2 expref: 16 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.899875:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dae9000/0xe64d3fbf12a7e218 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec2 expref: 16 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.899907:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dae9000, rc 0) 00000100:00100000:1.0:1746147728.899944:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794036096:12345-192.168.202.10@tcp:101:cat.0 Request processed in 195us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147728.899949:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16678 00010000:00010000:2.0:1746147728.899990:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.899992:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147728.899997:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6e00/0xe64d3fbf12a7e21f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec9 expref: 18 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.900014:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6e00/0xe64d3fbf12a7e21f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec9 expref: 18 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147728.900021:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00f6e00, rc 0) 00000100:00100000:2.0:1746147728.900040:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794036224:12345-192.168.202.10@tcp:101:cat.0 Request processed in 228us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147728.900045:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16679 00000100:00100000:0.0:1746147728.920054:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.920086:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.920107:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.920142:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.920170:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794036480 00000100:00100000:0.0:1746147728.920176:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794036480 00002000:00100000:0.0:1746147728.920214:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880135849180 x1830967794036480/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147728.920223:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849180 with x1830967794036480 ext(2097152->3145727) 00002000:00010000:0.0:1746147728.920227:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135849180 00000100:00100000:0.0:1746147728.920240:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794036736 00000100:00100000:0.0:1746147728.920242:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794036736 00002000:00100000:0.0:1746147728.920250:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88013584ad80 x1830967794036736/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147728.920257:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584ad80 with x1830967794036736 ext(3145728->4194303) 00002000:00010000:0.0:1746147728.920259:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584ad80 00000100:00100000:0.0:1746147728.920267:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794036992 00000100:00100000:0.0:1746147728.920268:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794036992 00002000:00100000:0.0:1746147728.920278:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88013584b100 x1830967794036992/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147728.920290:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584b100 with x1830967794036992 ext(2097152->3145727) 00002000:00010000:0.0:1746147728.920293:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013584b100 00000100:00100000:0.0:1746147728.920301:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794037248 00000100:00100000:0.0:1746147728.920302:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794037248 00002000:00100000:0.0:1746147728.920310:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880135848e00 x1830967794037248/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147728.920315:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848e00 with x1830967794037248 ext(3145728->4194303) 00002000:00010000:0.0:1746147728.920317:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135848e00 00000100:00100000:0.0:1746147728.920325:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7465 00000100:00100000:0.0:1746147728.920330:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794036480:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147728.921542:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7466 00000100:00100000:0.0:1746147728.921549:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794036736:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147728.923764:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7467 00000100:00100000:3.0:1746147728.923774:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794036992:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147728.924751:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7468 00000100:00100000:3.0:1746147728.924757:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967794037248:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147728.932236:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.932489:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794037504 00000100:00100000:1.0:1746147728.932498:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794037504 00002000:00100000:1.0:1746147728.932533:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880091632d80 x1830967794037504/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147728.932541:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091632d80 with x1830967794037504 ext(4194304->5017599) 00002000:00010000:1.0:1746147728.932546:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091632d80 00000100:00100000:0.0:1746147728.933457:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147728.934927:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794036480:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14593us (14877us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147728.934935:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7465 00002000:00100000:0.0:1746147728.934943:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880135849180 x1830967794036480/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147728.934950:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849180 with x1830967794036480 ext(2097152->3145727) 00002000:00010000:0.0:1746147728.934954:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135849180 00000100:00100000:0.0:1746147728.934972:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7469 00000100:00100000:0.0:1746147728.934978:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794037504:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147728.937296:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794037760 00000100:00100000:3.0:1746147728.937305:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794037760 00000100:00100000:3.0:1746147728.937350:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12049 00000100:00100000:3.0:1746147728.937357:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+346:32293:x1830967794037760:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147728.937375:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147728.937390:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2301c00/0xe64d3fbf12a7e226 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbed0 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.937470:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7e22d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.937481:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7e22d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147728.937492:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7e22d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147728.937500:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147728.937592:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2301c00/0xe64d3fbf12a7e226 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed0 expref: 349 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.937610:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7e22d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed0 expref: 348 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147728.937617:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147728.937619:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147728.937622:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a008da00, rc 0) 00000100:00100000:3.0:1746147728.937654:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+348:32293:x1830967794037760:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 298us (4198us total) trans 8589946071 rc 0/0 00000100:00100000:3.0:1746147728.937660:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12049 00000100:00100000:2.0:1746147728.943854:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794036736:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22298us (23758us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147728.943864:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7466 00002000:00100000:2.0:1746147728.943874:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88013584ad80 x1830967794036736/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.943896:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584ad80 with x1830967794036736 ext(3145728->4194303) 00002000:00010000:2.0:1746147728.943900:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584ad80 00000100:00100000:2.0:1746147728.945473:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967794036992:12345-192.168.202.10@tcp:3:cat.0 Request processed in 21697us (25360us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147728.945482:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7467 00002000:00100000:2.0:1746147728.945488:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88013584b100 x1830967794036992/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.945495:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584b100 with x1830967794036992 ext(2097152->3145727) 00002000:00010000:2.0:1746147728.945498:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013584b100 00000100:00100000:3.0:1746147728.949618:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794037248:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24852us (29467us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147728.949629:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7468 00002000:00100000:3.0:1746147728.949638:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880135848e00 x1830967794037248/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.949647:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848e00 with x1830967794037248 ext(3145728->4194303) 00002000:00010000:3.0:1746147728.949652:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135848e00 00000100:00100000:0.0:1746147728.951968:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147728.952324:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794038016 00000100:00100000:3.0:1746147728.952332:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794038016 00002000:00100000:3.0:1746147728.952365:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88008fb77480 x1830967794038016/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/0 e 0 to 0 dl 1746147739 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.952374:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb77480 with x1830967794038016 ext(4194304->5017599) 00002000:00010000:3.0:1746147728.952378:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb77480 00000100:00100000:3.0:1746147728.952406:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7470 00000100:00100000:3.0:1746147728.952413:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794038016:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147728.969307:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794037504:12345-192.168.202.10@tcp:3:cat.0 Request processed in 34320us (37070us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147728.969319:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7469 00002000:00100000:2.0:1746147728.969329:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880091632d80 x1830967794037504/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147728.969337:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091632d80 with x1830967794037504 ext(4194304->5017599) 00002000:00010000:2.0:1746147728.969342:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091632d80 00000100:00100000:3.0:1746147728.977288:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794038016:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24865us (25317us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746147728.977303:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7470 00002000:00100000:3.0:1746147728.977314:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88008fb77480 x1830967794038016/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:349/0 lens 488/440 e 0 to 0 dl 1746147739 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147728.977328:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb77480 with x1830967794038016 ext(4194304->5017599) 00002000:00010000:3.0:1746147728.977333:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb77480 00000100:00100000:0.0:1746147728.996197:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147728.996262:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794038144 00000100:00100000:1.0:1746147728.996270:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794038144 00000100:00100000:1.0:1746147728.996469:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16680 00000100:00100000:1.0:1746147728.996477:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32288:x1830967794038144:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147728.996493:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147728.996508:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbed7 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.996533:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7e211 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbebb expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.996541:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6e00/0xe64d3fbf12a7e21f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec9 expref: 19 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.996560:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.996561:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147728.996565:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2408448->3145727] (req 2408448->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 19 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.996591:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6e00/0xe64d3fbf12a7e21f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec9 expref: 19 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147728.996603:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6e00/0xe64d3fbf12a7e21f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec9 expref: 19 pid: 8184 timeout: 908 lvb_type: 1 00000100:00100000:1.0:1746147728.996613:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796486144:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147728.996712:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7e211 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbebb expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.996722:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7e211 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbebb expref: 23 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746147728.996729:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796486272:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147728.996753:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147728.997972:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796486144:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147728.999564:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796486272:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147728.999588:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2408448->3145727] (req 2408448->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 19 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147728.999602:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5715800, rc 0) 00000100:00100000:1.0:1746147729.000004:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:32288:x1830967794038144:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3526us (3815us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.000011:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16680 00000100:00100000:0.0:1746147729.000403:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.000440:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.000503:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794038272 00000100:00100000:1.0:1746147729.000504:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794038400 00000100:00100000:2.0:1746147729.000509:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794038272 00000100:00100000:1.0:1746147729.000509:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794038400 00010000:00010000:1.0:1746147729.000527:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7e211 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbebb expref: 24 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.000528:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6e00/0xe64d3fbf12a7e21f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec9 expref: 19 pid: 8184 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.000545:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8486 00000100:00100000:2.0:1746147729.000550:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794038272:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.000560:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147729.000565:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8487 00000100:00100000:1.0:1746147729.000570:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794038400:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147729.000576:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.000577:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6e00/0xe64d3fbf12a7e21f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec9 expref: 19 pid: 8184 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746147729.000585:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7e211 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbebb expref: 24 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.000586:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6e00/0xe64d3fbf12a7e21f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec9 expref: 19 pid: 8184 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746147729.000596:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7e211 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbebb expref: 24 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.000653:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6e00/0xe64d3fbf12a7e21f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec9 expref: 19 pid: 8184 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746147729.000714:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55ffa00/0xe64d3fbf12a7e211 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbebb expref: 24 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.000736:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.000741:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.000746:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 18 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.000752:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 18 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.000775:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 18 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.000784:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796486400:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147729.000844:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147729.000901:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 10 seconds 00000100:00100000:2.0:1746147729.000918:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794038272:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 367us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.000924:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8486 00000100:00100000:1.0:1746147729.003845:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796486400:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147729.003861:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147729.004094:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794038400:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3523us (3652us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.004207:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8487 00000100:00100000:0.0:1746147729.004650:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.004713:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794038656 00000100:00100000:3.0:1746147729.004719:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794038656 00002000:00100000:3.0:1746147729.004750:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2408448->2412543) req@ffff88008fb77b80 x1830967794038656/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.004758:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb77b80 with x1830967794038656 ext(2408448->2412543) 00002000:00010000:3.0:1746147729.004762:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb77b80 00000100:00100000:3.0:1746147729.004791:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7471 00000100:00100000:3.0:1746147729.004877:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794038656:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147729.005030:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794038656:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 233us (381us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147729.005037:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7471 00002000:00100000:3.0:1746147729.005041:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2408448->2412543) req@ffff88008fb77b80 x1830967794038656/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.005048:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb77b80 with x1830967794038656 ext(2408448->2412543) 00002000:00010000:3.0:1746147729.005050:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb77b80 00000100:00100000:0.0:1746147729.011816:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.011919:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794038784 00000100:00100000:1.0:1746147729.011927:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794038784 00000100:00100000:1.0:1746147729.011971:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16681 00000100:00100000:1.0:1746147729.011978:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32288:x1830967794038784:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147729.011994:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.012008:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbede expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.012033:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7e1f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbead expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.012040:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dae9000/0xe64d3fbf12a7e218 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec2 expref: 17 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.012045:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.012047:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.012050:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->3371007] (req 3145728->3371007) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 17 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.012074:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dae9000/0xe64d3fbf12a7e218 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec2 expref: 17 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.012081:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dae9000/0xe64d3fbf12a7e218 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec2 expref: 17 pid: 4592 timeout: 908 lvb_type: 1 00000100:00100000:1.0:1746147729.012089:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796486528:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147729.012171:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7e1f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbead expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.012182:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7e1f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbead expref: 23 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746147729.012189:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796486656:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147729.012205:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.017535:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796486528:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147729.017548:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796486656:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147729.017575:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->3371007] (req 3145728->3371007) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 17 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.017590:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5715a00, rc 0) 00000100:00100000:1.0:1746147729.017814:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32288:x1830967794038784:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5836us (6005us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.017822:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16681 00000100:00100000:0.0:1746147729.020532:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.020612:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794038912 00000100:00100000:1.0:1746147729.020620:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794038912 00010000:00010000:1.0:1746147729.020671:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7e1f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbead expref: 24 pid: 4592 timeout: 908 lvb_type: 0 00000100:00080000:2.0:1746147729.020695:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147729.020763:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8488 00000100:00100000:1.0:1746147729.020771:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794038912:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147729.020784:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147729.020804:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7e1f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbead expref: 24 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.020813:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7e1f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbead expref: 24 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.020832:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55fe600/0xe64d3fbf12a7e1f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbead expref: 24 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.021096:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147729.021139:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794038912:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 368us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.021145:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8488 00000100:00100000:0.0:1746147729.021929:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.021997:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794039040 00000100:00100000:1.0:1746147729.022000:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794039040 00010000:00010000:1.0:1746147729.022014:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae9000/0xe64d3fbf12a7e218 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec2 expref: 17 pid: 4592 timeout: 908 lvb_type: 1 00000100:00100000:1.0:1746147729.022091:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8489 00000100:00100000:1.0:1746147729.022097:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794039040:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147729.022105:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147729.022116:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dae9000/0xe64d3fbf12a7e218 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec2 expref: 17 pid: 4592 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746147729.022124:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dae9000/0xe64d3fbf12a7e218 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec2 expref: 17 pid: 4592 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746147729.022136:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dae9000/0xe64d3fbf12a7e218 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbec2 expref: 17 pid: 4592 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746147729.022145:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.022147:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.022152:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 16 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.022159:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 16 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.022183:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 16 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.022194:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796486784:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147729.022455:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.025083:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796486784:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147729.025100:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147729.025132:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794039040:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3034us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.025141:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8489 00000100:00100000:0.0:1746147729.027338:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.027425:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794039296 00000100:00100000:3.0:1746147729.027432:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794039296 00002000:00100000:3.0:1746147729.027471:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3366912->3371007) req@ffff88008fb74000 x1830967794039296/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.027480:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb74000 with x1830967794039296 ext(3366912->3371007) 00002000:00010000:3.0:1746147729.027484:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb74000 00000100:00100000:3.0:1746147729.027507:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7472 00000100:00100000:3.0:1746147729.027513:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794039296:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147729.027658:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794039296:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 145us (325us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147729.027664:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7472 00002000:00100000:3.0:1746147729.027669:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3366912->3371007) req@ffff88008fb74000 x1830967794039296/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.027675:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb74000 with x1830967794039296 ext(3366912->3371007) 00002000:00010000:3.0:1746147729.027677:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb74000 00000100:00100000:0.0:1746147729.028129:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.028297:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794039424 00000100:00100000:1.0:1746147729.028300:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794039424 00000100:00100000:1.0:1746147729.028322:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16682 00000100:00100000:1.0:1746147729.028327:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32293:x1830967794039424:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147729.028336:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.028349:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbee5 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.028374:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 15 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.028381:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147729.028383:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147729.028390:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3436544->4153343] (req 3436544->4153343) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 24 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.028414:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 15 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.028425:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 15 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746147729.028434:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796486912:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147729.028498:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.030775:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.030911:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796486912:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147729.030933:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3436544->4153343] (req 3436544->4153343) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 24 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.030946:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5529400, rc 0) 00000100:00100000:1.0:1746147729.030980:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32293:x1830967794039424:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2652us (2851us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.030987:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16682 00000100:00100000:2.0:1746147729.031217:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794039552 00000100:00100000:2.0:1746147729.031222:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794039552 00002000:00100000:2.0:1746147729.031248:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3371007) req@ffff88008fb77800 x1830967794039552/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.031256:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb77800 with x1830967794039552 ext(3145728->3371007) 00010000:00010000:2.0:1746147729.031261:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 16 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.031272:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 16 pid: 4592 timeout: 908 lvb_type: 0 00002000:00010000:2.0:1746147729.031277:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fb77800 00000100:00100000:2.0:1746147729.031302:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1492 00000100:00100000:2.0:1746147729.031307:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794039552:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:2.0:1746147729.036311:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794039552:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 4995us (5531us total) trans 17179874393 rc 0/0 00000100:00100000:2.0:1746147729.036326:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1492 00002000:00100000:2.0:1746147729.036336:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3371007) req@ffff88008fb77800 x1830967794039552/t17179874393(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/448 e 0 to 0 dl 1746147740 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.036344:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb77800 with x1830967794039552 ext(3145728->3371007) 00010000:00010000:2.0:1746147729.036352:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 18 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.036365:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 18 pid: 4592 timeout: 908 lvb_type: 0 00002000:00010000:2.0:1746147729.036371:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fb77800 00000100:00100000:0.0:1746147729.037849:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.038038:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794039680 00000100:00100000:1.0:1746147729.038050:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794039680 00010000:00010000:1.0:1746147729.038237:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 18 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746147729.038267:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8490 00000100:00100000:1.0:1746147729.038472:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794039680:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147729.038483:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147729.038497:0:15900:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147729 -> 1746147730 00002000:00010000:1.0:1746147729.038499:0:15900:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147729 -> 1746147730 00010000:00010000:1.0:1746147729.038508:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 18 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.038518:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 18 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.038536:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5715a00/0xe64d3fbf12a7e242 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3371007) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbede expref: 18 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.039263:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.039265:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.039272:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->4153343) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.039281:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->4153343) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.039309:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->4153343) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.039319:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796487040:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147729.039399:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.041868:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796487040:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147729.041914:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147729.041959:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794039680:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3686us (4113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.041968:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8490 00000100:00100000:0.0:1746147729.042578:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.042646:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794039936 00000100:00100000:2.0:1746147729.042654:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794039936 00002000:00100000:2.0:1746147729.042697:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3436544->3440639) req@ffff88012f517100 x1830967794039936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.042706:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f517100 with x1830967794039936 ext(3436544->3440639) 00002000:00010000:2.0:1746147729.042713:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f517100 00000100:00100000:2.0:1746147729.042743:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7473 00000100:00100000:2.0:1746147729.042749:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794039936:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147729.043079:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794039936:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 329us (506us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147729.043085:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7473 00002000:00100000:2.0:1746147729.043091:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3436544->3440639) req@ffff88012f517100 x1830967794039936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.043102:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f517100 with x1830967794039936 ext(3436544->3440639) 00002000:00010000:2.0:1746147729.043105:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f517100 00000100:00100000:0.0:1746147729.049624:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.049795:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794040192 00000100:00100000:2.0:1746147729.049807:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794040192 00002000:00100000:2.0:1746147729.049848:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4149248->4153343) req@ffff88012f516d80 x1830967794040192/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.049857:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f516d80 with x1830967794040192 ext(4149248->4153343) 00002000:00010000:2.0:1746147729.049862:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f516d80 00000100:00100000:3.0:1746147729.049934:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7474 00000100:00100000:3.0:1746147729.049945:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794040192:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147729.050112:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794040192:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 169us (499us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147729.050118:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7474 00002000:00100000:3.0:1746147729.050124:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (4149248->4153343) req@ffff88012f516d80 x1830967794040192/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.050131:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f516d80 with x1830967794040192 ext(4149248->4153343) 00002000:00010000:3.0:1746147729.050134:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f516d80 00000100:00100000:0.0:1746147729.194768:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.194864:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794040320 00000100:00100000:1.0:1746147729.194872:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794040320 00000100:00100000:1.0:1746147729.194943:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16683 00000100:00100000:1.0:1746147729.194949:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32300:x1830967794040320:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147729.194967:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.194981:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbeec expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.195006:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7e04a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd48 expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.195013:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7e169 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe3d expref: 6 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.195020:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e38c800/0xe64d3fbf12a7e066 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd64 expref: 19 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.195030:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.195031:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.195034:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1355776->1875967] (req 1355776->1875967) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 19 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.195057:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e38c800/0xe64d3fbf12a7e066 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd64 expref: 19 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.195067:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e38c800/0xe64d3fbf12a7e066 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd64 expref: 19 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:1.0:1746147729.195078:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796487168:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147729.195161:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7e169 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe3d expref: 6 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.195170:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7e169 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe3d expref: 6 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:1.0:1746147729.195176:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796487296:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147729.195201:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7e04a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd48 expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.195208:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7e04a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd48 expref: 22 pid: 7050 timeout: 908 lvb_type: 1 00000100:00100000:1.0:1746147729.195219:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796487424:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147729.195234:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.199969:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.200044:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.200242:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.200340:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796487168:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147729.200351:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796487296:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147729.200359:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796487424:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.200381:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794040448 00000100:00100000:2.0:1746147729.200389:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794040448 00010000:00010000:1.0:1746147729.200397:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1355776->1875967] (req 1355776->1875967) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 19 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.200415:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5715200, rc 0) 00010000:00010000:2.0:1746147729.200419:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7e169 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe3d expref: 7 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.200441:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794040576 00000100:00100000:2.0:1746147729.200443:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794040576 00010000:00010000:2.0:1746147729.200450:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e38c800/0xe64d3fbf12a7e066 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd64 expref: 20 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:1.0:1746147729.200460:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32300:x1830967794040320:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5511us (5699us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.200465:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794040704 00000100:00100000:2.0:1746147729.200467:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794040704 00000100:00100000:1.0:1746147729.200468:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16683 00010000:00010000:2.0:1746147729.200485:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7e04a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd48 expref: 23 pid: 7050 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.200497:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8491 00000100:00100000:2.0:1746147729.200503:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794040448:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.200514:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.200536:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7e169 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe3d expref: 7 pid: 20619 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.200545:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7e169 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe3d expref: 7 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:1.0:1746147729.200563:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8492 00010000:00010000:2.0:1746147729.200566:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7e169 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe3d expref: 7 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:1.0:1746147729.200568:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1957:x1830967794040576:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147729.200575:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.200580:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147729.200583:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e38c800/0xe64d3fbf12a7e066 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd64 expref: 19 pid: 20619 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746147729.200590:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e38c800/0xe64d3fbf12a7e066 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd64 expref: 19 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.200600:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794040448:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 98us (643us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147729.200602:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e38c800/0xe64d3fbf12a7e066 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd64 expref: 19 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.200605:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8491 00010000:00010000:1.0:1746147729.200613:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.200616:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8493 00000100:00100000:2.0:1746147729.200621:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794040704:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147729.200624:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794040576:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 56us (580us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147729.200626:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147729.200629:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8492 00010000:00010000:2.0:1746147729.200631:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7e04a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd48 expref: 23 pid: 7050 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.200639:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7e04a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd48 expref: 23 pid: 7050 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.200649:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7e04a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd48 expref: 23 pid: 7050 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.200656:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.200658:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.200665:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 17 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.200672:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 17 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.200715:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 17 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.200727:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796487552:192.168.202.10@tcp:105: 00000100:00080000:1.0:1746147729.200748:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147729.200769:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.203205:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.203788:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796487552:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147729.203812:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.204116:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794040704:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3492us (3871us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.204128:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8493 00000100:00100000:3.0:1746147729.205065:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794040960 00000100:00100000:3.0:1746147729.205074:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794040960 00002000:00100000:3.0:1746147729.205118:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1355776->1359871) req@ffff88012f514a80 x1830967794040960/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.205127:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514a80 with x1830967794040960 ext(1355776->1359871) 00002000:00010000:3.0:1746147729.205132:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f514a80 00000100:00100000:3.0:1746147729.205161:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7475 00000100:00100000:3.0:1746147729.205169:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794040960:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147729.205349:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794040960:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 180us (2154us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147729.205355:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7475 00002000:00100000:3.0:1746147729.205361:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1355776->1359871) req@ffff88012f514a80 x1830967794040960/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.205367:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514a80 with x1830967794040960 ext(1355776->1359871) 00002000:00010000:3.0:1746147729.205370:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f514a80 00000100:00100000:0.0:1746147729.208944:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.209237:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794041088 00000100:00100000:1.0:1746147729.209247:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794041088 00000100:00100000:1.0:1746147729.209301:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16684 00000100:00100000:1.0:1746147729.209309:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794041088:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147729.209330:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.209348:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7e257 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbef3 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.209402:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796487680:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147729.209492:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.215378:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.215738:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.215799:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794041216 00000100:00100000:3.0:1746147729.215808:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794041216 00000100:00100000:3.0:1746147729.215845:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794041344 00000100:00100000:3.0:1746147729.215847:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794041344 00000100:00100000:0.0:1746147729.215866:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:1.0:1746147729.215954:0:4592:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147729 -> 1746147730 00000100:00100000:1.0:1746147729.215978:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796487680:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147729.216015:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7e257 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbef3 expref: 18 pid: 4592 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147729.216017:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16685 00000100:00100000:3.0:1746147729.216025:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794041216:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147729.216030:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0298c00/0xe64d3fbf12a7e257 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbef3 expref: 18 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.216042:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.216045:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0298c00, rc 0) 00010000:00010000:3.0:1746147729.216057:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0486600/0xe64d3fbf12a7e25e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbefa expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.216104:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796487808:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147729.216168:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.216183:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16686 00000100:00100000:3.0:1746147729.216193:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794041344:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.216200:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.216208:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0487a00/0xe64d3fbf12a7e265 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf01 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.216229:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796487936:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147729.216248:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.216261:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794041600 00000100:00100000:3.0:1746147729.216263:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794041600 00002000:00100000:3.0:1746147729.216288:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1871872->1875967) req@ffff88012f515500 x1830967794041600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.216297:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f515500 with x1830967794041600 ext(1871872->1875967) 00002000:00010000:3.0:1746147729.216300:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f515500 00000100:00100000:3.0:1746147729.216314:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7476 00000100:00100000:3.0:1746147729.216319:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794041600:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147729.216458:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794041600:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 138us (591us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147729.216464:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7476 00002000:00100000:3.0:1746147729.216470:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1871872->1875967) req@ffff88012f515500 x1830967794041600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147729.216475:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794041088:12345-192.168.202.10@tcp:101:cat.0 Request processed in 7165us (7540us total) trans 0 rc 301/301 00002000:00100000:3.0:1746147729.216477:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f515500 with x1830967794041600 ext(1871872->1875967) 00002000:00010000:3.0:1746147729.216479:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f515500 00000100:00100000:1.0:1746147729.216482:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16684 00002000:00010000:3.0:1746147729.218453:0:4591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime: 1746147728 -> 1746147730 00002000:00010000:2.0:1746147729.218453:0:7050:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime: 1746147729 -> 1746147730 00002000:00010000:3.0:1746147729.218459:0:4591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime: 1746147728 -> 1746147730 00002000:00010000:2.0:1746147729.218459:0:7050:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime: 1746147729 -> 1746147730 00002000:00010000:3.0:1746147729.218461:0:4591:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime: 1746147728 -> 1746147730 00002000:00010000:2.0:1746147729.218461:0:7050:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime: 1746147729 -> 1746147730 00000100:00100000:3.0:1746147729.218481:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796487808:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147729.218481:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796487936:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147729.218512:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0486600/0xe64d3fbf12a7e25e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbefa expref: 25 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.218526:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0486600/0xe64d3fbf12a7e25e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbefa expref: 25 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.218553:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0486600, rc 0) 00000100:00100000:3.0:1746147729.218593:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794041216:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2568us (3227us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147729.218600:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16685 00010000:00010000:2.0:1746147729.218621:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0487a00/0xe64d3fbf12a7e265 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf01 expref: 23 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.218630:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0487a00/0xe64d3fbf12a7e265 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf01 expref: 23 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.218646:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0487a00, rc 0) 00000100:00100000:2.0:1746147729.218666:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794041344:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2477us (2928us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147729.218672:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16686 00000100:00100000:0.0:1746147729.227518:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.227601:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794041856 00000100:00100000:1.0:1746147729.227612:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794041856 00002000:00100000:1.0:1746147729.227663:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88012f514700 x1830967794041856/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 504/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.227673:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514700 with x1830967794041856 ext(1048576->2097151) 00002000:00010000:1.0:1746147729.227689:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f514700 00000100:00100000:1.0:1746147729.227721:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7477 00000100:00100000:1.0:1746147729.227730:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794041856:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147729.238549:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.238657:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794041984 00000100:00100000:2.0:1746147729.238667:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794041984 00000100:00100000:2.0:1746147729.238720:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16687 00000100:00100000:2.0:1746147729.238728:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:32308:x1830967794041984:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147729.238756:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.238774:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009545b600/0xe64d3fbf12a7e26c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf08 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.238804:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 19 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.238811:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147729.238812:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147729.238816:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009545b600/0xe64d3fbf12a7e26c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf08 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.239359:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794041856:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11629us (11850us total) trans 0 rc 528384/528384 00000100:00100000:1.0:1746147729.239369:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7477 00002000:00100000:1.0:1746147729.239378:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88012f514700 x1830967794041856/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 504/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 528384/528384 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.239388:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514700 with x1830967794041856 ext(1048576->2097151) 00010000:00010000:1.0:1746147729.239395:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x40000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 18 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.239405:0:31355:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x40000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 18 pid: 4592 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147729.239410:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f514700 00010000:00010000:2.0:1746147729.239661:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 17 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.239674:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 17 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.239703:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796488064:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.242362:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147729.242569:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796488064:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.242611:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009545b600/0xe64d3fbf12a7e26c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf08 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.242630:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009545b600, rc 0) 00000100:00100000:2.0:1746147729.242749:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32308:x1830967794041984:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4019us (4211us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.242759:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16687 00000100:00100000:0.0:1746147729.252986:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.253137:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.253209:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794042112 00000100:00100000:1.0:1746147729.253219:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794042112 00002000:00100000:1.0:1746147729.253268:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1355776->1875967) req@ffff88012f516a00 x1830967794042112/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.253279:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f516a00 with x1830967794042112 ext(1355776->1875967) 00010000:00010000:1.0:1746147729.253289:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 18 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.253305:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 18 pid: 4592 timeout: 908 lvb_type: 0 00002000:00010000:1.0:1746147729.253312:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f516a00 00000100:00100000:2.0:1746147729.253982:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794042240 00000100:00100000:2.0:1746147729.253986:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794042240 00000100:00100000:2.0:1746147729.254014:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16688 00000100:00100000:2.0:1746147729.254021:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32306:x1830967794042240:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147729.254035:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.254051:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090abb400/0xe64d3fbf12a7e273 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf0f expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.254079:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->4153343) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.254087:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147729.254089:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147729.254092:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090abb400/0xe64d3fbf12a7e273 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf0f expref: 18 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.254125:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->4153343) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.254137:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->4153343) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 23 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.254148:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796488192:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.254215:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.255133:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1493 00000100:00100000:3.0:1746147729.255145:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794042112:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147729.258344:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.258417:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794042368 00000100:00100000:1.0:1746147729.258427:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794042368 00002000:00100000:1.0:1746147729.258471:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3436544->4153343) req@ffff88009fe96d80 x1830967794042368/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.258482:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96d80 with x1830967794042368 ext(3436544->4153343) 00010000:00010000:1.0:1746147729.258490:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->4153343) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 24 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.258503:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->4153343) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 24 pid: 4592 timeout: 908 lvb_type: 0 00002000:00010000:1.0:1746147729.258510:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe96d80 00000100:00100000:1.0:1746147729.258545:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1494 00000100:00100000:1.0:1746147729.258553:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794042368:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147729.260800:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796488192:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.260834:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090abb400/0xe64d3fbf12a7e273 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf0f expref: 18 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.260852:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090abb400, rc 0) 00000100:00100000:2.0:1746147729.260929:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32306:x1830967794042240:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6907us (7791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.260937:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16688 00000100:00100000:2.0:1746147729.262753:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.262840:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794042496 00000100:00100000:3.0:1746147729.262849:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794042496 00000100:00100000:3.0:1746147729.262918:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16689 00000100:00100000:3.0:1746147729.262927:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32302:x1830967794042496:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147729.262945:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.262968:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf16 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.262998:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013013ba00/0xe64d3fbf12a7e138 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe21 expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.263007:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e1cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe83 expref: 27 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.263018:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.263020:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.263023:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [774144->1048575] (req 774144->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 27 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.263054:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e1cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe83 expref: 27 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.263066:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e1cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe83 expref: 27 pid: 8184 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746147729.263078:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796488320:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.263150:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013013ba00/0xe64d3fbf12a7e138 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe21 expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.263158:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013013ba00/0xe64d3fbf12a7e138 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe21 expref: 17 pid: 10613 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.263166:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796488448:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147729.263183:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a64ae540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.272003:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967794042112:12345-192.168.202.10@tcp:4:cat.0 Request processed in 16847us (19014us total) trans 21474841622 rc 0/0 00000100:00100000:3.0:1746147729.272019:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1493 00002000:00100000:3.0:1746147729.272035:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1355776->1875967) req@ffff88012f516a00 x1830967794042112/t21474841622(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/448 e 0 to 0 dl 1746147740 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.272050:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f516a00 with x1830967794042112 ext(1355776->1875967) 00010000:00010000:3.0:1746147729.272061:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 20 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.272077:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 20 pid: 4592 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746147729.272083:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f516a00 00000100:00100000:0.0:1746147729.272671:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.272754:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794042624 00000100:00100000:2.0:1746147729.272762:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794042624 00010000:00010000:2.0:1746147729.272792:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e1cb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe83 expref: 28 pid: 8184 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.272827:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8494 00000100:00100000:2.0:1746147729.272833:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794042624:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.272849:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.272872:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e1cb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe83 expref: 28 pid: 8184 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.272901:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e1cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe83 expref: 28 pid: 8184 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.272927:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.272962:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794042624:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 130us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.272968:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8494 00010000:00010000:3.0:1746147729.273103:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00f7000/0xe64d3fbf12a7e1cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe83 expref: 27 pid: 8184 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746147729.273136:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796488320:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147729.273148:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796488448:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.273177:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [774144->1048575] (req 774144->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 26 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.273188:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0da000, rc 0) 00000100:00100000:3.0:1746147729.273210:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32302:x1830967794042496:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 10285us (10466us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.273216:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16689 00000100:00100000:1.0:1746147729.275219:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.275313:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794042752 00000100:00100000:2.0:1746147729.275326:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794042752 00010000:00010000:2.0:1746147729.275360:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013013ba00/0xe64d3fbf12a7e138 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe21 expref: 18 pid: 10613 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.275401:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8495 00000100:00100000:2.0:1746147729.275408:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794042752:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.275421:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.275443:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013013ba00/0xe64d3fbf12a7e138 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe21 expref: 18 pid: 10613 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.275454:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013013ba00/0xe64d3fbf12a7e138 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe21 expref: 18 pid: 10613 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.275476:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013013ba00/0xe64d3fbf12a7e138 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe21 expref: 18 pid: 10613 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.275500:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.275502:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.275509:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 25 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.275517:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 25 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.275549:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 25 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.275562:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796488576:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147729.275627:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.277844:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.277975:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.278081:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796488576:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147729.278101:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.278152:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794042752:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2743us (2940us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.278162:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8495 00000100:00100000:2.0:1746147729.278187:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794042880 00000100:00100000:2.0:1746147729.278193:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794042880 00010000:00010000:2.0:1746147729.278214:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 20 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.278234:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8496 00000100:00100000:2.0:1746147729.278239:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794042880:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.278251:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.278275:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 20 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.278284:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 20 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.278305:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5715200/0xe64d3fbf12a7e250 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1355776->1875967) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeec expref: 20 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.278319:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.278321:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.278327:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009545b600/0xe64d3fbf12a7e26c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf08 expref: 22 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.278335:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009545b600/0xe64d3fbf12a7e26c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf08 expref: 22 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.278364:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009545b600/0xe64d3fbf12a7e26c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf08 expref: 22 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.278375:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796488704:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147729.278419:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147729.278442:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794043136 00000100:00100000:2.0:1746147729.278445:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794043136 00002000:00100000:2.0:1746147729.278468:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (774144->778239) req@ffff88009fe95f80 x1830967794043136/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.278484:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe95f80 with x1830967794043136 ext(774144->778239) 00002000:00010000:2.0:1746147729.278488:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe95f80 00000100:00100000:2.0:1746147729.278500:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7478 00000100:00100000:2.0:1746147729.278505:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794043136:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147729.278622:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794043136:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 117us (647us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147729.278628:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7478 00002000:00100000:2.0:1746147729.278632:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (774144->778239) req@ffff88009fe95f80 x1830967794043136/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.278639:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe95f80 with x1830967794043136 ext(774144->778239) 00002000:00010000:2.0:1746147729.278642:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe95f80 00000100:00100000:1.0:1746147729.280636:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794042368:12345-192.168.202.10@tcp:4:cat.0 Request processed in 22072us (22290us total) trans 17179874394 rc 0/0 00000100:00100000:1.0:1746147729.280649:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1494 00002000:00100000:1.0:1746147729.280659:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3436544->4153343) req@ffff88009fe96d80 x1830967794042368/t17179874394(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/448 e 0 to 0 dl 1746147740 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.280669:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96d80 with x1830967794042368 ext(3436544->4153343) 00010000:00010000:1.0:1746147729.280687:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->4153343) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 26 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.281693:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->4153343) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 26 pid: 4592 timeout: 908 lvb_type: 0 00002000:00010000:1.0:1746147729.281702:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe96d80 00000100:00100000:3.0:1746147729.283026:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796488704:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147729.283048:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147729.283640:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794042880:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5397us (5803us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.283656:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8496 00000100:00100000:0.0:1746147729.288191:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.288246:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.288436:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794043392 00000100:00100000:1.0:1746147729.288446:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794043392 00002000:00100000:1.0:1746147729.288492:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009fe94380 x1830967794043392/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.288502:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe94380 with x1830967794043392 ext(1048576->2097151) 00002000:00010000:1.0:1746147729.288508:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe94380 00000100:00100000:3.0:1746147729.288585:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794043648 00000100:00100000:3.0:1746147729.288589:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794043648 00000100:00100000:3.0:1746147729.288617:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16690 00000100:00100000:3.0:1746147729.288624:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32302:x1830967794043648:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147729.288640:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.288658:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf1d expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.288703:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6a00/0xe64d3fbf12a7e1c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe7c expref: 18 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.288712:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe8a expref: 25 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.288718:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.288720:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.288724:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->1404927] (req 1048576->1404927) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 25 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.288759:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe8a expref: 25 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.288771:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe8a expref: 25 pid: 8184 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746147729.288783:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796488832:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.288857:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6a00/0xe64d3fbf12a7e1c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe7c expref: 18 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.288865:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6a00/0xe64d3fbf12a7e1c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe7c expref: 18 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.288873:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796488960:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147729.288920:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.288978:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7479 00000100:00100000:1.0:1746147729.288985:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794043392:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147729.291978:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.292104:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794043520 00000100:00100000:3.0:1746147729.292112:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794043520 00010000:00010000:3.0:1746147729.292261:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->4153343) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 26 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.292292:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8497 00000100:00100000:3.0:1746147729.292299:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967794043520:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147729.292311:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147729.292332:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3436544->4153343) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 26 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.292342:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3436544->4153343) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 26 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.292364:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5529400/0xe64d3fbf12a7e249 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3436544->4153343) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbee5 expref: 26 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.292392:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.292394:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.292402:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090abb400/0xe64d3fbf12a7e273 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf0f expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.292409:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090abb400/0xe64d3fbf12a7e273 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf0f expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.292444:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090abb400/0xe64d3fbf12a7e273 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf0f expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.292457:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796489088:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147729.292525:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.294162:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796488832:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147729.294175:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796488960:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.294203:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->1404927] (req 1048576->1404927) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 26 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.294221:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a59f9a00, rc 0) 00000100:00100000:3.0:1746147729.294274:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32302:x1830967794043648:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5648us (6026us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.294282:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16690 00000100:00100000:0.0:1746147729.302240:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.302286:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.302377:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794043776 00000100:00100000:2.0:1746147729.302388:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794043776 00010000:00010000:2.0:1746147729.302430:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe8a expref: 26 pid: 8184 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.302462:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794043904 00000100:00100000:2.0:1746147729.302464:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794043904 00010000:00010000:2.0:1746147729.302474:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6a00/0xe64d3fbf12a7e1c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe7c expref: 19 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.302491:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8498 00000100:00100000:2.0:1746147729.302498:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967794043776:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.302516:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.302537:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe8a expref: 26 pid: 8184 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746147729.302559:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8499 00000100:00100000:3.0:1746147729.302568:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1958:x1830967794043904:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147729.302579:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147729.302590:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6a00/0xe64d3fbf12a7e1c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe7c expref: 19 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.302603:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6a00/0xe64d3fbf12a7e1c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe7c expref: 19 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.302628:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00f6a00/0xe64d3fbf12a7e1c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe7c expref: 19 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.302867:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe8a expref: 26 pid: 8184 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.303039:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00f7600/0xe64d3fbf12a7e1d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe8a expref: 26 pid: 8184 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.303156:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.303160:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.303168:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 25 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.303177:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 25 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.303306:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 25 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.303320:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796489216:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147729.303335:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147729.303740:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794043904:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1169us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.303750:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8499 00000100:00100000:2.0:1746147729.304742:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.311926:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.311946:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796489088:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147729.311954:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.311969:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147729.311970:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147729.311981:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.312014:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794043520:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 19715us (20045us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.312024:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8497 00000100:00100000:3.0:1746147729.312078:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794044160 00000100:00100000:3.0:1746147729.312085:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794044160 00002000:00100000:3.0:1746147729.312118:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009fe94a80 x1830967794044160/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147729.312125:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794044416 00002000:00100000:3.0:1746147729.312127:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe94a80 with x1830967794044160 ext(2097152->3145727) 00000100:00100000:2.0:1746147729.312129:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794044416 00002000:00010000:3.0:1746147729.312132:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe94a80 00000100:00100000:3.0:1746147729.312147:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794044544 00000100:00100000:3.0:1746147729.312149:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794044544 00002000:00100000:2.0:1746147729.312149:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3883007) req@ffff88009fe96a00 x1830967794044416/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 504/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.312158:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fe97480 x1830967794044544/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.312161:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96a00 with x1830967794044416 ext(2097152->3883007) 00002000:00010000:2.0:1746147729.312164:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe96a00 00002000:00100000:3.0:1746147729.312169:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe97480 with x1830967794044544 ext(3145728->4194303) 00002000:00010000:3.0:1746147729.312171:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe97480 00000100:00100000:2.0:1746147729.312175:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794044928 00000100:00100000:2.0:1746147729.312177:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794044928 00000100:00100000:3.0:1746147729.312181:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7480 00002000:00100000:2.0:1746147729.312185:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3883008->4194303) req@ffff88009fe96680 x1830967794044928/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147729.312187:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794044160:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:2.0:1746147729.312191:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96680 with x1830967794044928 ext(3883008->4194303) 00002000:00010000:2.0:1746147729.312193:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe96680 00000100:00100000:2.0:1746147729.312202:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7481 00000100:00100000:2.0:1746147729.312206:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794044416:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147729.312274:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7482 00000100:00100000:1.0:1746147729.312281:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794044544:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147729.312955:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7483 00000100:00100000:3.0:1746147729.312963:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794044928:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147729.315242:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796489216:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147729.315266:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.315300:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794043776:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 12800us (13070us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.315311:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8498 00000100:00100000:2.0:1746147729.315757:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794043392:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 26771us (27575us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147729.315765:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7479 00002000:00100000:2.0:1746147729.315775:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009fe94380 x1830967794043392/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.315785:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe94380 with x1830967794043392 ext(1048576->2097151) 00002000:00010000:2.0:1746147729.315791:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe94380 00000100:00100000:0.0:1746147729.319113:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.319205:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794045184 00000100:00100000:2.0:1746147729.319219:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794045184 00002000:00100000:2.0:1746147729.319271:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1400832->1404927) req@ffff88009fe97800 x1830967794045184/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.319281:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe97800 with x1830967794045184 ext(1400832->1404927) 00002000:00010000:2.0:1746147729.319287:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe97800 00000100:00100000:2.0:1746147729.319310:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7484 00000100:00100000:2.0:1746147729.319318:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794045184:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147729.319517:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794045184:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 198us (416us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147729.319523:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7484 00002000:00100000:2.0:1746147729.319529:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1400832->1404927) req@ffff88009fe97800 x1830967794045184/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.319536:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe97800 with x1830967794045184 ext(1400832->1404927) 00002000:00010000:2.0:1746147729.319538:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe97800 00000100:00100000:3.0:1746147729.324744:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967794044928:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11769us (12748us total) trans 0 rc 311296/311296 00000100:00100000:3.0:1746147729.324758:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7483 00002000:00100000:3.0:1746147729.324772:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3883008->4194303) req@ffff88009fe96680 x1830967794044928/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 311296/311296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.324782:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96680 with x1830967794044928 ext(3883008->4194303) 00002000:00010000:3.0:1746147729.324788:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe96680 00000100:00100000:2.0:1746147729.327511:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794044416:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15289us (15542us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147729.327525:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7481 00002000:00100000:2.0:1746147729.327538:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3883007) req@ffff88009fe96a00 x1830967794044416/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 504/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.327548:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96a00 with x1830967794044416 ext(2097152->3883007) 00002000:00010000:2.0:1746147729.327554:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe96a00 00000100:00100000:1.0:1746147729.330400:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794044544:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18107us (18417us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147729.330417:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7482 00002000:00100000:1.0:1746147729.330428:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fe97480 x1830967794044544/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.330438:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe97480 with x1830967794044544 ext(3145728->4194303) 00002000:00010000:1.0:1746147729.330444:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe97480 00000100:00100000:3.0:1746147729.333227:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794044160:12345-192.168.202.10@tcp:3:cat.0 Request processed in 21023us (21331us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147729.333241:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7480 00002000:00100000:3.0:1746147729.333252:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009fe94a80 x1830967794044160/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.333261:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe94a80 with x1830967794044160 ext(2097152->3145727) 00002000:00010000:3.0:1746147729.333268:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe94a80 00000100:00100000:0.0:1746147729.340334:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.341548:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.341576:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794045312 00000100:00100000:1.0:1746147729.341576:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.341586:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794045312 00000100:00100000:1.0:1746147729.341602:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.341617:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794045440 00000100:00100000:1.0:1746147729.341620:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794045440 00000100:00100000:3.0:1746147729.341628:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794045696 00000100:00100000:3.0:1746147729.341630:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794045696 00000100:00100000:2.0:1746147729.341632:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794045568 00000100:00100000:2.0:1746147729.341637:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794045568 00000100:00100000:1.0:1746147729.341642:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16691 00000100:00100000:1.0:1746147729.341649:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794045312:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147729.341670:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.341699:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e38d000/0xe64d3fbf12a7e288 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf24 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.341724:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.341726:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.341734:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e38d000/0xe64d3fbf12a7e288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf24 expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.341750:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e38d000/0xe64d3fbf12a7e288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf24 expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147729.341755:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16692 00000100:00100000:3.0:1746147729.341761:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794045440:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147729.341763:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e38d000, rc 0) 00010000:00010000:3.0:1746147729.341768:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147729.341771:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16693 00000100:00100000:2.0:1746147729.341777:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794045696:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.341778:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e99200/0xe64d3fbf12a7e28f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf2b expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.341786:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.341795:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095234600/0xe64d3fbf12a7e296 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf39 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.341808:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794045312:12345-192.168.202.10@tcp:101:cat.0 Request processed in 160us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.341815:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16691 00000100:00100000:3.0:1746147729.341817:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796489344:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147729.341824:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796489472:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147729.341832:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16694 00000100:00100000:1.0:1746147729.341836:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794045568:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147729.341841:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.341848:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e38d600/0xe64d3fbf12a7e29d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf32 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.341867:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796489600:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147729.341871:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147729.341874:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.341905:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.342016:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.342072:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794045824 00000100:00100000:0.0:1746147729.342076:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794045824 00000100:00100000:0.0:1746147729.342643:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16695 00000100:00100000:0.0:1746147729.342651:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1958:x1830967794045824:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147729.342660:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147729.342669:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7e2a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf40 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.342694:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147729.342696:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147729.342702:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7e2a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf40 expref: 21 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147729.342712:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7e2a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf40 expref: 21 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147729.342723:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cef5400, rc 0) 00000100:00100000:0.0:1746147729.342762:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794045824:12345-192.168.202.10@tcp:101:cat.0 Request processed in 112us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147729.342768:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16695 00000100:00100000:3.0:1746147729.349316:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796489344:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147729.349347:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e99200/0xe64d3fbf12a7e28f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf2b expref: 24 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.349360:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e99200/0xe64d3fbf12a7e28f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf2b expref: 24 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.349397:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e99200, rc 0) 00000100:00100000:3.0:1746147729.349447:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794045440:12345-192.168.202.10@tcp:101:cat.0 Request processed in 7685us (7901us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147729.349454:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16692 00002000:00010000:1.0:1746147729.349669:0:8468:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime: 1746147729 -> 1746147730 00002000:00010000:1.0:1746147729.349672:0:8468:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime: 1746147729 -> 1746147730 00002000:00010000:1.0:1746147729.349674:0:8468:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime: 1746147729 -> 1746147730 00000100:00100000:1.0:1746147729.349697:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796489600:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147729.349712:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e38d600/0xe64d3fbf12a7e29d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf32 expref: 18 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.349721:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e38d600/0xe64d3fbf12a7e29d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf32 expref: 18 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.349732:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e38d600, rc 0) 00000100:00100000:1.0:1746147729.349751:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794045568:12345-192.168.202.10@tcp:101:cat.0 Request processed in 7915us (8148us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147729.349756:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16694 00002000:00010000:2.0:1746147729.349853:0:8184:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime: 1746147729 -> 1746147730 00002000:00010000:2.0:1746147729.349858:0:8184:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime: 1746147729 -> 1746147730 00002000:00010000:2.0:1746147729.349860:0:8184:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime: 1746147729 -> 1746147730 00000100:00100000:2.0:1746147729.349879:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796489472:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147729.349939:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095234600/0xe64d3fbf12a7e296 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf39 expref: 20 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.349953:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095234600/0xe64d3fbf12a7e296 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf39 expref: 20 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.349968:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095234600, rc 0) 00000100:00100000:2.0:1746147729.350001:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1957:x1830967794045696:12345-192.168.202.10@tcp:101:cat.0 Request processed in 8224us (8423us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147729.350008:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16693 00000100:00100000:0.0:1746147729.357204:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.357282:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794045952 00000100:00100000:2.0:1746147729.357290:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794045952 00000100:00100000:2.0:1746147729.357489:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16696 00000100:00100000:2.0:1746147729.357498:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32312:x1830967794045952:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147729.357514:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.357530:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf47 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.357555:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e38da00/0xe64d3fbf12a7e051 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd4f expref: 25 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.357564:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7e14d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe44 expref: 5 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.357571:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800915e5800/0xe64d3fbf12a7e06d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd6b expref: 18 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.357577:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.357579:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.357582:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 6/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [1138688->1200127] (req 1138688->1200127) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.357606:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800915e5800/0xe64d3fbf12a7e06d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd6b expref: 18 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.357617:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800915e5800/0xe64d3fbf12a7e06d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd6b expref: 18 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.357628:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796489728:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.357712:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7e14d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe44 expref: 5 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.357721:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7e14d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe44 expref: 5 pid: 21480 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.357729:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796489856:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.357751:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e38da00/0xe64d3fbf12a7e051 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd4f expref: 25 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.357758:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e38da00/0xe64d3fbf12a7e051 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd4f expref: 25 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.357765:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796489984:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.357776:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.358286:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.358420:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794046208 00000100:00100000:3.0:1746147729.358424:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794046208 00002000:00100000:3.0:1746147729.358449:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009172c380 x1830967794046208/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.358457:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172c380 with x1830967794046208 ext(2097152->3145727) 00002000:00010000:3.0:1746147729.358461:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172c380 00000100:00100000:3.0:1746147729.359127:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7485 00000100:00100000:3.0:1746147729.359135:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967794046208:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147729.371049:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.371094:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.371121:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.371134:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.371152:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794046720 00000100:00100000:1.0:1746147729.371158:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794046720 00010000:00010000:1.0:1746147729.371185:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7e14d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe44 expref: 6 pid: 21480 timeout: 908 lvb_type: 1 00000100:00100000:1.0:1746147729.371207:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794046592 00000100:00100000:1.0:1746147729.371209:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794046592 00000100:00100000:0.0:1746147729.371216:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794046464 00010000:00010000:1.0:1746147729.371217:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800915e5800/0xe64d3fbf12a7e06d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd6b expref: 19 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:0.0:1746147729.371220:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794046464 00000100:00100000:1.0:1746147729.371235:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794046848 00000100:00100000:1.0:1746147729.371242:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794046848 00010000:00010000:1.0:1746147729.371250:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e38da00/0xe64d3fbf12a7e051 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd4f expref: 28 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:1.0:1746147729.371262:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8500 00000100:00100000:1.0:1746147729.371268:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967794046720:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147729.371277:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8501 00010000:00010000:1.0:1746147729.371278:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147729.371285:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794046592:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147729.371293:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147729.371297:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7e14d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe44 expref: 6 pid: 21480 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746147729.371303:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800915e5800/0xe64d3fbf12a7e06d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd6b expref: 20 pid: 20619 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746147729.371306:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7e14d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe44 expref: 6 pid: 21480 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746147729.371314:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800915e5800/0xe64d3fbf12a7e06d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd6b expref: 20 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.371493:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796489728:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.371503:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796489856:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.371510:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fb76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796489984:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147729.371578:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8502 00000100:00100000:0.0:1746147729.371585:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794046848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147729.371592:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147729.371634:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7e14d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe44 expref: 6 pid: 21480 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746147729.371651:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915e5800/0xe64d3fbf12a7e06d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd6b expref: 20 pid: 20619 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746147729.371656:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147729.371665:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147729.371698:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+5:1960:x1830967794046720:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 430us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.371699:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794046592:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 414us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.371705:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8501 00000100:00100000:1.0:1746147729.371711:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8500 00010000:00010000:0.0:1746147729.371783:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e38da00/0xe64d3fbf12a7e051 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd4f expref: 28 pid: 20619 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.371784:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [1138688->1200127] (req 1138688->1200127) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.371793:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e38da00/0xe64d3fbf12a7e051 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd4f expref: 28 pid: 20619 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.371827:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147729.371828:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e38da00/0xe64d3fbf12a7e051 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbd4f expref: 28 pid: 20619 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.371829:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.371835:0:8184:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.371842:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.372388:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147729.372796:0:8184:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.372808:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796490112:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147729.372975:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794046848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1389us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147729.372982:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8502 00002000:00100000:0.0:1746147729.373019:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800954c2300 x1830967794046464/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147729.373028:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c2300 with x1830967794046464 ext(4194304->5017599) 00002000:00010000:0.0:1746147729.373032:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c2300 00000100:00100000:0.0:1746147729.373048:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7486 00000100:00100000:0.0:1746147729.373053:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794046464:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147729.373797:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794046208:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14660us (15509us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147729.373804:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7485 00002000:00100000:3.0:1746147729.373810:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009172c380 x1830967794046208/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.373816:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172c380 with x1830967794046208 ext(2097152->3145727) 00002000:00010000:3.0:1746147729.373819:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172c380 00000100:00100000:2.0:1746147729.374055:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.381715:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.381816:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794046976 00000100:00100000:1.0:1746147729.381823:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794046976 00000100:00100000:2.0:1746147729.381824:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fb76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796490112:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147729.381845:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235800, rc 0) 00000100:00100000:1.0:1746147729.381873:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16697 00000100:00100000:1.0:1746147729.381881:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32308:x1830967794046976:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147729.381912:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:32312:x1830967794045952:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 24414us (24714us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.381918:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16696 00010000:00010000:1.0:1746147729.381923:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.381938:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e38ce00/0xe64d3fbf12a7e2b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf4e expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.381962:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 18 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.381969:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147729.381971:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147729.381974:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e38ce00/0xe64d3fbf12a7e2b2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf4e expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.381999:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 18 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.382010:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 18 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746147729.382026:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796490240:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147729.382077:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.383853:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.383914:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796490240:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147729.383936:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e38ce00/0xe64d3fbf12a7e2b2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf4e expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.383958:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e38ce00, rc 0) 00000100:00100000:1.0:1746147729.383984:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32308:x1830967794046976:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2104us (2277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.383991:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16697 00000100:00100000:3.0:1746147729.384049:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794047232 00000100:00100000:3.0:1746147729.384054:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794047232 00002000:00100000:3.0:1746147729.384079:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1138688->1142783) req@ffff88009172e680 x1830967794047232/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.384097:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172e680 with x1830967794047232 ext(1138688->1142783) 00002000:00010000:3.0:1746147729.384101:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172e680 00000100:00100000:3.0:1746147729.384125:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7487 00000100:00100000:3.0:1746147729.384131:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794047232:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147729.384249:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794047232:12345-192.168.202.10@tcp:3:cat.0 Request processed in 118us (400us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147729.384255:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7487 00002000:00100000:3.0:1746147729.384260:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1138688->1142783) req@ffff88009172e680 x1830967794047232/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.384266:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172e680 with x1830967794047232 ext(1138688->1142783) 00002000:00010000:3.0:1746147729.384268:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172e680 00000100:00100000:0.0:1746147729.384670:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.384865:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794047360 00000100:00100000:3.0:1746147729.384869:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794047360 00002000:00100000:3.0:1746147729.384910:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2408448->3145727) req@ffff88012ee58a80 x1830967794047360/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.384917:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58a80 with x1830967794047360 ext(2408448->3145727) 00010000:00010000:3.0:1746147729.384923:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 19 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.384934:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 19 pid: 4592 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746147729.384940:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ee58a80 00000100:00100000:3.0:1746147729.384957:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1495 00000100:00100000:3.0:1746147729.384963:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794047360:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147729.386541:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794046464:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13483us (15494us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147729.386550:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7486 00002000:00100000:2.0:1746147729.386557:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800954c2300 x1830967794046464/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.386565:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c2300 with x1830967794046464 ext(4194304->5017599) 00002000:00010000:2.0:1746147729.386569:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c2300 00000100:00100000:0.0:1746147729.386737:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.387975:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794047616 00000100:00100000:3.0:1746147729.387984:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794047616 00002000:00100000:3.0:1746147729.388009:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x457:0x0] (1196032->1200127) req@ffff88012ee5bb80 x1830967794047616/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.388017:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee5bb80 with x1830967794047616 ext(1196032->1200127) 00002000:00010000:3.0:1746147729.388022:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee5bb80 00000100:00100000:3.0:1746147729.388036:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7488 00000100:00100000:3.0:1746147729.388042:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967794047616:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147729.388336:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967794047616:12345-192.168.202.10@tcp:3:cat.0 Request processed in 293us (1598us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147729.388342:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7488 00002000:00100000:3.0:1746147729.388348:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x457:0x0] (1196032->1200127) req@ffff88012ee5bb80 x1830967794047616/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.388355:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee5bb80 with x1830967794047616 ext(1196032->1200127) 00002000:00010000:3.0:1746147729.388357:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee5bb80 00000100:00100000:0.0:1746147729.393438:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.393475:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.393503:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794047744 00000100:00100000:1.0:1746147729.393512:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794047744 00000100:00100000:0.0:1746147729.393526:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.393544:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794048000 00000100:00100000:3.0:1746147729.393548:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794048000 00000100:00100000:1.0:1746147729.393557:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794047872 00000100:00100000:1.0:1746147729.393560:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794047872 00000100:00100000:1.0:1746147729.393576:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16698 00000100:00100000:3.0:1746147729.393582:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16699 00000100:00100000:1.0:1746147729.393582:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794047744:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:0.0:1746147729.393587:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16700 00000100:00100000:0.0:1746147729.393592:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967794047872:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147729.393598:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147729.393598:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.393612:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e38cc00/0xe64d3fbf12a7e2b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf55 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.393612:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0028400/0xe64d3fbf12a7e2c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf5c expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.393651:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796490496:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147729.393651:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796490368:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147729.393736:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.393740:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.393777:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967794048000:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.393787:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.393795:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a732c600/0xe64d3fbf12a7e2c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf63 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.393821:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796490624:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147729.394851:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.398220:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796490368:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147729.398248:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0028400/0xe64d3fbf12a7e2c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf5c expref: 24 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147729.398262:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0028400/0xe64d3fbf12a7e2c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf5c expref: 24 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147729.398275:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0028400, rc 0) 00000100:00100000:0.0:1746147729.398309:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967794047872:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4717us (4782us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147729.398317:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16700 00000100:00100000:2.0:1746147729.398425:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796490624:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147729.398442:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a732c600/0xe64d3fbf12a7e2c7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf63 expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.398451:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a732c600/0xe64d3fbf12a7e2c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf63 expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.398467:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a732c600, rc 0) 00000100:00100000:2.0:1746147729.398487:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967794048000:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4900us (5012us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147729.398492:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16699 00000100:00100000:1.0:1746147729.398510:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796490496:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147729.398529:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e38cc00/0xe64d3fbf12a7e2b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf55 expref: 18 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.398539:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e38cc00/0xe64d3fbf12a7e2b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf55 expref: 18 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.398550:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e38cc00, rc 0) 00000100:00100000:1.0:1746147729.398571:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794047744:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4990us (5141us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147729.398577:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16698 00000100:00100000:3.0:1746147729.399500:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967794047360:12345-192.168.202.10@tcp:4:cat.0 Request processed in 14533us (14826us total) trans 21474841623 rc 0/0 00000100:00100000:3.0:1746147729.399509:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1495 00002000:00100000:3.0:1746147729.399516:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2408448->3145727) req@ffff88012ee58a80 x1830967794047360/t21474841623(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/448 e 0 to 0 dl 1746147740 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.399524:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58a80 with x1830967794047360 ext(2408448->3145727) 00010000:00010000:3.0:1746147729.399530:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 21 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.399540:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 21 pid: 4592 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746147729.399546:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ee58a80 00000100:00100000:0.0:1746147729.405435:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.405471:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.405498:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.405543:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.405566:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794048256 00000100:00100000:0.0:1746147729.405572:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794048256 00000100:00100000:0.0:1746147729.405612:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794048512 00000100:00100000:0.0:1746147729.405614:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794048512 00000100:00100000:0.0:1746147729.405624:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794048384 00000100:00100000:0.0:1746147729.405626:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794048384 00000100:00100000:0.0:1746147729.405640:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16701 00000100:00100000:0.0:1746147729.405646:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794048256:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147729.405648:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794048128 00000100:00100000:2.0:1746147729.405652:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794048128 00010000:00010000:0.0:1746147729.405662:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.405672:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 23 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746147729.405685:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0029200/0xe64d3fbf12a7e2ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf6a expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.405703:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8503 00000100:00100000:2.0:1746147729.405708:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967794048128:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.405717:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147729.405732:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796490752:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147729.405735:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 23 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.405746:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 23 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.405762:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5715800/0xe64d3fbf12a7e23b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed7 expref: 23 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.405773:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.405775:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.405780:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e38ce00/0xe64d3fbf12a7e2b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf4e expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.405791:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e38ce00/0xe64d3fbf12a7e2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf4e expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147729.405796:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00010000:00010000:2.0:1746147729.405810:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e38ce00/0xe64d3fbf12a7e2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf4e expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.405832:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb76d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796490880:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147729.405854:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147729.405871:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16702 00000100:00100000:2.0:1746147729.405877:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967794048512:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147729.405900:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.405907:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095234000/0xe64d3fbf12a7e2d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf78 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.405916:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.405918:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.405921:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095234000/0xe64d3fbf12a7e2d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf78 expref: 23 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.405930:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095234000/0xe64d3fbf12a7e2d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf78 expref: 23 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.405938:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095234000, rc 0) 00000100:00100000:2.0:1746147729.405960:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967794048512:12345-192.168.202.10@tcp:101:cat.0 Request processed in 83us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.405969:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16702 00000100:00100000:2.0:1746147729.405981:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16703 00000100:00100000:2.0:1746147729.405985:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967794048384:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147729.405990:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.405996:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095235a00/0xe64d3fbf12a7e2dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf71 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.406014:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796491008:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147729.406048:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.408877:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fb76d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796490880:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147729.408930:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.408961:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796490752:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147729.408995:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0029200/0xe64d3fbf12a7e2ce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf6a expref: 18 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.409009:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0029200/0xe64d3fbf12a7e2ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf6a expref: 18 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.409020:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0029200, rc 0) 00000100:00100000:3.0:1746147729.409447:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967794048128:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3736us (4018us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.409456:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794048256:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3807us (3981us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147729.409457:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8503 00000100:00100000:2.0:1746147729.409464:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16701 00000100:00100000:3.0:1746147729.409526:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fb75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796491008:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147729.409544:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095235a00/0xe64d3fbf12a7e2dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf71 expref: 22 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.409555:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095235a00/0xe64d3fbf12a7e2dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf71 expref: 22 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.409582:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235a00, rc 0) 00000100:00100000:3.0:1746147729.409604:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967794048384:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3618us (4060us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147729.409610:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16703 00000100:00100000:0.0:1746147729.416641:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.416669:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.416723:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.416727:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794048896 00000100:00100000:3.0:1746147729.416738:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794048896 00002000:00100000:3.0:1746147729.416787:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009d0df480 x1830967794048896/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.416796:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0df480 with x1830967794048896 ext(2097152->3145727) 00002000:00010000:3.0:1746147729.416801:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0df480 00000100:00100000:2.0:1746147729.416808:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794049024 00000100:00100000:2.0:1746147729.416815:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794049024 00000100:00100000:3.0:1746147729.416821:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794049280 00000100:00100000:3.0:1746147729.416824:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794049280 00002000:00100000:3.0:1746147729.416838:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009d0dce00 x1830967794049280/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.416844:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dce00 with x1830967794049280 ext(3145728->4194303) 00002000:00010000:3.0:1746147729.416847:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d0dce00 00002000:00100000:2.0:1746147729.416853:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009d0de680 x1830967794049024/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147729.416854:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7489 00002000:00100000:2.0:1746147729.416862:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0de680 with x1830967794049024 ext(3145728->4194303) 00000100:00100000:0.0:1746147729.416864:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794048896:12345-192.168.202.10@tcp:3:cat.0 00002000:00010000:2.0:1746147729.416867:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0de680 00000100:00100000:3.0:1746147729.417007:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7490 00000100:00100000:3.0:1746147729.417015:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794049280:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147729.417121:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7491 00000100:00100000:2.0:1746147729.417127:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794049024:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147729.429291:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794049280:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12262us (12552us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147729.429306:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7490 00002000:00100000:3.0:1746147729.429319:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009d0dce00 x1830967794049280/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.429328:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dce00 with x1830967794049280 ext(3145728->4194303) 00002000:00010000:3.0:1746147729.429335:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d0dce00 00000100:00100000:2.0:1746147729.432926:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794048896:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16019us (16251us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147729.432939:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7489 00002000:00100000:2.0:1746147729.432951:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009d0df480 x1830967794048896/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.432961:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0df480 with x1830967794048896 ext(2097152->3145727) 00002000:00010000:2.0:1746147729.432967:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0df480 00000100:00100000:0.0:1746147729.437284:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794049024:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20143us (20598us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147729.437299:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7491 00002000:00100000:0.0:1746147729.437311:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009d0de680 x1830967794049024/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147729.437322:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0de680 with x1830967794049024 ext(3145728->4194303) 00002000:00010000:0.0:1746147729.437329:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0de680 00000100:00100000:0.0:1746147729.443583:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.443654:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794049408 00000100:00100000:3.0:1746147729.443671:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794049408 00000100:00100000:3.0:1746147729.443750:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16704 00000100:00100000:3.0:1746147729.443759:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794049408:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.443782:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.443803:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a932a000/0xe64d3fbf12a7e2e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf7f expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.444215:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796491136:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147729.444313:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746147729.448673:0:21480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime: 1746147728 -> 1746147730 00002000:00010000:3.0:1746147729.448696:0:21480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime: 1746147728 -> 1746147730 00002000:00010000:3.0:1746147729.448699:0:21480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime: 1746147728 -> 1746147730 00000100:00100000:3.0:1746147729.448729:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796491136:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147729.448775:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a932a000/0xe64d3fbf12a7e2e3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf7f expref: 26 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.448791:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a932a000/0xe64d3fbf12a7e2e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf7f expref: 26 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.448828:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a932a000, rc 0) 00000100:00100000:3.0:1746147729.448924:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794049408:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5164us (5350us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147729.448933:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16704 00000100:00100000:0.0:1746147729.452655:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.452854:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794049664 00000100:00100000:2.0:1746147729.452864:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794049664 00002000:00100000:2.0:1746147729.452947:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009fc13b80 x1830967794049664/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.452958:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13b80 with x1830967794049664 ext(4194304->5017599) 00002000:00010000:2.0:1746147729.452963:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc13b80 00000100:00100000:2.0:1746147729.452982:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7492 00000100:00100000:2.0:1746147729.452990:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794049664:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147729.461200:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794049664:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8198us (8543us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147729.461212:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7492 00002000:00100000:2.0:1746147729.461224:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009fc13b80 x1830967794049664/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.461240:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13b80 with x1830967794049664 ext(4194304->5017599) 00002000:00010000:2.0:1746147729.461246:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc13b80 00000100:00100000:0.0:1746147729.464960:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.465020:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794049792 00000100:00100000:3.0:1746147729.465029:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794049792 00000100:00100000:3.0:1746147729.465076:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16705 00000100:00100000:3.0:1746147729.465082:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794049792:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.465098:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.465115:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9323a00/0xe64d3fbf12a7e2ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf86 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.465401:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796491264:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147729.465497:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.467104:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796491264:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147729.467144:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9323a00/0xe64d3fbf12a7e2ea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf86 expref: 26 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.467160:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9323a00/0xe64d3fbf12a7e2ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf86 expref: 26 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.467196:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9323a00, rc 0) 00000100:00100000:3.0:1746147729.467843:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794049792:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2755us (2891us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147729.467857:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16705 00000100:00100000:0.0:1746147729.471294:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.471388:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794049920 00000100:00100000:3.0:1746147729.471398:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794049920 00000100:00100000:3.0:1746147729.471453:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16706 00000100:00100000:3.0:1746147729.471462:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794049920:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.471483:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.471501:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a932ae00/0xe64d3fbf12a7e2f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf8d expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.471562:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796491392:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147729.471649:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.474117:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796491392:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147729.474162:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a932ae00/0xe64d3fbf12a7e2f1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf8d expref: 26 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.474176:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a932ae00/0xe64d3fbf12a7e2f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf8d expref: 26 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.474204:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a932ae00, rc 0) 00000100:00100000:3.0:1746147729.474315:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794049920:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2805us (2982us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147729.474324:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16706 00000100:00100000:0.0:1746147729.493282:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.493974:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794050048 00000100:00100000:3.0:1746147729.493985:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794050048 00000100:00100000:3.0:1746147729.494038:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12050 00000100:00100000:3.0:1746147729.494048:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+22:32316:x1830967794050048:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147729.494076:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.494095:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7e2f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf94 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.494161:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932ae00/0xe64d3fbf12a7e2ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.494175:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932ae00/0xe64d3fbf12a7e2ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.494186:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932ae00/0xe64d3fbf12a7e2ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.494198:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932a000/0xe64d3fbf12a7e306 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.494203:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932a000/0xe64d3fbf12a7e306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.494208:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932a000/0xe64d3fbf12a7e306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.494312:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.494321:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7a00/0xe64d3fbf12a7e203 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeb4 expref: 25 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.494327:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7e22d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed0 expref: 347 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.494332:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 5/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.494364:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7e22d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed0 expref: 347 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.494376:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7e22d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed0 expref: 347 pid: 5744 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.494387:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796491520:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.496004:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7a00/0xe64d3fbf12a7e203 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeb4 expref: 25 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.496019:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7a00/0xe64d3fbf12a7e203 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeb4 expref: 25 pid: 5744 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.496031:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796491648:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147729.496085:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.500846:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.500923:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794050304 00000100:00100000:0.0:1746147729.500932:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.500934:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794050304 00000100:00100000:3.0:1746147729.501050:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796491520:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147729.501062:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796491648:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.501095:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746147729.501345:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794050560 00000100:00100000:1.0:1746147729.501349:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794050560 00000100:00100000:0.0:1746147729.501353:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5021 00000100:00100000:0.0:1746147729.501364:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:23727:x1830967794050304:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147729.501379:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5022 00000100:00100000:1.0:1746147729.501384:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+348:7669:x1830967794050560:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147729.502522:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:23727:x1830967794050304:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 1156us (1682us total) trans 8589946072 rc 0/0 00000100:00100000:1.0:1746147729.502531:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5021 00000100:00100000:1.0:1746147729.502611:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+349:7669:x1830967794050560:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 1226us (1678us total) trans 8589946073 rc 0/0 00000100:00100000:1.0:1746147729.502617:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5022 00000100:00100000:0.0:1746147729.504335:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.504387:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.504457:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794050688 00000100:00100000:3.0:1746147729.504466:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794050688 00000100:00100000:1.0:1746147729.504805:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794050816 00000100:00100000:1.0:1746147729.504809:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794050816 00010000:00010000:3.0:1746147729.504814:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7e22d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed0 expref: 349 pid: 5744 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.504823:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7a00/0xe64d3fbf12a7e203 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeb4 expref: 27 pid: 5744 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.504852:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8504 00000100:00100000:3.0:1746147729.504863:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+349:1957:x1830967794050688:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147729.504913:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147729.504919:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7e22d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed0 expref: 349 pid: 5744 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746147729.504922:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8505 00000100:00100000:1.0:1746147729.504928:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794050816:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147729.504930:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7e22d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed0 expref: 349 pid: 5744 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.504936:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147729.504939:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7a00/0xe64d3fbf12a7e203 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeb4 expref: 27 pid: 5744 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.505114:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a008da00/0xe64d3fbf12a7e22d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbed0 expref: 349 pid: 5744 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.505115:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7a00/0xe64d3fbf12a7e203 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeb4 expref: 27 pid: 5744 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.505128:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f7a00/0xe64d3fbf12a7e203 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbeb4 expref: 27 pid: 5744 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.505139:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147729.505178:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147729.505191:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147729.505198:0:7096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.505232:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147729.505236:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147729.505286:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147729.505310:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505317:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746147729.505362:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:1.0:1746147729.505416:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794050816:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 486us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.505422:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8505 00000004:00200000:2.0:1746147729.505455:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147729.505473:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505482:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505491:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932ae00/0xe64d3fbf12a7e2ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505498:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932ae00/0xe64d3fbf12a7e2ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505504:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932ae00/0xe64d3fbf12a7e2ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505509:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a932ae00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147729.505512:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932ae00/0xe64d3fbf12a7e2ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505519:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932ae00/0xe64d3fbf12a7e2ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505528:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147729.505532:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147729.505535:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932ae00/0xe64d3fbf12a7e2ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505539:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932ae00/0xe64d3fbf12a7e2ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505564:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932a000/0xe64d3fbf12a7e306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505569:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932a000/0xe64d3fbf12a7e306 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505574:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932a000/0xe64d3fbf12a7e306 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746147729.505576:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+348:1957:x1830967794050688:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 717us (1248us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147729.505579:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a932a000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147729.505581:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932a000/0xe64d3fbf12a7e306 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746147729.505583:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8504 00010000:00010000:2.0:1746147729.505587:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932a000/0xe64d3fbf12a7e306 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505593:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a02f4400) 00010000:00010000:2.0:1746147729.505595:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147729.505597:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932a000/0xe64d3fbf12a7e306 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505602:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932a000/0xe64d3fbf12a7e306 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.505636:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7e2f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf94 expref: 24 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.505656:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf94 expref: 23 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.505662:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147729.505664:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147729.505666:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a932b000, rc 0) 00000100:00100000:2.0:1746147729.505703:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+23:32316:x1830967794050048:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 11656us (12434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.505709:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12050 00000100:00100000:0.0:1746147729.508834:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.508869:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.508942:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794050944 00000100:00100000:2.0:1746147729.508952:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794050944 00000100:00100000:2.0:1746147729.508994:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794051072 00000100:00100000:2.0:1746147729.508996:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794051072 00000100:00100000:0.0:1746147729.508999:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.509011:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794051200 00000100:00100000:2.0:1746147729.509013:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794051200 00000100:00100000:2.0:1746147729.509035:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16707 00000100:00100000:2.0:1746147729.509043:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+5:1957:x1830967794050944:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147729.509064:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.509082:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095235e00/0xe64d3fbf12a7e314 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbf9b expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.509138:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796491776:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147729.509254:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16708 00000100:00100000:1.0:1746147729.509262:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967794051072:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147729.509271:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.509282:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e31b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbfa2 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.509309:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796491904:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147729.509341:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.509836:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16709 00000100:00100000:3.0:1746147729.509844:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794051200:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147729.509852:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.509861:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7e322 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbfa9 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.509874:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.509876:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.509912:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7e322 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfa9 expref: 9 pid: 21480 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147729.509915:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147729.509927:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7e322 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfa9 expref: 9 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.509939:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5896800, rc 0) 00000100:00100000:3.0:1746147729.509963:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794051200:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 120us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.509969:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16709 00000100:00100000:0.0:1746147729.510338:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.510432:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.510984:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.511191:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794051328 00000100:00100000:3.0:1746147729.511198:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794051328 00000100:00100000:3.0:1746147729.511228:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794051456 00000100:00100000:3.0:1746147729.511230:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794051456 00000100:00100000:3.0:1746147729.511245:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794051584 00000100:00100000:3.0:1746147729.511247:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794051584 00000100:00100000:3.0:1746147729.511261:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16710 00000100:00100000:3.0:1746147729.511266:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794051328:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147729.511279:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.511292:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091628200/0xe64d3fbf12a7e329 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbfb0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.511332:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796492032:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147729.511380:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.511399:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16711 00000100:00100000:3.0:1746147729.511404:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794051456:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147729.511409:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.511417:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e330 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbfb7 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.511426:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.511428:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.511435:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e330 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfb7 expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.511446:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e330 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfb7 expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.511454:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce2d200, rc 0) 00000100:00100000:3.0:1746147729.511472:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967794051456:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 68us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.511478:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16711 00000100:00100000:3.0:1746147729.511490:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16712 00000100:00100000:3.0:1746147729.511494:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794051584:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147729.511500:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.511509:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ce2dc00/0xe64d3fbf12a7e337 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbfbe expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.511518:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.511519:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.511523:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce2dc00/0xe64d3fbf12a7e337 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfbe expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.511531:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ce2dc00/0xe64d3fbf12a7e337 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfbe expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.511537:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce2dc00, rc 0) 00000100:00100000:3.0:1746147729.511548:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967794051584:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 53us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.511556:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16712 00000100:00100000:2.0:1746147729.514363:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fb76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796491776:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147729.514402:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095235e00/0xe64d3fbf12a7e314 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf9b expref: 9 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.514421:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095235e00/0xe64d3fbf12a7e314 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf9b expref: 9 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.514440:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235e00, rc 0) 00000100:00100000:2.0:1746147729.514486:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794050944:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 5443us (5665us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147729.514495:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16707 00000100:00100000:1.0:1746147729.514580:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796491904:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147729.514600:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e31b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfa2 expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.514610:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e31b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfa2 expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.514618:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a9600, rc 0) 00000100:00100000:1.0:1746147729.514636:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794051072:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 5375us (5765us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147729.514642:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16708 00000100:00100000:3.0:1746147729.514720:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796492032:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147729.514737:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091628200/0xe64d3fbf12a7e329 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfb0 expref: 7 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.514746:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091628200/0xe64d3fbf12a7e329 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfb0 expref: 7 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.514768:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091628200, rc 0) 00000100:00100000:3.0:1746147729.514786:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967794051328:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 3519us (4449us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147729.514792:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16710 00000100:00100000:0.0:1746147729.520074:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.520155:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794051840 00000100:00100000:2.0:1746147729.520165:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794051840 00000100:00100000:2.0:1746147729.520213:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12051 00000100:00100000:2.0:1746147729.520221:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+23:32316:x1830967794051840:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147729.520243:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.520263:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e33e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbfc5 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.520355:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095234600/0xe64d3fbf12a7e345 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.520370:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf94 expref: 24 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.520377:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095234600/0xe64d3fbf12a7e345 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.520416:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf94 expref: 24 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.520432:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf94 expref: 24 pid: 14547 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.520444:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fb76300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796492160:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.520541:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147729.522167:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fb76300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796492160:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.522274:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095234600/0xe64d3fbf12a7e345 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746147729.522779:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.522833:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794051968 00000100:00100000:3.0:1746147729.522841:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794051968 00010000:00010000:3.0:1746147729.522872:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf94 expref: 25 pid: 14547 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.523768:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8506 00000100:00100000:3.0:1746147729.523779:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+25:1958:x1830967794051968:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147729.523792:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147729.523799:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf94 expref: 25 pid: 14547 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.523811:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf94 expref: 25 pid: 14547 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.523837:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e30d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf94 expref: 25 pid: 14547 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.523865:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147729.523870:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095234600/0xe64d3fbf12a7e345 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.523880:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095234600/0xe64d3fbf12a7e345 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.523900:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095234600/0xe64d3fbf12a7e345 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.523927:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147729.524051:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095234600/0xe64d3fbf12a7e345 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.524059:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095234600/0xe64d3fbf12a7e345 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746147729.524081:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147729.524232:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e33e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfc5 expref: 26 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.524269:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095234600/0xe64d3fbf12a7e345 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfc5 expref: 25 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.524276:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147729.524279:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147729.524282:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095234600, rc 0) 00000100:00100000:2.0:1746147729.524339:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+25:32316:x1830967794051840:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 4118us (4277us total) trans 8589946074 rc 0/0 00000100:00100000:2.0:1746147729.524350:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12051 00000100:00100000:3.0:1746147729.524379:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+24:1958:x1830967794051968:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 602us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.524386:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8506 00000100:00100000:2.0:1746147729.527569:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.527612:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.527669:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794052096 00000100:00100000:3.0:1746147729.527688:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794052096 00000100:00100000:3.0:1746147729.527737:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794052224 00000100:00100000:3.0:1746147729.527740:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794052224 00000100:00100000:3.0:1746147729.527769:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16713 00000100:00100000:3.0:1746147729.527777:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794052096:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:0.0:1746147729.527793:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16714 00010000:00010000:3.0:1746147729.527795:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147729.527801:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794052224:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147729.527811:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.527812:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e353 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbfcc expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.527821:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7e35a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbfd3 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.527864:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796492416:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147729.527864:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796492288:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147729.527948:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.528850:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147729.530121:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.530230:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794052352 00000100:00100000:3.0:1746147729.530239:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794052352 00000100:00100000:0.0:1746147729.530543:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.530590:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794052608 00000100:00100000:2.0:1746147729.530594:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794052608 00000100:00100000:2.0:1746147729.530620:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12052 00000100:00100000:2.0:1746147729.530625:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32318:x1830967794052608:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147729.530648:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.530666:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095235600/0xe64d3fbf12a7e361 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbfe1 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.530784:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095234c00/0xe64d3fbf12a7e368 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.530799:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095234c00/0xe64d3fbf12a7e368 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.530809:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095234c00/0xe64d3fbf12a7e368 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746147729.530819:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147729.530951:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095235600/0xe64d3fbf12a7e361 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe1 expref: 29 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.530967:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095234c00/0xe64d3fbf12a7e368 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe1 expref: 28 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.530975:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147729.530978:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147729.530981:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095234c00, rc 0) 00000100:00100000:2.0:1746147729.531025:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32318:x1830967794052608:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 399us (483us total) trans 8589946075 rc 0/0 00000100:00100000:2.0:1746147729.531031:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12052 00000100:00100000:3.0:1746147729.531286:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16715 00000100:00100000:3.0:1746147729.531296:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794052352:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147729.531305:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.531317:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a008da00/0xe64d3fbf12a7e376 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbfda expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.531361:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796492544:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147729.532423:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.534284:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.536140:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796492288:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147729.536209:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7e35a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfd3 expref: 9 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.536224:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7e35a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfd3 expref: 9 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.536235:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0300a00, rc 0) 00000100:00100000:2.0:1746147729.536284:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794052224:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 8484us (8670us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147729.536293:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16714 00000100:00100000:2.0:1746147729.536320:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794052736 00000100:00100000:2.0:1746147729.536325:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794052736 00000100:00100000:2.0:1746147729.536355:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16716 00000100:00100000:3.0:1746147729.536356:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796492544:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147729.536361:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32318:x1830967794052736:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147729.536375:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a008da00/0xe64d3fbf12a7e376 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfda expref: 9 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.536376:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.536385:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a008da00/0xe64d3fbf12a7e376 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfda expref: 9 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.536390:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbfe8 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.536398:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a008da00, rc 0) 00010000:00010000:2.0:1746147729.536413:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009545b600/0xe64d3fbf12a7e26c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf08 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.536420:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794052352:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 5126us (6306us total) trans 0 rc 301/301 00010000:00010000:2.0:1746147729.536425:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7e322 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfa9 expref: 7 pid: 21480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147729.536426:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16715 00010000:00010000:2.0:1746147729.536431:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7e2a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf40 expref: 22 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.536436:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.536438:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.536442:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 6/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [2023424->2097151] (req 2023424->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 22 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.536462:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796492416:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147729.536470:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7e2a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf40 expref: 22 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.536475:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e353 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfcc expref: 7 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.536481:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7e2a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf40 expref: 22 pid: 4591 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746147729.536487:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ce2da00/0xe64d3fbf12a7e353 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfcc expref: 7 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.536493:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce2da00, rc 0) 00000100:00100000:2.0:1746147729.536494:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796492672:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147729.536509:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794052096:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 8734us (8952us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147729.536514:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16713 00010000:00010000:2.0:1746147729.536541:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7e322 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfa9 expref: 7 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.536549:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7e322 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfa9 expref: 7 pid: 21480 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.536556:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796492800:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.536579:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009545b600/0xe64d3fbf12a7e26c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf08 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.536586:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009545b600/0xe64d3fbf12a7e26c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf08 expref: 23 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.536592:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796492928:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.536606:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147729.540266:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796492672:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.540280:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796492800:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.540288:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796492928:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.540317:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [2023424->2097151] (req 2023424->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 22 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.540337:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235400, rc 0) 00000100:00100000:2.0:1746147729.541059:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32318:x1830967794052736:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4692us (6781us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.541069:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16716 00000100:00100000:0.0:1746147729.541289:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.541315:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794053376 00000100:00100000:0.0:1746147729.541321:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794053376 00000100:00100000:0.0:1746147729.541370:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12053 00000100:00100000:0.0:1746147729.541377:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+24:32316:x1830967794053376:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147729.541402:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147729.541406:0:5744:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147729.541433:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095234600/0xe64d3fbf12a7e345 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfc5 expref: 24 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.541454:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147729.541459:0:5744:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147729.541469:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0301400/0xe64d3fbf12a7e384 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbfef expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.541560:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147729.541573:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095234c00/0xe64d3fbf12a7e368 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe1 expref: 27 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.541579:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 4/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147729.541606:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095234c00/0xe64d3fbf12a7e368 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe1 expref: 27 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.541616:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095234c00/0xe64d3fbf12a7e368 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe1 expref: 27 pid: 14547 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746147729.541627:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796493056:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147729.541695:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.541770:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.541827:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.541849:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.541864:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794052864 00000100:00100000:0.0:1746147729.541867:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794052864 00010000:00010000:0.0:1746147729.541905:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7e2a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf40 expref: 22 pid: 4591 timeout: 908 lvb_type: 1 00000100:00100000:0.0:1746147729.541922:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794052992 00000100:00100000:0.0:1746147729.541923:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794052992 00010000:00010000:0.0:1746147729.541933:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7e322 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfa9 expref: 8 pid: 21480 timeout: 908 lvb_type: 1 00000100:00100000:0.0:1746147729.541946:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794053120 00000100:00100000:0.0:1746147729.541948:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794053120 00010000:00010000:0.0:1746147729.541955:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009545b600/0xe64d3fbf12a7e26c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf08 expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746147729.541965:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8507 00000100:00100000:0.0:1746147729.541970:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a22d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967794052864:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147729.541978:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147729.541996:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7e2a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf40 expref: 22 pid: 4591 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746147729.542006:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7e2a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf40 expref: 22 pid: 4591 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746147729.542020:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cef5400/0xe64d3fbf12a7e2a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf40 expref: 22 pid: 4591 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746147729.542033:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147729.542052:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a22d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967794052864:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 82us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147729.542058:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8507 00000100:00100000:0.0:1746147729.542104:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8508 00000100:00100000:0.0:1746147729.542109:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794052992:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147729.542115:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147729.542123:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7e322 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfa9 expref: 8 pid: 21480 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746147729.542130:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7e322 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfa9 expref: 8 pid: 21480 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746147729.542141:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7e322 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfa9 expref: 8 pid: 21480 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746147729.542148:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147729.542161:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794052992:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 52us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147729.542166:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8508 00000100:00100000:0.0:1746147729.542175:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8509 00000100:00100000:0.0:1746147729.542180:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794053120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147729.542186:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147729.542192:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009545b600/0xe64d3fbf12a7e26c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf08 expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746147729.542199:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009545b600/0xe64d3fbf12a7e26c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf08 expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746147729.542210:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009545b600/0xe64d3fbf12a7e26c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf08 expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746147729.542218:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147729.542219:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147729.542227:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 20 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.542234:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 20 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.542253:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 20 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147729.542261:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796493184:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147729.542282:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147729.547252:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.547346:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794053504 00000100:00100000:3.0:1746147729.547355:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794053504 00010000:00010000:3.0:1746147729.547390:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095234c00/0xe64d3fbf12a7e368 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe1 expref: 28 pid: 14547 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.547415:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8510 00000100:00100000:3.0:1746147729.547422:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967794053504:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147729.547434:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147729.547439:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095234c00/0xe64d3fbf12a7e368 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe1 expref: 28 pid: 14547 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.547451:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095234c00/0xe64d3fbf12a7e368 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe1 expref: 28 pid: 14547 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.547472:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147729.547477:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147729.547486:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147729.547493:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147729.547510:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147729.547515:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095234c00/0xe64d3fbf12a7e368 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe1 expref: 28 pid: 14547 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746147729.547536:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796493056:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147729.547551:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1957:x1830967794053504:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 129us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.547557:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8510 00010000:00010000:0.0:1746147729.547557:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147729.547565:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147729.547570:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147729.547588:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147729.547593:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147729.547599:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147729.547605:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a932b000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147729.547618:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147729.547624:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147729.547636:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147729.547639:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147729.547642:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147729.547647:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a932b000/0xe64d3fbf12a7e38b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147729.547698:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0301400/0xe64d3fbf12a7e384 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfef expref: 24 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.547702:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796493184:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147729.547706:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0301400/0xe64d3fbf12a7e384 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfef expref: 24 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.547714:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0301400, rc 0) 00010000:00010000:1.0:1746147729.547716:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147729.547756:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794053120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5575us (5906us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147729.547761:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+23:32316:x1830967794053376:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 6384us (6472us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147729.547765:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8509 00000100:00100000:0.0:1746147729.547767:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12053 00000100:00100000:0.0:1746147729.548369:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.549630:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794053760 00000100:00100000:2.0:1746147729.549636:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794053760 00002000:00100000:2.0:1746147729.549667:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (2023424->2027519) req@ffff8800a5d7d880 x1830967794053760/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.549684:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7d880 with x1830967794053760 ext(2023424->2027519) 00002000:00010000:2.0:1746147729.549688:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7d880 00000100:00100000:2.0:1746147729.550936:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7493 00000100:00100000:2.0:1746147729.550944:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794053760:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147729.551104:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794053760:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 160us (2735us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147729.551110:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7493 00002000:00100000:2.0:1746147729.551116:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (2023424->2027519) req@ffff8800a5d7d880 x1830967794053760/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.551122:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7d880 with x1830967794053760 ext(2023424->2027519) 00002000:00010000:2.0:1746147729.551126:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7d880 00000100:00100000:1.0:1746147729.551863:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.552070:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794054016 00000100:00100000:2.0:1746147729.552075:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794054016 00000100:00100000:2.0:1746147729.552099:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5023 00000100:00100000:2.0:1746147729.552104:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+23:32316:x1830967794054016:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:2.0:1746147729.552237:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+24:32316:x1830967794054016:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 133us (375us total) trans 8589946076 rc 0/0 00000100:00100000:2.0:1746147729.552243:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5023 00000100:00100000:0.0:1746147729.557716:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.558011:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794054272 00000100:00100000:2.0:1746147729.558021:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794054272 00002000:00100000:2.0:1746147729.558071:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1077248->1081343) req@ffff8800a5d7e300 x1830967794054272/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.558082:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7e300 with x1830967794054272 ext(1077248->1081343) 00002000:00010000:2.0:1746147729.558087:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7e300 00000100:00100000:2.0:1746147729.558123:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7494 00000100:00100000:2.0:1746147729.558131:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794054272:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147729.558314:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794054272:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 183us (609us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147729.558320:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7494 00002000:00100000:2.0:1746147729.558325:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1077248->1081343) req@ffff8800a5d7e300 x1830967794054272/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.558332:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7e300 with x1830967794054272 ext(1077248->1081343) 00002000:00010000:2.0:1746147729.558335:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7e300 00000100:00100000:0.0:1746147729.558978:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.559002:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794054528 00000100:00100000:0.0:1746147729.559008:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794054528 00000100:00100000:0.0:1746147729.559039:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12054 00000100:00100000:0.0:1746147729.559045:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+348:32320:x1830967794054528:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147729.559062:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147729.559081:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0029400/0xe64d3fbf12a7e392 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbff6 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.559170:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0028c00/0xe64d3fbf12a7e399 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147729.559183:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0028c00/0xe64d3fbf12a7e399 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147729.559194:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0028c00/0xe64d3fbf12a7e399 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:0.0:1746147729.559202:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147729.559303:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0029400/0xe64d3fbf12a7e392 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbff6 expref: 351 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.559316:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0028c00/0xe64d3fbf12a7e399 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbff6 expref: 350 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.559325:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147729.559328:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147729.559331:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0028c00, rc 0) 00000100:00100000:0.0:1746147729.559352:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+350:32320:x1830967794054528:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 307us (376us total) trans 8589946077 rc 0/0 00000100:00100000:0.0:1746147729.559358:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12054 00000100:00100000:0.0:1746147729.561145:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.562378:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794054784 00000100:00100000:1.0:1746147729.562391:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794054784 00000100:00100000:1.0:1746147729.562528:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5024 00000100:00100000:1.0:1746147729.562537:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32318:x1830967794054784:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:1.0:1746147729.563235:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32318:x1830967794054784:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 697us (2098us total) trans 8589946078 rc 0/0 00000100:00100000:1.0:1746147729.563244:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5024 00000100:00100000:0.0:1746147729.601501:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.601596:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794054912 00000100:00100000:2.0:1746147729.601607:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794054912 00000100:00100000:0.0:1746147729.601607:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.601664:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794055040 00000100:00100000:2.0:1746147729.601666:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794055040 00000100:00100000:3.0:1746147729.601807:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16717 00000100:00100000:3.0:1746147729.601820:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794054912:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.601843:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.601862:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091628c00/0xe64d3fbf12a7e3a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafbffd expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.601975:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796493312:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147729.602050:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16718 00000100:00100000:2.0:1746147729.602059:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794055040:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147729.602060:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147729.602075:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.602247:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ce2d800/0xe64d3fbf12a7e3ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc004 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.602295:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796493440:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147729.602370:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.606019:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796493312:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147729.606061:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091628c00/0xe64d3fbf12a7e3a7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbffd expref: 24 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.606077:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091628c00/0xe64d3fbf12a7e3a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbffd expref: 24 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.606109:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091628c00, rc 0) 00000100:00100000:3.0:1746147729.606169:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794054912:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4351us (4678us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147729.606182:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16717 00000100:00100000:2.0:1746147729.606663:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796493440:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147729.606695:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ce2d800/0xe64d3fbf12a7e3ae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc004 expref: 26 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.606703:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ce2d800/0xe64d3fbf12a7e3ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc004 expref: 26 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.606722:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce2d800, rc 0) 00000100:00100000:2.0:1746147729.606746:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794055040:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4688us (5138us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147729.606752:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16718 00000100:00100000:0.0:1746147729.617212:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.617384:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794055296 00000100:00100000:3.0:1746147729.617394:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794055296 00002000:00100000:3.0:1746147729.617446:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (0->774143) req@ffff8800a5d7f480 x1830967794055296/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.617455:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f480 with x1830967794055296 ext(0->774143) 00002000:00010000:3.0:1746147729.617460:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7f480 00000100:00100000:3.0:1746147729.617494:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7495 00000100:00100000:3.0:1746147729.617502:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794055296:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147729.617746:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.617773:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794055552 00000100:00100000:3.0:1746147729.617776:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794055552 00002000:00100000:3.0:1746147729.617792:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1404928->2097151) req@ffff8800a5d7f800 x1830967794055552/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.617799:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f800 with x1830967794055552 ext(1404928->2097151) 00002000:00010000:3.0:1746147729.617802:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7f800 00000100:00100000:3.0:1746147729.617815:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7496 00000100:00100000:3.0:1746147729.617820:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794055552:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147729.629500:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794055552:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11666us (11742us total) trans 0 rc 692224/692224 00000100:00100000:3.0:1746147729.629511:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7496 00002000:00100000:3.0:1746147729.629523:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1404928->2097151) req@ffff8800a5d7f800 x1830967794055552/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.629533:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f800 with x1830967794055552 ext(1404928->2097151) 00002000:00010000:3.0:1746147729.629539:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7f800 00000100:00100000:3.0:1746147729.634410:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794055296:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16897us (17198us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746147729.634423:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7495 00002000:00100000:3.0:1746147729.634434:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (0->774143) req@ffff8800a5d7f480 x1830967794055296/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.634443:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f480 with x1830967794055296 ext(0->774143) 00002000:00010000:3.0:1746147729.634448:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7f480 00000100:00100000:0.0:1746147729.646530:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.646778:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794055680 00000100:00100000:2.0:1746147729.646788:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794055680 00000100:00100000:2.0:1746147729.646842:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16719 00000100:00100000:2.0:1746147729.646850:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:32320:x1830967794055680:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147729.646869:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.646926:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc00b expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.647082:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 16 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.647429:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147729.647432:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147729.647436:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1150976->1880063] (req 1150976->1880063) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 26 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.647471:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 16 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.647482:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 16 pid: 8184 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.647499:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796493568:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.647600:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.653494:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.653541:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.653699:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794055936 00000100:00100000:3.0:1746147729.653707:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794055936 00000100:00100000:3.0:1746147729.653759:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16720 00000100:00100000:3.0:1746147729.653766:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32325:x1830967794055936:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.653785:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.653803:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7e3bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc012 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.653831:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 20 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.653838:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147729.653840:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147729.653842:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7e3bc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc012 expref: 24 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.653874:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 20 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.653918:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 20 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.653929:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796493696:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.654187:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796493568:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.654214:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1150976->1880063] (req 1150976->1880063) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 26 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.654226:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b2e200, rc 0) 00000100:00100000:2.0:1746147729.654268:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32320:x1830967794055680:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 7419us (7749us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.654274:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16719 00000100:00100000:2.0:1746147729.654315:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794055808 00000100:00100000:2.0:1746147729.654318:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794055808 00002000:00100000:2.0:1746147729.654344:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1200127) req@ffff8800a5d7ca80 x1830967794055808/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 504/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.654352:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ca80 with x1830967794055808 ext(1048576->1200127) 00010000:00010000:2.0:1746147729.654359:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 17 pid: 8184 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.654369:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 17 pid: 8184 timeout: 908 lvb_type: 0 00002000:00010000:2.0:1746147729.654375:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d7ca80 00000100:00100000:2.0:1746147729.654388:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1496 00000100:00100000:2.0:1746147729.654393:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794055808:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:3.0:1746147729.656272:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.658842:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.659003:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796493696:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.659033:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7e3bc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc012 expref: 24 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.659051:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5896600, rc 0) 00000100:00100000:3.0:1746147729.659590:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32325:x1830967794055936:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5823us (6104us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.659599:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16720 00000100:00100000:2.0:1746147729.659997:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794056064 00000100:00100000:2.0:1746147729.660004:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794056064 00002000:00100000:2.0:1746147729.660039:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (2023424->2097151) req@ffff88009ce62d80 x1830967794056064/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.660049:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce62d80 with x1830967794056064 ext(2023424->2097151) 00010000:00010000:2.0:1746147729.660056:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 21 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.660067:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 21 pid: 4592 timeout: 908 lvb_type: 0 00002000:00010000:2.0:1746147729.660073:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ce62d80 00000100:00100000:2.0:1746147729.660089:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1497 00000100:00100000:2.0:1746147729.660095:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794056064:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:3.0:1746147729.661386:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794055808:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 6989us (7839us total) trans 17179874395 rc 0/0 00000100:00100000:3.0:1746147729.661394:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1496 00002000:00100000:3.0:1746147729.661400:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1200127) req@ffff8800a5d7ca80 x1830967794055808/t17179874395(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 504/448 e 0 to 0 dl 1746147740 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.661406:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ca80 with x1830967794055808 ext(1048576->1200127) 00010000:00010000:3.0:1746147729.661412:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 19 pid: 8184 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.661422:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 19 pid: 8184 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746147729.661428:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d7ca80 00000100:00100000:0.0:1746147729.665215:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.665235:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.665279:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.665477:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.665595:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794056192 00000100:00100000:1.0:1746147729.665604:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794056192 00000100:00100000:1.0:1746147729.665647:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794056320 00000100:00100000:1.0:1746147729.665648:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794056320 00000100:00100000:1.0:1746147729.665660:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794056448 00000100:00100000:1.0:1746147729.665662:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794056448 00000100:00100000:1.0:1746147729.665672:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794056576 00000100:00100000:1.0:1746147729.665683:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794056576 00000100:00100000:1.0:1746147729.665700:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16721 00000100:00100000:1.0:1746147729.665707:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1958:x1830967794056192:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147729.665726:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.665745:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e3c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc019 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.665799:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796493824:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147729.665871:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c9809c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.665908:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16722 00000100:00100000:1.0:1746147729.665914:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967794056320:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147729.665922:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.665932:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8000/0xe64d3fbf12a7e3ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc020 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.665957:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796493952:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147729.665984:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.665998:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16723 00000100:00100000:1.0:1746147729.666005:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967794056448:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147729.666010:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.666017:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e3d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc027 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.666037:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796494080:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147729.666054:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a299900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.666143:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16724 00000100:00100000:1.0:1746147729.666148:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794056576:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147729.666153:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.666160:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095235200/0xe64d3fbf12a7e3d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc02e expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.666179:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796494208:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147729.666197:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.666951:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967794056064:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 6853us (8116us total) trans 21474841624 rc 0/0 00000100:00100000:3.0:1746147729.666960:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1497 00002000:00100000:3.0:1746147729.666967:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (2023424->2097151) req@ffff88009ce62d80 x1830967794056064/t21474841624(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/448 e 0 to 0 dl 1746147740 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.666976:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce62d80 with x1830967794056064 ext(2023424->2097151) 00010000:00010000:3.0:1746147729.666982:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 27 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.666993:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 27 pid: 4592 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746147729.666999:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ce62d80 00000100:00100000:0.0:1746147729.667795:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.667987:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796493824:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147729.668016:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e3c3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc019 expref: 22 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.668028:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e3c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc019 expref: 22 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.668043:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8800, rc 0) 00000100:00100000:2.0:1746147729.668078:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794056192:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2371us (2874us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147729.668085:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16721 00000100:00100000:2.0:1746147729.668136:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796494080:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147729.668150:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e3d1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc027 expref: 26 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.668160:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e3d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc027 expref: 26 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.668167:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8600, rc 0) 00000100:00100000:2.0:1746147729.668182:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967794056448:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2177us (2902us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147729.668187:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16723 00000100:00100000:2.0:1746147729.668214:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796493952:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147729.668226:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8000/0xe64d3fbf12a7e3ca lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc020 expref: 24 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.668234:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8000/0xe64d3fbf12a7e3ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc020 expref: 24 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.668241:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8000, rc 0) 00000100:00100000:2.0:1746147729.668254:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967794056320:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2341us (3018us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147729.668258:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16722 00000100:00100000:0.0:1746147729.668956:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.669128:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794056704 00000100:00100000:1.0:1746147729.669136:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794056704 00010000:00010000:1.0:1746147729.669169:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 21 pid: 8184 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746147729.669194:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8511 00000100:00100000:1.0:1746147729.669201:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967794056704:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147729.669214:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147729.669232:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 21 pid: 8184 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.669247:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 21 pid: 8184 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.669269:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.669271:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.669278:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1150976->1880063) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 25 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.669286:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1150976->1880063) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 25 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.669315:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1150976->1880063) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 25 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.669327:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796494336:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147729.669328:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794056832 00000100:00100000:2.0:1746147729.669332:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794056832 00000100:00100000:2.0:1746147729.669373:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12055 00000100:00100000:2.0:1746147729.669379:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+24:32329:x1830967794056832:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:1.0:1746147729.669393:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f240 going to sleep for 11 seconds 00010000:00010000:2.0:1746147729.669396:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.669411:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f800/0xe64d3fbf12a7e3df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc035 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.669465:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f400/0xe64d3fbf12a7e3e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.669476:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f400/0xe64d3fbf12a7e3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.669485:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f400/0xe64d3fbf12a7e3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.669496:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f000/0xe64d3fbf12a7e3ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.669502:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f000/0xe64d3fbf12a7e3ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.669506:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f000/0xe64d3fbf12a7e3ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147729.670059:0:8184:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.10@tcp) returned -22 from glimpse AST (req@ffff88009fe97b80 x1830967796494208) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 21 pid: 8184 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.670075:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095235800/0xe64d3fbf12a7e2ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1138688->1200127) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf47 expref: 21 pid: 8184 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.670125:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746147729.670134:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796494208:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147729.670136:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0028c00/0xe64d3fbf12a7e399 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbff6 expref: 349 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.670141:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147729.670155:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095235200/0xe64d3fbf12a7e3d8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc02e expref: 20 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.670160:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0028c00/0xe64d3fbf12a7e399 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbff6 expref: 349 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.670164:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095235200/0xe64d3fbf12a7e3d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc02e expref: 20 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.670171:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235200, rc 0) 00010000:00010000:2.0:1746147729.670173:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0028c00/0xe64d3fbf12a7e399 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbff6 expref: 349 pid: 5744 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.670181:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796494464:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147729.670279:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1958:x1830967794056576:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4129us (4800us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147729.670286:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16724 00000100:00100000:2.0:1746147729.670948:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.671820:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.673061:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794056960 00000100:00100000:3.0:1746147729.673073:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794056960 00010000:00010000:3.0:1746147729.673110:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 23 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.673160:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8512 00000100:00100000:3.0:1746147729.673167:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967794056960:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147729.673182:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147729.673207:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 23 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746147729.673294:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796494336:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147729.673314:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147729.673360:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794056704:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4158us (5565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.673368:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8511 00010000:00010000:3.0:1746147729.673538:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 23 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.673562:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095235400/0xe64d3fbf12a7e37d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfe8 expref: 23 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.673590:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.673592:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.673600:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7e3bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc012 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.673608:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7e3bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc012 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.673642:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7e3bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc012 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.673655:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796494592:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147729.673724:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.674189:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.674717:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794057216 00000100:00100000:3.0:1746147729.674724:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794057216 00000100:00100000:2.0:1746147729.674915:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796494464:192.168.202.10@tcp:104: 00002000:00100000:3.0:1746147729.676408:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1150976->1155071) req@ffff8800a0225180 x1830967794057216/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.676421:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0225180 with x1830967794057216 ext(1150976->1155071) 00002000:00010000:3.0:1746147729.676427:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0225180 00000100:00100000:3.0:1746147729.676464:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7497 00000100:00100000:3.0:1746147729.676477:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794057216:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147729.676666:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794057216:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 193us (2477us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147729.676686:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7497 00002000:00100000:3.0:1746147729.676693:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1150976->1155071) req@ffff8800a0225180 x1830967794057216/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.676700:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0225180 with x1830967794057216 ext(1150976->1155071) 00002000:00010000:3.0:1746147729.676703:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0225180 00010000:00010000:2.0:1746147729.677367:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:2.0:1746147729.677777:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.677842:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794057344 00000100:00100000:1.0:1746147729.677850:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794057344 00000100:00100000:2.0:1746147729.677882:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.677912:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16725 00000100:00100000:2.0:1746147729.677917:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794057472 00000100:00100000:1.0:1746147729.677919:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32328:x1830967794057344:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147729.677920:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794057472 00010000:00010000:1.0:1746147729.677934:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.677940:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0028c00/0xe64d3fbf12a7e399 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbff6 expref: 350 pid: 5744 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.677949:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7e3fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc03c expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.677957:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8513 00000100:00100000:2.0:1746147729.677962:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+350:1959:x1830967794057472:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.677969:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147729.677971:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 25 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.677974:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0028c00/0xe64d3fbf12a7e399 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbff6 expref: 350 pid: 5744 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.677978:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147729.677981:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147729.677984:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0028c00/0xe64d3fbf12a7e399 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbff6 expref: 350 pid: 5744 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.677984:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7e3fb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc03c expref: 19 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.678001:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0028c00/0xe64d3fbf12a7e399 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbff6 expref: 350 pid: 5744 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.678010:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 25 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.678013:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147729.678017:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147729.678020:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 25 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.678026:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746147729.678030:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796494720:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.678032:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.678049:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147729.678096:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f240 going to sleep for 11 seconds 00010000:00010000:3.0:1746147729.678170:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678186:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746147729.678230:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:3.0:1746147729.678235:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147729.678250:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678260:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678269:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f400/0xe64d3fbf12a7e3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678275:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f400/0xe64d3fbf12a7e3e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678281:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f400/0xe64d3fbf12a7e3e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678287:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009576f400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147729.678290:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f400/0xe64d3fbf12a7e3e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678297:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f400/0xe64d3fbf12a7e3e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678305:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147729.678308:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147729.678311:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f400/0xe64d3fbf12a7e3e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678315:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f400/0xe64d3fbf12a7e3e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678327:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f000/0xe64d3fbf12a7e3ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678331:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f000/0xe64d3fbf12a7e3ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678335:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f000/0xe64d3fbf12a7e3ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678339:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009576f000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147729.678341:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f000/0xe64d3fbf12a7e3ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678344:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f000/0xe64d3fbf12a7e3ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678349:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130b32400) 00010000:00010000:3.0:1746147729.678350:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147729.678353:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f000/0xe64d3fbf12a7e3ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678357:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f000/0xe64d3fbf12a7e3ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.678390:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009576f800/0xe64d3fbf12a7e3df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc035 expref: 26 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.678398:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc035 expref: 25 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.678403:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147729.678405:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147729.678407:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009576e200, rc 0) 00000100:00100000:2.0:1746147729.679149:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+349:1959:x1830967794057472:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1179us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.679157:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8513 00000100:00100000:3.0:1746147729.679424:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+25:32329:x1830967794056832:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 10043us (10467us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.679478:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12055 00000100:00100000:2.0:1746147729.679592:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796494592:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147729.679610:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.679646:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967794056960:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6479us (7828us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.679652:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8512 00000100:00100000:0.0:1746147729.681247:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.681300:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.681399:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794057856 00000100:00100000:3.0:1746147729.681408:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794057856 00002000:00100000:3.0:1746147729.681453:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a0225500 x1830967794057856/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.681462:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0225500 with x1830967794057856 ext(1048576->2097151) 00002000:00010000:3.0:1746147729.681468:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0225500 00000100:00100000:3.0:1746147729.681483:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794057984 00000100:00100000:3.0:1746147729.681485:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794057984 00002000:00100000:3.0:1746147729.681496:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a0225880 x1830967794057984/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 504/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.681502:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0225880 with x1830967794057984 ext(1048576->2097151) 00002000:00010000:3.0:1746147729.681506:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0225880 00000100:00100000:3.0:1746147729.681517:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7498 00000100:00100000:3.0:1746147729.681524:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794057856:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147729.681718:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7499 00000100:00100000:2.0:1746147729.681725:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794057984:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147729.689200:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.689235:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.689258:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.689270:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.689295:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.689321:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794058112 00000100:00100000:0.0:1746147729.689330:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794058112 00000100:00100000:1.0:1746147729.689403:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796494720:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147729.689437:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7e3fb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc03c expref: 19 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.689455:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235600, rc 0) 00000100:00100000:1.0:1746147729.689497:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:32328:x1830967794057344:12345-192.168.202.10@tcp:101:cat.0 Request processed in 11578us (11723us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.689505:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16725 00000100:00100000:1.0:1746147729.689660:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794058240 00000100:00100000:1.0:1746147729.689663:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794058240 00000100:00100000:1.0:1746147729.689703:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794058496 00000100:00100000:1.0:1746147729.689706:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794058496 00000100:00100000:1.0:1746147729.689717:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794058368 00000100:00100000:1.0:1746147729.689719:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794058368 00000100:00100000:1.0:1746147729.689726:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794058624 00000100:00100000:1.0:1746147729.689728:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794058624 00000100:00100000:1.0:1746147729.689740:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16726 00000100:00100000:1.0:1746147729.689746:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794058240:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147729.689761:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.689776:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e402 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc043 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.689815:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796494848:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147729.689862:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.689880:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16727 00000100:00100000:1.0:1746147729.689898:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794058496:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147729.689905:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.689915:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095235000/0xe64d3fbf12a7e409 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc051 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.689925:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.689927:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.689934:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095235000/0xe64d3fbf12a7e409 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc051 expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.689946:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095235000/0xe64d3fbf12a7e409 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc051 expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.689952:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235000, rc 0) 00000100:00100000:1.0:1746147729.689965:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794058496:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 81us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.689969:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16727 00000100:00100000:1.0:1746147729.689977:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16728 00000100:00100000:1.0:1746147729.689982:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794058368:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147729.689986:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.689991:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095235e00/0xe64d3fbf12a7e410 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc04a expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.690009:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796494976:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147729.690025:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.690039:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16729 00000100:00100000:1.0:1746147729.690043:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794058624:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147729.690047:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.690054:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e190600/0xe64d3fbf12a7e417 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc058 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.690070:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796495104:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147729.690085:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649fb40 going to sleep for 11 seconds 00002000:00100000:0.0:1746147729.690478:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (774144->1048575) req@ffff8800a0226a00 x1830967794058112/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147729.690488:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0226a00 with x1830967794058112 ext(774144->1048575) 00010000:00010000:0.0:1746147729.690496:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 28 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746147729.690511:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 28 pid: 7050 timeout: 908 lvb_type: 0 00002000:00010000:0.0:1746147729.690518:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0226a00 00000100:00100000:0.0:1746147729.690541:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1498 00000100:00100000:0.0:1746147729.690547:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967794058112:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:3.0:1746147729.700336:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794057856:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 18799us (19084us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147729.700351:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7498 00002000:00100000:3.0:1746147729.700363:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a0225500 x1830967794057856/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.700373:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0225500 with x1830967794057856 ext(1048576->2097151) 00002000:00010000:3.0:1746147729.700380:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0225500 00000100:00100000:1.0:1746147729.702717:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796494848:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147729.702744:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e402 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc043 expref: 9 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.702756:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e402 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc043 expref: 9 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.702774:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235a00, rc 0) 00000100:00100000:1.0:1746147729.702809:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794058240:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 13063us (13621us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147729.702818:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16726 00000100:00100000:2.0:1746147729.703232:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794057984:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 21506us (21930us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746147729.703239:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7499 00002000:00100000:2.0:1746147729.703247:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a0225880 x1830967794057984/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 504/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.703260:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0225880 with x1830967794057984 ext(1048576->2097151) 00002000:00010000:2.0:1746147729.703264:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0225880 00000100:00100000:0.0:1746147729.705014:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967794058112:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 14461us (15712us total) trans 17179874396 rc 0/0 00000100:00100000:0.0:1746147729.705023:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1498 00002000:00100000:0.0:1746147729.705030:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (774144->1048575) req@ffff8800a0226a00 x1830967794058112/t17179874396(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/448 e 0 to 0 dl 1746147740 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147729.705037:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0226a00 with x1830967794058112 ext(774144->1048575) 00010000:00010000:0.0:1746147729.705045:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 28 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746147729.705059:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 28 pid: 7050 timeout: 908 lvb_type: 0 00002000:00010000:0.0:1746147729.705065:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0226a00 00000100:00100000:1.0:1746147729.705205:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796495104:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147729.705226:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e190600/0xe64d3fbf12a7e417 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc058 expref: 7 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.705235:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e190600/0xe64d3fbf12a7e417 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc058 expref: 7 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.705245:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e190600, rc 0) 00000100:00100000:1.0:1746147729.705266:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967794058624:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 15222us (15994us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147729.705272:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16729 00000100:00100000:1.0:1746147729.705869:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796494976:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147729.705910:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095235e00/0xe64d3fbf12a7e410 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc04a expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.705920:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095235e00/0xe64d3fbf12a7e410 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc04a expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.705928:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235e00, rc 0) 00000100:00100000:1.0:1746147729.705959:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794058368:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 15976us (16699us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147729.705965:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16728 00000100:00100000:3.0:1746147729.719426:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.719455:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.719503:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794058752 00000100:00100000:3.0:1746147729.719508:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.719514:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794058752 00000100:00100000:3.0:1746147729.719546:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794059392 00000100:00100000:3.0:1746147729.719552:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794059392 00000100:00100000:1.0:1746147729.719552:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16730 00000100:00100000:1.0:1746147729.719560:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967794058752:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147729.719574:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.719581:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 29 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.719588:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d706600/0xe64d3fbf12a7e41e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc05f expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.719605:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8514 00000100:00100000:3.0:1746147729.719611:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a237bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967794059392:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147729.719622:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147729.719632:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796495232:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147729.719643:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 30 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.719655:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 30 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.719694:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.719695:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147729.719700:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f780 going to sleep for 11 seconds 00010000:00010000:3.0:1746147729.719703:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7e3fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc03c expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.719711:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7e3fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc03c expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.719739:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7e3fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc03c expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.719749:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796495360:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147729.719785:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.720023:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794059264 00000100:00100000:0.0:1746147729.720028:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794059264 00000100:00100000:0.0:1746147729.720055:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5025 00000100:00100000:0.0:1746147729.720060:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+349:32320:x1830967794059264:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:0.0:1746147729.720232:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+350:32320:x1830967794059264:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 170us (774us total) trans 8589946079 rc 0/0 00000100:00100000:0.0:1746147729.720238:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5025 00000100:00100000:2.0:1746147729.720840:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.720967:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794059008 00000100:00100000:3.0:1746147729.720974:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794059008 00000100:00100000:3.0:1746147729.721017:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12056 00000100:00100000:3.0:1746147729.721023:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+25:32329:x1830967794059008:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147729.721037:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.721052:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fffec00/0xe64d3fbf12a7e425 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc066 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.721130:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fffe800/0xe64d3fbf12a7e42c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.721144:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc035 expref: 26 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.721154:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fffe800/0xe64d3fbf12a7e42c lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.721178:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc035 expref: 26 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.721189:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc035 expref: 26 pid: 14547 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.721198:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796495488:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147729.721252:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.723172:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796495360:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147729.723189:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147729.723210:0:20619:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.10@tcp) returned -22 from glimpse AST (req@ffff88009fe95180 x1830967796495232) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 30 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.723239:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7e27a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 774144->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf16 expref: 30 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746147729.723271:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a237bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967794059392:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3658us (3760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.723297:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796495232:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147729.723318:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d706600/0xe64d3fbf12a7e41e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc05f expref: 29 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.723328:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d706600/0xe64d3fbf12a7e41e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc05f expref: 29 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.723335:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d706600, rc 0) 00000100:00100000:1.0:1746147729.723354:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794058752:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3795us (3939us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147729.723360:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16730 00000100:00100000:3.0:1746147729.723402:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796495488:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.723415:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fffe800/0xe64d3fbf12a7e42c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746147729.723487:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8514 00000100:00100000:0.0:1746147729.727914:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.727945:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.727946:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794059648 00000100:00100000:0.0:1746147729.727960:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794059776 00000100:00100000:1.0:1746147729.727963:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794059648 00000100:00100000:0.0:1746147729.727964:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794059776 00010000:00010000:1.0:1746147729.727991:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc035 expref: 27 pid: 14547 timeout: 908 lvb_type: 0 00002000:00100000:0.0:1746147729.727997:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a0224e00 x1830967794059776/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147729.728005:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0224e00 with x1830967794059776 ext(0->1048575) 00002000:00010000:0.0:1746147729.728009:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0224e00 00000100:00100000:0.0:1746147729.728023:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7500 00000100:00100000:1.0:1746147729.728027:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8515 00000100:00100000:0.0:1746147729.728029:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794059776:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147729.728032:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+27:1960:x1830967794059648:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147729.728044:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147729.728050:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc035 expref: 27 pid: 14547 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.728060:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc035 expref: 27 pid: 14547 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.728078:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009576e200/0xe64d3fbf12a7e3f4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc035 expref: 27 pid: 14547 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.728091:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147729.728095:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fffe800/0xe64d3fbf12a7e42c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147729.728102:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fffe800/0xe64d3fbf12a7e42c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147729.728107:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fffe800/0xe64d3fbf12a7e42c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147729.728124:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147729.728157:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+26:1960:x1830967794059648:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 124us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.728165:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8515 00000100:00100000:1.0:1746147729.728276:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.728296:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794059904 00000100:00100000:1.0:1746147729.728299:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794059904 00010000:00010000:3.0:1746147729.728314:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fffe800/0xe64d3fbf12a7e42c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746147729.728315:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16731 00000100:00100000:1.0:1746147729.728320:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794059904:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.728321:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fffe800/0xe64d3fbf12a7e42c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147729.728327:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:3.0:1746147729.728336:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147729.728338:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d707200/0xe64d3fbf12a7e433 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc06d expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.728353:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.728354:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.728360:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d707200/0xe64d3fbf12a7e433 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc06d expref: 28 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.728369:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d707200/0xe64d3fbf12a7e433 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc06d expref: 28 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.728376:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d707200, rc 0) 00000100:00100000:1.0:1746147729.728390:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794059904:12345-192.168.202.10@tcp:101:cat.0 Request processed in 71us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.728394:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16731 00010000:00010000:3.0:1746147729.728443:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fffec00/0xe64d3fbf12a7e425 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc066 expref: 27 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.728459:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fffe800/0xe64d3fbf12a7e42c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc066 expref: 26 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.728464:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147729.728466:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147729.728468:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fffe800, rc 0) 00000100:00100000:3.0:1746147729.728487:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+26:32329:x1830967794059008:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 7465us (7648us total) trans 8589946080 rc 0/0 00000100:00100000:3.0:1746147729.728492:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12056 00000100:00100000:0.0:1746147729.735095:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.735127:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.735163:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794060160 00000100:00100000:1.0:1746147729.735171:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794060160 00000100:00100000:1.0:1746147729.735204:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794060032 00000100:00100000:1.0:1746147729.735206:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794060032 00000100:00100000:0.0:1746147729.735233:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.735238:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794060288 00000100:00100000:1.0:1746147729.735240:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794060288 00000100:00100000:1.0:1746147729.735255:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16732 00000100:00100000:1.0:1746147729.735261:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794060160:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:2.0:1746147729.735493:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16733 00000100:00100000:2.0:1746147729.735500:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794060032:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147729.735515:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.735529:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e441 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc074 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.735547:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.735549:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.735557:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc074 expref: 8 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.735569:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc074 expref: 8 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.735578:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8400, rc 0) 00010000:00010000:1.0:1746147729.735660:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.735670:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d707c00/0xe64d3fbf12a7e448 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc07b expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.735713:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796495616:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147729.735784:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16734 00000100:00100000:3.0:1746147729.735791:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794060288:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147729.735796:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.735802:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348e5e00/0xe64d3fbf12a7e44f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc082 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.735821:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796495744:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147729.736321:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794060032:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 821us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.736327:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16733 00000100:00100000:1.0:1746147729.736328:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147729.736374:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147729.736786:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794059776:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8757us (8839us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147729.736793:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7500 00002000:00100000:2.0:1746147729.736801:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a0224e00 x1830967794059776/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.736809:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0224e00 with x1830967794059776 ext(0->1048575) 00002000:00010000:2.0:1746147729.736813:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0224e00 00000100:00100000:1.0:1746147729.738681:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796495616:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147729.738707:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d707c00/0xe64d3fbf12a7e448 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc07b expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.738719:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d707c00/0xe64d3fbf12a7e448 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc07b expref: 9 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.738728:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d707c00, rc 0) 00000100:00100000:1.0:1746147729.738771:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794060160:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 3509us (3683us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147729.738777:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16732 00000100:00100000:3.0:1746147729.739439:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796495744:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147729.739457:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348e5e00/0xe64d3fbf12a7e44f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc082 expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.739465:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348e5e00/0xe64d3fbf12a7e44f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc082 expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.739476:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e5e00, rc 0) 00000100:00100000:3.0:1746147729.739564:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794060288:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 3772us (4330us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147729.739569:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16734 00000100:00100000:0.0:1746147729.742800:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.742935:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794060544 00000100:00100000:3.0:1746147729.742942:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794060544 00000100:00100000:3.0:1746147729.743039:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12057 00000100:00100000:3.0:1746147729.743047:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+26:32329:x1830967794060544:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147729.743069:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.743072:0:14547:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147729.743093:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fffe800/0xe64d3fbf12a7e42c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc066 expref: 26 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.743107:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147729.743111:0:14547:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147729.743120:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5200/0xe64d3fbf12a7e456 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc089 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.743198:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e45d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.743208:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e45d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.743215:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e45d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746147729.743225:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147729.743321:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5200/0xe64d3fbf12a7e456 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc089 expref: 28 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.743331:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e45d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc089 expref: 27 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.743337:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147729.743339:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147729.743341:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e5000, rc 0) 00000100:00100000:3.0:1746147729.744858:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+27:32329:x1830967794060544:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1809us (2063us total) trans 8589946081 rc 0/0 00000100:00100000:3.0:1746147729.744865:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12057 00000100:00100000:0.0:1746147729.751294:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.751329:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.751359:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794060672 00000100:00100000:3.0:1746147729.751367:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794060672 00000100:00100000:0.0:1746147729.751368:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.751400:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794060800 00000100:00100000:3.0:1746147729.751403:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794060800 00000100:00100000:0.0:1746147729.751405:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794061056 00000100:00100000:0.0:1746147729.751408:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794061056 00000100:00100000:3.0:1746147729.751417:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16735 00000100:00100000:3.0:1746147729.751423:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32328:x1830967794060672:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.751439:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.751456:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc090 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.751483:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.751491:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147729.751492:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147729.751495:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.751521:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.751531:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 23 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.751541:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796495872:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147729.751602:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93909c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.753514:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16736 00000100:00100000:1.0:1746147729.753541:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794060800:12345-192.168.202.10@tcp:1:lfs.0 00000100:00100000:3.0:1746147729.753542:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16737 00010000:00010000:1.0:1746147729.753572:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e472 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.753585:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7e3fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc03c expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.753593:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e441 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc074 expref: 7 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.753599:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d707200/0xe64d3fbf12a7e433 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc06d expref: 27 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.753604:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.753605:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147729.753606:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794061056:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:1.0:1746147729.753607:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e472 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.753624:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d707200/0xe64d3fbf12a7e433 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc06d expref: 27 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.753626:0:8468:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e479 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.753633:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d707200/0xe64d3fbf12a7e433 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc06d expref: 27 pid: 20619 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746147729.753635:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7e3bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc012 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.753641:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095235000/0xe64d3fbf12a7e409 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc051 expref: 8 pid: 20619 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147729.753642:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796496000:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.753645:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.753647:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.753648:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e479 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.753664:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095235000/0xe64d3fbf12a7e409 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc051 expref: 8 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.753671:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095235000/0xe64d3fbf12a7e409 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc051 expref: 8 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746147729.753689:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796496128:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147729.753706:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc074 expref: 7 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.753714:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc074 expref: 7 pid: 8468 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746147729.753718:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7e3bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc012 expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.753721:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796496256:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.753730:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7e3bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc012 expref: 23 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.753737:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796496384:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147729.753748:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7e3fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc03c expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.753753:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe480 going to sleep for 11 seconds 00010000:00010000:1.0:1746147729.753755:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7e3fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc03c expref: 18 pid: 8184 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746147729.753762:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796496512:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147729.753778:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.754522:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.754553:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.754831:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.755402:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.755666:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794061312 00000100:00100000:1.0:1746147729.755666:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794060928 00000100:00100000:2.0:1746147729.755672:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794061312 00000100:00100000:1.0:1746147729.755672:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794060928 00000100:00100000:1.0:1746147729.755710:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794061184 00000100:00100000:1.0:1746147729.755712:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794061184 00000100:00100000:0.0:1746147729.757279:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794061440 00000100:00100000:0.0:1746147729.757286:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794061440 00000100:00100000:0.0:1746147729.757312:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16738 00000100:00100000:0.0:1746147729.757318:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794060928:12345-192.168.202.10@tcp:1:lfs.0 00000100:00100000:2.0:1746147729.757435:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16739 00000100:00100000:2.0:1746147729.757442:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794061312:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:2.0:1746147729.757475:0:21480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e480 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.757490:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090abb400/0xe64d3fbf12a7e273 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf0f expref: 18 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.757498:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e330 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfb7 expref: 9 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.757505:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e38d000/0xe64d3fbf12a7e288 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf24 expref: 27 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.757510:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.757512:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.757515:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e480 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.757541:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e38d000/0xe64d3fbf12a7e288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf24 expref: 27 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147729.757606:0:8184:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7e487 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.757615:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147729.757620:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.757625:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746147729.757627:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7e487 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.757926:0:8184:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.757936:0:8184:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7e487 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.758265:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e38d000/0xe64d3fbf12a7e288 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf24 expref: 27 pid: 8468 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.758278:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796496640:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.758346:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e330 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfb7 expref: 9 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.758353:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e330 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfb7 expref: 9 pid: 21480 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.758361:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796496896:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.758384:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090abb400/0xe64d3fbf12a7e273 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf0f expref: 18 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.758390:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16740 00010000:00010000:2.0:1746147729.758392:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090abb400/0xe64d3fbf12a7e273 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf0f expref: 18 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.758399:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794061184:12345-192.168.202.10@tcp:1:lfs.0 00000100:00100000:2.0:1746147729.758399:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796497024:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.758413:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f180 going to sleep for 11 seconds 00010000:00010000:3.0:1746147729.758417:0:6715:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e48e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.758428:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1880063) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 27 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.758430:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16741 00010000:00010000:3.0:1746147729.758434:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147729.758435:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147729.758437:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e48e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.758437:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794061440:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:3.0:1746147729.758451:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1880063) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 27 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.758452:0:9615:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e495 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.758458:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1880063) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 27 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.758466:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e38ce00/0xe64d3fbf12a7e2b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf4e expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.758467:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094690e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796497152:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.758473:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ce2dc00/0xe64d3fbf12a7e337 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfbe expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.758481:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095234000/0xe64d3fbf12a7e2d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf78 expref: 23 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.758487:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147729.758488:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fee40 going to sleep for 11 seconds 00010000:00010000:2.0:1746147729.758488:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.758490:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e495 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.758504:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095234000/0xe64d3fbf12a7e2d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf78 expref: 23 pid: 21480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147729.758510:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796495872:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.758513:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095234000/0xe64d3fbf12a7e2d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf78 expref: 23 pid: 21480 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.758522:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796497280:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.758525:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.758534:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e5a00, rc 0) 00010000:00010000:2.0:1746147729.758546:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ce2dc00/0xe64d3fbf12a7e337 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfbe expref: 10 pid: 21480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147729.758552:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:32328:x1830967794060672:12345-192.168.202.10@tcp:101:cat.0 Request processed in 7129us (7266us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147729.758554:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ce2dc00/0xe64d3fbf12a7e337 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfbe expref: 10 pid: 21480 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746147729.758558:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16735 00000100:00100000:2.0:1746147729.758567:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796497408:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147729.758584:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796496128:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.758588:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e38ce00/0xe64d3fbf12a7e2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf4e expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.758591:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796496384:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.758596:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e38ce00/0xe64d3fbf12a7e2b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf4e expref: 23 pid: 8468 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.758603:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796497536:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.758605:0:8468:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e479 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.758615:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.758702:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796496000:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147729.758709:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796496256:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147729.758716:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796496512:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147729.758728:0:20619:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e472 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147729.759021:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.759227:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794061824 00000100:00100000:3.0:1746147729.759231:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794061824 00010000:00010000:3.0:1746147729.759247:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095235000/0xe64d3fbf12a7e409 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc051 expref: 11 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746147729.759274:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8516 00000100:00100000:3.0:1746147729.759279:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967794061824:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147729.759287:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147729.759304:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095235000/0xe64d3fbf12a7e409 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc051 expref: 11 pid: 20619 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746147729.759317:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095235000/0xe64d3fbf12a7e409 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc051 expref: 11 pid: 20619 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746147729.759333:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095235000/0xe64d3fbf12a7e409 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc051 expref: 11 pid: 20619 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746147729.759342:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147729.759358:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967794061824:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 79us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.759363:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8516 00000100:00100000:0.0:1746147729.771597:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.771663:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.771698:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.771720:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794062080 00000100:00100000:0.0:1746147729.771725:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794062080 00000100:00100000:2.0:1746147729.771734:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796497280:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.771754:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796496640:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147729.771756:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7e3bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc012 expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.771762:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796496896:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.771770:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796497024:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147729.771783:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794061952 00000100:00100000:0.0:1746147729.771785:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794061952 00010000:00010000:2.0:1746147729.771793:0:21480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e480 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.771796:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc074 expref: 10 pid: 8468 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746147729.771800:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794062336 00000100:00100000:3.0:1746147729.771805:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794062336 00000100:00100000:0.0:1746147729.771812:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8517 00000100:00100000:0.0:1746147729.771819:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794062080:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147729.771820:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7e3fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc03c expref: 19 pid: 8184 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.771823:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8518 00000100:00100000:2.0:1746147729.771830:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794061952:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147729.771830:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147729.771837:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8519 00010000:00010000:2.0:1746147729.771839:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147729.771842:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794062336:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147729.771847:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7e3bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc012 expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.771849:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.771852:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc074 expref: 10 pid: 8468 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746147729.771855:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7e3bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc012 expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.771857:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7e3fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc03c expref: 19 pid: 8184 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.771865:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7e3fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc03c expref: 19 pid: 8184 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.771879:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc074 expref: 10 pid: 8468 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.771910:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e441 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc074 expref: 10 pid: 8468 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.771925:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.771956:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794061952:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 126us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.771962:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8518 00000100:00100000:2.0:1746147729.771996:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094690e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796497152:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.772012:0:6715:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e48e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.772055:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7e3fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc03c expref: 19 pid: 8184 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.772056:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147729.772068:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.772069:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794062592 00000100:00100000:2.0:1746147729.772072:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794062592 00010000:00010000:2.0:1746147729.772084:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095234000/0xe64d3fbf12a7e2d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf78 expref: 23 pid: 21480 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746147729.772086:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794062336:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 244us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.772091:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8519 00000100:00100000:2.0:1746147729.772101:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8520 00000100:00100000:2.0:1746147729.772106:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967794062592:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.772111:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.772121:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095234000/0xe64d3fbf12a7e2d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf78 expref: 23 pid: 21480 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.772134:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095234000/0xe64d3fbf12a7e2d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf78 expref: 23 pid: 21480 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.772145:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095234000/0xe64d3fbf12a7e2d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf78 expref: 23 pid: 21480 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.772154:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.772167:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967794062592:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 61us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.772172:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8520 00000100:00100000:2.0:1746147729.772213:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.772253:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.772288:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794061696 00000100:00100000:3.0:1746147729.772291:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794061696 00000100:00100000:2.0:1746147729.772300:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147729.772302:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d707200/0xe64d3fbf12a7e433 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc06d expref: 28 pid: 20619 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.772316:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.772320:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794062208 00000100:00100000:3.0:1746147729.772322:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794062208 00000100:00100000:2.0:1746147729.772328:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8521 00010000:00010000:3.0:1746147729.772329:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e330 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfb7 expref: 9 pid: 21480 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746147729.772333:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a237b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794061696:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.772339:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147729.772341:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8522 00000100:00100000:3.0:1746147729.772345:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794062208:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.772347:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d707200/0xe64d3fbf12a7e433 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc06d expref: 28 pid: 20619 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746147729.772353:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.772355:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d707200/0xe64d3fbf12a7e433 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc06d expref: 28 pid: 20619 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746147729.772362:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e330 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfb7 expref: 9 pid: 21480 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.772366:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d707200/0xe64d3fbf12a7e433 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc06d expref: 28 pid: 20619 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746147729.772369:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e330 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfb7 expref: 9 pid: 21480 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.772378:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.772379:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ce2d200/0xe64d3fbf12a7e330 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfb7 expref: 9 pid: 21480 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.772380:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.772384:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e472 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.772392:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e472 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.772393:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147729.772404:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7e3bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc012 expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.772408:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147729.772410:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794062208:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 64us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.772415:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8522 00010000:00010000:0.0:1746147729.772418:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147729.772419:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147729.772421:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a237b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794061696:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 88us (208us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147729.772422:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e479 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.772426:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8521 00000100:00100000:3.0:1746147729.772431:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794061568 00010000:00010000:0.0:1746147729.772432:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e479 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.772433:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794061568 00010000:00010000:1.0:1746147729.772445:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e472 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.772446:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.772449:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147729.772452:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e472 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147729.772454:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1404927) req@ffff8800954c2d80 x1830967794061568/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.772461:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c2d80 with x1830967794061568 ext(1048576->1404927) 00000100:00100000:0.0:1746147729.772461:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794062080:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 643us (872us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147729.772467:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746147729.772467:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8517 00010000:00010000:1.0:1746147729.772468:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e472 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.772474:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 23 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746147729.772479:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e472 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147729.772480:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800954c2d80 00010000:00010000:1.0:1746147729.772485:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e472 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.772486:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796497408:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147729.772490:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794062464 00010000:00010000:1.0:1746147729.772491:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095235a00 already unused, calling callback (ffffffffa087ad70) 00000100:00100000:0.0:1746147729.772491:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794062720 00000100:00100000:3.0:1746147729.772492:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794062464 00000100:00100000:0.0:1746147729.772493:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794062720 00010000:00010000:1.0:1746147729.772494:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e472 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.772501:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e472 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.772501:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090abb400/0xe64d3fbf12a7e273 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf0f expref: 18 pid: 7050 timeout: 908 lvb_type: 0 00002000:00100000:3.0:1746147729.772502:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x457:0x0] (1150976->1880063) req@ffff8800954c3100 x1830967794062464/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.772508:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c3100 with x1830967794062464 ext(1150976->1880063) 00000100:00100000:2.0:1746147729.772508:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147729.772510:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e472 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.772512:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 27 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746147729.772512:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794062848 00000100:00100000:0.0:1746147729.772513:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794062848 00010000:00010000:1.0:1746147729.772515:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7e472 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.772518:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 28 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.772519:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8523 00010000:00010000:0.0:1746147729.772520:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e38d000/0xe64d3fbf12a7e288 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf24 expref: 28 pid: 8468 timeout: 908 lvb_type: 1 00002000:00010000:3.0:1746147729.772524:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800954c3100 00000100:00100000:2.0:1746147729.772524:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794062720:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.772529:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147729.772530:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8524 00000100:00100000:3.0:1746147729.772533:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1499 00000100:00100000:0.0:1746147729.772535:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967794062848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147729.772537:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794061568:12345-192.168.202.10@tcp:4:cat.0 00010000:00010000:2.0:1746147729.772538:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090abb400/0xe64d3fbf12a7e273 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf0f expref: 18 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746147729.772540:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.772545:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090abb400/0xe64d3fbf12a7e273 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf0f expref: 18 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746147729.772551:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794060800:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 19015us (21221us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147729.772554:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e38d000/0xe64d3fbf12a7e288 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf24 expref: 28 pid: 8468 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.772556:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090abb400/0xe64d3fbf12a7e273 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf0f expref: 18 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746147729.772558:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16736 00010000:00010000:0.0:1746147729.772561:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e38d000/0xe64d3fbf12a7e288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf24 expref: 28 pid: 8468 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746147729.772575:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147729.772581:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e38d000/0xe64d3fbf12a7e288 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf24 expref: 28 pid: 8468 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746147729.772588:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147729.772589:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967794062720:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 65us (139us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147729.772589:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147729.772592:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e480 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.772594:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8523 00010000:00010000:0.0:1746147729.772597:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e480 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147729.772608:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147729.772608:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.772612:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1500 00000100:00100000:2.0:1746147729.772617:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794062464:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147729.772617:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794062976 00000100:00100000:1.0:1746147729.772620:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794062976 00000100:00100000:0.0:1746147729.772621:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967794062848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 86us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147729.772626:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8524 00010000:00010000:1.0:1746147729.772630:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce2dc00/0xe64d3fbf12a7e337 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfbe expref: 10 pid: 21480 timeout: 908 lvb_type: 1 00000100:00100000:1.0:1746147729.772650:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8525 00000100:00100000:1.0:1746147729.772655:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967794062976:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147729.772661:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147729.772668:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ce2dc00/0xe64d3fbf12a7e337 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfbe expref: 10 pid: 21480 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746147729.772687:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ce2dc00/0xe64d3fbf12a7e337 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfbe expref: 10 pid: 21480 timeout: 908 lvb_type: 1 00000100:00100000:0.0:1746147729.772691:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147729.772697:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ce2dc00/0xe64d3fbf12a7e337 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbfbe expref: 10 pid: 21480 timeout: 908 lvb_type: 1 00000100:00100000:0.0:1746147729.772700:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794063104 00000100:00100000:0.0:1746147729.772703:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794063104 00010000:00010000:1.0:1746147729.772705:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147729.772712:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e38ce00/0xe64d3fbf12a7e2b2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf4e expref: 24 pid: 8468 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746147729.772717:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794062976:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 63us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.772723:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8525 00000100:00100000:0.0:1746147729.772725:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8526 00000100:00100000:0.0:1746147729.772729:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794063104:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147729.772734:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147729.772740:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e38ce00/0xe64d3fbf12a7e2b2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf4e expref: 24 pid: 8468 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746147729.772751:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e38ce00/0xe64d3fbf12a7e2b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf4e expref: 24 pid: 8468 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746147729.772760:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147729.772762:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147729.772764:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.772770:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e495 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.772779:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147729.772792:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794063104:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 62us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147729.772797:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8526 00010000:00010000:3.0:1746147729.772823:0:8468:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e479 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.772830:0:8468:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e479 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.772841:0:8468:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e479 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.772846:0:8468:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e479 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.772852:0:8468:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e479 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.772856:0:8468:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800915e6e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147729.772858:0:8468:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e479 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.772863:0:8468:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e479 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.772876:0:8468:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e479 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.772881:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e479 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.772935:0:21480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e480 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.772942:0:21480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e480 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.772954:0:21480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e480 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.772958:0:21480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e480 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.772967:0:21480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e480 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.772971:0:21480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a09a9400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147729.772974:0:21480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e480 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.772979:0:21480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e480 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.772986:0:21480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e480 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.772990:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e480 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147729.773031:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967794061312:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 15591us (18511us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147729.773037:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16739 00010000:00010000:2.0:1746147729.773228:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e38ce00/0xe64d3fbf12a7e2b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf4e expref: 24 pid: 8468 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.773237:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796497536:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.773253:0:9615:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.773260:0:9615:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.773266:0:9615:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.773274:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794061056:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 19587us (21820us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147729.773278:0:9615:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.773281:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16737 00010000:00010000:2.0:1746147729.773283:0:9615:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e495 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.773293:0:9615:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e495 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.773298:0:9615:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a09a8200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147729.773301:0:9615:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e495 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.773306:0:9615:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.773315:0:9615:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e495 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.773320:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e495 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.773343:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794061440:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 14907us (17941us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.773348:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16741 00000100:00100000:3.0:1746147729.782300:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794061568:12345-192.168.202.10@tcp:4:cat.0 Request processed in 9753us (10038us total) trans 21474841625 rc 0/0 00000100:00100000:3.0:1746147729.782311:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1499 00002000:00100000:3.0:1746147729.782322:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1404927) req@ffff8800954c2d80 x1830967794061568/t21474841625(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/448 e 0 to 0 dl 1746147740 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.782331:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c2d80 with x1830967794061568 ext(1048576->1404927) 00010000:00010000:3.0:1746147729.782340:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.782351:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746147729.782357:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800954c2d80 00000100:00100000:2.0:1746147729.786475:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.786936:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794063232 00000100:00100000:2.0:1746147729.786946:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794063232 00010000:00010000:2.0:1746147729.787250:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.787279:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8527 00000100:00100000:2.0:1746147729.787289:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794063232:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.787302:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.787324:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.787336:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.787360:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a59f9a00/0xe64d3fbf12a7e281 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbf1d expref: 24 pid: 7050 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.787376:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.787378:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.787386:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.787394:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.787427:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.787437:0:7095:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 21 pid: 10613 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.787447:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796497664:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147729.787540:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.787992:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.790196:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794063488 00000100:00100000:2.0:1746147729.790210:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794063488 00000100:00100000:2.0:1746147729.790794:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12058 00000100:00100000:2.0:1746147729.790804:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32333:x1830967794063488:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147729.790829:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.790850:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8000/0xe64d3fbf12a7e49c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc097 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.790975:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.790991:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e45d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc089 expref: 26 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.790998:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.791030:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e45d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc089 expref: 26 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.791040:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e45d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc089 expref: 26 pid: 14547 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.791051:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796497792:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.791141:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147729.791250:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796497664:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147729.791268:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.791291:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794063232:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4004us (4828us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.791304:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8527 00000100:00100000:3.0:1746147729.791522:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794062464:12345-192.168.202.10@tcp:4:cat.0 Request processed in 18896us (19213us total) trans 17179874397 rc 0/0 00000100:00100000:3.0:1746147729.791537:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1500 00002000:00100000:3.0:1746147729.791547:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1150976->1880063) req@ffff8800954c3100 x1830967794062464/t17179874397(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/448 e 0 to 0 dl 1746147740 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.791555:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c3100 with x1830967794062464 ext(1150976->1880063) 00010000:00010000:3.0:1746147729.791564:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 28 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.791575:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 28 pid: 4592 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746147729.791582:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800954c3100 00000100:00100000:0.0:1746147729.793861:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.794115:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794063744 00000100:00100000:3.0:1746147729.794123:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794063744 00002000:00100000:3.0:1746147729.794158:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880094339880 x1830967794063744/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.794167:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094339880 with x1830967794063744 ext(1048576->2097151) 00010000:00010000:3.0:1746147729.794174:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 22 pid: 10613 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.794193:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 22 pid: 10613 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746147729.794200:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094339880 00000100:00100000:3.0:1746147729.794222:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1501 00000100:00100000:3.0:1746147729.794229:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967794063744:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147729.796401:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147729.796472:0:20300:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147729.796535:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794063872 00000100:00100000:2.0:1746147729.796540:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794063872 00010000:00010000:2.0:1746147729.796563:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e45d lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc089 expref: 27 pid: 14547 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.796584:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8528 00000100:00100000:2.0:1746147729.796589:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a237b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+27:1959:x1830967794063872:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.796600:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.796604:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e45d lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc089 expref: 27 pid: 14547 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.796614:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e45d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc089 expref: 27 pid: 14547 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.796630:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147729.796634:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.796641:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.796647:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147729.796661:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.796691:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a237b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+27:1959:x1830967794063872:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 101us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.796697:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8528 00010000:00010000:3.0:1746147729.796880:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e45d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc089 expref: 26 pid: 14547 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746147729.797023:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796497792:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.797036:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.797042:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147729.797046:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746147729.797059:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147729.797169:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8000/0xe64d3fbf12a7e49c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc097 expref: 31 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.797178:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc097 expref: 30 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.797184:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147729.797186:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147729.797188:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8600, rc 0) 00000100:00100000:3.0:1746147729.798569:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:32333:x1830967794063488:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 7764us (10581us total) trans 8589946082 rc 0/0 00000100:00100000:3.0:1746147729.798575:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12058 00000100:00100000:1.0:1746147729.800037:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.800135:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794064000 00000100:00100000:0.0:1746147729.800142:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794064000 00010000:00010000:0.0:1746147729.800167:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 28 pid: 4592 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746147729.800200:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8529 00000100:00100000:0.0:1746147729.800206:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794064000:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147729.800215:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147729.800230:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1150976->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 28 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746147729.800239:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1150976->1880063) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 28 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746147729.800255:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094b2e200/0xe64d3fbf12a7e3b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1150976->1880063) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc00b expref: 28 pid: 4592 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746147729.800268:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147729.800270:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147729.800274:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e48e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.800281:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e48e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147729.800297:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147729.800327:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794064000:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 120us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147729.800332:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8529 00010000:00010000:2.0:1746147729.800380:0:6715:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e48e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.800388:0:6715:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e48e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.800405:0:6715:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e48e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.800412:0:6715:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e48e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.800418:0:6715:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e48e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.800424:0:6715:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095150800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147729.800427:0:6715:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e48e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.800432:0:6715:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e48e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.800440:0:6715:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e48e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.800446:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e48e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.800500:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+5:1960:x1830967794061184:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 42104us (45676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.800506:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16740 00000100:00100000:3.0:1746147729.801039:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967794063744:12345-192.168.202.10@tcp:3:cat.0 Request processed in 6810us (7184us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147729.801050:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1501 00002000:00100000:3.0:1746147729.801057:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880094339880 x1830967794063744/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.801065:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094339880 with x1830967794063744 ext(1048576->2097151) 00010000:00010000:3.0:1746147729.801070:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 22 pid: 10613 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746147729.801080:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 22 pid: 10613 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746147729.801085:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094339880 00000100:00100000:0.0:1746147729.816436:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.816818:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794064128 00000100:00100000:2.0:1746147729.816827:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794064128 00000100:00100000:2.0:1746147729.816909:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16742 00000100:00100000:2.0:1746147729.816916:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32328:x1830967794064128:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147729.816931:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.816948:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e4b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc09e expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147729.816971:0:6715:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x68141992, atime: 0x68141992, ctime: 0x68141992, blocks: 0x81d 00010000:00010000:2.0:1746147729.816987:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.816988:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.816995:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e4b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc09e expref: 23 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.817007:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e4b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc09e expref: 23 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.817015:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8800, rc 0) 00000100:00100000:2.0:1746147729.817069:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:32328:x1830967794064128:12345-192.168.202.10@tcp:101:cat.0 Request processed in 154us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.817075:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16742 00000100:00100000:0.0:1746147729.817627:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.819716:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794064256 00000100:00100000:2.0:1746147729.819725:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794064256 00010000:00010000:2.0:1746147729.819757:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 23 pid: 10613 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746147729.819792:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8530 00000100:00100000:2.0:1746147729.819798:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1957:x1830967794064256:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.819809:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.819828:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 23 pid: 10613 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.819838:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 23 pid: 10613 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.819858:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801348e5a00/0xe64d3fbf12a7e46b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc090 expref: 23 pid: 10613 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746147729.819915:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.819916:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.819920:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7e487 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.819927:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7e487 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.819953:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.819989:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967794064256:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 192us (2366us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.819994:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8530 00010000:00010000:1.0:1746147729.820912:0:8184:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7e487 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.820922:0:8184:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7e487 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.820943:0:8184:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7e487 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.820950:0:8184:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7e487 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.820957:0:8184:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7e487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.820962:0:8184:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a2127e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147729.820966:0:8184:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7e487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.820973:0:8184:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7e487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.820983:0:8184:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7e487 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.820987:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2127e00/0xe64d3fbf12a7e487 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.821038:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.821093:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794064512 00000100:00100000:2.0:1746147729.821097:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794064512 00002000:00100000:2.0:1746147729.821122:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880135848700 x1830967794064512/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.821130:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848700 with x1830967794064512 ext(1048576->2097151) 00002000:00010000:2.0:1746147729.821133:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135848700 00000100:00100000:2.0:1746147729.821146:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7501 00000100:00100000:2.0:1746147729.821150:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794064512:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147729.821583:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967794060928:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 64264us (67027us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.821591:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16738 00000100:00100000:2.0:1746147729.828198:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794064512:12345-192.168.202.10@tcp:3:cat.0 Request processed in 7033us (7147us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147729.828211:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7501 00002000:00100000:2.0:1746147729.828223:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880135848700 x1830967794064512/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.828234:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848700 with x1830967794064512 ext(1048576->2097151) 00002000:00010000:2.0:1746147729.828239:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135848700 00000100:00100000:0.0:1746147729.829096:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.829178:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794064768 00000100:00100000:3.0:1746147729.829191:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794064768 00000100:00100000:1.0:1746147729.829315:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12059 00000100:00100000:1.0:1746147729.829326:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+26:32329:x1830967794064768:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:1.0:1746147729.829370:0:5744:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1746147729.829617:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00f6200/0xe64d3fbf12a7e1a1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe67 expref: 26 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.829637:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5642000/0xe64d3fbf12a7e17e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafbe59 expref: 25 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.829645:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147729.829649:0:5744:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147729.829725:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+24:32329:x1830967794064768:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 401us (635us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746147729.829730:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12059 00000100:00100000:0.0:1746147729.833589:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.834119:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794065024 00000100:00100000:3.0:1746147729.834129:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794065024 00000100:00100000:3.0:1746147729.834175:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5026 00000100:00100000:3.0:1746147729.834183:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095028050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+24:32329:x1830967794065024:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1746147729.834342:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.834389:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794065152 00000100:00100000:1.0:1746147729.834399:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794065152 00000100:00100000:1.0:1746147729.834441:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16743 00000100:00100000:1.0:1746147729.834448:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32328:x1830967794065152:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147729.834465:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.834483:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095235200/0xe64d3fbf12a7e4b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc0a5 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147729.834502:0:8184:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x68141992, atime: 0x68141992, ctime: 0x68141992, blocks: 0x821 00010000:00010000:1.0:1746147729.834518:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.834520:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.834525:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095235200/0xe64d3fbf12a7e4b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0a5 expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.834541:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095235200/0xe64d3fbf12a7e4b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0a5 expref: 18 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.834555:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235200, rc 0) 00000100:00100000:1.0:1746147729.834603:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32328:x1830967794065152:12345-192.168.202.10@tcp:101:cat.0 Request processed in 155us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.834609:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16743 00000100:00100000:3.0:1746147729.835199:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095028050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+25:32329:x1830967794065024:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 1015us (1623us total) trans 8589946083 rc 0/0 00000100:00100000:3.0:1746147729.835207:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5026 00000100:00100000:0.0:1746147729.836584:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.836681:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794065408 00000100:00100000:3.0:1746147729.836687:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794065408 00000100:00100000:3.0:1746147729.836721:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5027 00000100:00100000:3.0:1746147729.836728:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+25:32329:x1830967794065408:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:3.0:1746147729.838073:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+26:32329:x1830967794065408:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 1337us (1483us total) trans 8589946084 rc 0/0 00000100:00100000:3.0:1746147729.838086:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5027 00000100:00100000:0.0:1746147729.840232:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.840449:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794065664 00000100:00100000:2.0:1746147729.840458:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794065664 00002000:00100000:2.0:1746147729.840506:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009433aa00 x1830967794065664/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.840516:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433aa00 with x1830967794065664 ext(1048576->2097151) 00002000:00010000:2.0:1746147729.840521:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009433aa00 00000100:00100000:2.0:1746147729.840540:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7502 00000100:00100000:2.0:1746147729.840546:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794065664:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147729.851101:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794065664:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10541us (10862us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147729.851115:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7502 00002000:00100000:2.0:1746147729.851127:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009433aa00 x1830967794065664/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.851138:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433aa00 with x1830967794065664 ext(1048576->2097151) 00002000:00010000:2.0:1746147729.851144:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009433aa00 00000100:00100000:0.0:1746147729.858620:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.858663:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.858698:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.858725:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794065792 00000100:00100000:0.0:1746147729.858735:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794065792 00000100:00100000:0.0:1746147729.858786:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794066048 00000100:00100000:0.0:1746147729.858789:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794066048 00000100:00100000:0.0:1746147729.858803:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794065920 00000100:00100000:0.0:1746147729.858805:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794065920 00000100:00100000:0.0:1746147729.858826:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16744 00000100:00100000:0.0:1746147729.858834:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1957:x1830967794065792:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147729.858856:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147729.858875:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5642000/0xe64d3fbf12a7e4bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc0ac expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.858919:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16745 00000100:00100000:2.0:1746147729.858928:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1957:x1830967794066048:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147729.858936:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.858946:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d707c00/0xe64d3fbf12a7e4c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc0ba expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147729.858962:0:6715:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x458:0x0] initial LVB size: 5013696, mtime: 0x68141992, atime: 0x68141991, ctime: 0x68141992, blocks: 0x1691 00010000:00010000:2.0:1746147729.858982:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.858984:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.858993:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d707c00/0xe64d3fbf12a7e4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ba expref: 20 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.859009:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d707c00/0xe64d3fbf12a7e4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ba expref: 20 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.859020:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d707c00, rc 0) 00000100:00100000:3.0:1746147729.859061:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16746 00000100:00100000:3.0:1746147729.859070:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967794065920:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147729.859070:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1957:x1830967794066048:12345-192.168.202.10@tcp:101:cat.0 Request processed in 144us (405us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147729.859078:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147729.859079:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16745 00010000:00010000:3.0:1746147729.859091:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095151400/0xe64d3fbf12a7e4cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc0b3 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.859135:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.859142:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794066176 00000100:00100000:1.0:1746147729.859146:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794066176 00000100:00100000:1.0:1746147729.859170:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16747 00000100:00100000:1.0:1746147729.859176:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1957:x1830967794066176:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147729.859182:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.859191:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd84c00/0xe64d3fbf12a7e4d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc0c1 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147729.859207:0:20619:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x456:0x0] initial LVB size: 4194304, mtime: 0x68141992, atime: 0x68141992, ctime: 0x68141992, blocks: 0x1029 00010000:00010000:1.0:1746147729.859217:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.859218:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.859223:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd84c00/0xe64d3fbf12a7e4d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c1 expref: 24 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.859235:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd84c00/0xe64d3fbf12a7e4d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c1 expref: 24 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.859242:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd84c00, rc 0) 00000100:00100000:1.0:1746147729.859263:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967794066176:12345-192.168.202.10@tcp:101:cat.0 Request processed in 88us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.859269:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16747 00002000:00010000:0.0:1746147729.859311:0:9615:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x68141992, atime: 0x68141992, ctime: 0x68141992, blocks: 0x7c7 00010000:00010000:0.0:1746147729.859321:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147729.859322:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147729.859327:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5642000/0xe64d3fbf12a7e4bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ac expref: 20 pid: 9615 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746147729.859332:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x68141992, atime: 0x68141992, ctime: 0x68141992, blocks: 0x81f 00010000:00010000:0.0:1746147729.859335:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5642000/0xe64d3fbf12a7e4bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ac expref: 20 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147729.859347:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5642000, rc 0) 00010000:00010000:3.0:1746147729.859361:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.859362:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147729.859365:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1957:x1830967794065792:12345-192.168.202.10@tcp:101:cat.0 Request processed in 532us (757us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147729.859366:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095151400/0xe64d3fbf12a7e4cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0b3 expref: 24 pid: 8468 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147729.859370:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16744 00010000:00010000:3.0:1746147729.859376:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095151400/0xe64d3fbf12a7e4cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0b3 expref: 24 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.859382:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095151400, rc 0) 00000100:00100000:3.0:1746147729.859397:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967794065920:12345-192.168.202.10@tcp:101:cat.0 Request processed in 329us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.859402:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16746 00000100:00100000:0.0:1746147729.871332:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.871371:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.871403:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.871428:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794066432 00000100:00100000:2.0:1746147729.871449:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794066432 00000100:00100000:1.0:1746147729.871454:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794066688 00000100:00100000:0.0:1746147729.871456:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.871461:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794066688 00000100:00100000:0.0:1746147729.871473:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794066944 00000100:00100000:0.0:1746147729.871475:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794066944 00002000:00100000:1.0:1746147729.871498:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009433bb80 x1830967794066688/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147729.871498:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880094338e00 x1830967794066944/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.871508:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433bb80 with x1830967794066688 ext(3145728->4194303) 00002000:00100000:0.0:1746147729.871508:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094338e00 with x1830967794066944 ext(2097152->3145727) 00002000:00010000:1.0:1746147729.871513:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009433bb80 00002000:00010000:0.0:1746147729.871513:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094338e00 00000100:00100000:0.0:1746147729.871527:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794067072 00000100:00100000:0.0:1746147729.871528:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794067072 00002000:00100000:2.0:1746147729.871542:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009433b800 x1830967794066432/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147729.871544:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a0224700 x1830967794067072/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147729.871550:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0224700 with x1830967794067072 ext(3145728->4194303) 00002000:00100000:2.0:1746147729.871552:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433b800 with x1830967794066432 ext(2097152->3145727) 00002000:00010000:0.0:1746147729.871552:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0224700 00002000:00010000:2.0:1746147729.871557:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009433b800 00000100:00100000:1.0:1746147729.871707:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7503 00000100:00100000:0.0:1746147729.871713:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7504 00000100:00100000:1.0:1746147729.871715:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967794066944:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147729.871718:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794066688:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147729.871733:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7505 00000100:00100000:2.0:1746147729.871742:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1957:x1830967794067072:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147729.871984:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7506 00000100:00100000:3.0:1746147729.871997:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794066432:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147729.887323:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794067072:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15574us (15858us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147729.887333:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7505 00002000:00100000:2.0:1746147729.887344:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a0224700 x1830967794067072/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.887352:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0224700 with x1830967794067072 ext(3145728->4194303) 00002000:00010000:2.0:1746147729.887358:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0224700 00000100:00100000:3.0:1746147729.890268:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794066432:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18265us (18936us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147729.890281:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7506 00002000:00100000:3.0:1746147729.890294:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009433b800 x1830967794066432/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147729.890303:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433b800 with x1830967794066432 ext(2097152->3145727) 00002000:00010000:3.0:1746147729.890308:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009433b800 00000100:00100000:1.0:1746147729.890982:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967794066944:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19262us (19573us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147729.890998:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7503 00002000:00100000:1.0:1746147729.891006:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880094338e00 x1830967794066944/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.891015:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094338e00 with x1830967794066944 ext(2097152->3145727) 00002000:00010000:1.0:1746147729.891020:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094338e00 00000100:00100000:1.0:1746147729.894445:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1958:x1830967794066688:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22713us (23060us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147729.894460:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7504 00002000:00100000:1.0:1746147729.894472:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009433bb80 x1830967794066688/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.894481:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433bb80 with x1830967794066688 ext(3145728->4194303) 00002000:00010000:1.0:1746147729.894487:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009433bb80 00000100:00100000:0.0:1746147729.910506:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.911494:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794067456 00000100:00100000:1.0:1746147729.911506:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794067456 00002000:00100000:1.0:1746147729.911560:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800954c0000 x1830967794067456/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.911570:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c0000 with x1830967794067456 ext(4194304->5017599) 00002000:00010000:1.0:1746147729.911577:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c0000 00000100:00100000:1.0:1746147729.911624:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7507 00000100:00100000:1.0:1746147729.911632:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967794067456:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147729.922060:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967794067456:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10419us (11555us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147729.922071:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7507 00002000:00100000:1.0:1746147729.922081:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800954c0000 x1830967794067456/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.922090:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c0000 with x1830967794067456 ext(4194304->5017599) 00002000:00010000:1.0:1746147729.922094:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c0000 00000100:00100000:0.0:1746147729.944822:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.944867:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.945077:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794067840 00000100:00100000:1.0:1746147729.945085:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794067840 00000100:00100000:1.0:1746147729.945376:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12060 00000100:00100000:1.0:1746147729.945383:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+350:32337:x1830967794067840:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147729.945404:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.945419:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd84e00/0xe64d3fbf12a7e4db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc0cf expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.945504:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095234e00/0xe64d3fbf12a7e4e2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147729.945516:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095234e00/0xe64d3fbf12a7e4e2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147729.945528:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095234e00/0xe64d3fbf12a7e4e2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:1.0:1746147729.945538:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147729.945634:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd84e00/0xe64d3fbf12a7e4db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0cf expref: 353 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.945768:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794067584 00000100:00100000:3.0:1746147729.945773:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794067584 00000100:00100000:3.0:1746147729.945795:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16748 00000100:00100000:3.0:1746147729.945799:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:32333:x1830967794067584:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147729.945807:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.945816:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc0c8 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.945832:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e4b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc09e expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.945839:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.945840:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.945843:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1155072->2068479] (req 1155072->2068479) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 25 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.945865:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e4b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc09e expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.945875:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e4b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc09e expref: 25 pid: 6715 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746147729.945901:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796497920:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147729.945966:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390480 going to sleep for 11 seconds 00010000:00010000:1.0:1746147729.946295:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095234e00/0xe64d3fbf12a7e4e2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0cf expref: 352 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.946303:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147729.946306:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147729.946308:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095234e00, rc 0) 00000100:00100000:1.0:1746147729.946483:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+352:32337:x1830967794067840:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1100us (1615us total) trans 8589946085 rc 0/0 00000100:00100000:1.0:1746147729.946489:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12060 00000100:00100000:3.0:1746147729.960266:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796497920:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.960291:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1155072->2068479] (req 1155072->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 25 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.960307:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e5000, rc 0) 00000100:00100000:3.0:1746147729.961251:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32333:x1830967794067584:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 15450us (16434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.961258:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16748 00000100:00100000:0.0:1746147729.962940:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.963027:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794067968 00000100:00100000:2.0:1746147729.963033:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794067968 00010000:00010000:2.0:1746147729.963060:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e4b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc09e expref: 25 pid: 6715 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147729.963092:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8531 00000100:00100000:2.0:1746147729.963099:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1957:x1830967794067968:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.963110:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.963126:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e4b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc09e expref: 25 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147729.963136:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e4b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc09e expref: 25 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147729.963155:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e4b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc09e expref: 25 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147729.963862:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.963864:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.963871:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->2068479) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.963879:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->2068479) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.963916:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.963924:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796498048:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147729.963988:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.965125:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.965150:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.965185:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.965258:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794068096 00000100:00100000:3.0:1746147729.965264:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794068096 00000100:00100000:0.0:1746147729.965264:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.965278:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.965282:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794068224 00000100:00100000:1.0:1746147729.965286:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794068224 00000100:00100000:3.0:1746147729.965291:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794068352 00000100:00100000:3.0:1746147729.965293:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794068352 00000100:00100000:0.0:1746147729.965297:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.965305:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794068480 00000100:00100000:3.0:1746147729.965310:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794068608 00000100:00100000:3.0:1746147729.965312:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794068608 00000100:00100000:3.0:1746147729.965320:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794068736 00000100:00100000:3.0:1746147729.965321:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794068736 00000100:00100000:3.0:1746147729.965333:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16749 00000100:00100000:3.0:1746147729.965338:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794068096:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.965351:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147729.965354:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16750 00000100:00100000:2.0:1746147729.965362:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794068224:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.965364:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fffe400/0xe64d3fbf12a7e4f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc0d6 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.965369:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.965378:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.965378:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a973a00/0xe64d3fbf12a7e4fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc0dd expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.965380:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.965385:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fffe400/0xe64d3fbf12a7e4f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0d6 expref: 29 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.965389:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.965390:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.965395:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a973a00/0xe64d3fbf12a7e4fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0dd expref: 26 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.965400:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fffe400/0xe64d3fbf12a7e4f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0d6 expref: 29 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147729.965403:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a973a00/0xe64d3fbf12a7e4fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0dd expref: 26 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.965407:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fffe400, rc 0) 00010000:00010000:2.0:1746147729.965410:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a973a00, rc 0) 00000100:00100000:3.0:1746147729.965518:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967794068096:12345-192.168.202.10@tcp:101:cat.0 Request processed in 178us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.965524:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16749 00000100:00100000:3.0:1746147729.965538:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16751 00000100:00100000:3.0:1746147729.965543:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794068352:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.965549:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.965555:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fffec00/0xe64d3fbf12a7e505 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc0e4 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147729.965580:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796498176:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147729.965608:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.965610:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794068480 00000100:00100000:3.0:1746147729.965623:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16752 00000100:00100000:3.0:1746147729.965628:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967794068608:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147729.965628:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16753 00000100:00100000:1.0:1746147729.965632:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794068736:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.965634:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147729.965638:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.965641:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e50c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc0f2 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147729.965644:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095235800/0xe64d3fbf12a7e513 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc0f9 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.965650:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.965651:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.965655:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.965656:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e50c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f2 expref: 30 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.965656:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147729.965661:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095235800/0xe64d3fbf12a7e513 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f9 expref: 28 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.965665:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e50c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f2 expref: 30 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147729.965669:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095235800/0xe64d3fbf12a7e513 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f9 expref: 28 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.965682:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095150800, rc 0) 00010000:00010000:1.0:1746147729.965685:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235800, rc 0) 00000100:00100000:3.0:1746147729.965698:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794068608:12345-192.168.202.10@tcp:101:cat.0 Request processed in 70us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147729.965701:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794068736:12345-192.168.202.10@tcp:101:cat.0 Request processed in 68us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.965702:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16752 00000100:00100000:1.0:1746147729.965706:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16753 00000100:00100000:3.0:1746147729.965713:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16754 00000100:00100000:3.0:1746147729.965717:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794068480:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147729.965722:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.965727:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e51a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc0eb expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.965737:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.965738:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.965741:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e51a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0eb expref: 30 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.965748:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e51a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0eb expref: 30 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.965753:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffffc00, rc 0) 00000100:00100000:3.0:1746147729.965767:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794068480:12345-192.168.202.10@tcp:101:cat.0 Request processed in 50us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.965771:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16754 00000100:00100000:2.0:1746147729.965846:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794068224:12345-192.168.202.10@tcp:101:cat.0 Request processed in 79us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.965853:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16750 00000100:00100000:2.0:1746147729.966157:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796498048:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147729.966170:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.966188:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967794067968:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3090us (3251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.966194:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8531 00000100:00100000:0.0:1746147729.966280:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.966326:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794068992 00000100:00100000:1.0:1746147729.966329:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794068992 00002000:00100000:1.0:1746147729.966350:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1155072->1159167) req@ffff8800a0290e00 x1830967794068992/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.966358:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0290e00 with x1830967794068992 ext(1155072->1159167) 00002000:00010000:1.0:1746147729.966361:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0290e00 00000100:00100000:1.0:1746147729.966379:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7508 00000100:00100000:1.0:1746147729.966387:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794068992:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147729.966505:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794068992:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 121us (225us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147729.966511:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7508 00002000:00100000:1.0:1746147729.966515:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1155072->1159167) req@ffff8800a0290e00 x1830967794068992/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.966521:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0290e00 with x1830967794068992 ext(1155072->1159167) 00002000:00010000:1.0:1746147729.966524:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0290e00 00002000:00010000:3.0:1746147729.967212:0:8468:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime: 1746147730 -> 1746147731 00002000:00010000:3.0:1746147729.967215:0:8468:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime: 1746147730 -> 1746147731 00000100:00100000:3.0:1746147729.967224:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796498176:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147729.967238:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fffec00/0xe64d3fbf12a7e505 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0e4 expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.967246:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fffec00/0xe64d3fbf12a7e505 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0e4 expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.967265:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fffec00, rc 0) 00000100:00100000:3.0:1746147729.967296:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794068352:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1752us (2109us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147729.967301:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16751 00000100:00100000:0.0:1746147729.978558:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147729.978641:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.978755:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794069248 00000100:00100000:1.0:1746147729.978763:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794069248 00002000:00100000:1.0:1746147729.978798:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (2064384->2068479) req@ffff8800a0291180 x1830967794069248/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.978808:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0291180 with x1830967794069248 ext(2064384->2068479) 00002000:00010000:1.0:1746147729.978813:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0291180 00000100:00100000:1.0:1746147729.978840:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794069504 00000100:00100000:1.0:1746147729.978842:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794069504 00002000:00100000:1.0:1746147729.978858:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a0291500 x1830967794069504/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.978865:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0291500 with x1830967794069504 ext(0->1048575) 00002000:00010000:1.0:1746147729.978868:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0291500 00000100:00100000:1.0:1746147729.978880:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7509 00000100:00100000:1.0:1746147729.978914:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967794069248:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147729.979055:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7510 00000100:00100000:1.0:1746147729.979058:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967794069248:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 140us (502us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147729.979062:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794069504:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147729.979063:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7509 00002000:00100000:1.0:1746147729.979068:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (2064384->2068479) req@ffff8800a0291180 x1830967794069248/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.979074:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0291180 with x1830967794069248 ext(2064384->2068479) 00002000:00010000:1.0:1746147729.979077:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0291180 00000100:00100000:0.0:1746147729.979244:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147729.979291:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794069760 00000100:00100000:1.0:1746147729.979294:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794069760 00002000:00100000:1.0:1746147729.979306:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a0291880 x1830967794069760/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.979317:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0291880 with x1830967794069760 ext(1048576->2097151) 00002000:00010000:1.0:1746147729.979320:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0291880 00000100:00100000:1.0:1746147729.979341:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7511 00000100:00100000:1.0:1746147729.979345:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794069760:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147729.983723:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.984612:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794069888 00000100:00100000:3.0:1746147729.984619:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794069888 00000100:00100000:3.0:1746147729.984667:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16755 00000100:00100000:3.0:1746147729.984682:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:32337:x1830967794069888:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147729.984697:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147729.984711:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc100 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.984734:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095151400/0xe64d3fbf12a7e4cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0b3 expref: 23 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.984740:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a973a00/0xe64d3fbf12a7e4fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0dd expref: 28 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.984750:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.984751:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147729.984755:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1945600->2097151] (req 1945600->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 28 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.984779:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a973a00/0xe64d3fbf12a7e4fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0dd expref: 28 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.984789:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a973a00/0xe64d3fbf12a7e4fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0dd expref: 28 pid: 9615 timeout: 909 lvb_type: 1 00000100:00100000:3.0:1746147729.984797:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796498304:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.985164:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095151400/0xe64d3fbf12a7e4cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0b3 expref: 23 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147729.985172:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095151400/0xe64d3fbf12a7e4cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0b3 expref: 23 pid: 8468 timeout: 909 lvb_type: 1 00000100:00100000:3.0:1746147729.985621:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094693100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796498432:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147729.985648:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147729.988978:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794069504:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9908us (10327us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147729.988989:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7510 00002000:00100000:2.0:1746147729.988999:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a0291500 x1830967794069504/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147729.989008:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0291500 with x1830967794069504 ext(0->1048575) 00002000:00010000:2.0:1746147729.989013:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0291500 00000100:00100000:2.0:1746147729.989605:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796498304:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.989754:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094693100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796498432:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147729.989777:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1945600->2097151] (req 1945600->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 28 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.989789:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fffee00, rc 0) 00000100:00100000:2.0:1746147729.990067:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:32337:x1830967794069888:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5393us (6351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.990074:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16755 00000100:00100000:1.0:1746147729.990334:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794069760:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10987us (11089us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147729.990341:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7511 00002000:00100000:1.0:1746147729.990347:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a0291880 x1830967794069760/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/440 e 0 to 0 dl 1746147740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.990352:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0291880 with x1830967794069760 ext(1048576->2097151) 00010000:00010000:1.0:1746147729.990357:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a973a00/0xe64d3fbf12a7e4fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0dd expref: 26 pid: 9615 timeout: 909 lvb_type: 1 00010000:00010000:1.0:1746147729.990366:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a973a00/0xe64d3fbf12a7e4fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0dd expref: 26 pid: 9615 timeout: 909 lvb_type: 1 00002000:00010000:1.0:1746147729.990370:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0291880 00000100:00100000:0.0:1746147729.990530:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.990602:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794070016 00000100:00100000:2.0:1746147729.990607:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794070016 00010000:00010000:2.0:1746147729.990629:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095151400/0xe64d3fbf12a7e4cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0b3 expref: 24 pid: 8468 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746147729.990646:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8532 00000100:00100000:2.0:1746147729.990651:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0291f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794070016:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.990661:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.990685:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095151400/0xe64d3fbf12a7e4cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0b3 expref: 24 pid: 8468 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147729.990693:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095151400/0xe64d3fbf12a7e4cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0b3 expref: 24 pid: 8468 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147729.990714:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095151400/0xe64d3fbf12a7e4cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0b3 expref: 24 pid: 8468 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147729.990728:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.990745:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0291f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967794070016:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 94us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.990750:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8532 00000100:00100000:0.0:1746147729.994493:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.994562:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794070144 00000100:00100000:2.0:1746147729.994569:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794070144 00010000:00010000:2.0:1746147729.994592:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a973a00/0xe64d3fbf12a7e4fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0dd expref: 26 pid: 9615 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746147729.994609:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8533 00000100:00100000:2.0:1746147729.994614:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0292300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967794070144:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147729.994622:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147729.994636:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a973a00/0xe64d3fbf12a7e4fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0dd expref: 26 pid: 9615 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147729.994644:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a973a00/0xe64d3fbf12a7e4fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0dd expref: 26 pid: 9615 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147729.994658:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a973a00/0xe64d3fbf12a7e4fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0dd expref: 26 pid: 9615 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147729.994745:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.994748:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147729.994755:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 25 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.994762:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 25 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.994789:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 25 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147729.994799:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796498560:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147729.995919:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147729.996231:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147729.996326:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794070272 00000100:00100000:2.0:1746147729.996330:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794070272 00000100:00100000:2.0:1746147729.996354:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16756 00000100:00100000:2.0:1746147729.996359:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32340:x1830967794070272:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147729.996372:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147729.996382:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a973400/0xe64d3fbf12a7e528 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc107 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.996398:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 27 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.996404:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147729.996405:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147729.996408:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a973400/0xe64d3fbf12a7e528 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc107 expref: 27 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.996427:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 27 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147729.996437:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 27 pid: 8468 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147729.996445:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796498688:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147729.996473:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147729.999219:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147729.999347:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796498688:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147729.999372:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a973400/0xe64d3fbf12a7e528 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc107 expref: 27 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147729.999391:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a973400, rc 0) 00000100:00100000:3.0:1746147729.999424:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:32340:x1830967794070272:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3063us (3192us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147729.999432:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16756 00000100:00100000:1.0:1746147729.999588:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794070528 00000100:00100000:1.0:1746147729.999593:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794070528 00002000:00100000:1.0:1746147729.999621:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1945600->1949695) req@ffff8800a0292680 x1830967794070528/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/0 e 0 to 0 dl 1746147740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147729.999629:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0292680 with x1830967794070528 ext(1945600->1949695) 00010000:00010000:1.0:1746147729.999635:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 27 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147729.999647:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 27 pid: 8468 timeout: 909 lvb_type: 0 00002000:00010000:1.0:1746147729.999654:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0292680 00000100:00100000:1.0:1746147729.999669:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1502 00000100:00100000:1.0:1746147729.999685:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794070528:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147729.999839:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796498560:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147729.999850:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147729.999872:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0292300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967794070144:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5257us (5385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147729.999879:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8533 00000100:00100000:1.0:1746147730.000293:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794070528:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 608us (1079us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147730.000299:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1502 00002000:00100000:1.0:1746147730.000305:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1945600->1949695) req@ffff8800a0292680 x1830967794070528/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:350/0 lens 488/4536 e 0 to 0 dl 1746147740 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.000312:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0292680 with x1830967794070528 ext(1945600->1949695) 00010000:00010000:1.0:1746147730.000317:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 26 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.000326:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 26 pid: 8468 timeout: 909 lvb_type: 0 00002000:00010000:1.0:1746147730.000331:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0292680 00000100:00100000:0.0:1746147730.003535:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.004271:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.004404:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794070784 00000100:00100000:3.0:1746147730.004412:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794070784 00000100:00100000:3.0:1746147730.004445:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16757 00000100:00100000:3.0:1746147730.004451:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32337:x1830967794070784:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147730.004464:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147730.004480:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc10e expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.004502:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.004508:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147730.004509:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147730.004517:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->1372159] (req 1048576->1372159) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 27 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.004539:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->2068479) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.004548:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->2068479) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 22 pid: 8468 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746147730.004562:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094691f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796498816:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147730.004625:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93903c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147730.005051:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794070912 00000100:00100000:1.0:1746147730.005055:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794070912 00002000:00100000:1.0:1746147730.005075:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1945600->2097151) req@ffff8800a0292d80 x1830967794070912/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.005083:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0292d80 with x1830967794070912 ext(1945600->2097151) 00010000:00010000:1.0:1746147730.005088:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 28 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.005096:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 28 pid: 8468 timeout: 909 lvb_type: 0 00002000:00010000:1.0:1746147730.005101:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0292d80 00000100:00100000:1.0:1746147730.005436:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1503 00000100:00100000:1.0:1746147730.005441:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1958:x1830967794070912:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:0.0:1746147730.013260:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.013399:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094691f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796498816:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147730.013427:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->1372159] (req 1048576->1372159) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 29 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.013442:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915e6e00, rc 0) 00000100:00100000:3.0:1746147730.013484:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32337:x1830967794070784:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 9032us (9955us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.013492:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16757 00000100:00100000:2.0:1746147730.013568:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794071040 00000100:00100000:2.0:1746147730.013574:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794071040 00002000:00100000:2.0:1746147730.013614:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x455:0x0] (1155072->2068479) req@ffff8800a0293100 x1830967794071040/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.013622:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0293100 with x1830967794071040 ext(1155072->2068479) 00010000:00010000:2.0:1746147730.013628:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 23 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.013638:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 23 pid: 8468 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746147730.013648:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0293100 00000100:00100000:2.0:1746147730.013662:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1504 00000100:00100000:2.0:1746147730.013669:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967794071040:12345-192.168.202.10@tcp:4:multiop.0 00000100:00080000:1.0:1746147730.013820:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147730.014841:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967794070912:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 9397us (10569us total) trans 21474841626 rc 0/0 00000100:00100000:1.0:1746147730.014849:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1503 00002000:00100000:1.0:1746147730.014855:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1945600->2097151) req@ffff8800a0292d80 x1830967794070912/t21474841626(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/448 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.014862:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0292d80 with x1830967794070912 ext(1945600->2097151) 00010000:00010000:1.0:1746147730.014868:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 29 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.014875:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 29 pid: 8468 timeout: 909 lvb_type: 0 00002000:00010000:1.0:1746147730.014881:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0292d80 00000100:00100000:0.0:1746147730.020380:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.020754:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794071168 00000100:00100000:3.0:1746147730.020762:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794071168 00010000:00010000:3.0:1746147730.020791:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 29 pid: 8468 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746147730.020832:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8534 00000100:00100000:3.0:1746147730.020839:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794071168:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147730.020851:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147730.020866:0:7095:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147730 -> 1746147731 00002000:00010000:3.0:1746147730.020868:0:7095:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147730 -> 1746147731 00010000:00010000:3.0:1746147730.020873:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 29 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746147730.020897:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 29 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746147730.020918:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fffee00/0xe64d3fbf12a7e521 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc100 expref: 29 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746147730.020934:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147730.020936:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147730.020941:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a973400/0xe64d3fbf12a7e528 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc107 expref: 28 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.020949:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a973400/0xe64d3fbf12a7e528 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc107 expref: 28 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.020978:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a973400/0xe64d3fbf12a7e528 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc107 expref: 28 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147730.020988:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094691f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796498944:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147730.021050:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147730.025140:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094691f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796498944:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147730.025162:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147730.025200:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794071168:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4360us (4828us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.025210:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8534 00000100:00100000:2.0:1746147730.026202:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.026238:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794071424 00000100:00100000:1.0:1746147730.026245:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794071424 00002000:00100000:1.0:1746147730.026272:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880091632a00 x1830967794071424/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.026282:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091632a00 with x1830967794071424 ext(1048576->2097151) 00002000:00010000:1.0:1746147730.026286:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091632a00 00000100:00100000:1.0:1746147730.026311:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7512 00000100:00100000:1.0:1746147730.026317:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794071424:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147730.032058:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794071040:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 18381us (18797us total) trans 21474841627 rc 0/0 00000100:00100000:1.0:1746147730.032070:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1504 00002000:00100000:1.0:1746147730.032081:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x455:0x0] (1155072->2068479) req@ffff8800a0293100 x1830967794071040/t21474841627(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/448 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.032091:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0293100 with x1830967794071040 ext(1155072->2068479) 00010000:00010000:1.0:1746147730.032099:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 25 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.032113:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 25 pid: 8468 timeout: 909 lvb_type: 0 00002000:00010000:1.0:1746147730.032118:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0293100 00000100:00100000:1.0:1746147730.034797:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794071424:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 8472us (8588us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147730.034807:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7512 00002000:00100000:1.0:1746147730.034816:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880091632a00 x1830967794071424/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.034826:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091632a00 with x1830967794071424 ext(1048576->2097151) 00002000:00010000:1.0:1746147730.034831:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091632a00 00000100:00100000:0.0:1746147730.039289:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.039414:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.040099:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794071552 00000100:00100000:3.0:1746147730.040107:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794071552 00000100:00100000:3.0:1746147730.040578:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16758 00000100:00100000:3.0:1746147730.040586:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:32340:x1830967794071552:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147730.040605:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147730.040620:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e190600/0xe64d3fbf12a7e536 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc115 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.040643:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147730.040648:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->1372159] (req 1048576->1372159) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 29 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.040653:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147730.040656:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e190600/0xe64d3fbf12a7e536 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc115 expref: 29 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.040698:0:8468:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->1372159] (req 1048576->1372159) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 29 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.040708:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e190600/0xe64d3fbf12a7e536 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc115 expref: 29 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.040716:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e190600, rc 0) 00000100:00100000:3.0:1746147730.040751:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32340:x1830967794071552:12345-192.168.202.10@tcp:101:cat.0 Request processed in 167us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.040756:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16758 00000100:00100000:2.0:1746147730.041218:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794071680 00000100:00100000:2.0:1746147730.041222:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794071680 00010000:00010000:2.0:1746147730.041238:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 25 pid: 8468 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147730.041426:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8535 00000100:00100000:2.0:1746147730.041430:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a237b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794071680:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.041435:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147730.041450:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1155072->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 25 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.041457:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1155072->2068479) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 25 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.041469:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801348e5000/0xe64d3fbf12a7e4f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1155072->2068479) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c8 expref: 25 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.041479:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.041480:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.041484:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 28 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.041492:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 28 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.041505:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 28 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.041512:0:7095:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 28 pid: 8468 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147730.041519:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796499200:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147730.041567:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.044525:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796499200:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147730.044579:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147730.044705:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a237b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794071680:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3272us (5289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.044715:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8535 00000100:00100000:0.0:1746147730.048295:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.048397:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794071936 00000100:00100000:1.0:1746147730.048405:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794071936 00002000:00100000:1.0:1746147730.048442:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1368064->1372159) req@ffff8800a0293b80 x1830967794071936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.048479:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0293b80 with x1830967794071936 ext(1368064->1372159) 00010000:00010000:1.0:1746147730.048489:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 29 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.048503:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 29 pid: 8468 timeout: 909 lvb_type: 0 00002000:00010000:1.0:1746147730.048509:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0293b80 00000100:00100000:1.0:1746147730.048542:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1505 00000100:00100000:1.0:1746147730.048549:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794071936:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147730.048721:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794071936:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 172us (432us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147730.048727:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1505 00002000:00100000:1.0:1746147730.048733:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1368064->1372159) req@ffff8800a0293b80 x1830967794071936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/4536 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.048739:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0293b80 with x1830967794071936 ext(1368064->1372159) 00010000:00010000:1.0:1746147730.048744:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 29 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.048752:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 29 pid: 8468 timeout: 909 lvb_type: 0 00002000:00010000:1.0:1746147730.048757:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0293b80 00000100:00100000:0.0:1746147730.051019:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.051080:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794072192 00000100:00100000:2.0:1746147730.051086:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794072192 00002000:00100000:2.0:1746147730.051114:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1372159) req@ffff8800a0291f80 x1830967794072192/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.051123:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0291f80 with x1830967794072192 ext(1048576->1372159) 00010000:00010000:2.0:1746147730.051129:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 29 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.051147:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 29 pid: 8468 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746147730.051153:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0291f80 00000100:00100000:2.0:1746147730.051187:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1506 00000100:00100000:2.0:1746147730.051193:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967794072192:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:0.0:1746147730.061397:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.061418:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.061443:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794072320 00000100:00100000:3.0:1746147730.061455:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794072320 00000100:00100000:3.0:1746147730.061489:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794072448 00000100:00100000:3.0:1746147730.061491:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794072448 00000100:00100000:3.0:1746147730.061591:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16759 00000100:00100000:3.0:1746147730.061599:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794072320:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147730.061617:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147730.061632:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e53d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc11c expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.061657:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147730.061659:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147730.061667:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e53d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc11c expref: 26 pid: 9615 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147730.061669:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16760 00000100:00100000:1.0:1746147730.061688:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794072448:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147730.061691:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e53d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc11c expref: 26 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.061694:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147730.061700:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8800, rc 0) 00010000:00010000:1.0:1746147730.061701:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944caa00/0xe64d3fbf12a7e544 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc123 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147730.061732:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796499328:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147730.061734:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794072320:12345-192.168.202.10@tcp:101:cat.0 Request processed in 138us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.061740:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16759 00000100:00100000:1.0:1746147730.061800:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.063727:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1957:x1830967794072192:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 12529us (12708us total) trans 21474841628 rc 0/0 00000100:00100000:2.0:1746147730.063736:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1506 00002000:00100000:2.0:1746147730.063745:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1372159) req@ffff8800a0291f80 x1830967794072192/t21474841628(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/448 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.063753:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0291f80 with x1830967794072192 ext(1048576->1372159) 00010000:00010000:2.0:1746147730.063761:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 31 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.063773:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 31 pid: 8468 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746147730.063779:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0291f80 00000100:00100000:0.0:1746147730.067619:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:1.0:1746147730.067794:0:21480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime: 1746147730 -> 1746147731 00000100:00100000:1.0:1746147730.067818:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796499328:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147730.067859:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800944caa00/0xe64d3fbf12a7e544 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc123 expref: 26 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.067875:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944caa00/0xe64d3fbf12a7e544 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc123 expref: 26 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.067944:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944caa00, rc 0) 00000100:00100000:1.0:1746147730.068013:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794072448:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6324us (6591us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147730.068021:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16760 00000100:00100000:2.0:1746147730.068523:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794072576 00000100:00100000:2.0:1746147730.068529:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794072576 00010000:00010000:2.0:1746147730.068551:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 31 pid: 8468 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147730.068574:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8536 00000100:00100000:2.0:1746147730.068580:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794072576:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.068591:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147730.068600:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 31 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.068609:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 31 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.068625:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915e6e00/0xe64d3fbf12a7e52f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1372159) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc10e expref: 31 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.068650:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.068652:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.068657:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e190600/0xe64d3fbf12a7e536 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc115 expref: 30 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.068664:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e190600/0xe64d3fbf12a7e536 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc115 expref: 30 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.068698:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e190600/0xe64d3fbf12a7e536 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc115 expref: 30 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147730.068708:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796499456:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147730.068757:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.071375:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796499456:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147730.071971:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147730.072019:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794072576:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3437us (4404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.072028:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8536 00000100:00100000:0.0:1746147730.077245:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.077277:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.077299:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.077337:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.077396:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794073088 00000100:00100000:2.0:1746147730.077403:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794073088 00002000:00100000:2.0:1746147730.077441:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a8acc380 x1830967794073088/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.077450:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acc380 with x1830967794073088 ext(1048576->2097151) 00002000:00010000:2.0:1746147730.077455:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acc380 00000100:00100000:1.0:1746147730.077495:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794073216 00000100:00100000:1.0:1746147730.077499:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794073216 00002000:00100000:1.0:1746147730.077513:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a8acc700 x1830967794073216/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.077521:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acc700 with x1830967794073216 ext(1048576->2097151) 00002000:00010000:1.0:1746147730.077524:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acc700 00000100:00100000:1.0:1746147730.077535:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794073600 00000100:00100000:1.0:1746147730.077537:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794073600 00002000:00100000:1.0:1746147730.077552:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a8acca80 x1830967794073600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.077558:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acca80 with x1830967794073600 ext(0->1048575) 00002000:00010000:1.0:1746147730.077561:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acca80 00000100:00100000:1.0:1746147730.077567:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794073728 00000100:00100000:1.0:1746147730.077568:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794073728 00000100:00100000:2.0:1746147730.077662:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7513 00000100:00100000:2.0:1746147730.077668:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794073216:12345-192.168.202.10@tcp:3:multiop.0 00000100:00080000:0.0:1746147730.077913:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147730.077916:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7514 00000100:00100000:3.0:1746147730.077924:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794073600:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:1.0:1746147730.077964:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a8acce00 x1830967794073728/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.077970:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acce00 with x1830967794073728 ext(1048576->2097151) 00002000:00010000:1.0:1746147730.077973:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acce00 00000100:00100000:1.0:1746147730.077984:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7515 00000100:00100000:1.0:1746147730.077988:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794073088:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147730.077995:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7516 00000100:00100000:0.0:1746147730.078003:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794073728:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147730.090855:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794073728:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12845us (13508us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147730.090866:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7516 00002000:00100000:1.0:1746147730.090877:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a8acce00 x1830967794073728/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.090909:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acce00 with x1830967794073728 ext(1048576->2097151) 00002000:00010000:1.0:1746147730.090915:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acce00 00000100:00100000:3.0:1746147730.099477:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794073600:12345-192.168.202.10@tcp:3:cat.0 Request processed in 21547us (22169us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147730.099489:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7514 00002000:00100000:3.0:1746147730.099499:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a8acca80 x1830967794073600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.099507:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acca80 with x1830967794073600 ext(0->1048575) 00002000:00010000:3.0:1746147730.099512:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acca80 00000100:00100000:1.0:1746147730.100654:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794073088:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 22661us (23413us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147730.100661:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7515 00002000:00100000:1.0:1746147730.100667:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a8acc380 x1830967794073088/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.100683:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acc380 with x1830967794073088 ext(1048576->2097151) 00002000:00010000:1.0:1746147730.100686:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acc380 00000100:00100000:2.0:1746147730.101683:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794073216:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 24002us (24392us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147730.101690:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7513 00002000:00100000:2.0:1746147730.101696:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a8acc700 x1830967794073216/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.101703:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acc700 with x1830967794073216 ext(1048576->2097151) 00002000:00010000:2.0:1746147730.101706:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acc700 00000100:00100000:0.0:1746147730.113188:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.113350:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794073856 00000100:00100000:1.0:1746147730.113358:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794073856 00000100:00100000:1.0:1746147730.113405:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16761 00000100:00100000:1.0:1746147730.113412:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32345:x1830967794073856:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147730.113431:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.113447:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944cb400/0xe64d3fbf12a7e54b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc12a expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.113469:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.113471:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.113477:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944cb400/0xe64d3fbf12a7e54b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc12a expref: 26 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.113489:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800944cb400/0xe64d3fbf12a7e54b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc12a expref: 26 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.113499:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944cb400, rc 0) 00000100:00100000:1.0:1746147730.113550:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32345:x1830967794073856:12345-192.168.202.10@tcp:101:cat.0 Request processed in 138us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.113556:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16761 00000100:00100000:0.0:1746147730.122403:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.122554:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794074112 00000100:00100000:2.0:1746147730.122562:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794074112 00002000:00100000:2.0:1746147730.122599:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a8acd500 x1830967794074112/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.122609:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acd500 with x1830967794074112 ext(1048576->2097151) 00002000:00010000:2.0:1746147730.122758:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acd500 00000100:00100000:2.0:1746147730.123226:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7517 00000100:00100000:2.0:1746147730.123233:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794074112:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147730.123806:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.123844:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.124118:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794074368 00000100:00100000:3.0:1746147730.124122:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794074624 00000100:00100000:1.0:1746147730.124123:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794074368 00000100:00100000:3.0:1746147730.124127:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794074624 00002000:00100000:3.0:1746147730.124149:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a8acdc00 x1830967794074624/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.124150:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a8acd880 x1830967794074368/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.124157:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acdc00 with x1830967794074624 ext(3145728->4194303) 00002000:00100000:1.0:1746147730.124158:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acd880 with x1830967794074368 ext(2097152->3145727) 00002000:00010000:3.0:1746147730.124161:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acdc00 00002000:00010000:1.0:1746147730.124161:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acd880 00000100:00100000:1.0:1746147730.124187:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7518 00000100:00100000:3.0:1746147730.124193:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7519 00000100:00100000:1.0:1746147730.124193:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1958:x1830967794074368:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147730.124198:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1958:x1830967794074624:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147730.126931:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.126971:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.127042:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794074880 00000100:00100000:3.0:1746147730.127048:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794074880 00002000:00100000:3.0:1746147730.127075:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a8acdf80 x1830967794074880/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.127084:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acdf80 with x1830967794074880 ext(2097152->3145727) 00002000:00010000:3.0:1746147730.127089:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acdf80 00000100:00100000:3.0:1746147730.127103:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794075136 00000100:00100000:3.0:1746147730.127105:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794075136 00002000:00100000:3.0:1746147730.127114:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a8ace300 x1830967794075136/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.127121:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ace300 with x1830967794075136 ext(3145728->4194303) 00002000:00010000:3.0:1746147730.127124:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8ace300 00000100:00100000:3.0:1746147730.127134:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7520 00000100:00100000:3.0:1746147730.127140:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1958:x1830967794074880:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147730.128189:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7521 00000100:00100000:3.0:1746147730.128197:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967794075136:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147730.140967:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967794074368:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16765us (17152us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147730.140978:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7518 00002000:00100000:1.0:1746147730.140988:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a8acd880 x1830967794074368/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.140998:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acd880 with x1830967794074368 ext(2097152->3145727) 00002000:00010000:1.0:1746147730.141003:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acd880 00000100:00100000:3.0:1746147730.144356:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967794074624:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20147us (20500us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147730.144367:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7519 00002000:00100000:3.0:1746147730.144377:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a8acdc00 x1830967794074624/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.144386:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acdc00 with x1830967794074624 ext(3145728->4194303) 00002000:00010000:3.0:1746147730.144390:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acdc00 00000100:00100000:2.0:1746147730.147345:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794074112:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24104us (24940us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147730.147354:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7517 00002000:00100000:2.0:1746147730.147363:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a8acd500 x1830967794074112/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.147371:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acd500 with x1830967794074112 ext(1048576->2097151) 00002000:00010000:2.0:1746147730.147376:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acd500 00000100:00100000:3.0:1746147730.151805:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967794074880:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24657us (24873us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147730.151816:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7520 00002000:00100000:3.0:1746147730.151825:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a8acdf80 x1830967794074880/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.151834:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acdf80 with x1830967794074880 ext(2097152->3145727) 00002000:00010000:3.0:1746147730.151839:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acdf80 00000100:00100000:3.0:1746147730.153598:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967794075136:12345-192.168.202.10@tcp:3:cat.0 Request processed in 25396us (26621us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147730.153608:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7521 00002000:00100000:3.0:1746147730.153616:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a8ace300 x1830967794075136/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.153624:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ace300 with x1830967794075136 ext(3145728->4194303) 00002000:00010000:3.0:1746147730.153629:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8ace300 00000100:00100000:0.0:1746147730.168324:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.168496:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794075392 00000100:00100000:3.0:1746147730.168507:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794075392 00002000:00100000:3.0:1746147730.168543:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a8ace680 x1830967794075392/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.168551:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ace680 with x1830967794075392 ext(4194304->5017599) 00002000:00010000:3.0:1746147730.168556:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8ace680 00000100:00100000:3.0:1746147730.168700:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7522 00000100:00100000:3.0:1746147730.168707:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794075392:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147730.185698:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794075392:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16984us (17374us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147730.185708:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7522 00002000:00100000:2.0:1746147730.185717:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a8ace680 x1830967794075392/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.185724:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ace680 with x1830967794075392 ext(4194304->5017599) 00002000:00010000:2.0:1746147730.185730:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8ace680 00000100:00100000:0.0:1746147730.223591:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.224403:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794075520 00000100:00100000:2.0:1746147730.224411:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794075520 00000100:00100000:2.0:1746147730.224454:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16762 00000100:00100000:2.0:1746147730.224460:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32351:x1830967794075520:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147730.224476:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147730.224492:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc131 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.224521:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd84c00/0xe64d3fbf12a7e4d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c1 expref: 27 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.224529:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095235800/0xe64d3fbf12a7e513 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f9 expref: 29 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.224534:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.224537:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.224539:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3764224->4112383] (req 3764224->4112383) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 27 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.224563:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095235800/0xe64d3fbf12a7e513 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f9 expref: 29 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.224572:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095235800/0xe64d3fbf12a7e513 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f9 expref: 29 pid: 20619 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746147730.224582:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796499584:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147730.224705:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd84c00/0xe64d3fbf12a7e4d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c1 expref: 27 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.224714:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd84c00/0xe64d3fbf12a7e4d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c1 expref: 27 pid: 20619 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746147730.224721:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796499712:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147730.224740:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.228828:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796499584:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147730.228839:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796499712:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147730.228865:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3764224->4112383] (req 3764224->4112383) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 27 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.228880:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d9fc00, rc 0) 00000100:00100000:2.0:1746147730.228942:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32351:x1830967794075520:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4481us (5360us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.228950:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16762 00000100:00100000:0.0:1746147730.234555:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.234636:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.234828:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794075776 00000100:00100000:2.0:1746147730.234836:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794075776 00010000:00010000:2.0:1746147730.234868:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd84c00/0xe64d3fbf12a7e4d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c1 expref: 27 pid: 20619 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746147730.234913:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794075648 00000100:00100000:2.0:1746147730.234915:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794075648 00010000:00010000:2.0:1746147730.234924:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095235800/0xe64d3fbf12a7e513 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f9 expref: 30 pid: 20619 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746147730.234938:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8537 00000100:00100000:2.0:1746147730.234944:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8aced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967794075776:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.234956:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147730.234973:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd84c00/0xe64d3fbf12a7e4d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c1 expref: 27 pid: 20619 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147730.234988:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd84c00/0xe64d3fbf12a7e4d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c1 expref: 27 pid: 20619 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147730.235008:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd84c00/0xe64d3fbf12a7e4d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0c1 expref: 27 pid: 20619 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147730.235038:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147730.235074:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8aced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794075776:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 131us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.235081:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8537 00000100:00100000:2.0:1746147730.235093:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8538 00000100:00100000:2.0:1746147730.235097:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967794075648:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.235103:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147730.235109:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095235800/0xe64d3fbf12a7e513 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f9 expref: 30 pid: 20619 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147730.235119:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095235800/0xe64d3fbf12a7e513 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f9 expref: 30 pid: 20619 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147730.235130:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095235800/0xe64d3fbf12a7e513 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f9 expref: 30 pid: 20619 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147730.235138:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.235140:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.235145:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4112383) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.235153:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4112383) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.235179:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4112383) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147730.235190:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796499840:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147730.235234:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147730.237499:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796499840:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147730.237519:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147730.237881:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.238141:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794076032 00000100:00100000:3.0:1746147730.238146:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794076032 00002000:00100000:3.0:1746147730.238177:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3764224->3768319) req@ffff880091633800 x1830967794076032/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.238185:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091633800 with x1830967794076032 ext(3764224->3768319) 00002000:00010000:3.0:1746147730.238189:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091633800 00000100:00100000:3.0:1746147730.238205:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7523 00000100:00100000:3.0:1746147730.238211:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794076032:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147730.238367:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967794075648:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3267us (3730us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147730.238375:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8538 00000100:00100000:3.0:1746147730.238565:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794076032:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 353us (684us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147730.238572:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7523 00002000:00100000:3.0:1746147730.238577:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3764224->3768319) req@ffff880091633800 x1830967794076032/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/4536 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.238584:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091633800 with x1830967794076032 ext(3764224->3768319) 00002000:00010000:3.0:1746147730.238587:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091633800 00000100:00100000:0.0:1746147730.248085:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.248158:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794076288 00000100:00100000:3.0:1746147730.248166:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794076288 00002000:00100000:3.0:1746147730.248201:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (4108288->4112383) req@ffff8800a8acf480 x1830967794076288/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.248211:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf480 with x1830967794076288 ext(4108288->4112383) 00002000:00010000:3.0:1746147730.248216:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acf480 00000100:00100000:3.0:1746147730.248233:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7524 00000100:00100000:3.0:1746147730.248239:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967794076288:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147730.249215:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967794076288:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 973us (1135us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147730.249222:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7524 00002000:00100000:3.0:1746147730.249232:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (4108288->4112383) req@ffff8800a8acf480 x1830967794076288/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/4536 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.249240:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf480 with x1830967794076288 ext(4108288->4112383) 00002000:00010000:3.0:1746147730.249243:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acf480 00000100:00100000:0.0:1746147730.269154:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.269717:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794076416 00000100:00100000:2.0:1746147730.269724:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794076416 00000100:00100000:2.0:1746147730.269775:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16763 00000100:00100000:2.0:1746147730.269783:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32347:x1830967794076416:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147730.269798:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147730.269813:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc138 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.269837:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a973400/0xe64d3fbf12a7e528 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc107 expref: 30 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.269845:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e53d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc11c expref: 25 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.269850:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.269852:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.269855:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [2015232->2097151] (req 2015232->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 30 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.269880:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e53d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc11c expref: 25 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.269911:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e53d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc11c expref: 25 pid: 9615 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746147730.269921:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796499968:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147730.271626:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a973400/0xe64d3fbf12a7e528 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc107 expref: 30 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.271636:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a973400/0xe64d3fbf12a7e528 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc107 expref: 30 pid: 8468 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147730.271645:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094339c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796500096:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147730.272743:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.275747:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796499968:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147730.275804:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094339c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796500096:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147730.275832:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [2015232->2097151] (req 2015232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 30 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.275845:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d9f200, rc 0) 00000100:00100000:2.0:1746147730.275903:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32347:x1830967794076416:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 6120us (6756us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.275912:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16763 00000100:00100000:0.0:1746147730.277328:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.278225:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.278300:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794076544 00000100:00100000:2.0:1746147730.278307:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794076544 00010000:00010000:2.0:1746147730.278335:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e53d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc11c expref: 26 pid: 9615 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746147730.278357:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794076672 00000100:00100000:2.0:1746147730.278359:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794076672 00010000:00010000:2.0:1746147730.278366:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a973400/0xe64d3fbf12a7e528 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc107 expref: 30 pid: 8468 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147730.278389:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8539 00000100:00100000:2.0:1746147730.278396:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967794076544:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147730.278402:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8540 00010000:00010000:2.0:1746147730.278408:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147730.278410:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794076672:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147730.278419:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147730.278427:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e53d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc11c expref: 26 pid: 9615 timeout: 909 lvb_type: 1 00010000:00010000:1.0:1746147730.278431:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a973400/0xe64d3fbf12a7e528 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc107 expref: 30 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.278437:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e53d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc11c expref: 26 pid: 9615 timeout: 909 lvb_type: 1 00010000:00010000:1.0:1746147730.278449:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a973400/0xe64d3fbf12a7e528 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc107 expref: 30 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.278718:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e53d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc11c expref: 26 pid: 9615 timeout: 909 lvb_type: 1 00010000:00010000:1.0:1746147730.278749:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a973400/0xe64d3fbf12a7e528 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc107 expref: 30 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.278779:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.278781:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.278787:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.278805:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.278821:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147730.278836:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147730.278848:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094339c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796500224:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147730.278860:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794076672:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 450us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.278867:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8540 00000100:00100000:2.0:1746147730.278918:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.280854:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094339c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796500224:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147730.280875:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147730.280928:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967794076544:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2530us (3599us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.280937:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8539 00000100:00100000:0.0:1746147730.281208:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.281328:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794076928 00000100:00100000:3.0:1746147730.281334:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794076928 00002000:00100000:3.0:1746147730.281363:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (2015232->2019327) req@ffff88009c2a8380 x1830967794076928/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.281371:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a8380 with x1830967794076928 ext(2015232->2019327) 00002000:00010000:3.0:1746147730.281375:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a8380 00000100:00100000:3.0:1746147730.281389:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7525 00000100:00100000:3.0:1746147730.281395:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794076928:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147730.281520:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794076928:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 124us (312us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147730.281525:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7525 00002000:00100000:3.0:1746147730.281531:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (2015232->2019327) req@ffff88009c2a8380 x1830967794076928/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/4536 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.281538:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a8380 with x1830967794076928 ext(2015232->2019327) 00002000:00010000:3.0:1746147730.281540:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a8380 00000100:00100000:0.0:1746147730.283647:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.283747:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794077056 00000100:00100000:2.0:1746147730.283753:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794077056 00000100:00100000:1.0:1746147730.284014:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16764 00000100:00100000:1.0:1746147730.284024:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32347:x1830967794077056:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147730.284038:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.284053:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc13f expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.284077:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e190600/0xe64d3fbf12a7e536 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc115 expref: 30 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.284085:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944cb400/0xe64d3fbf12a7e54b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc12a expref: 24 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.284092:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.284094:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.284097:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->1757183] (req 1048576->1757183) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 30 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.284121:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800944cb400/0xe64d3fbf12a7e54b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc12a expref: 24 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.284130:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800944cb400/0xe64d3fbf12a7e54b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc12a expref: 24 pid: 21480 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.284141:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796500352:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147730.284263:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e190600/0xe64d3fbf12a7e536 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc115 expref: 30 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.284270:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e190600/0xe64d3fbf12a7e536 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc115 expref: 30 pid: 8468 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.284277:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796500480:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147730.284296:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147730.287290:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796500352:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147730.287302:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796500480:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147730.287321:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->1757183] (req 1048576->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 30 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.287336:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308b7600, rc 0) 00000100:00100000:1.0:1746147730.287382:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32347:x1830967794077056:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3360us (3739us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.287390:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16764 00000100:00100000:0.0:1746147730.290035:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.290148:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794077184 00000100:00100000:2.0:1746147730.290155:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794077184 00010000:00010000:2.0:1746147730.290191:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800944cb400/0xe64d3fbf12a7e54b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc12a expref: 25 pid: 21480 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147730.290227:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8541 00000100:00100000:2.0:1746147730.290235:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794077184:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.290247:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147730.290264:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800944cb400/0xe64d3fbf12a7e54b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc12a expref: 25 pid: 21480 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.290279:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800944cb400/0xe64d3fbf12a7e54b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc12a expref: 25 pid: 21480 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.290297:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944cb400/0xe64d3fbf12a7e54b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc12a expref: 25 pid: 21480 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.290312:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147730.290354:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794077184:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 120us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.290360:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8541 00000100:00100000:2.0:1746147730.291507:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.291524:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794077312 00000100:00100000:2.0:1746147730.291527:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794077312 00010000:00010000:2.0:1746147730.291543:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e190600/0xe64d3fbf12a7e536 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc115 expref: 30 pid: 8468 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147730.291632:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8542 00000100:00100000:2.0:1746147730.291639:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a237ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794077312:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.291648:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147730.291658:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e190600/0xe64d3fbf12a7e536 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc115 expref: 30 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.291677:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e190600/0xe64d3fbf12a7e536 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc115 expref: 30 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.291696:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e190600/0xe64d3fbf12a7e536 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc115 expref: 30 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.291706:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.291708:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.291714:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 29 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.291721:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 29 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.291748:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 29 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147730.291758:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094339c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796500608:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147730.291822:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147730.292740:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.292775:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.292919:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794077440 00000100:00100000:1.0:1746147730.292924:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794077440 00000100:00100000:1.0:1746147730.292954:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794077568 00000100:00100000:1.0:1746147730.292956:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794077568 00000100:00100000:1.0:1746147730.292969:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16765 00000100:00100000:1.0:1746147730.292975:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794077440:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147730.292987:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.292997:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801308b7a00/0xe64d3fbf12a7e567 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc146 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147730.293026:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796500736:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147730.293066:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.293119:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16766 00000100:00100000:2.0:1746147730.293125:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794077568:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147730.293131:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147730.293137:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e56e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc14d expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147730.293158:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796500864:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147730.293176:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a299900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.297979:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094339c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796500608:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147730.298007:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147730.298048:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a237ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794077312:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6408us (6541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.298058:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8542 00002000:00010000:1.0:1746147730.298640:0:21480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime: 1746147730 -> 1746147731 00000100:00100000:1.0:1746147730.298659:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796500736:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147730.298703:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801308b7a00/0xe64d3fbf12a7e567 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc146 expref: 27 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.298714:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801308b7a00/0xe64d3fbf12a7e567 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc146 expref: 27 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.298738:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308b7a00, rc 0) 00000100:00100000:1.0:1746147730.298765:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794077440:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5790us (6026us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147730.298771:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16765 00000100:00100000:3.0:1746147730.299114:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796500864:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147730.299129:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e56e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc14d expref: 25 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.299138:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e56e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc14d expref: 25 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.299157:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d9f600, rc 0) 00000100:00100000:3.0:1746147730.299184:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967794077568:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6059us (6408us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147730.299189:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16766 00000100:00100000:0.0:1746147730.301715:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.302037:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794077824 00000100:00100000:2.0:1746147730.302044:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794077824 00002000:00100000:2.0:1746147730.302077:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1753088->1757183) req@ffff88009c2a9500 x1830967794077824/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.302085:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a9500 with x1830967794077824 ext(1753088->1757183) 00002000:00010000:2.0:1746147730.302089:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a9500 00000100:00100000:2.0:1746147730.302118:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7526 00000100:00100000:2.0:1746147730.302125:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794077824:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147730.302270:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794077824:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 145us (559us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147730.302275:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7526 00002000:00100000:2.0:1746147730.302279:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1753088->1757183) req@ffff88009c2a9500 x1830967794077824/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/4536 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.302285:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a9500 with x1830967794077824 ext(1753088->1757183) 00002000:00010000:2.0:1746147730.302287:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a9500 00000100:00100000:2.0:1746147730.306597:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.306793:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794077952 00000100:00100000:3.0:1746147730.306801:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794077952 00000100:00100000:3.0:1746147730.306843:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16767 00000100:00100000:3.0:1746147730.306850:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:32356:x1830967794077952:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147730.306865:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147730.306879:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e575 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc154 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.306926:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 28 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.306938:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147730.306939:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147730.306941:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e575 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc154 expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.306967:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 28 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.306977:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 28 pid: 6715 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746147730.306988:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094691f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796500992:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147730.307063:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93903c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147730.310755:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.312050:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094691f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796500992:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147730.312080:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e575 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc154 expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.312095:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a9400, rc 0) 00000100:00100000:3.0:1746147730.312929:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32356:x1830967794077952:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6077us (6337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.312937:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16767 00000100:00100000:2.0:1746147730.313021:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794078080 00000100:00100000:2.0:1746147730.313028:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794078080 00002000:00100000:2.0:1746147730.313061:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (2015232->2097151) req@ffff88009c2a9880 x1830967794078080/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.313069:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a9880 with x1830967794078080 ext(2015232->2097151) 00010000:00010000:2.0:1746147730.313077:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 29 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.313088:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 29 pid: 6715 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746147730.313094:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c2a9880 00000100:00100000:2.0:1746147730.313112:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1507 00000100:00100000:2.0:1746147730.313118:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794078080:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:2.0:1746147730.316108:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794078080:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 2982us (5352us total) trans 21474841629 rc 0/0 00000100:00100000:2.0:1746147730.316117:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1507 00002000:00100000:2.0:1746147730.316126:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (2015232->2097151) req@ffff88009c2a9880 x1830967794078080/t21474841629(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/448 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.316135:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a9880 with x1830967794078080 ext(2015232->2097151) 00010000:00010000:2.0:1746147730.316143:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 31 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.316156:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 31 pid: 6715 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746147730.316163:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c2a9880 00000100:00100000:0.0:1746147730.319734:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.319877:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794078208 00000100:00100000:2.0:1746147730.319908:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794078208 00010000:00010000:2.0:1746147730.319937:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 31 pid: 6715 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147730.319971:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8543 00000100:00100000:2.0:1746147730.319978:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967794078208:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.319989:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147730.320006:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 31 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.320017:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 31 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.320641:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e559 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc138 expref: 31 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.320665:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.320667:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.320679:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e575 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc154 expref: 24 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.320686:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e575 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc154 expref: 24 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.320712:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e575 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc154 expref: 24 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147730.320723:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796501120:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147730.320793:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.324539:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796501120:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147730.324555:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147730.324591:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794078208:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4613us (4864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.324600:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8543 00000100:00100000:0.0:1746147730.328454:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.329162:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794078464 00000100:00100000:2.0:1746147730.329170:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794078464 00002000:00100000:2.0:1746147730.329205:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009c2a9f80 x1830967794078464/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.329214:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a9f80 with x1830967794078464 ext(1048576->2097151) 00002000:00010000:2.0:1746147730.329219:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a9f80 00000100:00100000:2.0:1746147730.329595:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7527 00000100:00100000:2.0:1746147730.329602:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794078464:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147730.338302:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794078464:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8690us (9844us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147730.338313:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7527 00002000:00100000:2.0:1746147730.338324:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009c2a9f80 x1830967794078464/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.338332:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a9f80 with x1830967794078464 ext(1048576->2097151) 00002000:00010000:2.0:1746147730.338337:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a9f80 00000100:00100000:0.0:1746147730.342330:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.342492:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794078592 00000100:00100000:3.0:1746147730.342500:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794078592 00000100:00100000:3.0:1746147730.342549:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16768 00000100:00100000:3.0:1746147730.342556:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32356:x1830967794078592:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147730.342572:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147730.342587:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e57c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc15b expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.343979:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 29 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.343986:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147730.343988:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147730.343991:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e57c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc15b expref: 26 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.344017:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 29 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.344028:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 29 pid: 21480 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746147730.344039:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094691f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796501248:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147730.344764:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147730.348440:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094691f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796501248:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147730.348471:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e57c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc15b expref: 26 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.348487:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8800, rc 0) 00000100:00100000:3.0:1746147730.348526:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32356:x1830967794078592:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5969us (6201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.348534:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16768 00000100:00100000:0.0:1746147730.353248:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.353342:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794078720 00000100:00100000:2.0:1746147730.353350:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794078720 00002000:00100000:2.0:1746147730.353389:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1757183) req@ffff88009c2aa680 x1830967794078720/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.353397:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2aa680 with x1830967794078720 ext(1048576->1757183) 00010000:00010000:2.0:1746147730.353405:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 30 pid: 21480 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.353417:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 30 pid: 21480 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746147730.353423:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c2aa680 00000100:00100000:2.0:1746147730.354821:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1508 00000100:00100000:2.0:1746147730.354833:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794078720:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:2.0:1746147730.368935:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967794078720:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 14093us (15682us total) trans 21474841630 rc 0/0 00000100:00100000:2.0:1746147730.368948:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1508 00002000:00100000:2.0:1746147730.368961:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1757183) req@ffff88009c2aa680 x1830967794078720/t21474841630(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/448 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.368970:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2aa680 with x1830967794078720 ext(1048576->1757183) 00010000:00010000:2.0:1746147730.368979:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 32 pid: 21480 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.368995:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 32 pid: 21480 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746147730.369298:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c2aa680 00000100:00100000:0.0:1746147730.371735:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.371798:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794078848 00000100:00100000:2.0:1746147730.371805:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794078848 00010000:00010000:2.0:1746147730.371837:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 32 pid: 21480 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147730.371880:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8544 00000100:00100000:2.0:1746147730.372056:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1957:x1830967794078848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.372071:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147730.372089:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 32 pid: 21480 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.372101:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 32 pid: 21480 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.372120:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801308b7600/0xe64d3fbf12a7e560 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc13f expref: 32 pid: 21480 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.372148:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.372149:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.372155:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e57c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc15b expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.372163:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e57c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc15b expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.372192:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e57c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc15b expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147730.372201:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796501376:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147730.373854:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.376125:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796501376:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147730.376140:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147730.376192:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1957:x1830967794078848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4138us (4461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.376202:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8544 00000100:00100000:0.0:1746147730.378630:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.379073:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794079104 00000100:00100000:2.0:1746147730.379080:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794079104 00002000:00100000:2.0:1746147730.379116:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009c2aad80 x1830967794079104/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.379125:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2aad80 with x1830967794079104 ext(1048576->2097151) 00002000:00010000:2.0:1746147730.379129:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2aad80 00000100:00100000:2.0:1746147730.379157:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7528 00000100:00100000:2.0:1746147730.379164:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794079104:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147730.388093:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794079104:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8920us (9464us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147730.388104:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7528 00002000:00100000:2.0:1746147730.388114:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009c2aad80 x1830967794079104/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.388122:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2aad80 with x1830967794079104 ext(1048576->2097151) 00002000:00010000:2.0:1746147730.388127:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2aad80 00000100:00100000:0.0:1746147730.409273:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.409329:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.409353:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794079360 00000100:00100000:2.0:1746147730.409361:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794079360 00002000:00100000:2.0:1746147730.409395:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009c2ab100 x1830967794079360/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.409403:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2ab100 with x1830967794079360 ext(2097152->3145727) 00002000:00010000:2.0:1746147730.409408:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2ab100 00000100:00100000:2.0:1746147730.409432:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794079616 00000100:00100000:2.0:1746147730.409434:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794079616 00002000:00100000:2.0:1746147730.409442:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009c2ab480 x1830967794079616/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 504/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.409448:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2ab480 with x1830967794079616 ext(3145728->4194303) 00002000:00010000:2.0:1746147730.409450:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2ab480 00000100:00100000:2.0:1746147730.409483:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7529 00000100:00100000:2.0:1746147730.409488:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967794079360:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147730.409489:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7530 00000100:00100000:1.0:1746147730.409497:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967794079616:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147730.421315:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.421365:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.421391:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.421474:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794079744 00000100:00100000:1.0:1746147730.421482:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794079744 00000100:00100000:1.0:1746147730.421519:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794079872 00000100:00100000:1.0:1746147730.421521:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794079872 00000100:00100000:1.0:1746147730.421532:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794080000 00000100:00100000:1.0:1746147730.421534:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794080000 00000100:00100000:1.0:1746147730.421547:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16769 00000100:00100000:1.0:1746147730.421553:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794079744:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147730.421568:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.421589:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2275e00/0xe64d3fbf12a7e583 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc162 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.421607:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.421609:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147730.421611:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16770 00010000:00010000:1.0:1746147730.421615:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2275e00/0xe64d3fbf12a7e583 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc162 expref: 34 pid: 21480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147730.421618:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794079872:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147730.421624:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.421629:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2275e00/0xe64d3fbf12a7e583 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc162 expref: 34 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.421630:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e58a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc169 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.421638:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2275e00, rc 0) 00010000:00010000:3.0:1746147730.421640:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147730.421641:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147730.421644:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e58a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc169 expref: 35 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.421652:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e58a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc169 expref: 35 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.421658:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a9e00, rc 0) 00000100:00100000:3.0:1746147730.421703:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967794079872:12345-192.168.202.10@tcp:101:cat.0 Request processed in 85us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.421708:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16770 00000100:00100000:3.0:1746147730.421722:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16771 00000100:00100000:3.0:1746147730.421726:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794080000:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147730.421731:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147730.421736:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e591 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc170 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147730.421765:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094691f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796501504:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147730.421810:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147730.422004:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967794079616:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12508us (12675us total) trans 0 rc 700416/700416 00000100:00100000:3.0:1746147730.422011:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7530 00002000:00100000:3.0:1746147730.422018:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009c2ab480 x1830967794079616/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 504/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 700416/700416 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.422027:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2ab480 with x1830967794079616 ext(3145728->4194303) 00002000:00010000:3.0:1746147730.422030:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2ab480 00000100:00100000:1.0:1746147730.422733:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967794079744:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1179us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.422739:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16769 00000100:00100000:2.0:1746147730.422932:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794079360:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13443us (13666us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147730.422939:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7529 00002000:00100000:2.0:1746147730.422945:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009c2ab100 x1830967794079360/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.422952:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2ab100 with x1830967794079360 ext(2097152->3145727) 00002000:00010000:2.0:1746147730.422955:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2ab100 00002000:00010000:2.0:1746147730.424037:0:8468:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime: 1746147730 -> 1746147731 00002000:00010000:2.0:1746147730.424041:0:8468:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime: 1746147730 -> 1746147731 00002000:00010000:2.0:1746147730.424043:0:8468:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime: 1746147730 -> 1746147731 00000100:00100000:2.0:1746147730.424058:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094691f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796501504:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147730.424083:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e591 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc170 expref: 34 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.424094:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e591 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc170 expref: 34 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.424107:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a9600, rc 0) 00000100:00100000:2.0:1746147730.424129:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967794080000:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2402us (2737us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147730.424134:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16771 00000100:00100000:0.0:1746147730.438392:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.438448:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.438467:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794080256 00000100:00100000:2.0:1746147730.438476:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794080256 00002000:00100000:2.0:1746147730.438519:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009c2a8700 x1830967794080256/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.438531:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a8700 with x1830967794080256 ext(1048576->2097151) 00002000:00010000:2.0:1746147730.438536:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a8700 00000100:00100000:2.0:1746147730.438560:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794080384 00000100:00100000:2.0:1746147730.438563:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794080384 00002000:00100000:2.0:1746147730.438574:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009c2a8e00 x1830967794080384/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147730.438576:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7531 00002000:00100000:2.0:1746147730.438580:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a8e00 with x1830967794080384 ext(1048576->2097151) 00000100:00100000:0.0:1746147730.438582:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794080256:12345-192.168.202.10@tcp:3:cat.0 00002000:00010000:2.0:1746147730.438583:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a8e00 00000100:00100000:2.0:1746147730.438603:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7532 00000100:00100000:2.0:1746147730.438608:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967794080384:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147730.448533:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967794080384:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9916us (10076us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147730.448544:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7532 00002000:00100000:2.0:1746147730.448554:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009c2a8e00 x1830967794080384/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.448569:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a8e00 with x1830967794080384 ext(1048576->2097151) 00002000:00010000:2.0:1746147730.448574:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a8e00 00000100:00100000:0.0:1746147730.449199:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967794080256:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10616us (10812us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147730.449206:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7531 00002000:00100000:0.0:1746147730.449210:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009c2a8700 x1830967794080256/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147730.449216:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a8700 with x1830967794080256 ext(1048576->2097151) 00002000:00010000:0.0:1746147730.449480:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a8700 00000100:00100000:0.0:1746147730.459236:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.459705:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.461437:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794080640 00000100:00100000:1.0:1746147730.461446:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794080640 00000100:00100000:1.0:1746147730.461792:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12061 00000100:00100000:1.0:1746147730.461800:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+26:32362:x1830967794080640:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147730.461822:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.461839:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7e598 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc177 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.461901:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7e59f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.461912:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7e59f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.461921:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7e59f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.461934:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f000/0xe64d3fbf12a7e5a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.461939:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f000/0xe64d3fbf12a7e5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.461943:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f000/0xe64d3fbf12a7e5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00080000:0.0:1746147730.462021:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746147730.462031:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.462040:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc097 expref: 29 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.462048:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095234e00/0xe64d3fbf12a7e4e2 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0cf expref: 351 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.462053:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 5/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.462079:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095234e00/0xe64d3fbf12a7e4e2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0cf expref: 351 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.462090:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095234e00/0xe64d3fbf12a7e4e2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0cf expref: 351 pid: 5744 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.462105:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796501632:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147730.462187:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc097 expref: 29 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.462195:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc097 expref: 29 pid: 14547 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.462202:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796501760:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147730.462225:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.462657:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794080768 00000100:00100000:2.0:1746147730.462662:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794080768 00000100:00100000:2.0:1746147730.464981:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16772 00000100:00100000:2.0:1746147730.464993:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:32360:x1830967794080768:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147730.465008:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147730.465023:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e5b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc17e expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.465047:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4112383) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.465054:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147730.465055:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147730.465058:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e5b4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc17e expref: 34 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.465080:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4112383) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 25 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.465089:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4112383) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 25 pid: 6715 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147730.465098:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796501888:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147730.465179:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147730.465476:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796501632:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147730.465524:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796501760:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147730.465535:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147730.465539:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:3.0:1746147730.465727:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794081024 00000100:00100000:3.0:1746147730.465733:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794081024 00000100:00100000:0.0:1746147730.465761:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.465783:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794081280 00000100:00100000:3.0:1746147730.465820:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794081280 00000100:00100000:1.0:1746147730.465820:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5028 00000100:00100000:1.0:1746147730.465826:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+352:27452:x1830967794081024:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147730.465840:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5029 00000100:00100000:3.0:1746147730.465844:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:27451:x1830967794081280:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00080000:1.0:1746147730.465913:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147730.466040:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:27451:x1830967794081280:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 193us (277us total) trans 8589946086 rc 0/0 00000100:00100000:3.0:1746147730.466046:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5029 00000100:00100000:0.0:1746147730.466093:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+353:27452:x1830967794081024:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 267us (558us total) trans 8589946087 rc 0/0 00000100:00100000:0.0:1746147730.466099:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5028 00000100:00100000:0.0:1746147730.467100:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.467193:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796501888:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147730.467209:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e5b4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc17e expref: 34 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.467220:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d9f600, rc 0) 00000100:00100000:2.0:1746147730.467244:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32360:x1830967794080768:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2254us (7538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.467249:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16772 00000100:00100000:1.0:1746147730.467307:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794081408 00000100:00100000:1.0:1746147730.467311:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794081408 00002000:00100000:1.0:1746147730.467335:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3764224->4112383) req@ffff88009c2a8a80 x1830967794081408/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.467343:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a8a80 with x1830967794081408 ext(3764224->4112383) 00010000:00010000:1.0:1746147730.467348:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4112383) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 26 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.467362:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4112383) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 26 pid: 6715 timeout: 909 lvb_type: 0 00002000:00010000:1.0:1746147730.467368:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c2a8a80 00000100:00100000:1.0:1746147730.467381:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1509 00000100:00100000:1.0:1746147730.467387:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967794081408:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147730.468189:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.468585:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.468998:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794081536 00000100:00100000:1.0:1746147730.469003:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794081536 00010000:00010000:1.0:1746147730.469027:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095234e00/0xe64d3fbf12a7e4e2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0cf expref: 353 pid: 5744 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.469046:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794081664 00000100:00100000:1.0:1746147730.469048:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794081664 00010000:00010000:1.0:1746147730.469058:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc097 expref: 31 pid: 14547 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.469078:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8545 00000100:00100000:1.0:1746147730.469084:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+353:1960:x1830967794081536:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147730.469096:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147730.469101:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095234e00/0xe64d3fbf12a7e4e2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0cf expref: 353 pid: 5744 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.469109:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095234e00/0xe64d3fbf12a7e4e2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0cf expref: 353 pid: 5744 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.469125:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095234e00/0xe64d3fbf12a7e4e2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0cf expref: 353 pid: 5744 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147730.469130:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8546 00000100:00100000:2.0:1746147730.469138:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1957:x1830967794081664:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147730.469144:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147730.469145:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147730.469149:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147730.469150:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc097 expref: 31 pid: 14547 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.469157:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469746:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469753:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147730.469759:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc097 expref: 31 pid: 14547 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.469772:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e4a3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc097 expref: 31 pid: 14547 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.469781:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+352:1960:x1830967794081536:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 697us (1592us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147730.469785:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147730.469788:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147730.469788:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8545 00010000:00010000:2.0:1746147730.469795:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147730.469800:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147730.469816:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147730.469825:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469831:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147730.469834:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1957:x1830967794081664:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 697us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.469840:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8546 00000004:00200000:1.0:1746147730.469865:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:1.0:1746147730.469869:0:5744:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147730.469899:0:5744:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469907:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469915:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7e59f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469920:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7e59f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469925:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7e59f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469930:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013179f200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147730.469932:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7e59f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469938:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7e59f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469944:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147730.469946:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147730.469949:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7e59f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469952:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7e59f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469960:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f000/0xe64d3fbf12a7e5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469964:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f000/0xe64d3fbf12a7e5a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469969:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f000/0xe64d3fbf12a7e5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469973:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013179f000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147730.469975:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f000/0xe64d3fbf12a7e5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469979:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f000/0xe64d3fbf12a7e5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469988:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009129cb00) 00010000:00010000:1.0:1746147730.469990:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147730.469992:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f000/0xe64d3fbf12a7e5a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.469996:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f000/0xe64d3fbf12a7e5a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.470024:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7e598 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc177 expref: 28 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.470033:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc177 expref: 27 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.470038:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147730.470039:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147730.470041:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179ee00, rc 0) 00000100:00100000:1.0:1746147730.470065:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+27:32362:x1830967794080640:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 8266us (10836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.470071:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12061 00000100:00100000:1.0:1746147730.472764:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1958:x1830967794081408:12345-192.168.202.10@tcp:4:cat.0 Request processed in 5370us (5658us total) trans 21474841631 rc 0/0 00000100:00100000:1.0:1746147730.472774:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1509 00002000:00100000:1.0:1746147730.472783:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3764224->4112383) req@ffff88009c2a8a80 x1830967794081408/t21474841631(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/448 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.472791:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a8a80 with x1830967794081408 ext(3764224->4112383) 00010000:00010000:1.0:1746147730.472798:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4112383) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 28 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.472811:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4112383) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 28 pid: 6715 timeout: 909 lvb_type: 0 00002000:00010000:1.0:1746147730.472817:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c2a8a80 00000100:00100000:3.0:1746147730.473047:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.473130:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794081792 00000100:00100000:2.0:1746147730.473135:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794081792 00000100:00100000:2.0:1746147730.473178:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16773 00000100:00100000:2.0:1746147730.473184:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+5:1959:x1830967794081792:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147730.473195:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1746147730.473235:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746147730.473272:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fa00/0xe64d3fbf12a7e5bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc185 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.473291:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.473292:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.473300:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fa00/0xe64d3fbf12a7e5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc185 expref: 6 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.473312:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fa00/0xe64d3fbf12a7e5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc185 expref: 6 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.473321:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d9fa00, rc 0) 00000100:00100000:2.0:1746147730.473343:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794081792:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 159us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.473348:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16773 00000100:00100000:0.0:1746147730.473861:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.473901:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794081920 00000100:00100000:0.0:1746147730.473903:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.473904:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794081920 00000100:00100000:0.0:1746147730.473942:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:1.0:1746147730.473990:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147730.474035:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794082048 00000100:00100000:2.0:1746147730.474039:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794082048 00000100:00100000:0.0:1746147730.474052:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794082176 00000100:00100000:0.0:1746147730.474055:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794082176 00000100:00100000:2.0:1746147730.474056:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16774 00000100:00100000:2.0:1746147730.474060:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794081920:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147730.474068:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147730.474073:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16775 00010000:00010000:2.0:1746147730.474076:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e5c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc18c expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147730.474077:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794082048:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147730.474082:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147730.474087:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147730.474088:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03efc00/0xe64d3fbf12a7e5c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc193 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.474089:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.474093:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e5c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc18c expref: 8 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147730.474096:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147730.474098:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147730.474101:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03efc00/0xe64d3fbf12a7e5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc193 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.474102:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e5c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc18c expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.474108:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d9f000, rc 0) 00010000:00010000:0.0:1746147730.474113:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03efc00/0xe64d3fbf12a7e5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc193 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147730.474119:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03efc00, rc 0) 00000100:00100000:2.0:1746147730.474127:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794081920:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 66us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147730.474130:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794082048:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 53us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.474132:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16774 00000100:00100000:0.0:1746147730.474134:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16775 00000100:00100000:2.0:1746147730.474141:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16776 00000100:00100000:2.0:1746147730.474145:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794082176:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147730.474150:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147730.474155:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9ec00/0xe64d3fbf12a7e5d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc19a expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.474163:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.474164:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.474168:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9ec00/0xe64d3fbf12a7e5d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc19a expref: 7 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.474176:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9ec00/0xe64d3fbf12a7e5d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc19a expref: 7 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.474182:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d9ec00, rc 0) 00000100:00100000:2.0:1746147730.474195:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794082176:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 50us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.474239:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.474249:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794082304 00000100:00100000:3.0:1746147730.474251:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794082304 00000100:00100000:0.0:1746147730.474434:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.474449:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16776 00000100:00100000:2.0:1746147730.474508:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794082432 00000100:00100000:2.0:1746147730.474511:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794082432 00000100:00100000:2.0:1746147730.474548:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16777 00000100:00100000:3.0:1746147730.474552:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16778 00000100:00100000:2.0:1746147730.474553:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794082304:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:3.0:1746147730.474557:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794082432:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147730.474559:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147730.474561:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147730.474565:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e5d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc1a1 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.474566:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e5de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc1a8 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.474574:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.474575:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.474579:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e5d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1a1 expref: 8 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.474586:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e5d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1a1 expref: 8 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.474591:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d9fe00, rc 0) 00000100:00100000:3.0:1746147730.474600:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796502016:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147730.474605:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794082304:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 53us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.474612:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16777 00000100:00100000:3.0:1746147730.474635:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147730.475939:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.476074:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794082688 00000100:00100000:1.0:1746147730.476079:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794082688 00000100:00100000:1.0:1746147730.476115:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12062 00000100:00100000:1.0:1746147730.476120:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:32364:x1830967794082688:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147730.476135:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.476147:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f600/0xe64d3fbf12a7e5e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc1af expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.476220:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.476231:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc177 expref: 26 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.476237:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.476255:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc177 expref: 26 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.476263:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc177 expref: 26 pid: 5744 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.476276:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796502144:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147730.476324:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147730.479492:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.479502:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796502016:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147730.479527:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e5de lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1a8 expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.479538:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e5de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1a8 expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.479560:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a9600, rc 0) 00000100:00100000:2.0:1746147730.479622:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794082816 00000100:00100000:2.0:1746147730.479628:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794082816 00000100:00100000:3.0:1746147730.479632:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794082432:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 5072us (5196us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147730.479642:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16778 00000100:00100000:1.0:1746147730.479647:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796502144:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147730.479654:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4112383) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 28 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.479659:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147730.479684:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8547 00000100:00100000:2.0:1746147730.479689:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967794082816:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.479699:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147730.479707:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3764224->4112383) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 28 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.479715:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3764224->4112383) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 28 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.479729:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fc00/0xe64d3fbf12a7e552 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3764224->4112383) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc131 expref: 28 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.479752:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.479754:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.479760:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e5b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc17e expref: 33 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.479767:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e5b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc17e expref: 33 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.479788:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e5b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc17e expref: 33 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147730.479797:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796502272:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147730.479839:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.480107:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.480166:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794082944 00000100:00100000:1.0:1746147730.480169:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794082944 00010000:00010000:1.0:1746147730.480307:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc177 expref: 27 pid: 5744 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.480330:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8548 00000100:00100000:1.0:1746147730.480335:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8aced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+27:1960:x1830967794082944:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147730.480343:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147730.480348:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc177 expref: 27 pid: 5744 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.480356:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc177 expref: 27 pid: 5744 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.480797:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ee00/0xe64d3fbf12a7e5ad lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc177 expref: 27 pid: 5744 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.480819:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147730.480822:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.480833:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.480837:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.480851:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147730.480872:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8aced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+26:1960:x1830967794082944:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 537us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.480877:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8548 00010000:00010000:0.0:1746147730.480900:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147730.480907:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:0.0:1746147730.480923:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147730.481053:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f600/0xe64d3fbf12a7e5e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1af expref: 33 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147730.481083:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1af expref: 32 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147730.481089:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147730.481091:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147730.481093:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179e600, rc 0) 00000100:00100000:0.0:1746147730.481116:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:32364:x1830967794082688:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4995us (5180us total) trans 8589946088 rc 0/0 00000100:00100000:0.0:1746147730.481185:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12062 00000100:00100000:0.0:1746147730.483132:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.483394:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796502272:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147730.483409:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147730.483438:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794082816:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3747us (3952us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.483446:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8547 00000100:00100000:1.0:1746147730.483570:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794083072 00000100:00100000:1.0:1746147730.483575:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794083072 00000100:00100000:1.0:1746147730.483611:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12063 00000100:00100000:1.0:1746147730.483616:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+26:32362:x1830967794083072:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147730.483631:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.483643:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7e5fa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc1b6 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.484132:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7e5fa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1b6 expref: 27 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.484142:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7e5fa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1b6 expref: 27 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.484154:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147730.484157:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147730.484159:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179e200, rc 0) 00000100:00100000:1.0:1746147730.484188:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+27:32362:x1830967794083072:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 571us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.484194:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12063 00000100:00100000:0.0:1746147730.487687:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.488272:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794083328 00000100:00100000:1.0:1746147730.488282:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794083328 00000100:00100000:1.0:1746147730.488429:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12064 00000100:00100000:1.0:1746147730.488437:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+27:32362:x1830967794083328:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147730.488453:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.488471:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e000/0xe64d3fbf12a7e601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc1bd expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.488564:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ea00/0xe64d3fbf12a7e608 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488574:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ea00/0xe64d3fbf12a7e608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488584:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ea00/0xe64d3fbf12a7e608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488596:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7e60f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488601:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7e60f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488606:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7e60f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488706:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7e616 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488715:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7e616 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488721:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7e616 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:1.0:1746147730.488729:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147730.488794:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ea00/0xe64d3fbf12a7e608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488800:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ea00/0xe64d3fbf12a7e608 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488805:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ea00/0xe64d3fbf12a7e608 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488810:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013179ea00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147730.488814:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ea00/0xe64d3fbf12a7e608 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488820:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ea00/0xe64d3fbf12a7e608 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488827:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147730.488830:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147730.488833:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ea00/0xe64d3fbf12a7e608 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488837:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ea00/0xe64d3fbf12a7e608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488848:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7e60f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488854:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7e60f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488862:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7e60f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488867:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013179e800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147730.488869:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7e60f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488873:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7e60f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488878:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130b32a00) 00010000:00010000:1.0:1746147730.488879:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147730.488881:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7e60f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488914:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7e60f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.488959:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e000/0xe64d3fbf12a7e601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1bd expref: 30 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.488968:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7e616 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1bd expref: 29 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.488974:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147730.488976:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147730.488978:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179f400, rc 0) 00000100:00100000:1.0:1746147730.489022:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+29:32362:x1830967794083328:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 586us (1361us total) trans 8589946089 rc 0/0 00000100:00100000:1.0:1746147730.489027:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12064 00000100:00100000:0.0:1746147730.489391:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.489430:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.489834:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794083584 00000100:00100000:1.0:1746147730.489839:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794083584 00002000:00100000:1.0:1746147730.489866:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fc12a00 x1830967794083584/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.489874:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc12a00 with x1830967794083584 ext(2097152->3145727) 00002000:00010000:1.0:1746147730.489877:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc12a00 00000100:00100000:1.0:1746147730.489919:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794083712 00000100:00100000:1.0:1746147730.489921:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794083712 00000100:00100000:2.0:1746147730.489929:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7533 00002000:00100000:1.0:1746147730.489931:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009ce61880 x1830967794083712/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.489936:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61880 with x1830967794083712 ext(3145728->4194303) 00000100:00100000:2.0:1746147730.489937:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967794083584:12345-192.168.202.10@tcp:3:cat.0 00002000:00010000:1.0:1746147730.489939:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce61880 00000100:00100000:1.0:1746147730.489950:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7534 00000100:00100000:1.0:1746147730.489955:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967794083712:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147730.503362:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.503770:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794083968 00000100:00100000:3.0:1746147730.503778:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794083968 00000100:00100000:3.0:1746147730.503828:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16779 00000100:00100000:3.0:1746147730.503835:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794083968:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147730.503850:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147730.503864:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e624 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc1c4 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.503903:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147730.503906:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147730.503915:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e624 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1c4 expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.503933:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e624 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1c4 expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.503944:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8400, rc 0) 00000100:00100000:3.0:1746147730.503980:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794083968:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 145us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.503986:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16779 00000100:00100000:2.0:1746147730.504024:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967794083584:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14087us (14636us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147730.504032:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7533 00002000:00100000:2.0:1746147730.504041:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fc12a00 x1830967794083584/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.504049:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc12a00 with x1830967794083584 ext(2097152->3145727) 00002000:00010000:2.0:1746147730.504052:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc12a00 00000100:00100000:1.0:1746147730.509774:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967794083712:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19810us (20334us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147730.509785:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7534 00002000:00100000:1.0:1746147730.509795:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009ce61880 x1830967794083712/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.509804:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61880 with x1830967794083712 ext(3145728->4194303) 00002000:00010000:1.0:1746147730.509809:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce61880 00000100:00100000:0.0:1746147730.510055:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.510099:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794084224 00000100:00100000:1.0:1746147730.510107:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794084224 00000100:00100000:1.0:1746147730.510869:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12065 00000100:00100000:1.0:1746147730.510877:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+29:32362:x1830967794084224:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147730.510916:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.510931:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7e62b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc1cb expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.511011:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.511024:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1af expref: 31 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.511029:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.511056:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1af expref: 31 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.511066:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1af expref: 31 pid: 5744 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.511076:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796502400:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147730.511150:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147730.513543:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796502400:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147730.513561:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147730.516030:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.516128:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794084352 00000100:00100000:2.0:1746147730.516134:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794084352 00010000:00010000:2.0:1746147730.516167:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1af expref: 32 pid: 5744 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147730.516203:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8549 00000100:00100000:2.0:1746147730.516211:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a237a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1959:x1830967794084352:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.516223:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147730.516228:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1af expref: 32 pid: 5744 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.516238:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1af expref: 32 pid: 5744 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.516258:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e5ec lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1af expref: 32 pid: 5744 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.516287:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147730.516292:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147730.516299:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147730.516304:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147730.516322:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147730.516361:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.516369:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147730.516374:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a237a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1959:x1830967794084352:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 162us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.516380:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8549 00010000:00010000:1.0:1746147730.516390:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.516395:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.516401:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.516406:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013179ec00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147730.516409:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.516415:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.516423:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147730.516426:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147730.516429:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.516433:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179ec00/0xe64d3fbf12a7e632 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.516476:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7e62b lrc: 1/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1cb expref: 30 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.516483:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7e62b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1cb expref: 30 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.516491:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179f200, rc 0) 00000100:00100000:1.0:1746147730.516514:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+29:32362:x1830967794084224:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 5638us (6465us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147730.516522:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12065 00000100:00100000:2.0:1746147730.520275:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.520345:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794084608 00000100:00100000:0.0:1746147730.520353:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794084608 00000100:00100000:0.0:1746147730.520402:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5030 00000100:00100000:0.0:1746147730.520408:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41587371-240a-4781-aecb-638f17200fbd+29:32362:x1830967794084608:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1746147730.520604:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41587371-240a-4781-aecb-638f17200fbd+30:32362:x1830967794084608:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 195us (334us total) trans 8589946090 rc 0/0 00000100:00100000:0.0:1746147730.520610:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5030 00000100:00100000:0.0:1746147730.534573:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.534636:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794084864 00000100:00100000:1.0:1746147730.534644:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794084864 00000100:00100000:1.0:1746147730.534999:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12066 00000100:00100000:1.0:1746147730.535008:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+352:32366:x1830967794084864:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147730.535026:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.535040:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f800/0xe64d3fbf12a7e639 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc1d2 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.535117:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179fa00/0xe64d3fbf12a7e640 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.535128:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179fa00/0xe64d3fbf12a7e640 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147730.535136:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179fa00/0xe64d3fbf12a7e640 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:1.0:1746147730.535144:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147730.535236:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f800/0xe64d3fbf12a7e639 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d2 expref: 355 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.535271:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179fa00/0xe64d3fbf12a7e640 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d2 expref: 354 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.535278:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147730.535280:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147730.535284:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179fa00, rc 0) 00000100:00100000:1.0:1746147730.535324:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+354:32366:x1830967794084864:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 317us (758us total) trans 8589946091 rc 0/0 00000100:00100000:1.0:1746147730.535330:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12066 00000100:00100000:0.0:1746147730.573005:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.573150:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794084992 00000100:00100000:1.0:1746147730.573158:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794084992 00000100:00100000:1.0:1746147730.573212:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16780 00000100:00100000:1.0:1746147730.573219:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32364:x1830967794084992:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147730.573236:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.573250:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc1d9 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.573277:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d707c00/0xe64d3fbf12a7e4c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ba expref: 21 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.573286:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e5d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1a1 expref: 7 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.573293:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e50c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f2 expref: 29 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.573298:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.573299:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.573302:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2994176->3145727] (req 2994176->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 21 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.573327:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e50c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f2 expref: 29 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.573337:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e50c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f2 expref: 29 pid: 6715 timeout: 909 lvb_type: 1 00000100:00100000:1.0:1746147730.573347:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796502528:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147730.573449:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e5d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1a1 expref: 7 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.573456:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e5d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1a1 expref: 7 pid: 8468 timeout: 909 lvb_type: 1 00000100:00100000:1.0:1746147730.573464:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796502656:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147730.573487:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d707c00/0xe64d3fbf12a7e4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ba expref: 21 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.573494:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d707c00/0xe64d3fbf12a7e4c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ba expref: 21 pid: 6715 timeout: 909 lvb_type: 1 00000100:00100000:1.0:1746147730.573501:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796502784:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147730.573515:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147730.575620:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796502528:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147730.575629:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796502656:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147730.575635:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796502784:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147730.575656:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2994176->3145727] (req 2994176->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 21 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.575686:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179fc00, rc 0) 00000100:00100000:1.0:1746147730.575713:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32364:x1830967794084992:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2494us (2716us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.575721:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16780 00000100:00100000:0.0:1746147730.576244:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.576297:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794085120 00000100:00100000:3.0:1746147730.576303:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794085120 00010000:00010000:3.0:1746147730.576323:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e5d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1a1 expref: 8 pid: 8468 timeout: 909 lvb_type: 1 00000100:00100000:3.0:1746147730.576358:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8550 00000100:00100000:3.0:1746147730.576363:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794085120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147730.576373:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147730.576393:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e5d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1a1 expref: 8 pid: 8468 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746147730.576412:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e5d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1a1 expref: 8 pid: 8468 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746147730.576430:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e5d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1a1 expref: 8 pid: 8468 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746147730.576443:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147730.576464:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+7:1958:x1830967794085120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 101us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.576470:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8550 00000100:00100000:0.0:1746147730.578414:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.578459:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.578466:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794085376 00000100:00100000:1.0:1746147730.578471:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794085376 00000100:00100000:1.0:1746147730.578507:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16781 00000100:00100000:1.0:1746147730.578513:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32366:x1830967794085376:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147730.578525:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.578537:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc1e0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.578558:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e575 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc154 expref: 26 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.578565:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e5c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc18c expref: 8 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.578572:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2275e00/0xe64d3fbf12a7e583 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc162 expref: 35 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.578578:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.578579:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.578582:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [1818624->2097151] (req 1818624->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 35 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.578607:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2275e00/0xe64d3fbf12a7e583 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc162 expref: 35 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.578616:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a2275e00/0xe64d3fbf12a7e583 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc162 expref: 35 pid: 21480 timeout: 909 lvb_type: 1 00000100:00100000:1.0:1746147730.578625:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796502912:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147730.578696:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e5c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc18c expref: 8 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.578704:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e5c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc18c expref: 8 pid: 8468 timeout: 909 lvb_type: 1 00000100:00100000:1.0:1746147730.578712:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796503040:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147730.578736:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e575 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc154 expref: 26 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.578744:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e575 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc154 expref: 26 pid: 6715 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147730.578746:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794085248 00000100:00100000:2.0:1746147730.578750:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794085248 00000100:00100000:1.0:1746147730.578751:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796503168:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147730.578765:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e50c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f2 expref: 30 pid: 6715 timeout: 909 lvb_type: 1 00000100:00100000:1.0:1746147730.578765:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.578791:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8551 00000100:00100000:2.0:1746147730.578797:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794085248:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.578805:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147730.579518:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.579555:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794085504 00000100:00100000:3.0:1746147730.579560:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794085504 00010000:00010000:3.0:1746147730.579575:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d707c00/0xe64d3fbf12a7e4c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ba expref: 21 pid: 6715 timeout: 909 lvb_type: 1 00000100:00100000:3.0:1746147730.579605:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8552 00010000:00010000:2.0:1746147730.579606:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e50c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f2 expref: 30 pid: 6715 timeout: 909 lvb_type: 1 00000100:00100000:3.0:1746147730.579611:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794085504:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.579616:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e50c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f2 expref: 30 pid: 6715 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746147730.579618:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147730.579629:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095150800/0xe64d3fbf12a7e50c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0f2 expref: 30 pid: 6715 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746147730.579753:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d707c00/0xe64d3fbf12a7e4c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ba expref: 21 pid: 6715 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746147730.579762:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d707c00/0xe64d3fbf12a7e4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ba expref: 21 pid: 6715 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746147730.579774:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d707c00/0xe64d3fbf12a7e4c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ba expref: 21 pid: 6715 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746147730.579782:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147730.579784:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147730.579789:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 20 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.579796:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 20 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.579820:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 20 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147730.579828:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796503296:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147730.579838:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147730.579859:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967794085248:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1062us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.579865:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.579865:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8551 00000100:00100000:3.0:1746147730.580358:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.580377:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794085632 00000100:00100000:2.0:1746147730.580381:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794085632 00010000:00010000:2.0:1746147730.580392:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e5c2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc18c expref: 9 pid: 8468 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746147730.580416:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8553 00000100:00100000:2.0:1746147730.580421:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794085632:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.580428:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147730.580441:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e5c2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc18c expref: 9 pid: 8468 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147730.580448:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e5c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc18c expref: 9 pid: 8468 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147730.580460:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147730.580504:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796502912:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147730.580512:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e5c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc18c expref: 9 pid: 8468 timeout: 909 lvb_type: 1 00000100:00100000:0.0:1746147730.580535:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796503040:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147730.580543:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796503168:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147730.580558:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1818624->2097151] (req 1818624->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 35 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147730.580566:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179e600, rc 0) 00000100:00100000:0.0:1746147730.580585:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:32366:x1830967794085376:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2073us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147730.580591:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16781 00000100:00100000:2.0:1746147730.580664:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794085632:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 242us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.580677:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8553 00000100:00100000:3.0:1746147730.582288:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.582299:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.582354:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794085760 00000100:00100000:2.0:1746147730.582358:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794085760 00000100:00100000:3.0:1746147730.582363:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796503296:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147730.582372:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147730.582372:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2275e00/0xe64d3fbf12a7e583 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc162 expref: 35 pid: 21480 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746147730.582388:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794085888 00000100:00100000:3.0:1746147730.582390:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794085504:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2780us (2874us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.582390:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794085888 00000100:00100000:3.0:1746147730.582402:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8552 00010000:00010000:2.0:1746147730.582404:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e575 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc154 expref: 27 pid: 6715 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746147730.582413:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8554 00000100:00100000:3.0:1746147730.582417:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967794085760:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147730.582419:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8555 00010000:00010000:3.0:1746147730.582422:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147730.582424:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967794085888:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.582431:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147730.582432:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a2275e00/0xe64d3fbf12a7e583 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc162 expref: 35 pid: 21480 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746147730.582439:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a2275e00/0xe64d3fbf12a7e583 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc162 expref: 35 pid: 21480 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147730.582439:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e575 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc154 expref: 27 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746147730.582448:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2275e00/0xe64d3fbf12a7e583 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc162 expref: 35 pid: 21480 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746147730.582450:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e575 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc154 expref: 27 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746147730.582463:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147730.582470:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e575 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc154 expref: 27 pid: 6715 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746147730.582472:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967794085760:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 55us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.582476:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8554 00010000:00010000:2.0:1746147730.582478:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.582479:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.582483:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 33 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.582490:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 33 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.582508:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 33 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147730.582517:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796503424:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147730.582566:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147730.583110:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.583167:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794086144 00000100:00100000:1.0:1746147730.583171:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794086144 00002000:00100000:1.0:1746147730.583193:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (2994176->2998271) req@ffff88008fb75880 x1830967794086144/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.583198:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb75880 with x1830967794086144 ext(2994176->2998271) 00002000:00010000:1.0:1746147730.583201:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb75880 00000100:00100000:1.0:1746147730.583300:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7535 00000100:00100000:1.0:1746147730.583306:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794086144:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147730.583435:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794086144:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 129us (326us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147730.583441:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7535 00002000:00100000:1.0:1746147730.583445:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (2994176->2998271) req@ffff88008fb75880 x1830967794086144/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/4536 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.583451:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb75880 with x1830967794086144 ext(2994176->2998271) 00002000:00010000:1.0:1746147730.583454:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fb75880 00000100:00100000:2.0:1746147730.584442:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796503424:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147730.584452:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147730.584472:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967794085888:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2047us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.584479:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8555 00000100:00100000:0.0:1746147730.584623:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.584661:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794086400 00000100:00100000:1.0:1746147730.584676:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794086400 00002000:00100000:1.0:1746147730.584692:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x454:0x0] (1818624->1822719) req@ffff88008fb75c00 x1830967794086400/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.584698:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb75c00 with x1830967794086400 ext(1818624->1822719) 00002000:00010000:1.0:1746147730.584704:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb75c00 00000100:00100000:1.0:1746147730.584720:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7536 00000100:00100000:1.0:1746147730.584725:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967794086400:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147730.584802:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967794086400:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 76us (179us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147730.584807:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7536 00002000:00100000:1.0:1746147730.584812:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x454:0x0] (1818624->1822719) req@ffff88008fb75c00 x1830967794086400/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/4536 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.584818:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fb75c00 with x1830967794086400 ext(1818624->1822719) 00002000:00010000:1.0:1746147730.584821:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fb75c00 00000100:00100000:0.0:1746147730.586551:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.586603:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794086528 00000100:00100000:2.0:1746147730.586609:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794086528 00000100:00100000:2.0:1746147730.586639:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16782 00000100:00100000:2.0:1746147730.586644:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32364:x1830967794086528:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147730.586657:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147730.586681:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc1e7 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.586702:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e5b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc17e expref: 33 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.586710:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e624 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1c4 expref: 7 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.586716:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.586718:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.586721:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->2662399] (req 2097152->2662399) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.586742:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e624 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1c4 expref: 7 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.586752:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e624 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1c4 expref: 7 pid: 9615 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746147730.586762:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796503552:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147730.586831:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e5b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc17e expref: 33 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.586839:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e5b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc17e expref: 33 pid: 8468 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746147730.586852:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796503680:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147730.587414:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147730.587809:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.587863:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794086656 00000100:00100000:3.0:1746147730.587867:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794086656 00000100:00100000:2.0:1746147730.587875:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796503552:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147730.587903:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16783 00000100:00100000:3.0:1746147730.587908:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32366:x1830967794086656:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147730.587920:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147730.587930:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc1ee expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.587944:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e57c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc15b expref: 27 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.587951:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03efc00/0xe64d3fbf12a7e5c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc193 expref: 7 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.587958:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e58a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc169 expref: 35 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.587963:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147730.587964:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147730.587966:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1048576->1298431] (req 1048576->1298431) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 35 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.587986:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e58a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc169 expref: 35 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.587993:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e58a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc169 expref: 35 pid: 8468 timeout: 909 lvb_type: 1 00000100:00100000:3.0:1746147730.588001:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796503808:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147730.588035:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03efc00/0xe64d3fbf12a7e5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc193 expref: 7 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.588042:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03efc00/0xe64d3fbf12a7e5c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc193 expref: 7 pid: 8184 timeout: 909 lvb_type: 1 00000100:00100000:3.0:1746147730.588049:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796503936:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147730.588065:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e57c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc15b expref: 27 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.588072:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e57c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc15b expref: 27 pid: 6715 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746147730.588079:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796504064:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147730.588090:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9390480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.588251:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.588371:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796503680:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147730.588385:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794086784 00010000:00010000:3.0:1746147730.588388:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->2662399] (req 2097152->2662399) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147730.588388:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794086784 00010000:00010000:0.0:1746147730.588402:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e624 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1c4 expref: 8 pid: 9615 timeout: 909 lvb_type: 1 00000100:00100000:0.0:1746147730.588424:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8556 00000100:00100000:0.0:1746147730.588429:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a237a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794086784:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147730.588437:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147730.588618:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d9f400, rc 0) 00000100:00100000:3.0:1746147730.588646:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32364:x1830967794086528:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2001us (2098us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.588651:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16782 00010000:00010000:0.0:1746147730.588746:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e624 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1c4 expref: 8 pid: 9615 timeout: 909 lvb_type: 1 00010000:00010000:0.0:1746147730.588761:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e624 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1c4 expref: 8 pid: 9615 timeout: 909 lvb_type: 1 00010000:00010000:0.0:1746147730.588775:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e624 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1c4 expref: 8 pid: 9615 timeout: 909 lvb_type: 1 00010000:00010000:0.0:1746147730.588793:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147730.588815:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a237a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794086784:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 385us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147730.588821:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8556 00000100:00100000:0.0:1746147730.590849:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.590851:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796503808:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147730.590947:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794086912 00000100:00100000:1.0:1746147730.590951:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794086912 00010000:00010000:1.0:1746147730.590971:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e58a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc169 expref: 36 pid: 8468 timeout: 909 lvb_type: 1 00000100:00100000:1.0:1746147730.591150:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8557 00000100:00100000:1.0:1746147730.591157:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1957:x1830967794086912:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147730.591167:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147730.591182:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e58a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc169 expref: 36 pid: 8468 timeout: 909 lvb_type: 1 00010000:00010000:1.0:1746147730.591191:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e58a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc169 expref: 36 pid: 8468 timeout: 909 lvb_type: 1 00010000:00010000:1.0:1746147730.591206:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e58a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc169 expref: 36 pid: 8468 timeout: 909 lvb_type: 1 00010000:00010000:1.0:1746147730.591310:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147730.591340:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967794086912:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 184us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.591346:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8557 00000100:00100000:1.0:1746147730.591375:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.591385:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794087040 00000100:00100000:1.0:1746147730.591387:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794087040 00010000:00010000:1.0:1746147730.591395:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e5b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc17e expref: 35 pid: 8468 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746147730.591495:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796503936:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147730.591587:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8558 00000100:00100000:1.0:1746147730.591592:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967794087040:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147730.591599:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147730.591607:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e5b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc17e expref: 35 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.591615:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e5b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc17e expref: 35 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.591625:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f600/0xe64d3fbf12a7e5b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc17e expref: 35 pid: 8468 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.591632:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.591634:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.591639:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 26 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.591645:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 26 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.591674:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 26 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147730.591688:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796504192:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147730.592092:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.592189:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147730.592231:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794087168 00000100:00100000:3.0:1746147730.592234:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794087168 00010000:00010000:3.0:1746147730.592247:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03efc00/0xe64d3fbf12a7e5c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc193 expref: 7 pid: 8184 timeout: 909 lvb_type: 1 00000100:00100000:3.0:1746147730.592263:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8559 00000100:00100000:3.0:1746147730.592267:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794087168:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147730.592274:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147730.592282:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03efc00/0xe64d3fbf12a7e5c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc193 expref: 7 pid: 8184 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746147730.592290:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03efc00/0xe64d3fbf12a7e5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc193 expref: 7 pid: 8184 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746147730.592300:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03efc00/0xe64d3fbf12a7e5c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc193 expref: 7 pid: 8184 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746147730.592313:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147730.592330:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794087168:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 62us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.592336:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8559 00000100:00100000:3.0:1746147730.592354:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796504064:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147730.592370:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->1298431] (req 1048576->1298431) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 34 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.592378:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a9000, rc 0) 00000100:00100000:3.0:1746147730.592393:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32366:x1830967794086656:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4485us (4585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.592399:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16783 00000100:00100000:1.0:1746147730.593194:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796504192:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147730.593200:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147730.593320:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967794087040:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1729us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.593324:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8558 00000100:00100000:0.0:1746147730.596762:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.597113:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794087296 00000100:00100000:1.0:1746147730.597120:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794087296 00010000:00010000:1.0:1746147730.597146:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e57c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc15b expref: 27 pid: 6715 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.597168:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8560 00000100:00100000:1.0:1746147730.597175:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794087296:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147730.597185:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147730.597203:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e57c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc15b expref: 27 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.597213:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e57c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc15b expref: 27 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.597233:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7e57c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc15b expref: 27 pid: 6715 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.597249:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.597250:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.597256:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 32 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.597263:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 32 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.597288:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 32 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147730.597298:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796504320:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147730.597379:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147730.599281:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.599357:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794087552 00000100:00100000:1.0:1746147730.599362:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794087552 00002000:00100000:1.0:1746147730.599389:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2658304->2662399) req@ffff8800a0434000 x1830967794087552/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.599399:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0434000 with x1830967794087552 ext(2658304->2662399) 00002000:00010000:1.0:1746147730.599403:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0434000 00000100:00100000:1.0:1746147730.599428:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7537 00000100:00100000:1.0:1746147730.599433:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794087552:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147730.599555:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794087552:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 121us (279us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147730.599561:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7537 00002000:00100000:1.0:1746147730.599566:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2658304->2662399) req@ffff8800a0434000 x1830967794087552/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/4536 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.599573:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0434000 with x1830967794087552 ext(2658304->2662399) 00002000:00010000:1.0:1746147730.599576:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0434000 00000100:00100000:0.0:1746147730.603210:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.603234:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796504320:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147730.603249:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147730.603269:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794087808 00000100:00100000:2.0:1746147730.603275:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794087808 00000100:00100000:1.0:1746147730.603291:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794087296:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6115us (6533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.603300:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8560 00002000:00100000:2.0:1746147730.603309:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1294336->1298431) req@ffff8800956b7800 x1830967794087808/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.603318:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b7800 with x1830967794087808 ext(1294336->1298431) 00002000:00010000:2.0:1746147730.603322:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800956b7800 00000100:00100000:2.0:1746147730.603337:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7538 00000100:00100000:2.0:1746147730.603343:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794087808:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147730.604310:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.604362:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794088064 00000100:00100000:3.0:1746147730.604365:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794088064 00000100:00100000:3.0:1746147730.604384:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5031 00000100:00100000:3.0:1746147730.604388:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:32364:x1830967794088064:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:2.0:1746147730.604486:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794087808:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 1142us (1281us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147730.604492:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7538 00002000:00100000:2.0:1746147730.604498:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1294336->1298431) req@ffff8800956b7800 x1830967794087808/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/4536 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746147730.604499:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:32364:x1830967794088064:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 111us (190us total) trans 8589946092 rc 0/0 00000100:00100000:3.0:1746147730.604503:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5031 00002000:00100000:2.0:1746147730.604505:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b7800 with x1830967794087808 ext(1294336->1298431) 00002000:00010000:2.0:1746147730.604508:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800956b7800 00000100:00100000:0.0:1746147730.648582:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.648634:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.648692:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794088192 00000100:00100000:3.0:1746147730.648700:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794088192 00000100:00100000:3.0:1746147730.648737:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794088320 00000100:00100000:3.0:1746147730.648738:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794088320 00000100:00100000:2.0:1746147730.648748:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16784 00000100:00100000:2.0:1746147730.648759:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794088192:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147730.648768:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16785 00000100:00100000:3.0:1746147730.648773:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967794088320:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147730.648782:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147730.648782:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147730.648796:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f800/0xe64d3fbf12a7e66a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc1fc expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.648796:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095234e00/0xe64d3fbf12a7e671 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc1f5 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147730.648837:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796504576:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147730.648838:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796504448:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147730.648967:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c9809c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147730.649318:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.651200:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796504448:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147730.651224:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095234e00/0xe64d3fbf12a7e671 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1f5 expref: 29 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.651237:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095234e00/0xe64d3fbf12a7e671 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1f5 expref: 29 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.651251:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095234e00, rc 0) 00000100:00100000:2.0:1746147730.651295:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967794088192:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2539us (2719us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147730.651302:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16784 00000100:00100000:3.0:1746147730.651387:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796504576:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147730.651400:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f800/0xe64d3fbf12a7e66a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1fc expref: 27 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.651408:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f800/0xe64d3fbf12a7e66a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1fc expref: 27 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147730.651418:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d9f800, rc 0) 00000100:00100000:3.0:1746147730.651437:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794088320:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2663us (2802us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147730.651442:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16785 00000100:00100000:0.0:1746147730.658009:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.658109:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794088448 00000100:00100000:3.0:1746147730.658116:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794088448 00000100:00100000:3.0:1746147730.658407:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16786 00000100:00100000:3.0:1746147730.658415:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32373:x1830967794088448:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147730.658433:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147730.658448:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9ee00/0xe64d3fbf12a7e678 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc203 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.658476:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 32 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.658483:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147730.658485:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147730.658488:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9ee00/0xe64d3fbf12a7e678 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc203 expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.658512:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 32 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.658524:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 32 pid: 8184 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746147730.658534:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796504704:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147730.659657:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147730.660385:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796504704:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147730.660402:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9ee00/0xe64d3fbf12a7e678 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc203 expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.660411:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d9ee00, rc 0) 00000100:00100000:3.0:1746147730.660433:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32373:x1830967794088448:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2020us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.660438:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16786 00000100:00100000:0.0:1746147730.661101:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.661186:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794088576 00000100:00100000:2.0:1746147730.661191:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794088576 00002000:00100000:2.0:1746147730.661220:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1818624->2097151) req@ffff8800a5d7dc00 x1830967794088576/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.661228:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7dc00 with x1830967794088576 ext(1818624->2097151) 00010000:00010000:2.0:1746147730.661234:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 33 pid: 8184 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.661248:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 33 pid: 8184 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746147730.661259:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7dc00 00000100:00100000:2.0:1746147730.661326:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1510 00000100:00100000:2.0:1746147730.661332:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967794088576:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:2.0:1746147730.666121:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967794088576:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 4780us (5012us total) trans 21474841632 rc 0/0 00000100:00100000:2.0:1746147730.666133:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1510 00002000:00100000:2.0:1746147730.666143:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1818624->2097151) req@ffff8800a5d7dc00 x1830967794088576/t21474841632(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/448 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.666152:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7dc00 with x1830967794088576 ext(1818624->2097151) 00010000:00010000:2.0:1746147730.666161:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 35 pid: 8184 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746147730.666175:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 35 pid: 8184 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746147730.666183:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7dc00 00000100:00100000:0.0:1746147730.672133:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.672255:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794088704 00000100:00100000:1.0:1746147730.672265:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794088704 00010000:00010000:1.0:1746147730.672305:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 35 pid: 8184 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.672334:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8561 00000100:00100000:1.0:1746147730.672342:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967794088704:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147730.672359:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147730.672382:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 35 pid: 8184 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.672394:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 35 pid: 8184 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.672419:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013179e600/0xe64d3fbf12a7e655 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e0 expref: 35 pid: 8184 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.672455:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.672458:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.672466:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9ee00/0xe64d3fbf12a7e678 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc203 expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.672473:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9ee00/0xe64d3fbf12a7e678 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc203 expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.672508:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9ee00/0xe64d3fbf12a7e678 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc203 expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147730.672521:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796504832:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147730.672604:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147730.677799:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.677953:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794088960 00000100:00100000:2.0:1746147730.677962:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794088960 00002000:00100000:2.0:1746147730.678008:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a5d7c000 x1830967794088960/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.678018:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c000 with x1830967794088960 ext(1048576->2097151) 00002000:00010000:2.0:1746147730.678023:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7c000 00000100:00100000:2.0:1746147730.678277:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7539 00000100:00100000:2.0:1746147730.678289:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967794088960:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147730.678549:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796504832:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147730.678568:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147730.678703:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967794088704:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6360us (6581us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.678712:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8561 00000100:00100000:2.0:1746147730.691721:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967794088960:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13417us (13915us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147730.691736:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7539 00002000:00100000:2.0:1746147730.691750:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a5d7c000 x1830967794088960/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.691761:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c000 with x1830967794088960 ext(1048576->2097151) 00002000:00010000:2.0:1746147730.691768:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7c000 00000100:00100000:0.0:1746147730.695811:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.695981:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794089088 00000100:00100000:3.0:1746147730.695990:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794089088 00000100:00100000:3.0:1746147730.696050:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16787 00000100:00100000:3.0:1746147730.696361:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32373:x1830967794089088:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147730.696379:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147730.696395:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e67f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc20a expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.696419:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 33 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.696425:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147730.696426:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147730.696430:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e67f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc20a expref: 28 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.696454:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 33 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.696465:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 33 pid: 9615 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746147730.696475:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796504960:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147730.696650:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a93903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147730.698328:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094692300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796504960:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147730.698350:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e67f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc20a expref: 28 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.698362:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d9fe00, rc 0) 00000100:00100000:3.0:1746147730.698422:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32373:x1830967794089088:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2063us (2623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.698430:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16787 00000100:00100000:0.0:1746147730.698824:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.699178:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794089216 00000100:00100000:3.0:1746147730.699183:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794089216 00002000:00100000:3.0:1746147730.699212:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1298431) req@ffff8800a5d7ed80 x1830967794089216/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.699221:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ed80 with x1830967794089216 ext(1048576->1298431) 00010000:00010000:3.0:1746147730.699227:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 34 pid: 9615 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746147730.699238:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 34 pid: 9615 timeout: 909 lvb_type: 0 00002000:00010000:3.0:1746147730.699243:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7ed80 00000100:00100000:3.0:1746147730.699269:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1511 00000100:00100000:3.0:1746147730.699275:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967794089216:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:3.0:1746147730.704229:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967794089216:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 4946us (5399us total) trans 21474841633 rc 0/0 00000100:00100000:3.0:1746147730.704240:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1511 00002000:00100000:3.0:1746147730.704250:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1298431) req@ffff8800a5d7ed80 x1830967794089216/t21474841633(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/448 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.704258:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ed80 with x1830967794089216 ext(1048576->1298431) 00010000:00010000:3.0:1746147730.704267:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 36 pid: 9615 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746147730.704284:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 36 pid: 9615 timeout: 909 lvb_type: 0 00002000:00010000:3.0:1746147730.704290:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7ed80 00000100:00100000:0.0:1746147730.706422:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.706598:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794089344 00000100:00100000:1.0:1746147730.706606:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794089344 00010000:00010000:1.0:1746147730.706632:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 36 pid: 9615 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.706674:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8562 00000100:00100000:1.0:1746147730.706681:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1957:x1830967794089344:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147730.706694:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147730.706711:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 36 pid: 9615 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.706720:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 36 pid: 9615 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.706738:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e663 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1ee expref: 36 pid: 9615 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.706966:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.706969:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.706975:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e67f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc20a expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.706982:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e67f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc20a expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.707009:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e67f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc20a expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147730.707019:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796505088:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147730.707080:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147730.708287:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796505088:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147730.708300:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147730.708324:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967794089344:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1643us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.708332:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8562 00000100:00100000:0.0:1746147730.712586:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.712819:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794089600 00000100:00100000:3.0:1746147730.712827:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794089600 00002000:00100000:3.0:1746147730.712864:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a5d7fb80 x1830967794089600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.712873:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7fb80 with x1830967794089600 ext(1048576->2097151) 00002000:00010000:3.0:1746147730.712877:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7fb80 00000100:00100000:3.0:1746147730.713126:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7540 00000100:00100000:3.0:1746147730.713134:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967794089600:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147730.724564:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967794089600:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11423us (11978us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147730.724576:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7540 00002000:00100000:3.0:1746147730.724586:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a5d7fb80 x1830967794089600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.724595:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7fb80 with x1830967794089600 ext(1048576->2097151) 00002000:00010000:3.0:1746147730.724600:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7fb80 00000100:00100000:0.0:1746147730.749560:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.750259:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794089984 00000100:00100000:3.0:1746147730.750268:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794089984 00000100:00100000:0.0:1746147730.750279:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.750308:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.750329:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794090112 00000100:00100000:1.0:1746147730.750333:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794090112 00000100:00100000:0.0:1746147730.750348:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00100000:1.0:1746147730.750352:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3297280->4194303) req@ffff880130d27b80 x1830967794090112/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147730.750360:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794090496 00002000:00100000:1.0:1746147730.750361:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d27b80 with x1830967794090112 ext(3297280->4194303) 00000100:00100000:0.0:1746147730.750363:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794090496 00000100:00100000:2.0:1746147730.750364:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794090368 00002000:00010000:1.0:1746147730.750365:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d27b80 00000100:00100000:2.0:1746147730.750368:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794090368 00000100:00100000:1.0:1746147730.750381:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7541 00002000:00100000:0.0:1746147730.750381:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (3710976->4194303) req@ffff880130d27480 x1830967794090496/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.750386:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (2662400->3710975) req@ffff880130d25180 x1830967794090368/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147730.750386:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794090112:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:0.0:1746147730.750388:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d27480 with x1830967794090496 ext(3710976->4194303) 00002000:00010000:0.0:1746147730.750390:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d27480 00002000:00100000:2.0:1746147730.750394:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d25180 with x1830967794090368 ext(2662400->3710975) 00002000:00010000:2.0:1746147730.750397:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d25180 00000100:00100000:0.0:1746147730.750411:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7542 00000100:00100000:0.0:1746147730.750417:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967794090496:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147730.750431:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7543 00000100:00100000:2.0:1746147730.750437:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967794090368:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:3.0:1746147730.750909:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3297279) req@ffff8800a5d7c700 x1830967794089984/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 504/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.750923:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c700 with x1830967794089984 ext(2097152->3297279) 00002000:00010000:3.0:1746147730.750926:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7c700 00000100:00100000:3.0:1746147730.750942:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7544 00000100:00100000:3.0:1746147730.750948:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794089984:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147730.753480:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.753521:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.753535:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.753560:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.753578:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794090752 00000100:00100000:0.0:1746147730.753583:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794090752 00000100:00100000:0.0:1746147730.753611:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794090880 00000100:00100000:0.0:1746147730.753612:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794090880 00000100:00100000:0.0:1746147730.753621:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794091008 00000100:00100000:0.0:1746147730.753623:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794091008 00000100:00100000:0.0:1746147730.753632:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794091136 00000100:00100000:0.0:1746147730.753634:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794091136 00000100:00100000:0.0:1746147730.753657:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16788 00000100:00100000:0.0:1746147730.753671:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1957:x1830967794090752:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147730.753684:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147730.753700:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2275200/0xe64d3fbf12a7e686 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc211 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147730.753720:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147730.753721:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147730.753729:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2275200/0xe64d3fbf12a7e686 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc211 expref: 38 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147730.753741:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2275200/0xe64d3fbf12a7e686 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc211 expref: 38 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147730.753751:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2275200, rc 0) 00000100:00100000:0.0:1746147730.753778:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967794090752:12345-192.168.202.10@tcp:101:cat.0 Request processed in 115us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147730.753784:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16788 00000100:00100000:0.0:1746147730.753798:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16789 00000100:00100000:0.0:1746147730.753803:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1957:x1830967794090880:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147730.753808:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147730.753813:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2275c00/0xe64d3fbf12a7e68d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc218 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147730.753821:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147730.753823:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147730.753826:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2275c00/0xe64d3fbf12a7e68d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc218 expref: 38 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147730.753834:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2275c00/0xe64d3fbf12a7e68d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc218 expref: 38 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147730.753845:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2275c00, rc 0) 00000100:00100000:0.0:1746147730.753860:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967794090880:12345-192.168.202.10@tcp:101:cat.0 Request processed in 57us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147730.753869:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16789 00000100:00100000:0.0:1746147730.753879:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16790 00000100:00100000:0.0:1746147730.753899:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967794091008:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147730.753906:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147730.753914:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a2275a00/0xe64d3fbf12a7e694 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc21f expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147730.754075:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e387100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796505216:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147730.754122:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147730.754123:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16791 00000100:00100000:1.0:1746147730.754131:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1957:x1830967794091136:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147730.754138:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.754145:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013179ea00/0xe64d3fbf12a7e69b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc226 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147730.754165:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796505344:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147730.754188:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.755992:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1960:x1830967794090496:12345-192.168.202.10@tcp:3:cat.0 Request processed in 5566us (5675us total) trans 0 rc 483328/483328 00000100:00100000:2.0:1746147730.756005:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7542 00002000:00100000:2.0:1746147730.756015:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (3710976->4194303) req@ffff880130d27480 x1830967794090496/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 483328/483328 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.756024:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d27480 with x1830967794090496 ext(3710976->4194303) 00002000:00010000:2.0:1746147730.756029:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d27480 00000100:00100000:2.0:1746147730.762005:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967794090368:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11560us (11648us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147730.762017:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7543 00002000:00100000:2.0:1746147730.762027:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2662400->3710975) req@ffff880130d25180 x1830967794090368/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.762035:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d25180 with x1830967794090368 ext(2662400->3710975) 00002000:00010000:2.0:1746147730.762040:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d25180 00002000:00010000:2.0:1746147730.767075:0:6715:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime: 1746147730 -> 1746147731 00000100:00100000:1.0:1746147730.767080:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796505344:192.168.202.10@tcp:106: 00002000:00010000:2.0:1746147730.767081:0:6715:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147729 -> 1746147731 00002000:00010000:2.0:1746147730.767083:0:6715:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime: 1746147730 -> 1746147731 00000100:00100000:2.0:1746147730.767094:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e387100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796505216:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147730.767106:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013179ea00/0xe64d3fbf12a7e69b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc226 expref: 38 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.767112:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a2275a00/0xe64d3fbf12a7e694 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc21f expref: 30 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.767118:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013179ea00/0xe64d3fbf12a7e69b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc226 expref: 38 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.767121:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a2275a00/0xe64d3fbf12a7e694 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc21f expref: 30 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.767146:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2275a00, rc 0) 00010000:00010000:1.0:1746147730.767151:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179ea00, rc 0) 00000100:00100000:1.0:1746147730.768098:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1957:x1830967794091136:12345-192.168.202.10@tcp:101:cat.0 Request processed in 13965us (14533us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147730.768107:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16791 00000100:00100000:2.0:1746147730.768659:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967794091008:12345-192.168.202.10@tcp:101:cat.0 Request processed in 14773us (15120us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147730.768674:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16790 00000100:00100000:1.0:1746147730.768995:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967794090112:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18607us (18715us total) trans 0 rc 897024/897024 00000100:00100000:1.0:1746147730.769002:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7541 00002000:00100000:1.0:1746147730.769010:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3297280->4194303) req@ffff880130d27b80 x1830967794090112/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.769018:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d27b80 with x1830967794090112 ext(3297280->4194303) 00002000:00010000:1.0:1746147730.769022:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d27b80 00000100:00100000:3.0:1746147730.773536:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794089984:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22579us (23974us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147730.773547:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7544 00002000:00100000:3.0:1746147730.773557:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3297279) req@ffff8800a5d7c700 x1830967794089984/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 504/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.773566:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c700 with x1830967794089984 ext(2097152->3297279) 00002000:00010000:3.0:1746147730.773571:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7c700 00000100:00100000:0.0:1746147730.777036:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.778388:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.778479:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794091392 00000100:00100000:3.0:1746147730.778488:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794091392 00002000:00100000:3.0:1746147730.778525:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88012e385180 x1830967794091392/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.778533:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e385180 with x1830967794091392 ext(1048576->2097151) 00002000:00010000:3.0:1746147730.778538:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e385180 00000100:00100000:3.0:1746147730.778563:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794091648 00000100:00100000:3.0:1746147730.778565:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794091648 00002000:00100000:3.0:1746147730.778572:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009fe95500 x1830967794091648/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.778578:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe95500 with x1830967794091648 ext(1048576->2097151) 00002000:00010000:3.0:1746147730.778580:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe95500 00000100:00100000:3.0:1746147730.778589:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7545 00000100:00100000:3.0:1746147730.778595:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967794091392:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147730.778708:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7546 00000100:00100000:2.0:1746147730.778716:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967794091648:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147730.785998:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.786073:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794091904 00000100:00100000:0.0:1746147730.786080:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794091904 00002000:00100000:0.0:1746147730.786116:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a8acfb80 x1830967794091904/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147730.786125:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acfb80 with x1830967794091904 ext(4194304->5017599) 00002000:00010000:0.0:1746147730.786131:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acfb80 00000100:00100000:0.0:1746147730.786150:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7547 00000100:00100000:0.0:1746147730.786157:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967794091904:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147730.792168:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1957:x1830967794091392:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13564us (15133us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147730.792183:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7545 00002000:00100000:0.0:1746147730.792194:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88012e385180 x1830967794091392/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147730.792204:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e385180 with x1830967794091392 ext(1048576->2097151) 00002000:00010000:0.0:1746147730.792209:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e385180 00000100:00100000:3.0:1746147730.792475:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1957:x1830967794091648:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13759us (14089us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147730.792483:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7546 00002000:00100000:3.0:1746147730.792488:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009fe95500 x1830967794091648/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.792495:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe95500 with x1830967794091648 ext(1048576->2097151) 00002000:00010000:3.0:1746147730.792498:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe95500 00010000:00010000:1.0:1746147730.797336:0:7099:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147730.801048:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967794091904:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14883us (15049us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147730.801059:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7547 00002000:00100000:1.0:1746147730.801069:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a8acfb80 x1830967794091904/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.801078:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acfb80 with x1830967794091904 ext(4194304->5017599) 00002000:00010000:1.0:1746147730.801083:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acfb80 00000100:00100000:0.0:1746147730.806066:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.806120:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.806205:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794092032 00000100:00100000:2.0:1746147730.806214:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794092032 00000100:00100000:2.0:1746147730.806251:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794092160 00000100:00100000:2.0:1746147730.806253:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794092160 00000100:00100000:2.0:1746147730.806270:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16792 00000100:00100000:2.0:1746147730.806276:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794092032:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147730.806292:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147730.806295:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16793 00000100:00100000:1.0:1746147730.806302:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1959:x1830967794092160:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147730.806306:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a736ea00/0xe64d3fbf12a7e6a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc22d expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.806311:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.806321:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134985800/0xe64d3fbf12a7e6a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc234 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147730.806351:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796505600:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147730.806429:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147730.806536:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796505472:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147730.806733:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.808577:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796505600:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147730.808598:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a736ea00/0xe64d3fbf12a7e6a2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc22d expref: 30 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.808608:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a736ea00/0xe64d3fbf12a7e6a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc22d expref: 30 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.808625:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736ea00, rc 0) 00000100:00100000:2.0:1746147730.808677:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794092032:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2400us (2617us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147730.808683:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16792 00000100:00100000:1.0:1746147730.809472:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796505472:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147730.809489:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134985800/0xe64d3fbf12a7e6a9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc234 expref: 38 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.809498:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134985800/0xe64d3fbf12a7e6a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc234 expref: 38 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147730.809521:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134985800, rc 0) 00000100:00100000:1.0:1746147730.809543:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1959:x1830967794092160:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3242us (3423us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147730.809549:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16793 00000100:00100000:0.0:1746147730.815566:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.815803:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794092288 00000100:00100000:1.0:1746147730.815811:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794092288 00000100:00100000:1.0:1746147730.815847:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16794 00000100:00100000:1.0:1746147730.815853:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32376:x1830967794092288:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147730.815868:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.815908:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134985c00/0xe64d3fbf12a7e6b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc23b expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.815936:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 19 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.815945:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147730.815947:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147730.815950:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134985c00/0xe64d3fbf12a7e6b0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc23b expref: 30 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.815976:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 19 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.815988:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 19 pid: 8184 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.815998:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796505728:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147730.816078:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147730.818452:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796505728:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147730.818482:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134985c00/0xe64d3fbf12a7e6b0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc23b expref: 30 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.818497:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134985c00, rc 0) 00000100:00100000:1.0:1746147730.818548:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32376:x1830967794092288:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2694us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.818558:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16794 00000100:00100000:0.0:1746147730.819313:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.820582:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794092416 00000100:00100000:1.0:1746147730.820590:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794092416 00002000:00100000:1.0:1746147730.820624:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2994176->3145727) req@ffff88012e387100 x1830967794092416/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.820637:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e387100 with x1830967794092416 ext(2994176->3145727) 00010000:00010000:1.0:1746147730.820645:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 20 pid: 8184 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.820657:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 20 pid: 8184 timeout: 909 lvb_type: 0 00002000:00010000:1.0:1746147730.820676:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e387100 00000100:00100000:1.0:1746147730.820702:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1512 00000100:00100000:1.0:1746147730.820708:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794092416:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147730.824795:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967794092416:12345-192.168.202.10@tcp:4:cat.0 Request processed in 4078us (5475us total) trans 17179874398 rc 0/0 00000100:00100000:1.0:1746147730.824807:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1512 00002000:00100000:1.0:1746147730.824817:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2994176->3145727) req@ffff88012e387100 x1830967794092416/t17179874398(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/448 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.824825:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e387100 with x1830967794092416 ext(2994176->3145727) 00010000:00010000:1.0:1746147730.824833:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 22 pid: 8184 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.824847:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 22 pid: 8184 timeout: 909 lvb_type: 0 00002000:00010000:1.0:1746147730.824853:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e387100 00000100:00100000:0.0:1746147730.830532:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.830728:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794092544 00000100:00100000:1.0:1746147730.830738:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794092544 00010000:00010000:1.0:1746147730.830774:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 22 pid: 8184 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746147730.830822:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8563 00000100:00100000:1.0:1746147730.830830:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a237a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967794092544:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147730.830847:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147730.830870:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 22 pid: 8184 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.830882:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 22 pid: 8184 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.830940:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e64e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d9 expref: 22 pid: 8184 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746147730.830977:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.830979:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.830986:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134985c00/0xe64d3fbf12a7e6b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc23b expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.830995:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134985c00/0xe64d3fbf12a7e6b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc23b expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.831029:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134985c00/0xe64d3fbf12a7e6b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc23b expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147730.831042:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796505856:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147730.831140:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147730.832522:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796505856:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147730.832537:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147730.832574:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a237a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967794092544:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1745us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.832582:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8563 00000100:00100000:2.0:1746147730.837266:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.837365:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.837449:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794092800 00000100:00100000:1.0:1746147730.837458:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794092800 00002000:00100000:1.0:1746147730.837589:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a8acf100 x1830967794092800/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.837599:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf100 with x1830967794092800 ext(2097152->3145727) 00002000:00010000:1.0:1746147730.837604:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acf100 00000100:00100000:3.0:1746147730.837605:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794093056 00000100:00100000:3.0:1746147730.837609:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794093056 00000100:00100000:1.0:1746147730.837633:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7548 00000100:00100000:1.0:1746147730.837640:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967794092800:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147730.837642:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12067 00000100:00100000:3.0:1746147730.837646:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:32381:x1830967794093056:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147730.837660:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147730.837685:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e6b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc242 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.837762:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e6be lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147730.837773:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e6be lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147730.837782:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e6be lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746147730.837790:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147730.837879:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d9f200/0xe64d3fbf12a7e6b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc242 expref: 35 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.837917:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e6be lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc242 expref: 34 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147730.837923:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147730.837926:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147730.837928:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d9f000, rc 0) 00000100:00100000:3.0:1746147730.837963:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:32381:x1830967794093056:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 316us (600us total) trans 8589946093 rc 0/0 00000100:00100000:3.0:1746147730.837968:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12067 00000100:00100000:1.0:1746147730.845019:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967794092800:12345-192.168.202.10@tcp:3:cat.0 Request processed in 7370us (7752us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147730.845031:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7548 00002000:00100000:1.0:1746147730.845043:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a8acf100 x1830967794092800/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.845052:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf100 with x1830967794092800 ext(2097152->3145727) 00002000:00010000:1.0:1746147730.845057:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acf100 00000100:00100000:0.0:1746147730.845225:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.845340:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794093184 00000100:00100000:1.0:1746147730.845347:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794093184 00000100:00100000:1.0:1746147730.845385:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16795 00000100:00100000:1.0:1746147730.845391:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:32380:x1830967794093184:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147730.845403:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.845420:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc249 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.845444:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.845451:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147730.845452:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147730.845455:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2498560->2871295] (req 2498560->2871295) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 38 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.845481:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.845492:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 27 pid: 8184 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746147730.845502:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796505984:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147730.845585:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147730.847935:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796505984:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147730.847967:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2498560->2871295] (req 2498560->2871295) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 38 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.847981:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cafdc00, rc 0) 00000100:00100000:1.0:1746147730.848019:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:32380:x1830967794093184:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2627us (2793us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.848026:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16795 00000100:00100000:0.0:1746147730.850901:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.851029:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794093312 00000100:00100000:1.0:1746147730.851037:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794093312 00002000:00100000:1.0:1746147730.851071:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->2662399) req@ffff8800a08a8700 x1830967794093312/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.851079:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a8700 with x1830967794093312 ext(2097152->2662399) 00010000:00010000:1.0:1746147730.851086:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 28 pid: 8184 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746147730.851107:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147730.851370:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 28 pid: 8184 timeout: 910 lvb_type: 0 00002000:00010000:1.0:1746147730.851377:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a08a8700 00000100:00100000:2.0:1746147730.851485:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794093440 00000100:00100000:2.0:1746147730.851490:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794093440 00000100:00100000:1.0:1746147730.851498:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1513 00000100:00100000:1.0:1746147730.851505:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1958:x1830967794093312:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147730.851511:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16796 00000100:00100000:2.0:1746147730.851515:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:32376:x1830967794093440:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147730.851523:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147730.851535:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a736f800/0xe64d3fbf12a7e6d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc250 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.851551:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147730.851555:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2498560->2871295] (req 2498560->2871295) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 39 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.851560:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147730.851562:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736f800/0xe64d3fbf12a7e6d3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc250 expref: 39 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.851592:0:10613:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2498560->2871295] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 39 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.851601:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a736f800/0xe64d3fbf12a7e6d3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc250 expref: 39 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.851609:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736f800, rc 0) 00000100:00100000:2.0:1746147730.851700:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:32376:x1830967794093440:12345-192.168.202.10@tcp:101:cat.0 Request processed in 182us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.851705:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16796 00000100:00100000:0.0:1746147730.852089:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.852145:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794093568 00000100:00100000:2.0:1746147730.852148:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794093568 00000100:00100000:2.0:1746147730.852195:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16797 00000100:00100000:2.0:1746147730.852200:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:32381:x1830967794093568:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147730.852209:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147730.852214:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc257 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.852225:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147730.852227:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147730.852230:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3547136->3891199] (req 3547136->3891199) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 30 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.852237:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3547136->3891199] (req 3547136->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 30 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.852243:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736fa00, rc 0) 00000100:00100000:2.0:1746147730.852272:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:32381:x1830967794093568:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 71us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.852276:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16797 00000100:00100000:1.0:1746147730.859463:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1958:x1830967794093312:12345-192.168.202.10@tcp:4:cat.0 Request processed in 7951us (8578us total) trans 21474841634 rc 0/0 00000100:00100000:1.0:1746147730.859475:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1513 00002000:00100000:1.0:1746147730.859485:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->2662399) req@ffff8800a08a8700 x1830967794093312/t21474841634(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/448 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.859494:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a8700 with x1830967794093312 ext(2097152->2662399) 00010000:00010000:1.0:1746147730.859502:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 31 pid: 8184 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147730.859521:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 31 pid: 8184 timeout: 910 lvb_type: 0 00002000:00010000:1.0:1746147730.859527:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a08a8700 00000100:00100000:0.0:1746147730.862937:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.863020:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794093696 00000100:00100000:1.0:1746147730.863029:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794093696 00010000:00010000:1.0:1746147730.863059:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 31 pid: 8184 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746147730.863082:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8564 00000100:00100000:1.0:1746147730.863089:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1960:x1830967794093696:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147730.863102:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147730.863119:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 31 pid: 8184 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147730.863129:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 31 pid: 8184 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147730.863150:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9f400/0xe64d3fbf12a7e65c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1e7 expref: 31 pid: 8184 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147730.863344:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.863346:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.863353:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 38 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.863365:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 38 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.863392:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 38 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.863402:0:20557:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 38 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746147730.863412:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796506240:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147730.863741:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a649f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147730.869041:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.869111:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796506240:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147730.869130:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147730.869166:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1960:x1830967794093696:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6077us (6236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.869176:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8564 00000100:00100000:2.0:1746147730.869252:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794093952 00000100:00100000:2.0:1746147730.869258:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794093952 00002000:00100000:2.0:1746147730.869288:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2498560->2502655) req@ffff88009fe41180 x1830967794093952/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.869296:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41180 with x1830967794093952 ext(2498560->2502655) 00010000:00010000:2.0:1746147730.869303:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 39 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147730.869315:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 39 pid: 10613 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746147730.869325:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe41180 00000100:00100000:2.0:1746147730.869396:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1514 00000100:00100000:2.0:1746147730.869403:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1960:x1830967794093952:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147730.869541:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1960:x1830967794093952:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 138us (508us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147730.869547:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1514 00002000:00100000:2.0:1746147730.869551:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2498560->2502655) req@ffff88009fe41180 x1830967794093952/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/4536 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.869558:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41180 with x1830967794093952 ext(2498560->2502655) 00010000:00010000:2.0:1746147730.869562:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 39 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147730.869569:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 39 pid: 10613 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746147730.869575:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe41180 00000100:00100000:0.0:1746147730.876973:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.877038:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794094208 00000100:00100000:3.0:1746147730.877046:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794094208 00002000:00100000:3.0:1746147730.877080:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2867200->2871295) req@ffff8800941b0000 x1830967794094208/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.877089:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b0000 with x1830967794094208 ext(2867200->2871295) 00010000:00010000:3.0:1746147730.877097:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 39 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147730.877109:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 39 pid: 10613 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746147730.877116:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800941b0000 00000100:00100000:3.0:1746147730.877145:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1515 00000100:00100000:3.0:1746147730.877152:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1957:x1830967794094208:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147730.877304:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1957:x1830967794094208:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 152us (337us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147730.877314:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1515 00002000:00100000:3.0:1746147730.877319:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2867200->2871295) req@ffff8800941b0000 x1830967794094208/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/4536 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.877325:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b0000 with x1830967794094208 ext(2867200->2871295) 00010000:00010000:3.0:1746147730.877329:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 39 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147730.877337:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 39 pid: 10613 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746147730.877342:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800941b0000 00000100:00100000:0.0:1746147730.881020:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.881765:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794094464 00000100:00100000:3.0:1746147730.881773:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794094464 00002000:00100000:3.0:1746147730.881811:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2498560->2871295) req@ffff8800941b0380 x1830967794094464/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.881825:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b0380 with x1830967794094464 ext(2498560->2871295) 00010000:00010000:3.0:1746147730.881833:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 39 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147730.881845:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 39 pid: 10613 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746147730.881851:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800941b0380 00000100:00100000:3.0:1746147730.881881:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1516 00000100:00100000:3.0:1746147730.881971:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1960:x1830967794094464:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:3.0:1746147730.890041:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1960:x1830967794094464:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 8061us (9017us total) trans 21474841635 rc 0/0 00000100:00100000:3.0:1746147730.890052:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1516 00002000:00100000:3.0:1746147730.890064:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2498560->2871295) req@ffff8800941b0380 x1830967794094464/t21474841635(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/448 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.890248:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b0380 with x1830967794094464 ext(2498560->2871295) 00010000:00010000:3.0:1746147730.890257:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 41 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147730.890270:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 41 pid: 10613 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746147730.890276:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800941b0380 00000100:00100000:0.0:1746147730.893265:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.893290:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794094592 00000100:00100000:0.0:1746147730.893297:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794094592 00010000:00010000:0.0:1746147730.893326:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 41 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746147730.893357:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8565 00000100:00100000:0.0:1746147730.893364:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1958:x1830967794094592:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147730.893378:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147730.893398:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 41 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746147730.893408:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 41 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746147730.893427:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cafdc00/0xe64d3fbf12a7e6cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->3547135] (req 2498560->2871295) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc249 expref: 41 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746147730.893443:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147730.893445:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147730.893451:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a736f800/0xe64d3fbf12a7e6d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc250 expref: 40 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147730.893459:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736f800/0xe64d3fbf12a7e6d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc250 expref: 40 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147730.893466:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147730.893467:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147730.893470:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3547136->18446744073709551615] (req 3547136->3891199) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147730.893475:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3547136->18446744073709551615] (req 3547136->3891199) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147730.893499:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3547136->18446744073709551615] (req 3547136->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147730.893626:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796506368:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147730.893765:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a736f800/0xe64d3fbf12a7e6d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc250 expref: 40 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147730.893773:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796506496:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147730.893792:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147730.896974:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796506368:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147730.896984:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796506496:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147730.897001:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147730.897380:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1958:x1830967794094592:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4014us (4118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147730.897392:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8565 00000100:00100000:2.0:1746147730.897804:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.897835:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794094848 00000100:00100000:2.0:1746147730.897840:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794094848 00002000:00100000:2.0:1746147730.897872:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (3547136->3551231) req@ffff8800a8acd180 x1830967794094848/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.897879:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acd180 with x1830967794094848 ext(3547136->3551231) 00002000:00010000:2.0:1746147730.897900:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acd180 00000100:00100000:2.0:1746147730.897915:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7549 00000100:00100000:2.0:1746147730.897922:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967794094848:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147730.898036:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967794094848:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 115us (233us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147730.898041:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7549 00002000:00100000:2.0:1746147730.898046:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (3547136->3551231) req@ffff8800a8acd180 x1830967794094848/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/4536 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.898053:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acd180 with x1830967794094848 ext(3547136->3551231) 00002000:00010000:2.0:1746147730.898055:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acd180 00000100:00100000:2.0:1746147730.903716:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.903749:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.903751:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794095104 00000100:00100000:3.0:1746147730.903758:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794095104 00000100:00100000:2.0:1746147730.903762:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794095360 00000100:00100000:2.0:1746147730.903764:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794095360 00002000:00100000:3.0:1746147730.903791:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a8acea00 x1830967794095104/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.903791:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a8acf800 x1830967794095360/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.903799:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acea00 with x1830967794095104 ext(2097152->3145727) 00002000:00100000:2.0:1746147730.903799:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf800 with x1830967794095360 ext(3145728->4194303) 00002000:00010000:3.0:1746147730.903803:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acea00 00002000:00010000:2.0:1746147730.903803:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acf800 00000100:00100000:0.0:1746147730.903999:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7550 00000100:00100000:0.0:1746147730.904009:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1959:x1830967794095104:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147730.904015:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7551 00000100:00100000:2.0:1746147730.904020:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794095360:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147730.906718:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.908596:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794095616 00000100:00100000:2.0:1746147730.908605:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794095616 00002000:00100000:2.0:1746147730.908646:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3887104->3891199) req@ffff8800941b0e00 x1830967794095616/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.908655:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b0e00 with x1830967794095616 ext(3887104->3891199) 00002000:00010000:2.0:1746147730.908659:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b0e00 00000100:00100000:2.0:1746147730.908691:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7552 00000100:00100000:2.0:1746147730.908698:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1957:x1830967794095616:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147730.908826:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1957:x1830967794095616:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 128us (2114us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147730.908832:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7552 00002000:00100000:2.0:1746147730.908838:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3887104->3891199) req@ffff8800941b0e00 x1830967794095616/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/4536 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.908844:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b0e00 with x1830967794095616 ext(3887104->3891199) 00002000:00010000:2.0:1746147730.908847:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b0e00 00000100:00100000:0.0:1746147730.917647:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794095360:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 13620us (13891us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147730.917658:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7551 00002000:00100000:0.0:1746147730.917681:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a8acf800 x1830967794095360/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147730.917690:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf800 with x1830967794095360 ext(3145728->4194303) 00002000:00010000:0.0:1746147730.917694:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acf800 00000100:00100000:1.0:1746147730.918037:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1959:x1830967794095104:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 14029us (14325us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147730.918044:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7550 00002000:00100000:1.0:1746147730.918050:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a8acea00 x1830967794095104/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.918057:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acea00 with x1830967794095104 ext(2097152->3145727) 00002000:00010000:1.0:1746147730.918060:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acea00 00000100:00100000:1.0:1746147730.925093:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.925340:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794095744 00000100:00100000:2.0:1746147730.925348:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794095744 00000100:00100000:2.0:1746147730.925383:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16798 00000100:00100000:2.0:1746147730.925390:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967794095744:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147730.925405:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147730.925418:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98e00/0xe64d3fbf12a7e6e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc25e expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.925437:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.925438:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.925445:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98e00/0xe64d3fbf12a7e6e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc25e expref: 22 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.925458:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98e00/0xe64d3fbf12a7e6e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc25e expref: 22 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147730.925467:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d98e00, rc 0) 00000100:00100000:2.0:1746147730.925503:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967794095744:12345-192.168.202.10@tcp:101:cat.0 Request processed in 114us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.925509:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16798 00000100:00100000:3.0:1746147730.925645:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.925711:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794095872 00000100:00100000:0.0:1746147730.925715:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794095872 00000100:00100000:0.0:1746147730.925734:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16799 00000100:00100000:0.0:1746147730.925739:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1957:x1830967794095872:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147730.925747:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147730.925756:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2275000/0xe64d3fbf12a7e6e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc265 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147730.925787:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796506624:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147730.925830:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f8a80 going to sleep for 11 seconds 00000001:00080000:0.0:1746147730.927563:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946090 is committed 00000001:00080000:0.0:1746147730.927572:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946088 is committed 00000001:00080000:0.0:1746147730.927577:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946087 is committed 00000001:00080000:0.0:1746147730.927591:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946091 is committed 00000001:00080000:0.0:1746147730.927710:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946093 is committed 00000100:00100000:0.0:1746147730.928067:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796506624:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147730.928088:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2275000/0xe64d3fbf12a7e6e8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc265 expref: 31 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147730.928099:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2275000/0xe64d3fbf12a7e6e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc265 expref: 31 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147730.928109:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2275000, rc 0) 00000100:00100000:0.0:1746147730.928134:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1957:x1830967794095872:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2394us (2489us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147730.928140:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16799 00000100:00100000:0.0:1746147730.928215:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.928228:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794096000 00000100:00100000:0.0:1746147730.928232:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794096000 00000100:00100000:0.0:1746147730.928412:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16800 00000100:00100000:0.0:1746147730.928418:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:32376:x1830967794096000:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147730.928426:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147730.928478:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2274e00/0xe64d3fbf12a7e6ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc26c expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147730.928555:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3547136->18446744073709551615] (req 3547136->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147730.928562:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147730.928564:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147730.928566:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2274e00/0xe64d3fbf12a7e6ef lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc26c expref: 41 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147730.928585:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3547136->18446744073709551615] (req 3547136->3891199) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147730.928595:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3547136->18446744073709551615] (req 3547136->3891199) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 29 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746147730.928605:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796506752:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147730.928650:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.929760:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796506752:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147730.929774:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2274e00/0xe64d3fbf12a7e6ef lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc26c expref: 41 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.929783:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2274e00, rc 0) 00000100:00100000:2.0:1746147730.929806:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:32376:x1830967794096000:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1388us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.929812:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16800 00000100:00100000:0.0:1746147730.930246:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.930400:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794096128 00000100:00100000:1.0:1746147730.930406:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794096128 00002000:00100000:1.0:1746147730.930432:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3547136->3891199) req@ffff8800941b1500 x1830967794096128/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.930440:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b1500 with x1830967794096128 ext(3547136->3891199) 00010000:00010000:1.0:1746147730.930445:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3547136->18446744073709551615] (req 3547136->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 30 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147730.930455:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3547136->18446744073709551615] (req 3547136->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 30 pid: 6715 timeout: 910 lvb_type: 0 00002000:00010000:1.0:1746147730.930461:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800941b1500 00000100:00100000:1.0:1746147730.930473:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1517 00000100:00100000:1.0:1746147730.930479:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967794096128:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:2.0:1746147730.933809:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1959:x1830967794096128:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 3321us (3554us total) trans 21474841636 rc 0/0 00000100:00100000:2.0:1746147730.933820:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1517 00002000:00100000:2.0:1746147730.933830:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3547136->3891199) req@ffff8800941b1500 x1830967794096128/t21474841636(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/448 e 0 to 0 dl 1746147741 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.933838:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b1500 with x1830967794096128 ext(3547136->3891199) 00010000:00010000:2.0:1746147730.933846:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3547136->18446744073709551615] (req 3547136->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 32 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147730.933859:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3547136->18446744073709551615] (req 3547136->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 32 pid: 6715 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746147730.933865:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800941b1500 00000100:00100000:0.0:1746147730.935341:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.935405:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794096256 00000100:00100000:2.0:1746147730.935411:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794096256 00010000:00010000:2.0:1746147730.935436:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3547136->18446744073709551615] (req 3547136->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 32 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147730.935456:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8566 00000100:00100000:2.0:1746147730.935462:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1960:x1830967794096256:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147730.935473:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147730.935488:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3547136->18446744073709551615] (req 3547136->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 32 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147730.935497:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3547136->18446744073709551615] (req 3547136->3891199) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 32 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147730.935515:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a736fa00/0xe64d3fbf12a7e6da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3547136->18446744073709551615] (req 3547136->3891199) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc257 expref: 32 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147730.935541:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.935543:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147730.935549:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2274e00/0xe64d3fbf12a7e6ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc26c expref: 40 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.935557:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2274e00/0xe64d3fbf12a7e6ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc26c expref: 40 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147730.935584:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2274e00/0xe64d3fbf12a7e6ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc26c expref: 40 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147730.935594:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796506880:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147730.935842:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147730.936989:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796506880:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147730.937000:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147730.937036:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1960:x1830967794096256:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1573us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.937043:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8566 00000100:00100000:1.0:1746147730.938869:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.939019:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794096512 00000100:00100000:2.0:1746147730.939025:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794096512 00002000:00100000:2.0:1746147730.939053:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fe95c00 x1830967794096512/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.939062:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe95c00 with x1830967794096512 ext(3145728->4194303) 00002000:00010000:2.0:1746147730.939066:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe95c00 00000100:00100000:2.0:1746147730.939089:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7553 00000100:00100000:2.0:1746147730.939095:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967794096512:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147730.940340:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147730.940392:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794096768 00000100:00100000:1.0:1746147730.940396:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794096768 00002000:00100000:1.0:1746147730.940419:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800941b1c00 x1830967794096768/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.940427:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b1c00 with x1830967794096768 ext(2097152->3145727) 00002000:00010000:1.0:1746147730.940431:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800941b1c00 00000100:00100000:1.0:1746147730.940458:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7554 00000100:00100000:1.0:1746147730.940464:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967794096768:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147730.945152:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967794096512:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 6049us (6280us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147730.945162:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7553 00002000:00100000:2.0:1746147730.945172:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fe95c00 x1830967794096512/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.945182:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe95c00 with x1830967794096512 ext(3145728->4194303) 00002000:00010000:2.0:1746147730.945186:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe95c00 00000100:00100000:1.0:1746147730.947248:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967794096768:12345-192.168.202.10@tcp:3:cat.0 Request processed in 6778us (6904us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147730.947261:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7554 00002000:00100000:1.0:1746147730.947269:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800941b1c00 x1830967794096768/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.947277:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b1c00 with x1830967794096768 ext(2097152->3145727) 00002000:00010000:1.0:1746147730.947282:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800941b1c00 00000100:00100000:3.0:1746147730.953132:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796507008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746147730.953189:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147730.953305:0:10630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796507008 00000100:00100000:1.0:1746147730.953312:0:10630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796507008 00000100:00100000:1.0:1746147730.953370:0:10630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1746147730.953376:0:10630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1830967796507008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746147730.953394:0:10630:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 610861056 pending 40894464 free 3850371072 avail 3848273920 00000100:00100000:1.0:1746147730.953427:0:10630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1830967796507008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.953433:0:10630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:1.0:1746147730.953450:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147730.953513:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746147730.953521:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796507136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746147730.953539:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147730.953552:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a634195-95c6-4e3b-860d-2cf2df4961a5:3302:1830967796507264:0@lo:400:kworker.0 00000100:00100000:2.0:1746147730.953560:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796507136 00000100:00100000:2.0:1746147730.953564:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796507136 00000100:00100000:3.0:1746147730.953572:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147730.953586:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1746147730.953591:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1830967796507776:0@lo:400:kworker.0 00000100:00100000:2.0:1746147730.953592:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1830967796507136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746147730.953598:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1830967796507392:0@lo:400:kworker.0 00002000:00000024:2.0:1746147730.953602:0:8472:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 629473280 pending 20447232 free 3849322496 avail 3847225344 00000100:00100000:3.0:1746147730.953609:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147730.953622:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746147730.953627:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796507648:0@lo:400:kworker.0 00000100:00100000:1.0:1746147730.953628:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147730.953630:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1830967796507136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.953642:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746147730.953643:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147730.953645:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1830967796507520:0@lo:400:kworker.0 00000100:00100000:1.0:1746147730.953660:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147730.953674:0:3302:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874381 gen 2 00000004:00080000:3.0:1746147730.953678:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc12d80, transno 17179874304 00000004:00080000:3.0:1746147730.953684:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc12300, transno 17179874305 00000004:00080000:3.0:1746147730.953687:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800951d5880, transno 17179874306 00000004:00080000:3.0:1746147730.953689:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ee58e00, transno 17179874307 00000100:00100000:1.0:1746147730.953690:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796507776 00000004:00080000:3.0:1746147730.953691:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b109500, transno 17179874308 00000004:00080000:3.0:1746147730.953693:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ee5a300, transno 17179874309 00000100:00100000:1.0:1746147730.953693:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796507776 00000004:00080000:3.0:1746147730.953695:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b10b100, transno 17179874310 00000004:00080000:3.0:1746147730.953697:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091119500, transno 17179874311 00000004:00080000:3.0:1746147730.953699:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800951d5c00, transno 17179874312 00000004:00080000:3.0:1746147730.953701:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d0dc380, transno 17179874313 00000004:00080000:3.0:1746147730.953703:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d0dc000, transno 17179874314 00000004:00080000:3.0:1746147730.953705:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009111ad80, transno 17179874315 00000004:00080000:3.0:1746147730.953707:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d0dd500, transno 17179874316 00000004:00080000:3.0:1746147730.953709:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc13480, transno 17179874317 00000100:00100000:1.0:1746147730.953710:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796507392 00000004:00080000:3.0:1746147730.953711:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d0df800, transno 17179874318 00000100:00100000:1.0:1746147730.953712:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796507392 00000004:00080000:3.0:1746147730.953713:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091118700, transno 17179874319 00000100:00100000:0.0:1746147730.953713:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796507520 00000004:00080000:3.0:1746147730.953715:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d0dc700, transno 17179874320 00000004:00080000:3.0:1746147730.953717:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135810e00, transno 17179874321 00000100:00100000:0.0:1746147730.953717:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796507520 00000004:00080000:3.0:1746147730.953719:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800956b4380, transno 17179874331 00000004:00080000:3.0:1746147730.953721:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d5500, transno 17179874332 00000004:00080000:3.0:1746147730.953724:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800956b6300, transno 17179874333 00000100:00100000:1.0:1746147730.953724:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000004:00080000:3.0:1746147730.953726:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d7b80, transno 17179874334 00000100:00100000:1.0:1746147730.953727:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1830967796507776:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1746147730.953728:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d6680, transno 17179874335 00000004:00080000:3.0:1746147730.953730:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800956b4e00, transno 17179874336 00000004:00080000:3.0:1746147730.953732:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d4700, transno 17179874337 00000004:00080000:3.0:1746147730.953734:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800956b4a80, transno 17179874338 00000004:00080000:3.0:1746147730.953735:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d7100, transno 17179874339 00000004:00080000:3.0:1746147730.953737:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a08a9c00, transno 17179874340 00000004:00080000:3.0:1746147730.953739:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a08a8a80, transno 17179874341 00000004:00080000:3.0:1746147730.953741:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a08ab480, transno 17179874342 00000004:00080000:3.0:1746147730.953743:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a08abb80, transno 17179874343 00000004:00080000:3.0:1746147730.953745:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a08aaa00, transno 17179874344 00000100:00100000:0.0:1746147730.953746:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000004:00080000:3.0:1746147730.953747:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a08a8000, transno 17179874345 00000004:00080000:3.0:1746147730.953749:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a08ab800, transno 17179874346 00000004:00080000:3.0:1746147730.953750:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a08a9880, transno 17179874347 00000100:00100000:1.0:1746147730.953751:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1830967796507776:12345-0@lo:400:kworker.0 Request processed in 24us (141us total) trans 0 rc 0/0 00000004:00080000:3.0:1746147730.953753:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d24e00, transno 17179874348 00000100:00100000:0.0:1746147730.953754:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1830967796507392:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1746147730.953755:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe41880, transno 17179874352 00000100:00100000:1.0:1746147730.953756:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000004:00080000:3.0:1746147730.953757:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe43b80, transno 17179874353 00000004:00080000:3.0:1746147730.953759:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe40a80, transno 17179874354 00000004:00080000:3.0:1746147730.953761:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ee5aa00, transno 17179874355 00000004:00080000:3.0:1746147730.953763:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ee59180, transno 17179874356 00000100:00100000:1.0:1746147730.953763:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000004:00080000:3.0:1746147730.953765:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ee5ad80, transno 17179874357 00000100:00100000:1.0:1746147730.953767:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1830967796507520:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1746147730.953768:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe42a00, transno 17179874358 00000004:00080000:3.0:1746147730.953770:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0435880, transno 17179874359 00000004:00080000:3.0:1746147730.953772:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe40380, transno 17179874360 00000004:00080000:3.0:1746147730.953774:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009505ea00, transno 17179874364 00000004:00080000:3.0:1746147730.953776:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ce61180, transno 17179874365 00000004:00080000:3.0:1746147730.953779:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009505f800, transno 17179874366 00000004:00080000:3.0:1746147730.953781:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009505fb80, transno 17179874367 00000004:00080000:3.0:1746147730.953783:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009505d880, transno 17179874368 00000100:00100000:1.0:1746147730.953784:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1830967796507520:12345-0@lo:400:kworker.0 Request processed in 17us (123us total) trans 0 rc 0/0 00000004:00080000:3.0:1746147730.953785:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009505c000, transno 17179874369 00000004:00080000:3.0:1746147730.953787:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009505df80, transno 17179874370 00000100:00100000:1.0:1746147730.953787:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1746147730.953788:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1830967796507392:12345-0@lo:400:kworker.0 Request processed in 37us (158us total) trans 0 rc 0/0 00000004:00080000:3.0:1746147730.953789:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009505c700, transno 17179874371 00000004:00080000:3.0:1746147730.953791:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02aea00, transno 17179874372 00000004:00080000:3.0:1746147730.953793:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0435f80, transno 17179874373 00000004:00080000:3.0:1746147730.953795:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0435c00, transno 17179874374 00000100:00100000:0.0:1746147730.953796:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000004:00080000:3.0:1746147730.953797:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0434a80, transno 17179874375 00000004:00080000:3.0:1746147730.953799:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0434380, transno 17179874376 00000004:00080000:3.0:1746147730.953800:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0437800, transno 17179874377 00000004:00080000:3.0:1746147730.953802:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0436d80, transno 17179874378 00000004:00080000:3.0:1746147730.953804:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0434e00, transno 17179874379 00000004:00080000:3.0:1746147730.953806:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0435180, transno 17179874380 00000004:00080000:3.0:1746147730.953808:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d7480, transno 17179874381 00000100:00100000:3.0:1746147730.953816:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796507136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746147730.953835:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1830967796507776:0@lo:400:kworker.0 00000100:00100000:3.0:1746147730.953850:0:14542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796507264 00000100:00100000:3.0:1746147730.953852:0:14542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796507264 00000100:00100000:3.0:1746147730.953873:0:14542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1746147730.953877:0:14542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a634195-95c6-4e3b-860d-2cf2df4961a5+18:3302:x1830967796507264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147730.953915:0:14542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a634195-95c6-4e3b-860d-2cf2df4961a5+18:3302:x1830967796507264:12345-0@lo:400:kworker.0 Request processed in 38us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147730.953920:0:14542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1746147730.953929:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1830967796507520:0@lo:400:kworker.0 00000100:00100000:1.0:1746147730.953936:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1830967796507392:0@lo:400:kworker.0 00000100:00100000:2.0:1746147730.954123:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:2.0:1746147730.954142:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746147730.954145:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147730.954153:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796507648 00000100:00100000:2.0:1746147730.954156:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796507648 00000100:00100000:2.0:1746147730.954176:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1746147730.954181:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3302:x1830967796507648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147730.954204:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3302:x1830967796507648:12345-0@lo:400:kworker.0 Request processed in 23us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147730.954208:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000004:00080000:3.0:1746147730.954363:0:14594:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 63 done 00000100:00100000:3.0:1746147730.954385:0:3304:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841607 gen 2 00000004:00080000:3.0:1746147730.954388:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe43800, transno 21474841538 00000004:00080000:3.0:1746147730.954405:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fb74380, transno 21474841539 00000004:00080000:3.0:1746147730.954408:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe40700, transno 21474841540 00000004:00080000:3.0:1746147730.954410:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe42300, transno 21474841541 00000004:00080000:3.0:1746147730.954412:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe43480, transno 21474841542 00000004:00080000:3.0:1746147730.954414:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fb77100, transno 21474841543 00000004:00080000:3.0:1746147730.954416:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe42680, transno 21474841544 00000004:00080000:3.0:1746147730.954418:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe40000, transno 21474841545 00000004:00080000:3.0:1746147730.954420:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e387800, transno 21474841546 00000004:00080000:3.0:1746147730.954422:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800951d5500, transno 21474841547 00000004:00080000:3.0:1746147730.954423:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e385880, transno 21474841548 00000004:00080000:3.0:1746147730.954425:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800951d4380, transno 21474841549 00000004:00080000:3.0:1746147730.954427:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e384000, transno 21474841550 00000004:00080000:3.0:1746147730.954429:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800951d5180, transno 21474841551 00000004:00080000:3.0:1746147730.954430:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e386a00, transno 21474841552 00000004:00080000:3.0:1746147730.954433:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800951d4e00, transno 21474841553 00000004:00080000:3.0:1746147730.954436:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f514000, transno 21474841561 00000004:00080000:3.0:1746147730.954437:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f514380, transno 21474841562 00000004:00080000:3.0:1746147730.954439:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f517b80, transno 21474841563 00000004:00080000:3.0:1746147730.954441:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f516300, transno 21474841564 00000004:00080000:3.0:1746147730.954442:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f516680, transno 21474841565 00000004:00080000:3.0:1746147730.954444:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f517480, transno 21474841566 00000004:00080000:3.0:1746147730.954446:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f515c00, transno 21474841567 00000004:00080000:3.0:1746147730.954448:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f517800, transno 21474841568 00000004:00080000:3.0:1746147730.954450:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2139500, transno 21474841569 00000004:00080000:3.0:1746147730.954452:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aee9180, transno 21474841570 00000004:00080000:3.0:1746147730.954454:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aee8e00, transno 21474841571 00000004:00080000:3.0:1746147730.954456:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2139f80, transno 21474841572 00000004:00080000:3.0:1746147730.954458:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aee9500, transno 21474841573 00000004:00080000:3.0:1746147730.954460:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2138700, transno 21474841574 00000004:00080000:3.0:1746147730.954462:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a213bb80, transno 21474841575 00000004:00080000:3.0:1746147730.954464:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aee8a80, transno 21474841576 00000004:00080000:3.0:1746147730.954466:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172ce00, transno 21474841581 00000004:00080000:3.0:1746147730.954468:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172c700, transno 21474841582 00000004:00080000:3.0:1746147730.954469:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172f800, transno 21474841583 00000004:00080000:3.0:1746147730.954471:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172e300, transno 21474841584 00000004:00080000:3.0:1746147730.954473:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172d880, transno 21474841585 00000004:00080000:3.0:1746147730.954475:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172fb80, transno 21474841586 00000004:00080000:3.0:1746147730.954476:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172d180, transno 21474841587 00000004:00080000:3.0:1746147730.954478:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172f100, transno 21474841588 00000004:00080000:3.0:1746147730.954480:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c3b80, transno 21474841592 00000004:00080000:3.0:1746147730.954482:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c3800, transno 21474841593 00000004:00080000:3.0:1746147730.954484:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c0380, transno 21474841594 00000004:00080000:3.0:1746147730.954485:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c2680, transno 21474841595 00000004:00080000:3.0:1746147730.954487:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c1500, transno 21474841596 00000004:00080000:3.0:1746147730.954489:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c3480, transno 21474841597 00000004:00080000:3.0:1746147730.954491:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c1f80, transno 21474841598 00000004:00080000:3.0:1746147730.954493:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c1180, transno 21474841599 00000004:00080000:3.0:1746147730.954495:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02af480, transno 21474841600 00000004:00080000:3.0:1746147730.954497:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02af100, transno 21474841601 00000004:00080000:3.0:1746147730.954499:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02afb80, transno 21474841602 00000004:00080000:3.0:1746147730.954501:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02ad880, transno 21474841603 00000004:00080000:3.0:1746147730.954503:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02ae300, transno 21474841604 00000004:00080000:3.0:1746147730.954505:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d25f80, transno 21474841605 00000004:00080000:3.0:1746147730.954507:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02af800, transno 21474841606 00000004:00080000:3.0:1746147730.954509:0:3304:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d25c00, transno 21474841607 00000100:00100000:3.0:1746147730.954517:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796507008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746147730.954537:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796507648:0@lo:400:kworker.0 00000100:00100000:3.0:1746147730.954543:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3a634195-95c6-4e3b-860d-2cf2df4961a5:3302:1830967796507264:0@lo:400:kworker.0 00000100:00100000:0.0:1746147730.954724:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.954766:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000004:00080000:2.0:1746147730.954870:0:14588:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 41 in progress, 0 in flight, 15 done 00000100:00100000:1.0:1746147730.954905:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794097152 00000100:00100000:1.0:1746147730.954908:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794097152 00000100:00100000:1.0:1746147730.954927:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16801 00000100:00100000:1.0:1746147730.954932:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:32385:x1830967794097152:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147730.954941:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147730.954954:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5410800/0xe64d3fbf12a7e6f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc273 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.954970:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.954972:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147730.954978:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5410800/0xe64d3fbf12a7e6f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc273 expref: 32 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.954991:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5410800/0xe64d3fbf12a7e6f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc273 expref: 32 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147730.955004:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5410800, rc 0) 00000100:00100000:1.0:1746147730.955029:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:32385:x1830967794097152:12345-192.168.202.10@tcp:101:cat.0 Request processed in 97us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147730.955034:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16801 00000004:00080000:2.0:1746147730.955041:0:14588:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 41 done 00000100:00100000:1.0:1746147730.955048:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794097024 00000100:00100000:1.0:1746147730.955051:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794097024 00002000:00100000:1.0:1746147730.955067:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800941b2300 x1830967794097024/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.955074:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b2300 with x1830967794097024 ext(4194304->5017599) 00002000:00010000:1.0:1746147730.955078:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800941b2300 00000100:00100000:1.0:1746147730.955087:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7555 00000100:00100000:1.0:1746147730.955091:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794097024:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147730.966324:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147730.966373:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.966540:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794097408 00000100:00100000:2.0:1746147730.966547:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794097408 00002000:00100000:2.0:1746147730.966582:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800941b2680 x1830967794097408/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.966591:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b2680 with x1830967794097408 ext(2097152->3145727) 00002000:00010000:2.0:1746147730.966595:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b2680 00000100:00100000:2.0:1746147730.966610:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7556 00000100:00100000:2.0:1746147730.966616:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1957:x1830967794097408:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147730.966702:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794097664 00000100:00100000:3.0:1746147730.966707:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794097664 00002000:00100000:3.0:1746147730.966723:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800941b2a00 x1830967794097664/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.966730:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b2a00 with x1830967794097664 ext(3145728->4194303) 00002000:00010000:3.0:1746147730.966733:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b2a00 00000100:00100000:3.0:1746147730.966746:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7557 00000100:00100000:3.0:1746147730.966752:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:1958:x1830967794097664:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147730.967452:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147730.968360:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794097920 00000100:00100000:2.0:1746147730.968365:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794097920 00002000:00100000:2.0:1746147730.968387:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800941b2d80 x1830967794097920/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.968396:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b2d80 with x1830967794097920 ext(3145728->4194303) 00002000:00010000:2.0:1746147730.968400:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800941b2d80 00000100:00100000:2.0:1746147730.968413:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7558 00000100:00100000:2.0:1746147730.968418:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794097920:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147730.968510:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794097024:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13416us (13742us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147730.968519:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7555 00002000:00100000:1.0:1746147730.968525:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800941b2300 x1830967794097024/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147730.968531:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b2300 with x1830967794097024 ext(4194304->5017599) 00002000:00010000:1.0:1746147730.968534:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800941b2300 00000100:00100000:2.0:1746147730.978466:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1957:x1830967794097408:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11842us (12141us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147730.978477:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7556 00002000:00100000:2.0:1746147730.978486:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800941b2680 x1830967794097408/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.978494:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b2680 with x1830967794097408 ext(2097152->3145727) 00002000:00010000:2.0:1746147730.978499:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b2680 00000100:00100000:2.0:1746147730.985103:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794097920:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16677us (17644us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147730.985113:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7558 00002000:00100000:2.0:1746147730.985123:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800941b2d80 x1830967794097920/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.985131:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b2d80 with x1830967794097920 ext(3145728->4194303) 00002000:00010000:2.0:1746147730.985137:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800941b2d80 00000100:00100000:0.0:1746147730.985740:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147730.985878:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1958:x1830967794097664:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19125us (19503us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147730.985908:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794098176 00000100:00100000:2.0:1746147730.985915:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794098176 00002000:00100000:2.0:1746147730.985938:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800941b3100 x1830967794098176/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/0 e 0 to 0 dl 1746147741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.985944:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b3100 with x1830967794098176 ext(4194304->5017599) 00002000:00010000:2.0:1746147730.985948:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800941b3100 00000100:00100000:2.0:1746147730.985960:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7559 00000100:00100000:2.0:1746147730.985967:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794098176:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147730.986119:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7557 00002000:00100000:3.0:1746147730.986124:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800941b2a00 x1830967794097664/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147730.986131:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b2a00 with x1830967794097664 ext(3145728->4194303) 00002000:00010000:3.0:1746147730.986134:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b2a00 00000100:00100000:2.0:1746147730.992467:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794098176:12345-192.168.202.10@tcp:3:cat.0 Request processed in 6491us (6719us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147730.992478:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7559 00002000:00100000:2.0:1746147730.992488:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800941b3100 x1830967794098176/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:351/0 lens 488/440 e 0 to 0 dl 1746147741 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147730.992496:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b3100 with x1830967794098176 ext(4194304->5017599) 00002000:00010000:2.0:1746147730.992501:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800941b3100 00000100:00100000:0.0:1746147731.139840:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.139944:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794098304 00000100:00100000:2.0:1746147731.139953:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794098304 00000100:00100000:2.0:1746147731.139997:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12068 00000100:00100000:2.0:1746147731.140004:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32394:x1830967794098304:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147731.140024:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147731.140041:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99a00/0xe64d3fbf12a7e6fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc27a expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.140100:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e704 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.140111:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e704 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.140119:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e704 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.140130:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e70b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.140136:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e70b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.140141:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e70b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.140230:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.140239:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179fa00/0xe64d3fbf12a7e640 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d2 expref: 324 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.140246:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e6be lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc242 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.140250:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.140272:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e6be lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc242 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.140281:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e6be lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc242 expref: 9 pid: 14547 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.140290:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796507904:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147731.140382:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013179fa00/0xe64d3fbf12a7e640 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d2 expref: 324 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.140389:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179fa00/0xe64d3fbf12a7e640 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d2 expref: 324 pid: 5744 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.140400:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796508032:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147731.140415:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147731.143053:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.143101:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.143125:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794098688 00000100:00100000:3.0:1746147731.143137:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794098688 00000100:00100000:0.0:1746147731.143143:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794098432 00000100:00100000:0.0:1746147731.143148:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794098432 00010000:00010000:0.0:1746147731.143180:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179fa00/0xe64d3fbf12a7e640 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d2 expref: 325 pid: 5744 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.143186:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5032 00000100:00100000:3.0:1746147731.143193:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009502ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:15394:x1830967794098688:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147731.143220:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8567 00000100:00100000:0.0:1746147731.143227:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:1957:x1830967794098432:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147731.143241:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147731.143246:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013179fa00/0xe64d3fbf12a7e640 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d2 expref: 325 pid: 5744 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746147731.143256:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013179fa00/0xe64d3fbf12a7e640 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d2 expref: 325 pid: 5744 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746147731.143281:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147731.143286:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147731.143294:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147731.143299:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147731.143303:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147731.143345:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:1957:x1830967794098432:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 118us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147731.143351:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8567 00000100:00100000:3.0:1746147731.143416:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009502ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:15394:x1830967794098688:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 222us (374us total) trans 8589946094 rc 0/0 00000100:00100000:3.0:1746147731.143423:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5032 00000100:00100000:2.0:1746147731.143727:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796507904:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147731.143739:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179fa00/0xe64d3fbf12a7e640 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1d2 expref: 324 pid: 5744 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.143756:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796508032:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147731.143779:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:1.0:1746147731.145646:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.145726:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794098816 00000100:00100000:2.0:1746147731.145733:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794098816 00010000:00010000:2.0:1746147731.145761:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e6be lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc242 expref: 11 pid: 14547 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.145797:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8568 00000100:00100000:2.0:1746147731.145803:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967794098816:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147731.145815:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147731.145820:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e6be lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc242 expref: 11 pid: 14547 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.145830:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e6be lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc242 expref: 11 pid: 14547 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.145850:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d9f000/0xe64d3fbf12a7e6be lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc242 expref: 11 pid: 14547 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.145866:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147731.145870:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.145880:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.145905:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.145931:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147731.145966:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1958:x1830967794098816:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 163us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.145972:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8568 00010000:00010000:3.0:1746147731.146704:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146718:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:3.0:1746147731.146759:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:3.0:1746147731.146762:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147731.146778:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146788:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146796:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e704 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146802:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e704 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146807:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e704 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146812:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0d99e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147731.146815:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e704 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146820:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e704 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146832:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147731.146835:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147731.146838:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e704 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146843:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e704 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146855:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e70b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146859:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e70b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146863:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e70b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146866:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0d99400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147731.146869:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e70b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146873:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e70b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146877:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a0003d00) 00010000:00010000:3.0:1746147731.146879:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147731.146881:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e70b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146919:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e70b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.146954:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99a00/0xe64d3fbf12a7e6fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc27a expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.146964:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc27a expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.146971:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147731.146972:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147731.146974:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d99200, rc 0) 00000100:00100000:3.0:1746147731.147034:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+9:32394:x1830967794098304:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 7029us (7200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.147043:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12068 00000100:00100000:0.0:1746147731.151058:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.151094:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.151408:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794099072 00000100:00100000:3.0:1746147731.151421:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794099072 00000100:00100000:3.0:1746147731.151776:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12069 00000100:00100000:3.0:1746147731.151785:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32396:x1830967794099072:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147731.151808:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147731.151824:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7e719 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc281 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147731.151920:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147731.151935:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147731.151938:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147731.151948:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc27a expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.151954:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147731.151962:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147731.151983:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc27a expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147731.151983:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794099328 00000100:00100000:0.0:1746147731.151989:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794099328 00010000:00010000:3.0:1746147731.151994:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc27a expref: 8 pid: 17544 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.152004:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796508160:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147731.152023:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794099584 00000100:00100000:0.0:1746147731.152025:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794099584 00000100:00100000:0.0:1746147731.152035:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794099200 00000100:00100000:0.0:1746147731.152037:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794099200 00000100:00100000:0.0:1746147731.152045:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794099456 00000100:00100000:0.0:1746147731.152047:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794099456 00000100:00100000:0.0:1746147731.152063:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16802 00000100:00100000:0.0:1746147731.152069:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794099328:12345-192.168.202.10@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147731.152083:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ea0540 going to sleep for 11 seconds 00010000:00010000:0.0:1746147731.152085:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147731.152100:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e727 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc28f expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.152121:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.152123:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.152132:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc28f expref: 9 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.152147:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc28f expref: 9 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.152159:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095092800, rc 0) 00000100:00100000:0.0:1746147731.152193:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967794099328:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 124us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147731.152199:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16802 00000100:00100000:0.0:1746147731.152216:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16803 00000100:00100000:0.0:1746147731.152221:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794099584:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147731.152227:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147731.152233:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7e72e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc29d expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.152243:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.152244:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.152249:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7e72e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc29d expref: 9 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.152262:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7e72e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc29d expref: 9 pid: 21480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147731.152265:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16804 00010000:00010000:0.0:1746147731.152269:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095093a00, rc 0) 00000100:00100000:3.0:1746147731.152273:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967794099200:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147731.152283:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147731.152290:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967794099584:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 67us (370us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147731.152293:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7e735 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc288 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147731.152295:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16803 00010000:00010000:3.0:1746147731.152306:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.152308:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147731.152309:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16805 00000100:00100000:0.0:1746147731.152314:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+7:1958:x1830967794099456:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147731.152316:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7e735 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc288 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.152320:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147731.152327:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7e735 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc288 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.152329:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7e73c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc296 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.152336:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136272400, rc 0) 00010000:00010000:0.0:1746147731.152343:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.152344:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.152348:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7e73c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc296 expref: 8 pid: 21480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147731.152358:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967794099200:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 86us (418us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147731.152358:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7e73c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc296 expref: 8 pid: 21480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147731.152365:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16804 00010000:00010000:0.0:1746147731.152365:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095092400, rc 0) 00000100:00100000:0.0:1746147731.152381:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794099456:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 67us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147731.152385:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16805 00000100:00100000:1.0:1746147731.162610:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.162812:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.162827:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796508160:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147731.162851:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794099840 00010000:00010000:2.0:1746147731.162857:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:1.0:1746147731.162858:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794099840 00010000:00010000:1.0:1746147731.162913:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc27a expref: 9 pid: 17544 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746147731.162938:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794099968 00000100:00100000:1.0:1746147731.162947:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8569 00000100:00100000:0.0:1746147731.162949:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794099968 00000100:00100000:1.0:1746147731.162954:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967794099840:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147731.162969:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147731.162974:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc27a expref: 10 pid: 17544 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.162985:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc27a expref: 10 pid: 17544 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746147731.162994:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12070 00000100:00100000:0.0:1746147731.163001:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32394:x1830967794099968:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147731.163006:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e712 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc27a expref: 10 pid: 17544 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746147731.163018:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147731.163031:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147731.163036:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147731.163044:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147731.163050:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147731.163066:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147731.163104:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794099840:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 150us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.163111:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8569 00010000:00010000:0.0:1746147731.163113:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7e743 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc2a4 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.163196:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e74a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147731.163406:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e74a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147731.163417:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e74a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:0.0:1746147731.163428:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147731.163481:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.163489:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147731.163507:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147731.163648:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7e719 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc281 expref: 13 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.163683:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc281 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.163694:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147731.163697:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147731.163700:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2b0000, rc 0) 00000100:00100000:2.0:1746147731.163727:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32396:x1830967794099072:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 11944us (12680us total) trans 8589946095 rc 0/0 00000100:00100000:2.0:1746147731.163734:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12069 00010000:00010000:1.0:1746147731.163845:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7e743 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2a4 expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.163862:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e74a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2a4 expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.163870:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147731.163873:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147731.163876:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095092a00, rc 0) 00000100:00100000:1.0:1746147731.163961:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32394:x1830967794099968:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 959us (1362us total) trans 8589946096 rc 0/0 00000100:00100000:1.0:1746147731.163967:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12070 00000100:00100000:0.0:1746147731.169687:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.169782:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794100224 00000100:00100000:1.0:1746147731.169790:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794100224 00000100:00100000:1.0:1746147731.169848:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12071 00000100:00100000:1.0:1746147731.169857:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32394:x1830967794100224:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147731.169912:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147731.169915:0:5744:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147731.169936:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e74a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2a4 expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.170518:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147731.170523:0:5744:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147731.170537:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9323c00/0xe64d3fbf12a7e75f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc2ab expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.170627:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147731.170643:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc281 expref: 11 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.170648:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147731.170681:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc281 expref: 11 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.170691:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc281 expref: 11 pid: 17544 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746147731.170702:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796508288:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147731.170798:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147731.172355:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796508288:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147731.172372:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147731.172552:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.172587:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794100352 00000100:00100000:1.0:1746147731.172592:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794100352 00010000:00010000:1.0:1746147731.172614:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc281 expref: 12 pid: 17544 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746147731.172650:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8570 00000100:00100000:1.0:1746147731.172656:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2379c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1957:x1830967794100352:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147731.172674:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147731.172679:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc281 expref: 12 pid: 17544 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.172688:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc281 expref: 12 pid: 17544 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.172704:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0000/0xe64d3fbf12a7e720 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc281 expref: 12 pid: 17544 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.172716:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147731.172720:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147731.172727:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147731.172732:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147731.172758:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147731.172796:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2379c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967794100352:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 140us (245us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147731.172799:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147731.172803:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8570 00010000:00010000:2.0:1746147731.172804:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147731.172817:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147731.172822:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147731.172827:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147731.172831:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a9322000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147731.172835:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147731.172841:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147731.172848:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147731.172854:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147731.172858:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147731.172862:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9322000/0xe64d3fbf12a7e766 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147731.172909:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9323c00/0xe64d3fbf12a7e75f lrc: 1/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ab expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.172917:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9323c00/0xe64d3fbf12a7e75f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ab expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.172925:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9323c00, rc 0) 00000100:00100000:2.0:1746147731.172947:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+9:32394:x1830967794100224:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 3092us (3267us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147731.172952:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12071 00000100:00100000:0.0:1746147731.174808:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.174878:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794100608 00000100:00100000:3.0:1746147731.174904:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794100608 00000100:00100000:3.0:1746147731.174931:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5033 00000100:00100000:3.0:1746147731.174937:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+9:32394:x1830967794100608:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147731.175339:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+10:32394:x1830967794100608:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 400us (534us total) trans 8589946097 rc 0/0 00000100:00100000:3.0:1746147731.175345:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5033 00000100:00100000:2.0:1746147731.200934:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.200961:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794100736 00000100:00100000:0.0:1746147731.200969:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794100736 00000100:00100000:1.0:1746147731.202109:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16806 00000100:00100000:1.0:1746147731.202118:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32396:x1830967794100736:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147731.202133:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147731.202148:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc2b2 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.202173:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5642000/0xe64d3fbf12a7e4bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ac expref: 23 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.202185:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fa00/0xe64d3fbf12a7e5bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc185 expref: 7 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.202193:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fffe400/0xe64d3fbf12a7e4f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0d6 expref: 29 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.202198:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147731.202200:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147731.202203:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [831488->1048575] (req 831488->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.202227:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fffe400/0xe64d3fbf12a7e4f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0d6 expref: 29 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.202237:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fffe400/0xe64d3fbf12a7e4f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0d6 expref: 29 pid: 8468 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746147731.202248:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796508416:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147731.203092:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fa00/0xe64d3fbf12a7e5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc185 expref: 7 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.203162:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fa00/0xe64d3fbf12a7e5bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc185 expref: 7 pid: 8468 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746147731.203172:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796508544:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147731.203201:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5642000/0xe64d3fbf12a7e4bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ac expref: 23 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.203208:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5642000/0xe64d3fbf12a7e4bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ac expref: 23 pid: 9615 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746147731.203215:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796508672:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147731.203236:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147731.203506:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.203545:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794100864 00000100:00100000:0.0:1746147731.203550:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794100864 00000100:00100000:0.0:1746147731.203601:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16807 00000100:00100000:0.0:1746147731.203608:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:32390:x1830967794100864:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147731.203617:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147731.203627:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc2b9 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.203647:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9ee00/0xe64d3fbf12a7e678 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc203 expref: 31 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.203654:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7e735 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc288 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.203673:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2275200/0xe64d3fbf12a7e686 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc211 expref: 42 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.203679:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.203680:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.203683:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [1966080->2097151] (req 1966080->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 42 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.203700:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2275200/0xe64d3fbf12a7e686 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc211 expref: 42 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.203707:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a2275200/0xe64d3fbf12a7e686 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc211 expref: 42 pid: 6715 timeout: 910 lvb_type: 1 00000100:00100000:0.0:1746147731.203715:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796508800:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147731.203744:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7e735 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc288 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.203752:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7e735 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc288 expref: 8 pid: 8184 timeout: 910 lvb_type: 1 00000100:00100000:0.0:1746147731.203760:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796508928:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147731.203783:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9ee00/0xe64d3fbf12a7e678 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc203 expref: 31 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.203790:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9ee00/0xe64d3fbf12a7e678 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc203 expref: 31 pid: 9615 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746147731.203797:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796509056:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147731.203812:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f83c0 going to sleep for 11 seconds 00000100:00080000:2.0:1746147731.204048:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147731.209916:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796508416:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147731.209932:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796508544:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147731.209940:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796508672:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147731.209972:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [831488->1048575] (req 831488->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.209987:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bc600, rc 0) 00000100:00100000:1.0:1746147731.210043:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:32396:x1830967794100736:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 7925us (9113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.210050:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16806 00000100:00100000:0.0:1746147731.210581:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.210611:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.210622:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.210640:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.210652:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.210673:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.210687:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.210700:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794100992 00000100:00100000:3.0:1746147731.210707:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794100992 00010000:00010000:3.0:1746147731.210731:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fa00/0xe64d3fbf12a7e5bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc185 expref: 8 pid: 8468 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746147731.210750:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794101248 00000100:00100000:3.0:1746147731.210752:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794101248 00010000:00010000:3.0:1746147731.210761:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7e735 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc288 expref: 9 pid: 8184 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746147731.210769:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794101120 00000100:00100000:3.0:1746147731.210770:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794101120 00010000:00010000:3.0:1746147731.210777:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2275200/0xe64d3fbf12a7e686 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc211 expref: 43 pid: 6715 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746147731.210784:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794101376 00000100:00100000:3.0:1746147731.210785:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794101376 00000100:00100000:1.0:1746147731.210826:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794101632 00000100:00100000:1.0:1746147731.210829:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794101632 00010000:00010000:1.0:1746147731.210840:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9ee00/0xe64d3fbf12a7e678 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc203 expref: 32 pid: 9615 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746147731.210849:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794101504 00000100:00100000:1.0:1746147731.210850:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794101504 00010000:00010000:1.0:1746147731.210858:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5642000/0xe64d3fbf12a7e4bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ac expref: 23 pid: 9615 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746147731.210867:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8571 00000100:00100000:1.0:1746147731.210872:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794100992:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147731.210880:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796508800:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147731.210896:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147731.210905:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796508928:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147731.210911:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796509056:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147731.210914:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fa00/0xe64d3fbf12a7e5bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc185 expref: 8 pid: 8468 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.210923:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fa00/0xe64d3fbf12a7e5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc185 expref: 8 pid: 8468 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746147731.210934:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [1966080->2097151] (req 1966080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 43 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.210940:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9fa00/0xe64d3fbf12a7e5bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc185 expref: 8 pid: 8468 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746147731.210944:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095093000, rc 0) 00010000:00010000:1.0:1746147731.210961:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147731.210983:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794100992:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 110us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.210988:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8571 00000100:00100000:1.0:1746147731.211000:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8572 00000100:00100000:1.0:1746147731.211004:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794101248:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147731.211012:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147731.211023:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7e735 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc288 expref: 9 pid: 8184 timeout: 910 lvb_type: 1 00000100:00100000:2.0:1746147731.211027:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:32390:x1830967794100864:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 7419us (7520us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147731.211030:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7e735 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc288 expref: 9 pid: 8184 timeout: 910 lvb_type: 1 00000100:00100000:2.0:1746147731.211036:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16807 00010000:00010000:1.0:1746147731.211043:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136272400/0xe64d3fbf12a7e735 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc288 expref: 9 pid: 8184 timeout: 910 lvb_type: 1 00000100:00100000:2.0:1746147731.211049:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794101888 00000100:00100000:2.0:1746147731.211051:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794101888 00010000:00010000:1.0:1746147731.211051:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147731.211064:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794101248:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 60us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.211069:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8572 00000100:00100000:2.0:1746147731.211072:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16808 00000100:00100000:2.0:1746147731.211077:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1960:x1830967794101888:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147731.211078:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8573 00000100:00100000:1.0:1746147731.211083:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1960:x1830967794101120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147731.211088:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147731.211089:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147731.211095:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a2275200/0xe64d3fbf12a7e686 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc211 expref: 43 pid: 6715 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746147731.211096:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98600/0xe64d3fbf12a7e77b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc2c7 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.211103:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a2275200/0xe64d3fbf12a7e686 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc211 expref: 44 pid: 6715 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746147731.211109:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.211153:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fffe400/0xe64d3fbf12a7e4f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0d6 expref: 30 pid: 8468 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746147731.211165:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8574 00000100:00100000:3.0:1746147731.211170:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1959:x1830967794101632:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147731.211175:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147731.211258:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.211278:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794101760 00000100:00100000:0.0:1746147731.211281:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794101760 00000100:00100000:0.0:1746147731.211297:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16809 00000100:00100000:0.0:1746147731.211301:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794101760:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147731.211307:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147731.211314:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013179e000/0xe64d3fbf12a7e782 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc2c0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.211329:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.211334:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013179e000/0xe64d3fbf12a7e782 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2c0 expref: 32 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.211342:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013179e000/0xe64d3fbf12a7e782 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2c0 expref: 32 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.211353:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179e000, rc 0) 00000100:00100000:0.0:1746147731.211367:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794101760:12345-192.168.202.10@tcp:101:cat.0 Request processed in 66us (110us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147731.211372:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16809 00010000:00010000:1.0:1746147731.211718:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2275200/0xe64d3fbf12a7e686 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc211 expref: 44 pid: 6715 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746147731.211726:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98600/0xe64d3fbf12a7e77b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2c7 expref: 44 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.211728:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147731.211737:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98600/0xe64d3fbf12a7e77b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2c7 expref: 43 pid: 8470 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147731.211747:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967794101120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 664us (1123us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147731.211752:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d98600, rc 0) 00000100:00100000:1.0:1746147731.211753:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8573 00000100:00100000:1.0:1746147731.211763:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8575 00000100:00100000:1.0:1746147731.211768:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967794101504:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147731.211770:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1960:x1830967794101888:12345-192.168.202.10@tcp:101:cat.0 Request processed in 693us (1082us total) trans 0 rc 301/301 00010000:00010000:1.0:1746147731.211775:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147731.211776:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16808 00010000:00010000:1.0:1746147731.211783:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5642000/0xe64d3fbf12a7e4bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ac expref: 23 pid: 9615 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.211790:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5642000/0xe64d3fbf12a7e4bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ac expref: 23 pid: 9615 timeout: 910 lvb_type: 1 00000100:00080000:2.0:1746147731.211792:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746147731.211801:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5642000/0xe64d3fbf12a7e4bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0ac expref: 23 pid: 9615 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.211808:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147731.211819:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8576 00000100:00100000:1.0:1746147731.211820:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794101504:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 52us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.211825:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794101376:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147731.211825:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8575 00010000:00010000:2.0:1746147731.211833:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147731.211842:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fffe400/0xe64d3fbf12a7e4f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0d6 expref: 30 pid: 8468 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746147731.211855:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fffe400/0xe64d3fbf12a7e4f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0d6 expref: 30 pid: 8468 timeout: 910 lvb_type: 1 00010000:00010000:3.0:1746147731.212012:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9ee00/0xe64d3fbf12a7e678 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc203 expref: 32 pid: 9615 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.212020:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9ee00/0xe64d3fbf12a7e678 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc203 expref: 32 pid: 9615 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.212479:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fffe400/0xe64d3fbf12a7e4f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0d6 expref: 30 pid: 8468 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746147731.212488:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.212489:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.212495:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.212502:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.212527:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9ee00/0xe64d3fbf12a7e678 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc203 expref: 32 pid: 9615 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.212528:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147731.212538:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094339180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796509184:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147731.212553:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.212554:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.212559:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 40 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.212565:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 40 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.212583:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 40 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147731.212587:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147731.212591:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796509312:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147731.212754:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ea0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147731.215384:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.215402:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.215465:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.215563:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796509312:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147731.215585:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147731.215620:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1959:x1830967794101632:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4449us (4966us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.215629:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8574 00000100:00100000:3.0:1746147731.215672:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794102144 00000100:00100000:3.0:1746147731.215677:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794102144 00002000:00100000:3.0:1746147731.215708:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x454:0x0] (1966080->1970175) req@ffff88009fe40380 x1830967794102144/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.215716:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe40380 with x1830967794102144 ext(1966080->1970175) 00002000:00010000:3.0:1746147731.215721:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe40380 00000100:00100000:3.0:1746147731.215733:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794102400 00000100:00100000:3.0:1746147731.215735:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794102400 00002000:00100000:3.0:1746147731.215746:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x455:0x0] (831488->835583) req@ffff88009fe40700 x1830967794102400/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.215753:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe40700 with x1830967794102400 ext(831488->835583) 00002000:00010000:3.0:1746147731.215756:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe40700 00000100:00100000:3.0:1746147731.215771:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7560 00000100:00100000:3.0:1746147731.215776:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967794102144:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147731.215912:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967794102144:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 135us (534us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147731.215918:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7560 00002000:00100000:3.0:1746147731.215922:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1966080->1970175) req@ffff88009fe40380 x1830967794102144/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/4536 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.215929:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe40380 with x1830967794102144 ext(1966080->1970175) 00002000:00010000:3.0:1746147731.215931:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe40380 00000100:00100000:3.0:1746147731.215941:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7561 00000100:00100000:3.0:1746147731.215945:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967794102400:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147731.215984:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094339180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796509184:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147731.215995:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147731.216003:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967794102400:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 57us (600us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147731.216008:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7561 00002000:00100000:3.0:1746147731.216013:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (831488->835583) req@ffff88009fe40700 x1830967794102400/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/4536 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147731.216013:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794101376:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4188us (5372us total) trans 0 rc 0/0 00002000:00100000:3.0:1746147731.216018:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe40700 with x1830967794102400 ext(831488->835583) 00002000:00010000:3.0:1746147731.216020:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe40700 00000100:00100000:2.0:1746147731.216020:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8576 00000100:00100000:1.0:1746147731.216164:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794102528 00000100:00100000:1.0:1746147731.216168:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794102528 00000100:00100000:1.0:1746147731.216193:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16810 00000100:00100000:1.0:1746147731.216198:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32401:x1830967794102528:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147731.216206:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147731.216218:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e789 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc2ce expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.216238:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.216245:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147731.216246:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147731.216250:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e789 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ce expref: 30 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.216274:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.216285:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 21 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746147731.216294:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796509440:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147731.216349:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147731.218525:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796509440:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147731.218550:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e789 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ce expref: 30 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.218564:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095093400, rc 0) 00000100:00100000:1.0:1746147731.218596:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32401:x1830967794102528:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2396us (3130us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.218602:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16810 00000100:00100000:0.0:1746147731.219398:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.219713:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794102656 00000100:00100000:1.0:1746147731.219718:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794102656 00000100:00100000:1.0:1746147731.219755:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16811 00000100:00100000:1.0:1746147731.219761:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:32390:x1830967794102656:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147731.219773:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147731.219785:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc2d5 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.219809:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e67f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc20a expref: 30 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.219821:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e727 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc28f expref: 7 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.219827:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2275c00/0xe64d3fbf12a7e68d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc218 expref: 42 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.219832:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147731.219834:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147731.219837:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1048576->1658879] (req 1048576->1658879) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 42 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.219859:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2275c00/0xe64d3fbf12a7e68d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc218 expref: 42 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.219867:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a2275c00/0xe64d3fbf12a7e68d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc218 expref: 42 pid: 6715 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746147731.219876:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796509568:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147731.219958:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc28f expref: 7 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.219965:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc28f expref: 7 pid: 21480 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746147731.219972:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796509696:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147731.220261:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147731.220325:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e67f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc20a expref: 30 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.220333:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e67f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc20a expref: 30 pid: 9615 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746147731.220341:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796509824:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147731.220360:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147731.220444:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.220458:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794103040 00000100:00100000:2.0:1746147731.220462:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794103040 00000100:00100000:2.0:1746147731.220482:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16812 00000100:00100000:2.0:1746147731.220487:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:32396:x1830967794103040:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147731.220494:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147731.220501:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc2dc expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.220515:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 42 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.220520:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147731.220521:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147731.220524:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->1314815] (req 1048576->1314815) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 32 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.220538:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 42 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.220545:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 42 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.220553:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094339180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796509952:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147731.220575:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147731.220620:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794102912 00000100:00100000:3.0:1746147731.220624:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794102912 00002000:00100000:3.0:1746147731.220647:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (831488->1048575) req@ffff880093cd5c00 x1830967794102912/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.220656:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5c00 with x1830967794102912 ext(831488->1048575) 00010000:00010000:3.0:1746147731.220672:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 22 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.220681:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 22 pid: 10613 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746147731.220687:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093cd5c00 00000100:00100000:3.0:1746147731.220703:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1518 00000100:00100000:3.0:1746147731.220708:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967794102912:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:1.0:1746147731.222295:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796509568:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147731.222306:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796509696:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147731.222313:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796509824:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147731.222344:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1048576->1658879] (req 1048576->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 42 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.222355:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950f5600, rc 0) 00000100:00100000:1.0:1746147731.222379:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:32390:x1830967794102656:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2618us (2983us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.222385:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16811 00000100:00100000:2.0:1746147731.226393:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.226421:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794103296 00000100:00100000:2.0:1746147731.226430:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794103296 00010000:00010000:2.0:1746147731.226466:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2275c00/0xe64d3fbf12a7e68d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc218 expref: 42 pid: 6715 timeout: 910 lvb_type: 1 00000100:00100000:2.0:1746147731.226498:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8577 00000100:00100000:2.0:1746147731.226505:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2379850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967794103296:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147731.226519:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147731.226543:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a2275c00/0xe64d3fbf12a7e68d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc218 expref: 42 pid: 6715 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746147731.226553:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a2275c00/0xe64d3fbf12a7e68d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc218 expref: 42 pid: 6715 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746147731.226572:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2275c00/0xe64d3fbf12a7e68d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc218 expref: 42 pid: 6715 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746147731.226586:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147731.227057:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2379850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1960:x1830967794103296:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 551us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.227063:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8577 00000100:00100000:0.0:1746147731.227178:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.227304:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.227325:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.227394:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794103168 00000100:00100000:3.0:1746147731.227398:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794103168 00010000:00010000:3.0:1746147731.227413:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc28f expref: 8 pid: 21480 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746147731.227427:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794103552 00000100:00100000:3.0:1746147731.227429:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794103552 00010000:00010000:3.0:1746147731.227437:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e67f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc20a expref: 33 pid: 9615 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.227450:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8578 00000100:00100000:3.0:1746147731.227455:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794103168:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147731.227461:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147731.227471:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc28f expref: 8 pid: 21480 timeout: 910 lvb_type: 1 00000100:00100000:2.0:1746147731.227511:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094339180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796509952:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147731.227533:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->1314815] (req 1048576->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 33 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.227542:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d98a00, rc 0) 00000100:00100000:2.0:1746147731.227562:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:32396:x1830967794103040:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 7076us (7118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.227568:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16812 00000100:00100000:2.0:1746147731.227589:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794103424 00000100:00100000:2.0:1746147731.227591:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794103424 00002000:00100000:2.0:1746147731.227609:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x454:0x0] (1966080->2097151) req@ffff880135813800 x1830967794103424/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.227616:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135813800 with x1830967794103424 ext(1966080->2097151) 00010000:00010000:2.0:1746147731.227621:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 41 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.227629:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 41 pid: 6715 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746147731.227634:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135813800 00000100:00100000:2.0:1746147731.227645:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1519 00000100:00100000:2.0:1746147731.227650:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1960:x1830967794103424:12345-192.168.202.10@tcp:4:cat.0 00010000:00010000:3.0:1746147731.227843:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc28f expref: 8 pid: 21480 timeout: 910 lvb_type: 1 00010000:00010000:3.0:1746147731.227855:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e727 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc28f expref: 8 pid: 21480 timeout: 910 lvb_type: 1 00000100:00100000:0.0:1746147731.228057:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8579 00000100:00100000:0.0:1746147731.228065:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1960:x1830967794103552:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147731.228072:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147731.228080:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e67f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc20a expref: 32 pid: 9615 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746147731.228092:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e67f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc20a expref: 32 pid: 9615 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746147731.228104:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d9fe00/0xe64d3fbf12a7e67f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc20a expref: 32 pid: 9615 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.228108:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.228110:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.228116:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 42 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.228334:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 42 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.228370:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147731.228383:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 42 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147731.228390:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1960:x1830967794103552:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 328us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.228393:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796510080:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147731.228395:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8579 00000100:00100000:3.0:1746147731.229043:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ea0540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147731.229860:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794102912:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 9148us (9600us total) trans 17179874399 rc 0/0 00000100:00100000:3.0:1746147731.229868:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1518 00002000:00100000:3.0:1746147731.229875:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (831488->1048575) req@ffff880093cd5c00 x1830967794102912/t17179874399(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/448 e 0 to 0 dl 1746147742 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.229905:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5c00 with x1830967794102912 ext(831488->1048575) 00010000:00010000:3.0:1746147731.229912:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 24 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.229922:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 24 pid: 10613 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746147731.229927:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093cd5c00 00000100:00100000:0.0:1746147731.232151:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.232295:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794103680 00000100:00100000:3.0:1746147731.232301:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794103680 00010000:00010000:3.0:1746147731.232327:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 24 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.232350:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8580 00000100:00100000:3.0:1746147731.232356:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967794103680:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147731.232366:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147731.232380:0:7097:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147730 -> 1746147732 00002000:00010000:3.0:1746147731.232382:0:7097:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147730 -> 1746147732 00010000:00010000:3.0:1746147731.232387:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 24 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.232395:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 24 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.232414:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7e76d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b2 expref: 24 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.232427:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.232429:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.232435:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e789 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ce expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.232442:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e789 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ce expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.232468:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e789 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ce expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147731.232478:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796510208:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147731.233627:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ea0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147731.233656:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796510080:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147731.233684:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147731.233710:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794103168:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6254us (6532us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.233716:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8578 00000100:00100000:2.0:1746147731.235009:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796510208:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147731.235021:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147731.235057:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967794103680:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2700us (2909us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.235064:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8580 00000100:00100000:3.0:1746147731.235817:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1960:x1830967794103424:12345-192.168.202.10@tcp:4:cat.0 Request processed in 8165us (8510us total) trans 21474841637 rc 0/0 00000100:00100000:3.0:1746147731.235825:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1519 00002000:00100000:3.0:1746147731.235834:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x454:0x0] (1966080->2097151) req@ffff880135813800 x1830967794103424/t21474841637(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/448 e 0 to 0 dl 1746147742 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.235842:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135813800 with x1830967794103424 ext(1966080->2097151) 00010000:00010000:3.0:1746147731.235850:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 43 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.236041:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 43 pid: 6715 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746147731.236048:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135813800 00000100:00100000:0.0:1746147731.237855:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.237919:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.237963:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794104320 00000100:00100000:2.0:1746147731.237970:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794104320 00010000:00010000:2.0:1746147731.237997:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 43 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.238018:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8581 00000100:00100000:2.0:1746147731.238024:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1958:x1830967794104320:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147731.238035:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147731.238047:0:7097:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147731 -> 1746147732 00002000:00010000:2.0:1746147731.238050:0:7097:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147731 -> 1746147732 00010000:00010000:2.0:1746147731.238054:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 43 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746147731.238059:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147731.238064:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 43 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.238081:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e774 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2b9 expref: 43 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.238092:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.238094:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147731.238170:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794103936 00000100:00100000:3.0:1746147731.238173:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794103936 00002000:00100000:3.0:1746147731.238193:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x455:0x0] (1654784->1658879) req@ffff880135812680 x1830967794103936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.238201:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812680 with x1830967794103936 ext(1654784->1658879) 00002000:00010000:3.0:1746147731.238205:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135812680 00000100:00100000:3.0:1746147731.238258:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794104192 00000100:00100000:3.0:1746147731.238260:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794104192 00002000:00100000:3.0:1746147731.238276:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a5488700 x1830967794104192/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.238282:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5488700 with x1830967794104192 ext(0->1048575) 00002000:00010000:3.0:1746147731.238285:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5488700 00000100:00100000:3.0:1746147731.238300:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7562 00000100:00100000:3.0:1746147731.238305:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1959:x1830967794103936:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:2.0:1746147731.238351:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 30 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.238360:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 30 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.238386:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 30 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147731.238396:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094339180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796510336:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147731.238821:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7563 00000100:00100000:0.0:1746147731.238828:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794104192:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147731.239309:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1959:x1830967794103936:12345-192.168.202.10@tcp:3:cat.0 Request processed in 1002us (1457us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147731.239315:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7562 00002000:00100000:3.0:1746147731.239320:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1654784->1658879) req@ffff880135812680 x1830967794103936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/4536 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.239333:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812680 with x1830967794103936 ext(1654784->1658879) 00002000:00010000:3.0:1746147731.239336:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135812680 00000100:00100000:2.0:1746147731.239465:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147731.243619:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094339180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796510336:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147731.243642:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147731.243697:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1958:x1830967794104320:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5673us (5776us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.243707:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8581 00000100:00100000:0.0:1746147731.248825:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.249016:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794104576 00000100:00100000:3.0:1746147731.249026:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794104576 00000100:00100000:3.0:1746147731.249087:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5034 00000100:00100000:3.0:1746147731.249096:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32390:x1830967794104576:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:0.0:1746147731.249219:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.249307:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794104832 00000100:00100000:2.0:1746147731.249312:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794104832 00002000:00100000:2.0:1746147731.249339:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1310720->1314815) req@ffff8800a5489880 x1830967794104832/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.249349:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5489880 with x1830967794104832 ext(1310720->1314815) 00002000:00010000:2.0:1746147731.249355:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5489880 00000100:00100000:2.0:1746147731.249369:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7564 00000100:00100000:2.0:1746147731.249374:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1960:x1830967794104832:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147731.249502:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32390:x1830967794104576:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 407us (689us total) trans 8589946098 rc 0/0 00000100:00100000:3.0:1746147731.249509:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5034 00000100:00100000:2.0:1746147731.249527:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1960:x1830967794104832:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 151us (308us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147731.249533:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7564 00002000:00100000:2.0:1746147731.249538:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1310720->1314815) req@ffff8800a5489880 x1830967794104832/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/4536 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.249733:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5489880 with x1830967794104832 ext(1310720->1314815) 00002000:00010000:2.0:1746147731.249737:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5489880 00000100:00100000:0.0:1746147731.249876:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794104192:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11049us (11816us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147731.249899:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7563 00002000:00100000:0.0:1746147731.249905:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff8800a5488700 x1830967794104192/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147731.249913:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5488700 with x1830967794104192 ext(0->1048575) 00002000:00010000:0.0:1746147731.249917:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5488700 00000100:00100000:0.0:1746147731.254602:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.254812:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794105088 00000100:00100000:3.0:1746147731.254822:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794105088 00000100:00100000:3.0:1746147731.254868:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5035 00000100:00100000:3.0:1746147731.254875:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32396:x1830967794105088:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147731.255160:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32396:x1830967794105088:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 285us (569us total) trans 8589946099 rc 0/0 00000100:00100000:3.0:1746147731.255167:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5035 00000100:00100000:0.0:1746147731.265978:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.266041:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794105216 00000100:00100000:2.0:1746147731.266052:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794105216 00000100:00100000:2.0:1746147731.266106:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16813 00000100:00100000:2.0:1746147731.266115:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:32401:x1830967794105216:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147731.266192:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147731.266238:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5287600/0xe64d3fbf12a7e79e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc2e3 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.266270:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 30 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.266277:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147731.266279:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147731.266692:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5287600/0xe64d3fbf12a7e79e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2e3 expref: 43 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.266824:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 30 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.266844:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 30 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.266857:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796510464:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147731.267528:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147731.269151:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796510464:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147731.269179:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5287600/0xe64d3fbf12a7e79e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2e3 expref: 43 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.269195:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5287600, rc 0) 00000100:00100000:2.0:1746147731.269243:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:32401:x1830967794105216:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3129us (3276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.269252:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16813 00000100:00100000:0.0:1746147731.269514:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.270014:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794105344 00000100:00100000:2.0:1746147731.270021:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794105344 00002000:00100000:2.0:1746147731.270054:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1314815) req@ffff8800943c5f80 x1830967794105344/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.270064:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5f80 with x1830967794105344 ext(1048576->1314815) 00010000:00010000:2.0:1746147731.270070:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 31 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.270084:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 31 pid: 6715 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746147731.270091:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800943c5f80 00000100:00100000:2.0:1746147731.270165:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1520 00000100:00100000:2.0:1746147731.270172:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:1959:x1830967794105344:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:2.0:1746147731.275727:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:1959:x1830967794105344:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 5541us (6199us total) trans 21474841638 rc 0/0 00000100:00100000:2.0:1746147731.275740:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1520 00002000:00100000:2.0:1746147731.275752:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1314815) req@ffff8800943c5f80 x1830967794105344/t21474841638(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/448 e 0 to 0 dl 1746147742 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.275761:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5f80 with x1830967794105344 ext(1048576->1314815) 00010000:00010000:2.0:1746147731.275772:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 33 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.275788:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 33 pid: 6715 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746147731.275795:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800943c5f80 00000100:00100000:0.0:1746147731.278431:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.278536:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794105472 00000100:00100000:3.0:1746147731.278546:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794105472 00010000:00010000:3.0:1746147731.278583:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 33 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.278611:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8582 00000100:00100000:3.0:1746147731.278618:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:1960:x1830967794105472:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147731.278631:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147731.278654:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 33 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.278681:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 33 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.278704:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98a00/0xe64d3fbf12a7e797 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2dc expref: 33 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.279097:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.279100:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.279109:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5287600/0xe64d3fbf12a7e79e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2e3 expref: 42 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.279118:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5287600/0xe64d3fbf12a7e79e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2e3 expref: 42 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.279152:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5287600/0xe64d3fbf12a7e79e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2e3 expref: 42 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147731.279165:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796510592:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147731.279473:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ea0540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147731.281150:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796510592:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147731.281180:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147731.281232:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1960:x1830967794105472:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2613us (2811us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.281243:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8582 00000100:00100000:0.0:1746147731.283704:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.283755:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.283772:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794105728 00000100:00100000:2.0:1746147731.283781:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794105728 00000100:00100000:1.0:1746147731.283796:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794105984 00000100:00100000:1.0:1746147731.283800:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794105984 00002000:00100000:1.0:1746147731.283823:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1658880->2097151) req@ffff8800943c5c00 x1830967794105984/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.283824:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800943c4e00 x1830967794105728/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.283833:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4e00 with x1830967794105728 ext(1048576->2097151) 00002000:00100000:1.0:1746147731.283834:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5c00 with x1830967794105984 ext(1658880->2097151) 00002000:00010000:2.0:1746147731.283838:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c4e00 00002000:00010000:1.0:1746147731.283838:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c5c00 00000100:00100000:1.0:1746147731.283864:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7565 00000100:00100000:2.0:1746147731.283870:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7566 00000100:00100000:1.0:1746147731.283870:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1960:x1830967794105984:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147731.283876:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1959:x1830967794105728:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147731.288206:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1960:x1830967794105984:12345-192.168.202.10@tcp:3:cat.0 Request processed in 4323us (4438us total) trans 0 rc 438272/438272 00000100:00100000:1.0:1746147731.288219:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7565 00002000:00100000:1.0:1746147731.288231:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1658880->2097151) req@ffff8800943c5c00 x1830967794105984/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 438272/438272 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.288241:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5c00 with x1830967794105984 ext(1658880->2097151) 00002000:00010000:1.0:1746147731.288248:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c5c00 00000100:00100000:2.0:1746147731.291293:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1959:x1830967794105728:12345-192.168.202.10@tcp:3:cat.0 Request processed in 7404us (7583us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147731.291319:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7566 00002000:00100000:2.0:1746147731.291331:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800943c4e00 x1830967794105728/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.291340:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4e00 with x1830967794105728 ext(1048576->2097151) 00002000:00010000:2.0:1746147731.291346:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c4e00 00000100:00100000:0.0:1746147731.367852:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.369301:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794106112 00000100:00100000:2.0:1746147731.369316:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794106112 00000100:00100000:0.0:1746147731.369346:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.369400:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.369440:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794106240 00000100:00100000:2.0:1746147731.369443:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794106240 00000100:00100000:1.0:1746147731.369443:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794106368 00000100:00100000:1.0:1746147731.369447:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794106368 00000100:00100000:0.0:1746147731.369458:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16814 00000100:00100000:0.0:1746147731.369469:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1957:x1830967794106112:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147731.369480:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16815 00000100:00100000:1.0:1746147731.369486:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16816 00000100:00100000:2.0:1746147731.369487:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:1958:x1830967794106240:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147731.369490:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147731.369491:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:1957:x1830967794106368:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147731.369496:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147731.369498:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147731.369511:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7e7ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc2f1 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.369511:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e7a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc2f8 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.369511:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7e7b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc2ea expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.369535:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.369535:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.369537:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.369537:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.369546:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7e7ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2f1 expref: 35 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.369546:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7e7b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ea expref: 24 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147731.369561:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7e7ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2f1 expref: 35 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.369562:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7e7b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ea expref: 24 pid: 8470 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147731.369570:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796510720:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147731.369571:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5286c00, rc 0) 00010000:00010000:0.0:1746147731.369571:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03b7400, rc 0) 00000100:00100000:0.0:1746147731.369619:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967794106112:12345-192.168.202.10@tcp:101:cat.0 Request processed in 153us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147731.369625:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16814 00000100:00100000:2.0:1746147731.370036:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+35:1958:x1830967794106240:12345-192.168.202.10@tcp:101:cat.0 Request processed in 548us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.370042:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16815 00000100:00100000:1.0:1746147731.370232:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01e40 going to sleep for 11 seconds 00002000:00010000:1.0:1746147731.372190:0:10613:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime: 1746147731 -> 1746147732 00002000:00010000:1.0:1746147731.372198:0:10613:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime: 1746147731 -> 1746147732 00002000:00010000:1.0:1746147731.372201:0:10613:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime: 1746147731 -> 1746147732 00000100:00100000:1.0:1746147731.372225:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796510720:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147731.372274:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e7a5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2f8 expref: 34 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.372288:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095093000/0xe64d3fbf12a7e7a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2f8 expref: 34 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.372525:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095093000, rc 0) 00000100:00100000:1.0:1746147731.372585:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:1957:x1830967794106368:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3092us (3182us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147731.372594:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16816 00000100:00100000:0.0:1746147731.377863:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.377924:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.377951:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.377965:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794106880 00000100:00100000:0.0:1746147731.377974:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794106880 00000100:00100000:1.0:1746147731.377975:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794107136 00000100:00100000:1.0:1746147731.377980:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794107136 00000100:00100000:3.0:1746147731.378002:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794106752 00000100:00100000:3.0:1746147731.378005:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794106752 00002000:00100000:1.0:1746147731.378018:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009433a300 x1830967794107136/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147731.378018:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880094338380 x1830967794106880/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.378027:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433a300 with x1830967794107136 ext(1048576->2097151) 00002000:00100000:0.0:1746147731.378027:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094338380 with x1830967794106880 ext(0->1048575) 00002000:00010000:1.0:1746147731.378032:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009433a300 00002000:00010000:0.0:1746147731.378032:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094338380 00000100:00100000:3.0:1746147731.378042:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12072 00000100:00100000:0.0:1746147731.378045:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7567 00000100:00100000:0.0:1746147731.378051:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967794106880:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147731.378079:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32408:x1830967794106752:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147731.378094:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147731.378111:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7e7ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc2ff expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.378197:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136272000/0xe64d3fbf12a7e7c1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147731.378211:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136272000/0xe64d3fbf12a7e7c1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147731.378222:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136272000/0xe64d3fbf12a7e7c1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147731.378231:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147731.378327:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7e7ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ff expref: 328 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.378344:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136272000/0xe64d3fbf12a7e7c1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ff expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.378351:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00000100:00100000:1.0:1746147731.378352:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7568 00010000:00010000:3.0:1746147731.378355:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147731.378358:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136272000, rc 0) 00000100:00100000:1.0:1746147731.378359:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:1958:x1830967794107136:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147731.378399:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32408:x1830967794106752:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 320us (547us total) trans 8589946100 rc 0/0 00000100:00100000:3.0:1746147731.379135:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12072 00000100:00100000:1.0:1746147731.390286:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:1958:x1830967794107136:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11915us (12322us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147731.390301:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7568 00002000:00100000:1.0:1746147731.390313:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009433a300 x1830967794107136/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.390328:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433a300 with x1830967794107136 ext(1048576->2097151) 00002000:00010000:1.0:1746147731.390333:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009433a300 00000100:00100000:2.0:1746147731.390435:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967794106880:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12383us (12510us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147731.390442:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7567 00002000:00100000:2.0:1746147731.390447:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880094338380 x1830967794106880/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.390454:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094338380 with x1830967794106880 ext(0->1048575) 00002000:00010000:2.0:1746147731.390457:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094338380 00000100:00100000:0.0:1746147731.403994:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.404052:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794107264 00000100:00100000:1.0:1746147731.404062:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794107264 00000100:00100000:1.0:1746147731.404119:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16817 00000100:00100000:1.0:1746147731.404128:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:32409:x1830967794107264:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147731.404148:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147731.404168:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7e7cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc306 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.404200:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 42 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.404208:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147731.404209:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147731.404213:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7e7cf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc306 expref: 34 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.404244:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 42 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.404256:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 42 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746147731.404268:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796510848:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147731.404355:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147731.407014:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796510848:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147731.407053:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7e7cf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc306 expref: 34 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.407073:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bc400, rc 0) 00000100:00100000:1.0:1746147731.407120:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:32409:x1830967794107264:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2993us (3136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.407129:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16817 00000100:00100000:0.0:1746147731.407695:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.407733:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794107392 00000100:00100000:2.0:1746147731.407744:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794107392 00002000:00100000:2.0:1746147731.407785:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1658879) req@ffff8800949d7b80 x1830967794107392/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.407799:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d7b80 with x1830967794107392 ext(1048576->1658879) 00010000:00010000:2.0:1746147731.407809:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 43 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.407823:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 43 pid: 10613 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746147731.407835:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800949d7b80 00000100:00100000:2.0:1746147731.407864:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1521 00000100:00100000:2.0:1746147731.407872:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1958:x1830967794107392:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147731.418545:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1958:x1830967794107392:12345-192.168.202.10@tcp:4:cat.0 Request processed in 10661us (10839us total) trans 21474841639 rc 0/0 00000100:00100000:2.0:1746147731.418560:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1521 00002000:00100000:2.0:1746147731.418573:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1658879) req@ffff8800949d7b80 x1830967794107392/t21474841639(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/448 e 0 to 0 dl 1746147742 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.418583:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d7b80 with x1830967794107392 ext(1048576->1658879) 00010000:00010000:2.0:1746147731.418594:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 45 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.418613:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 45 pid: 10613 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746147731.418620:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800949d7b80 00000100:00100000:0.0:1746147731.422421:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.422514:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794107520 00000100:00100000:3.0:1746147731.422525:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794107520 00010000:00010000:3.0:1746147731.422566:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 45 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.422604:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8583 00000100:00100000:3.0:1746147731.422612:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1957:x1830967794107520:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147731.422627:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147731.422647:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 45 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.422668:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 45 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.422692:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800950f5600/0xe64d3fbf12a7e790 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2d5 expref: 45 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.422852:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.422855:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.422863:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7e7cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc306 expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.422872:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7e7cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc306 expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.422941:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7e7cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc306 expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147731.422955:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796510976:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147731.424137:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ea0540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147731.425140:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796510976:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147731.425164:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147731.425229:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1957:x1830967794107520:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2616us (2816us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.425239:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8583 00000100:00100000:0.0:1746147731.427561:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.427621:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.427742:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794107904 00000100:00100000:1.0:1746147731.427751:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794107904 00000100:00100000:2.0:1746147731.427756:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794107776 00000100:00100000:2.0:1746147731.427761:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794107776 00002000:00100000:2.0:1746147731.427797:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800949d4700 x1830967794107776/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.427807:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d4700 with x1830967794107776 ext(1048576->2097151) 00000100:00100000:1.0:1746147731.427808:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16818 00002000:00010000:2.0:1746147731.427812:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d4700 00000100:00100000:1.0:1746147731.427816:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1960:x1830967794107904:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147731.427827:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7569 00000100:00100000:2.0:1746147731.427832:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1958:x1830967794107776:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:1.0:1746147731.427832:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147731.427850:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e7d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc30d expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.427872:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147731.427874:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147731.427908:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e7d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc30d expref: 45 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.427924:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e7d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc30d expref: 45 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.427934:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095092800, rc 0) 00000100:00100000:1.0:1746147731.427977:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1960:x1830967794107904:12345-192.168.202.10@tcp:101:cat.0 Request processed in 162us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.427987:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16818 00000100:00100000:2.0:1746147731.439879:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1958:x1830967794107776:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12036us (12318us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147731.439903:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7569 00002000:00100000:2.0:1746147731.439918:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800949d4700 x1830967794107776/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.439926:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d4700 with x1830967794107776 ext(1048576->2097151) 00002000:00010000:2.0:1746147731.439931:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d4700 00000100:00100000:0.0:1746147731.441326:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.441393:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794108160 00000100:00100000:2.0:1746147731.441402:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794108160 00002000:00100000:2.0:1746147731.441493:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800949d7480 x1830967794108160/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.441503:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d7480 with x1830967794108160 ext(1048576->2097151) 00002000:00010000:2.0:1746147731.441508:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d7480 00000100:00100000:2.0:1746147731.441527:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7570 00000100:00100000:2.0:1746147731.441535:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1959:x1830967794108160:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147731.448532:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1959:x1830967794108160:12345-192.168.202.10@tcp:3:cat.0 Request processed in 6983us (7198us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147731.448549:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7570 00002000:00100000:2.0:1746147731.448566:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800949d7480 x1830967794108160/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.448576:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d7480 with x1830967794108160 ext(1048576->2097151) 00002000:00010000:2.0:1746147731.448583:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d7480 00000100:00100000:0.0:1746147731.474611:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.474726:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794108416 00000100:00100000:3.0:1746147731.474739:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794108416 00000100:00100000:3.0:1746147731.474811:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12073 00000100:00100000:3.0:1746147731.474820:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32417:x1830967794108416:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147731.474847:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147731.474867:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136272c00/0xe64d3fbf12a7e7dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc314 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.475001:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7e7e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147731.475016:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7e7e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147731.475027:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7e7e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147731.475040:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147731.475160:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136272c00/0xe64d3fbf12a7e7dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc314 expref: 15 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.475188:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7e7e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc314 expref: 14 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.475195:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147731.475198:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147731.475201:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136273a00, rc 0) 00000100:00100000:3.0:1746147731.475270:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32417:x1830967794108416:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 450us (667us total) trans 8589946101 rc 0/0 00000100:00100000:3.0:1746147731.475276:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12073 00000100:00100000:0.0:1746147731.563253:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.565135:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794108544 00000100:00100000:3.0:1746147731.565150:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794108544 00000100:00100000:3.0:1746147731.565222:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16819 00000100:00100000:3.0:1746147731.565230:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32408:x1830967794108544:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147731.565249:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147731.565266:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc31b expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.565299:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e789 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ce expref: 31 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.565307:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7e7b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ea expref: 23 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147731.565325:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.565327:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.565330:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 31 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.565362:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7e7b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ea expref: 23 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147731.565372:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7e7b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ea expref: 23 pid: 8470 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746147731.565383:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796511104:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147731.566284:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e789 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ce expref: 31 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.566295:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e789 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ce expref: 31 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.566305:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796511232:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147731.567211:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147731.571027:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796511104:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147731.571039:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796511232:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147731.571073:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 31 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.571096:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136273400, rc 0) 00000100:00100000:3.0:1746147731.572007:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:32408:x1830967794108544:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 6772us (8759us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.572016:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16819 00000100:00100000:0.0:1746147731.572238:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.572308:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.572342:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.572387:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794108928 00000100:00100000:0.0:1746147731.572393:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794108928 00010000:00010000:0.0:1746147731.572426:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e789 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ce expref: 31 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746147731.572453:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794108672 00000100:00100000:0.0:1746147731.572456:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794108672 00000100:00100000:1.0:1746147731.572459:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8584 00010000:00010000:0.0:1746147731.572466:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7e7b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ea expref: 24 pid: 8470 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746147731.572467:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2379450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1957:x1830967794108928:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147731.572480:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147731.572480:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8585 00000100:00100000:0.0:1746147731.572483:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967794108672:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147731.572489:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147731.572500:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e789 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ce expref: 31 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746147731.572500:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7e7b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ea expref: 24 pid: 8470 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.572510:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e789 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ce expref: 31 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.572602:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794108800 00000100:00100000:3.0:1746147731.572605:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794108800 00000100:00100000:3.0:1746147731.572623:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16820 00000100:00100000:3.0:1746147731.572627:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:32417:x1830967794108800:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147731.572645:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147731.572673:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc322 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.572694:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2274e00/0xe64d3fbf12a7e6ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc26c expref: 44 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.572702:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7e72e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc29d expref: 6 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147731.572708:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5410800/0xe64d3fbf12a7e6f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc273 expref: 35 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.572713:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.572714:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.572718:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [4055040->4194303] (req 4055040->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 35 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.572747:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5410800/0xe64d3fbf12a7e6f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc273 expref: 35 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.572997:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5410800/0xe64d3fbf12a7e6f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc273 expref: 35 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.573008:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796511360:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147731.573066:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7e72e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc29d expref: 6 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147731.573073:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7e72e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc29d expref: 6 pid: 21480 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746147731.573079:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796511488:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147731.573096:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2274e00/0xe64d3fbf12a7e6ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc26c expref: 44 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.573102:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a2274e00/0xe64d3fbf12a7e6ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc26c expref: 44 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.573108:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796511616:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147731.573120:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6480 going to sleep for 11 seconds 00010000:00010000:0.0:1746147731.573197:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7e7b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ea expref: 24 pid: 8470 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.573287:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e789 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ce expref: 31 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.573304:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147731.573326:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2379450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967794108928:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 860us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.573332:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8584 00010000:00010000:0.0:1746147731.573491:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03b7400/0xe64d3fbf12a7e7b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ea expref: 24 pid: 8470 timeout: 910 lvb_type: 1 00010000:00010000:0.0:1746147731.573512:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.573514:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.573519:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.573526:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.573546:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147731.573554:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796511744:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147731.573599:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147731.575179:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.575264:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796511360:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147731.575276:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796511488:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147731.575283:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796511616:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147731.575319:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [4055040->4194303] (req 4055040->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 35 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.575341:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136273600, rc 0) 00000100:00100000:3.0:1746147731.575379:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+35:32417:x1830967794108800:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2750us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.575387:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16820 00000100:00100000:1.0:1746147731.575466:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794109056 00000100:00100000:1.0:1746147731.575472:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794109056 00010000:00010000:1.0:1746147731.575494:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7e72e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc29d expref: 7 pid: 21480 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746147731.575760:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8586 00000100:00100000:1.0:1746147731.575767:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794109056:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147731.575779:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147731.575799:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7e72e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc29d expref: 7 pid: 21480 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.575810:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7e72e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc29d expref: 7 pid: 21480 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.575829:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7e72e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc29d expref: 7 pid: 21480 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.575842:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147731.575858:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794109056:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 92us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.575863:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8586 00000100:00100000:0.0:1746147731.578040:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.578072:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.578103:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.578249:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796511744:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147731.578273:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147731.578311:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1957:x1830967794108672:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5825us (5967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.578320:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8585 00000100:00100000:2.0:1746147731.578347:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794109184 00000100:00100000:3.0:1746147731.578352:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794109568 00000100:00100000:2.0:1746147731.578352:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794109184 00000100:00100000:3.0:1746147731.578357:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794109568 00010000:00010000:2.0:1746147731.578377:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2274e00/0xe64d3fbf12a7e6ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc26c expref: 45 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.578378:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5410800/0xe64d3fbf12a7e6f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc273 expref: 35 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.578667:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8587 00000100:00100000:2.0:1746147731.578675:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1957:x1830967794109184:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147731.578687:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147731.578710:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a2274e00/0xe64d3fbf12a7e6ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc26c expref: 45 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.578809:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8588 00000100:00100000:3.0:1746147731.578816:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+35:1960:x1830967794109568:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147731.578825:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147731.578834:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5410800/0xe64d3fbf12a7e6f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc273 expref: 35 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.578846:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5410800/0xe64d3fbf12a7e6f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc273 expref: 35 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746147731.578847:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794109440 00000100:00100000:1.0:1746147731.578852:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794109440 00010000:00010000:3.0:1746147731.578869:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5410800/0xe64d3fbf12a7e6f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc273 expref: 35 pid: 10613 timeout: 910 lvb_type: 0 00002000:00100000:1.0:1746147731.578880:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (16384->20479) req@ffff8800949d6680 x1830967794109440/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746147731.578914:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746147731.578916:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d6680 with x1830967794109440 ext(16384->20479) 00002000:00010000:1.0:1746147731.578921:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d6680 00000100:00100000:3.0:1746147731.578935:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1960:x1830967794109568:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 120us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.578939:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7571 00000100:00100000:3.0:1746147731.578941:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8588 00000100:00100000:1.0:1746147731.578944:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967794109440:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147731.579118:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967794109440:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 174us (1046us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147731.579124:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7571 00002000:00100000:1.0:1746147731.579128:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (16384->20479) req@ffff8800949d6680 x1830967794109440/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/4536 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.579142:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d6680 with x1830967794109440 ext(16384->20479) 00002000:00010000:1.0:1746147731.579144:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d6680 00010000:00010000:2.0:1746147731.579342:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a2274e00/0xe64d3fbf12a7e6ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc26c expref: 45 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.579356:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2274e00/0xe64d3fbf12a7e6ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc26c expref: 45 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.579367:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.579369:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.579376:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4055040->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 33 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.579388:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4055040->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 33 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.579415:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4055040->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 33 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147731.579425:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009433b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796511872:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147731.579487:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147731.581878:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.581986:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794109696 00000100:00100000:3.0:1746147731.581995:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794109696 00000100:00100000:3.0:1746147731.582474:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16821 00000100:00100000:3.0:1746147731.582482:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1959:x1830967794109696:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147731.582501:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147731.582520:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98600/0xe64d3fbf12a7e800 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc329 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147731.582574:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796512000:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147731.582679:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009433b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796511872:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147731.582697:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147731.582819:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1957:x1830967794109184:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4145us (4788us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.582828:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8587 00000100:00100000:3.0:1746147731.582842:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147731.583357:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.583418:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794109952 00000100:00100000:1.0:1746147731.583424:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794109952 00002000:00100000:1.0:1746147731.583451:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (4055040->4059135) req@ffff880094ef8000 x1830967794109952/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.583460:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef8000 with x1830967794109952 ext(4055040->4059135) 00002000:00010000:1.0:1746147731.583464:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ef8000 00000100:00100000:1.0:1746147731.583846:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7572 00000100:00100000:1.0:1746147731.583852:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1960:x1830967794109952:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147731.584033:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1960:x1830967794109952:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 181us (676us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147731.584039:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7572 00002000:00100000:1.0:1746147731.584044:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (4055040->4059135) req@ffff880094ef8000 x1830967794109952/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/4536 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.584051:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef8000 with x1830967794109952 ext(4055040->4059135) 00002000:00010000:1.0:1746147731.584054:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ef8000 00002000:00010000:3.0:1746147731.585523:0:6715:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime: 1746147731 -> 1746147732 00002000:00010000:3.0:1746147731.585530:0:6715:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime: 1746147731 -> 1746147732 00002000:00010000:3.0:1746147731.585532:0:6715:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime: 1746147731 -> 1746147732 00000100:00100000:3.0:1746147731.585553:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796512000:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147731.585595:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98600/0xe64d3fbf12a7e800 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc329 expref: 45 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147731.585607:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98600/0xe64d3fbf12a7e800 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc329 expref: 45 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147731.585635:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d98600, rc 0) 00000100:00100000:3.0:1746147731.585694:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1959:x1830967794109696:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3213us (3824us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147731.585702:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16821 00000100:00100000:1.0:1746147731.590230:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.590384:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794110080 00000100:00100000:3.0:1746147731.590398:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794110080 00000100:00100000:3.0:1746147731.590468:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16822 00000100:00100000:3.0:1746147731.590477:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:32417:x1830967794110080:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147731.590498:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147731.590522:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc330 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.590559:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134985c00/0xe64d3fbf12a7e6b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc23b expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.590570:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7e73c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc296 expref: 6 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147731.590578:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98e00/0xe64d3fbf12a7e6e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc25e expref: 24 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147731.590585:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.590587:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.590590:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 24 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.590634:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98e00/0xe64d3fbf12a7e6e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc25e expref: 24 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147731.590648:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98e00/0xe64d3fbf12a7e6e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc25e expref: 24 pid: 10613 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746147731.590677:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796512128:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147731.591914:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7e73c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc296 expref: 6 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147731.591929:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7e73c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc296 expref: 6 pid: 21480 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746147731.591944:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796512256:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147731.592024:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134985c00/0xe64d3fbf12a7e6b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc23b expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.592037:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134985c00/0xe64d3fbf12a7e6b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc23b expref: 29 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.592045:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796512384:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147731.592166:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147731.592635:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.592695:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.592998:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794110464 00000100:00100000:2.0:1746147731.593007:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794110464 00000100:00100000:2.0:1746147731.593058:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16823 00000100:00100000:2.0:1746147731.593067:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:32408:x1830967794110464:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147731.593085:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147731.593104:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc337 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.593134:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5287600/0xe64d3fbf12a7e79e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2e3 expref: 45 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.593147:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7e7ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2f1 expref: 33 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147731.593154:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.593156:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.593160:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 45 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.593187:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7e7ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2f1 expref: 33 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147731.593199:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7e7ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2f1 expref: 33 pid: 6715 timeout: 910 lvb_type: 1 00000100:00100000:2.0:1746147731.593211:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009433b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796512512:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147731.593301:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5287600/0xe64d3fbf12a7e79e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2e3 expref: 45 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.593310:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5287600/0xe64d3fbf12a7e79e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2e3 expref: 45 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.593319:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009433ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796512640:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147731.593348:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147731.593800:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794110336 00000100:00100000:3.0:1746147731.593806:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794110336 00002000:00100000:3.0:1746147731.593841:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (0->16383) req@ffff880094efb100 x1830967794110336/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.593850:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efb100 with x1830967794110336 ext(0->16383) 00002000:00010000:3.0:1746147731.593856:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efb100 00000100:00100000:3.0:1746147731.593870:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7573 00000100:00100000:3.0:1746147731.593875:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794110336:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147731.594158:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794110336:12345-192.168.202.10@tcp:3:cat.0 Request processed in 281us (1462us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1746147731.594165:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7573 00002000:00100000:3.0:1746147731.594170:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (0->16383) req@ffff880094efb100 x1830967794110336/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/16824 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 16384/16384 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.594177:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efb100 with x1830967794110336 ext(0->16383) 00002000:00010000:3.0:1746147731.594180:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efb100 00000100:00100000:3.0:1746147731.594219:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796512128:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147731.595027:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796512384:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147731.595159:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796512256:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147731.595193:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 24 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.595210:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d98200, rc 0) 00000100:00100000:3.0:1746147731.595238:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:32417:x1830967794110080:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4762us (5022us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.595245:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16822 00000100:00100000:0.0:1746147731.600146:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.600190:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.600217:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.600219:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794110848 00000100:00100000:3.0:1746147731.600228:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794110848 00010000:00010000:3.0:1746147731.600271:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98e00/0xe64d3fbf12a7e6e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc25e expref: 24 pid: 10613 timeout: 910 lvb_type: 1 00000100:00100000:2.0:1746147731.600459:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009433b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796512512:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147731.600473:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009433ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796512640:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147731.600512:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 45 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.600532:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013b000, rc 0) 00000100:00100000:2.0:1746147731.600728:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:32408:x1830967794110464:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 7660us (8093us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.600729:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794110720 00000100:00100000:3.0:1746147731.600732:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794110720 00000100:00100000:2.0:1746147731.600737:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16823 00010000:00010000:3.0:1746147731.600745:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7e73c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc296 expref: 7 pid: 21480 timeout: 910 lvb_type: 1 00000100:00100000:0.0:1746147731.601076:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.601521:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794110976 00000100:00100000:1.0:1746147731.601528:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794110976 00010000:00010000:1.0:1746147731.601561:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7e7ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2f1 expref: 34 pid: 6715 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746147731.601579:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794111104 00000100:00100000:1.0:1746147731.601582:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794111104 00010000:00010000:1.0:1746147731.601596:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5287600/0xe64d3fbf12a7e79e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2e3 expref: 45 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746147731.601608:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8589 00000100:00100000:1.0:1746147731.601617:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967794110848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147731.601632:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147731.601676:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98e00/0xe64d3fbf12a7e6e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc25e expref: 24 pid: 10613 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.601688:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98e00/0xe64d3fbf12a7e6e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc25e expref: 24 pid: 10613 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.601713:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98e00/0xe64d3fbf12a7e6e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc25e expref: 24 pid: 10613 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.601741:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147731.601776:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967794110848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 160us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.601782:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8589 00000100:00100000:1.0:1746147731.601804:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8590 00000100:00100000:1.0:1746147731.601811:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794110720:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147731.601821:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147731.601833:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7e73c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc296 expref: 7 pid: 21480 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.601847:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7e73c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc296 expref: 7 pid: 21480 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.601859:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7e73c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc296 expref: 7 pid: 21480 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.601872:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147731.601917:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794110720:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 105us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.601923:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8590 00000100:00100000:1.0:1746147731.601936:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8591 00000100:00100000:1.0:1746147731.601942:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2379050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1959:x1830967794110976:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147731.601953:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147731.601968:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7e7ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2f1 expref: 34 pid: 6715 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.601976:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7e7ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2f1 expref: 34 pid: 6715 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.601990:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7e7ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2f1 expref: 34 pid: 6715 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746147731.602003:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147731.602024:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2379050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:1959:x1830967794110976:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 82us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.602046:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8591 00000100:00100000:1.0:1746147731.602111:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8592 00000100:00100000:1.0:1746147731.602118:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1960:x1830967794111104:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147731.602126:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147731.602136:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5287600/0xe64d3fbf12a7e79e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2e3 expref: 45 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.602145:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5287600/0xe64d3fbf12a7e79e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2e3 expref: 45 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.602158:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5287600/0xe64d3fbf12a7e79e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2e3 expref: 45 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.602169:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147731.602171:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147731.602178:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 44 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.602187:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 44 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.602221:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 44 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147731.602235:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796512768:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147731.602286:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147731.602370:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.602391:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794111232 00000100:00100000:1.0:1746147731.602395:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794111232 00010000:00010000:1.0:1746147731.602411:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134985c00/0xe64d3fbf12a7e6b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc23b expref: 30 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746147731.602428:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8593 00000100:00100000:1.0:1746147731.602434:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967794111232:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147731.602442:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147731.602452:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134985c00/0xe64d3fbf12a7e6b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc23b expref: 30 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.602461:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134985c00/0xe64d3fbf12a7e6b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc23b expref: 30 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.602472:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134985c00/0xe64d3fbf12a7e6b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc23b expref: 30 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.602479:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147731.602481:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147731.602484:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 22 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.602491:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 22 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.602512:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 22 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147731.602525:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796512896:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147731.602553:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147731.602653:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.602820:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794111360 00000100:00100000:1.0:1746147731.602824:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794111360 00000100:00100000:1.0:1746147731.602854:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16824 00000100:00100000:1.0:1746147731.602861:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:32420:x1830967794111360:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147731.602876:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147731.602932:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e815 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc33e expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.602955:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 46 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.602962:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147731.602963:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147731.602967:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e815 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc33e expref: 46 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.602987:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 46 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.602999:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 46 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746147731.603009:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796513024:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147731.603638:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147731.604854:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796512768:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147731.604872:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147731.604946:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1960:x1830967794111104:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2826us (3869us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.604956:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8592 00000100:00100000:2.0:1746147731.605065:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796512896:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147731.605075:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147731.605093:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967794111232:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2660us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.605099:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8593 00000100:00100000:1.0:1746147731.605868:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796513024:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147731.605939:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e815 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc33e expref: 45 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.605958:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8600, rc 0) 00000100:00100000:1.0:1746147731.606001:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:32420:x1830967794111360:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3140us (3347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.606011:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16824 00000100:00100000:0.0:1746147731.607134:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.607323:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794111616 00000100:00100000:1.0:1746147731.607332:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794111616 00002000:00100000:1.0:1746147731.607382:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1060864->1064959) req@ffff880094efaa00 x1830967794111616/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.607392:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efaa00 with x1830967794111616 ext(1060864->1064959) 00010000:00010000:1.0:1746147731.607401:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 45 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.607416:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 45 pid: 10613 timeout: 910 lvb_type: 0 00002000:00010000:1.0:1746147731.607423:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094efaa00 00000100:00100000:1.0:1746147731.607467:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1522 00000100:00100000:1.0:1746147731.607475:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1959:x1830967794111616:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147731.608200:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1959:x1830967794111616:12345-192.168.202.10@tcp:3:cat.0 Request processed in 720us (1066us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147731.608209:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1522 00002000:00100000:1.0:1746147731.608218:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1060864->1064959) req@ffff880094efaa00 x1830967794111616/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/4536 e 0 to 0 dl 1746147742 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.608383:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efaa00 with x1830967794111616 ext(1060864->1064959) 00010000:00010000:1.0:1746147731.608394:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 45 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.608407:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 45 pid: 10613 timeout: 910 lvb_type: 0 00002000:00010000:1.0:1746147731.608414:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094efaa00 00000100:00100000:0.0:1746147731.610109:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.610480:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794111872 00000100:00100000:1.0:1746147731.610489:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794111872 00002000:00100000:1.0:1746147731.610535:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4825088->4829183) req@ffff880094efad80 x1830967794111872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.610545:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efad80 with x1830967794111872 ext(4825088->4829183) 00002000:00010000:1.0:1746147731.610551:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efad80 00000100:00100000:1.0:1746147731.610682:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7574 00000100:00100000:1.0:1746147731.610691:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967794111872:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147731.611226:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967794111872:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 534us (1125us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147731.611234:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7574 00002000:00100000:1.0:1746147731.611240:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4825088->4829183) req@ffff880094efad80 x1830967794111872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/4536 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.611246:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efad80 with x1830967794111872 ext(4825088->4829183) 00002000:00010000:1.0:1746147731.611249:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efad80 00000100:00100000:0.0:1746147731.612804:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.613973:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794112128 00000100:00100000:1.0:1746147731.613987:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794112128 00002000:00100000:1.0:1746147731.614030:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1064959) req@ffff880094efa300 x1830967794112128/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 16872/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.614039:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efa300 with x1830967794112128 ext(1048576->1064959) 00010000:00010000:1.0:1746147731.614048:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 45 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.614061:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 45 pid: 10613 timeout: 910 lvb_type: 0 00002000:00010000:1.0:1746147731.614068:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094efa300 00000100:00100000:1.0:1746147731.614106:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1523 00000100:00100000:1.0:1746147731.614113:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1959:x1830967794112128:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147731.614519:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1959:x1830967794112128:12345-192.168.202.10@tcp:4:cat.0 Request processed in 405us (1720us total) trans 21474841640 rc 0/0 00000100:00100000:1.0:1746147731.614527:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1523 00002000:00100000:1.0:1746147731.614533:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1064959) req@ffff880094efa300 x1830967794112128/t21474841640(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 16872/448 e 0 to 0 dl 1746147742 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.614546:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efa300 with x1830967794112128 ext(1048576->1064959) 00010000:00010000:1.0:1746147731.614550:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 47 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.614558:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 47 pid: 10613 timeout: 910 lvb_type: 0 00002000:00010000:1.0:1746147731.614563:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094efa300 00000100:00100000:0.0:1746147731.621968:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.622234:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794112256 00000100:00100000:2.0:1746147731.622241:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794112256 00010000:00010000:2.0:1746147731.622273:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 47 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.622300:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8594 00000100:00100000:2.0:1746147731.622307:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1957:x1830967794112256:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147731.622318:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147731.622338:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 47 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.622349:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 47 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.622369:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013013b000/0xe64d3fbf12a7e80e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc337 expref: 47 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.622397:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.622399:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.622404:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e815 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc33e expref: 46 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.622412:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e815 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc33e expref: 46 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.622442:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e815 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc33e expref: 46 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147731.622453:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009433ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796513152:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147731.622685:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147731.627958:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009433ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796513152:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147731.627981:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147731.628105:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.628724:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1957:x1830967794112256:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6410us (6755us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.628730:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794112512 00000100:00100000:2.0:1746147731.628734:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8594 00000100:00100000:3.0:1746147731.628738:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794112512 00002000:00100000:3.0:1746147731.628784:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880091119500 x1830967794112512/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.628795:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091119500 with x1830967794112512 ext(1048576->2097151) 00002000:00010000:3.0:1746147731.628800:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091119500 00000100:00100000:3.0:1746147731.629389:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7575 00000100:00100000:3.0:1746147731.629398:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1959:x1830967794112512:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147731.646120:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1959:x1830967794112512:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16711us (18009us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147731.646134:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7575 00002000:00100000:3.0:1746147731.646146:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880091119500 x1830967794112512/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.646154:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091119500 with x1830967794112512 ext(1048576->2097151) 00002000:00010000:3.0:1746147731.646160:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091119500 00000100:00100000:0.0:1746147731.658741:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.658799:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.659085:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794112640 00000100:00100000:2.0:1746147731.659095:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794112640 00000100:00100000:2.0:1746147731.659503:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794112768 00000100:00100000:2.0:1746147731.659507:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794112768 00000100:00100000:2.0:1746147731.659539:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16825 00000100:00100000:2.0:1746147731.659549:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967794112640:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147731.659570:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147731.659587:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013013be00/0xe64d3fbf12a7e81c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc345 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147731.659640:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009433ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796513280:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147731.659742:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147731.660141:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16826 00000100:00100000:3.0:1746147731.660151:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1957:x1830967794112768:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147731.660166:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147731.660178:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e823 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc34c expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147731.660205:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796513408:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147731.660262:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6480 going to sleep for 11 seconds 00002000:00010000:2.0:1746147731.661940:0:6715:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime: 1746147731 -> 1746147732 00002000:00010000:2.0:1746147731.661947:0:6715:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147731 -> 1746147732 00002000:00010000:2.0:1746147731.661950:0:6715:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime: 1746147731 -> 1746147732 00000100:00100000:2.0:1746147731.661973:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009433ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796513280:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147731.662129:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013013be00/0xe64d3fbf12a7e81c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc345 expref: 30 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147731.662143:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013013be00/0xe64d3fbf12a7e81c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc345 expref: 30 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147731.662158:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013be00, rc 0) 00000100:00100000:2.0:1746147731.662209:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967794112640:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2660us (3477us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147731.662218:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16825 00000100:00100000:2.0:1746147731.662336:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796513408:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147731.662356:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e823 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc34c expref: 47 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147731.662371:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e823 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc34c expref: 47 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147731.662378:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d99400, rc 0) 00000100:00100000:2.0:1746147731.662395:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1957:x1830967794112768:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2247us (3596us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147731.662400:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16826 00000100:00100000:0.0:1746147731.665783:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.665994:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794112896 00000100:00100000:2.0:1746147731.666003:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794112896 00000100:00100000:2.0:1746147731.666048:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16827 00000100:00100000:2.0:1746147731.666056:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32420:x1830967794112896:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147731.666076:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147731.666095:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7e82a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc353 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.666331:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 22 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.666339:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147731.666341:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147731.666345:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7e82a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc353 expref: 30 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.666375:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 22 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.666391:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 22 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.666403:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009433ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796513536:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147731.666498:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147731.669232:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009433ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796513536:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147731.669232:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147731.669272:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7e82a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc353 expref: 30 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.669293:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8000, rc 0) 00000100:00100000:3.0:1746147731.669353:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32420:x1830967794112896:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3295us (3583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.669364:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16827 00000100:00100000:2.0:1746147731.669367:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794113024 00000100:00100000:2.0:1746147731.669375:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794113024 00002000:00100000:2.0:1746147731.669417:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4829183) req@ffff880091118a80 x1830967794113024/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.669527:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091118a80 with x1830967794113024 ext(4194304->4829183) 00010000:00010000:2.0:1746147731.669536:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 23 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.669548:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 23 pid: 6715 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746147731.669555:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091118a80 00000100:00100000:2.0:1746147731.669580:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1524 00000100:00100000:2.0:1746147731.669588:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1959:x1830967794113024:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:2.0:1746147731.677696:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.678119:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.678146:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.678289:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794113152 00000100:00100000:3.0:1746147731.678300:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794113152 00000100:00100000:2.0:1746147731.678319:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.678338:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794113280 00000100:00100000:0.0:1746147731.678343:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794113280 00000100:00100000:3.0:1746147731.678350:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794113408 00000100:00100000:3.0:1746147731.678354:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794113408 00000100:00100000:0.0:1746147731.678364:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794113536 00000100:00100000:0.0:1746147731.678366:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794113536 00000100:00100000:3.0:1746147731.678374:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16828 00000100:00100000:3.0:1746147731.678383:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794113152:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:0.0:1746147731.678396:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16829 00000100:00100000:0.0:1746147731.678402:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1958:x1830967794113280:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147731.678406:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147731.678412:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147731.678426:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0d99c00/0xe64d3fbf12a7e838 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc35a expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.678426:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e831 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc361 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.678448:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.678450:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147731.678460:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc361 expref: 35 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.678476:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc361 expref: 35 pid: 9615 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147731.678482:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796513664:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147731.678488:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095092a00, rc 0) 00000100:00100000:0.0:1746147731.678533:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+35:1958:x1830967794113280:12345-192.168.202.10@tcp:101:cat.0 Request processed in 130us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147731.678540:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16829 00000100:00100000:0.0:1746147731.678557:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16830 00000100:00100000:0.0:1746147731.678562:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967794113408:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147731.678569:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147731.678576:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e83f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc368 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147731.678599:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009111a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796513792:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147731.678784:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16831 00000100:00100000:1.0:1746147731.678794:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1958:x1830967794113536:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147731.678801:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147731.678811:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e846 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc36f expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147731.678837:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796513920:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147731.679336:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943ccc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147731.679341:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f8600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147731.679349:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147731.684288:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967794113024:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 14685us (15051us total) trans 17179874400 rc 0/0 00000100:00100000:2.0:1746147731.684303:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1524 00002000:00100000:2.0:1746147731.684317:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4829183) req@ffff880091118a80 x1830967794113024/t17179874400(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/448 e 0 to 0 dl 1746147742 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.684327:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091118a80 with x1830967794113024 ext(4194304->4829183) 00010000:00010000:2.0:1746147731.684338:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 29 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.684353:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 29 pid: 6715 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746147731.684360:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091118a80 00000100:00100000:1.0:1746147731.684832:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796513920:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147731.684832:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009111a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796513792:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147731.684861:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e846 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc36f expref: 35 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.684861:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e83f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc368 expref: 28 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.684873:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9000/0xe64d3fbf12a7e846 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc36f expref: 35 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.684873:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7e83f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc368 expref: 28 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.684899:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095093400, rc 0) 00010000:00010000:1.0:1746147731.684900:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a9000, rc 0) 00000100:00100000:1.0:1746147731.685005:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1958:x1830967794113536:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6214us (6685us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147731.685005:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967794113408:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6442us (6857us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147731.685011:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16831 00000100:00100000:0.0:1746147731.685017:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16830 00002000:00010000:0.0:1746147731.685047:0:8468:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime: 1746147730 -> 1746147732 00000100:00100000:0.0:1746147731.685055:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796513664:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147731.685071:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d99c00/0xe64d3fbf12a7e838 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc35a expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.685078:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d99c00/0xe64d3fbf12a7e838 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc35a expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147731.685084:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d99c00, rc 0) 00000100:00100000:0.0:1746147731.685099:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1957:x1830967794113152:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6719us (7417us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147731.685103:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16828 00000100:00100000:0.0:1746147731.687549:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.687725:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794113664 00000100:00100000:2.0:1746147731.687734:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794113664 00010000:00010000:2.0:1746147731.687924:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 25 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.687963:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8595 00000100:00100000:2.0:1746147731.687971:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794113664:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147731.687985:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147731.688007:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 25 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.688019:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 25 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.688046:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d98200/0xe64d3fbf12a7e807 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc330 expref: 25 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.688076:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.688078:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.688085:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7e82a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc353 expref: 29 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.688092:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7e82a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc353 expref: 29 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.688123:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7e82a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc353 expref: 29 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147731.688134:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796514048:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147731.688224:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147731.688469:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.689221:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794113792 00000100:00100000:2.0:1746147731.689227:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794113792 00000100:00100000:2.0:1746147731.689270:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16832 00000100:00100000:2.0:1746147731.689276:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32425:x1830967794113792:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147731.689290:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147731.689304:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a237f800/0xe64d3fbf12a7e84d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc376 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.689326:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.689336:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147731.689338:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147731.689340:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a237f800/0xe64d3fbf12a7e84d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc376 expref: 26 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.689360:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 29 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.689370:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 29 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.689379:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796514176:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147731.689443:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147731.690792:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796514048:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147731.690810:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147731.690844:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794113664:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2874us (3305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.690853:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8595 00000100:00100000:3.0:1746147731.693147:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796514176:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147731.693173:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147731.693416:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a237f800/0xe64d3fbf12a7e84d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc376 expref: 25 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.693436:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a237f800, rc 0) 00000100:00100000:3.0:1746147731.693671:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32425:x1830967794113792:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4393us (5201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.693681:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16832 00000100:00100000:3.0:1746147731.693733:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794113920 00000100:00100000:3.0:1746147731.693739:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794113920 00002000:00100000:3.0:1746147731.693774:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (16384->1048575) req@ffff88009111a300 x1830967794113920/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.693783:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111a300 with x1830967794113920 ext(16384->1048575) 00010000:00010000:3.0:1746147731.693791:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 30 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.693803:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 30 pid: 6715 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746147731.693810:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009111a300 00000100:00100000:3.0:1746147731.693826:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1525 00000100:00100000:3.0:1746147731.693832:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794113920:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147731.694000:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.694070:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.694146:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794114176 00000100:00100000:2.0:1746147731.694151:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794114176 00002000:00100000:2.0:1746147731.694168:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009111b100 x1830967794114176/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.694175:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111b100 with x1830967794114176 ext(2097152->3145727) 00002000:00010000:2.0:1746147731.694179:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009111b100 00000100:00100000:2.0:1746147731.694197:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794114304 00000100:00100000:2.0:1746147731.694203:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794114304 00002000:00100000:2.0:1746147731.694212:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009111b800 x1830967794114304/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.694219:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111b800 with x1830967794114304 ext(3145728->4194303) 00002000:00010000:2.0:1746147731.694222:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009111b800 00000100:00100000:2.0:1746147731.694486:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7576 00000100:00100000:2.0:1746147731.694492:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967794114176:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147731.695974:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7577 00000100:00100000:3.0:1746147731.695986:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794114304:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147731.705472:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794114176:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10967us (11460us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147731.705485:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7576 00002000:00100000:2.0:1746147731.705497:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009111b100 x1830967794114176/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.705506:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111b100 with x1830967794114176 ext(2097152->3145727) 00002000:00010000:2.0:1746147731.705512:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009111b100 00000100:00100000:2.0:1746147731.707779:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794114304:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11784us (13696us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147731.707790:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7577 00002000:00100000:2.0:1746147731.707800:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009111b800 x1830967794114304/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.707809:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111b800 with x1830967794114304 ext(3145728->4194303) 00002000:00010000:2.0:1746147731.707815:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009111b800 00000100:00100000:0.0:1746147731.713473:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.713550:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794114560 00000100:00100000:3.0:1746147731.713559:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794114560 00000100:00100000:3.0:1746147731.713617:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16833 00000100:00100000:3.0:1746147731.713626:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:32420:x1830967794114560:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147731.713644:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147731.713677:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e854 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc37d expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.713708:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4055040->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 33 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.713715:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147731.713717:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147731.713721:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e854 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc37d expref: 47 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.713750:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4055040->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 33 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.713760:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4055040->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 33 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.713773:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796514304:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147731.713860:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147731.715913:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794113920:12345-192.168.202.10@tcp:4:cat.0 Request processed in 22045us (22704us total) trans 17179874401 rc 0/0 00000100:00100000:3.0:1746147731.715927:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1525 00002000:00100000:3.0:1746147731.715940:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (16384->1048575) req@ffff88009111a300 x1830967794113920/t17179874401(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/448 e 0 to 0 dl 1746147742 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.715950:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111a300 with x1830967794113920 ext(16384->1048575) 00010000:00010000:3.0:1746147731.715960:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 32 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.715974:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 32 pid: 6715 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746147731.715981:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009111a300 00000100:00100000:0.0:1746147731.717276:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.717614:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794114688 00000100:00100000:2.0:1746147731.717623:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794114688 00002000:00100000:2.0:1746147731.717676:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (4055040->4194303) req@ffff88009111aa00 x1830967794114688/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.717691:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111aa00 with x1830967794114688 ext(4055040->4194303) 00010000:00010000:2.0:1746147731.717699:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4055040->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 34 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.717712:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4055040->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 34 pid: 6715 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746147731.717718:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009111aa00 00000100:00100000:2.0:1746147731.717772:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1526 00000100:00100000:2.0:1746147731.717780:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1959:x1830967794114688:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147731.718193:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796514304:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147731.718225:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e854 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc37d expref: 47 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.718240:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d99e00, rc 0) 00000100:00100000:3.0:1746147731.718511:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:32420:x1830967794114560:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4885us (5046us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.718518:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16833 00000100:00100000:1.0:1746147731.720226:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.720372:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794114816 00000100:00100000:2.0:1746147731.720380:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794114816 00010000:00010000:2.0:1746147731.720410:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 32 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.720435:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8596 00000100:00100000:2.0:1746147731.720442:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794114816:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147731.720453:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147731.720480:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 32 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.720490:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 32 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.720513:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136273400/0xe64d3fbf12a7e7f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc31b expref: 32 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.720542:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.720545:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.720553:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a237f800/0xe64d3fbf12a7e84d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc376 expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.720561:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a237f800/0xe64d3fbf12a7e84d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc376 expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.720704:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a237f800/0xe64d3fbf12a7e84d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc376 expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147731.720717:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796514432:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147731.721083:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147731.721845:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+36:1959:x1830967794114688:12345-192.168.202.10@tcp:4:cat.0 Request processed in 4061us (4569us total) trans 21474841641 rc 0/0 00000100:00100000:3.0:1746147731.721856:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1526 00002000:00100000:3.0:1746147731.721867:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (4055040->4194303) req@ffff88009111aa00 x1830967794114688/t21474841641(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/448 e 0 to 0 dl 1746147742 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.721877:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111aa00 with x1830967794114688 ext(4055040->4194303) 00010000:00010000:3.0:1746147731.721914:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4055040->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 36 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.721935:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4055040->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 36 pid: 6715 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746147731.721942:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009111aa00 00000100:00100000:2.0:1746147731.724088:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796514432:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147731.724108:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147731.724642:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794114816:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4196us (4418us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.724651:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8596 00000100:00100000:0.0:1746147731.726152:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.726215:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794114944 00000100:00100000:2.0:1746147731.726224:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794114944 00010000:00010000:2.0:1746147731.726265:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4055040->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 36 pid: 6715 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.726300:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8597 00000100:00100000:2.0:1746147731.726308:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+36:1960:x1830967794114944:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147731.726324:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147731.726347:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [4055040->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 36 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.726360:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [4055040->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 36 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.726385:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136273600/0xe64d3fbf12a7e7f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [4055040->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc322 expref: 36 pid: 6715 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.726401:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.726403:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.726410:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e854 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc37d expref: 46 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.726419:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e854 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc37d expref: 46 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.726452:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e854 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc37d expref: 46 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147731.726465:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796514560:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147731.726776:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147731.730482:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796514560:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147731.730504:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147731.730551:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+35:1960:x1830967794114944:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4243us (4406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.730564:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8597 00000100:00100000:0.0:1746147731.732476:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.732533:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.732665:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794115456 00000100:00100000:1.0:1746147731.732665:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794115328 00000100:00100000:3.0:1746147731.732673:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794115456 00000100:00100000:1.0:1746147731.732673:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794115328 00002000:00100000:1.0:1746147731.732718:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fd18380 x1830967794115328/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.732728:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18380 with x1830967794115328 ext(0->1048575) 00002000:00100000:3.0:1746147731.732729:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fd1b800 x1830967794115456/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:1.0:1746147731.732734:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd18380 00002000:00100000:3.0:1746147731.732736:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1b800 with x1830967794115456 ext(3145728->4194303) 00002000:00010000:3.0:1746147731.732739:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1b800 00000100:00100000:1.0:1746147731.732765:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7578 00000100:00100000:1.0:1746147731.732772:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967794115328:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147731.733316:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.733335:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794115712 00000100:00100000:2.0:1746147731.733339:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794115712 00002000:00100000:2.0:1746147731.733363:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009fd19c00 x1830967794115712/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.733370:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19c00 with x1830967794115712 ext(1048576->2097151) 00002000:00010000:2.0:1746147731.733374:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd19c00 00000100:00100000:2.0:1746147731.733387:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7579 00000100:00100000:2.0:1746147731.733392:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1957:x1830967794115456:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147731.733444:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7580 00000100:00100000:0.0:1746147731.733452:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+35:1958:x1830967794115712:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147731.749312:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967794115328:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16527us (16832us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147731.749326:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7578 00002000:00100000:1.0:1746147731.749339:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fd18380 x1830967794115328/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.749348:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18380 with x1830967794115328 ext(0->1048575) 00002000:00010000:1.0:1746147731.749354:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd18380 00000100:00100000:2.0:1746147731.751132:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1957:x1830967794115456:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 17729us (18588us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147731.751144:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7579 00002000:00100000:2.0:1746147731.751154:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fd1b800 x1830967794115456/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.751163:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1b800 with x1830967794115456 ext(3145728->4194303) 00002000:00010000:2.0:1746147731.751168:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1b800 00000100:00100000:2.0:1746147731.754130:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+35:1958:x1830967794115712:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20668us (20804us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147731.754143:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7580 00002000:00100000:2.0:1746147731.754156:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009fd19c00 x1830967794115712/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.754166:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19c00 with x1830967794115712 ext(1048576->2097151) 00002000:00010000:2.0:1746147731.754173:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd19c00 00000100:00100000:0.0:1746147731.758618:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.758692:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.758715:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794115840 00000100:00100000:3.0:1746147731.758725:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794115840 00000100:00100000:3.0:1746147731.758767:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794115968 00000100:00100000:3.0:1746147731.758770:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794115968 00000100:00100000:1.0:1746147731.758777:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16834 00000100:00100000:1.0:1746147731.758789:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1958:x1830967794115840:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147731.758792:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16835 00000100:00100000:3.0:1746147731.758797:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:32427:x1830967794115968:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147731.758807:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147731.758807:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147731.758825:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc38b expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.758825:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e862 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc384 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.758848:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147731.758850:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.758857:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a736f800/0xe64d3fbf12a7e6d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc250 expref: 48 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.758857:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e862 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc384 expref: 32 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.758872:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e862 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc384 expref: 32 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.758912:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a9600, rc 0) 00000100:00100000:1.0:1746147731.758958:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967794115840:12345-192.168.202.10@tcp:101:cat.0 Request processed in 173us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.758964:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16834 00010000:00010000:3.0:1746147731.759177:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e854 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc37d expref: 48 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.759189:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147731.759191:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147731.759194:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2248704->2469887] (req 2248704->2469887) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 48 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.759224:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e854 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc37d expref: 48 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.759236:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e854 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc37d expref: 48 pid: 8468 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.759248:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796514688:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147731.759321:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a736f800/0xe64d3fbf12a7e6d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc250 expref: 48 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.759329:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a736f800/0xe64d3fbf12a7e6d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc250 expref: 48 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.759337:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796514816:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147731.759356:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147731.763264:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.763308:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.763393:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794116096 00000100:00100000:2.0:1746147731.763401:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794116096 00010000:00010000:2.0:1746147731.763435:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e854 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc37d expref: 49 pid: 8468 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.763460:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794116224 00000100:00100000:2.0:1746147731.763462:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794116224 00010000:00010000:2.0:1746147731.763471:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736f800/0xe64d3fbf12a7e6d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc250 expref: 50 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746147731.763485:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8598 00000100:00100000:2.0:1746147731.763492:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2378c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+50:1957:x1830967794116096:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147731.763506:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147731.763526:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e854 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc37d expref: 50 pid: 8468 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.763538:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e854 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc37d expref: 50 pid: 8468 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.763564:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147731.763602:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2378c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+50:1957:x1830967794116096:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 111us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.763608:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8598 00000100:00100000:2.0:1746147731.763672:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8599 00000100:00100000:2.0:1746147731.763677:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+49:1957:x1830967794116224:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147731.763683:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147731.763689:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a736f800/0xe64d3fbf12a7e6d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc250 expref: 49 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.763698:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a736f800/0xe64d3fbf12a7e6d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc250 expref: 49 pid: 10613 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.763707:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.763709:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.763716:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 49 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.763724:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 49 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.763753:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 49 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147731.763765:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796514944:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147731.763814:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147731.764047:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e854 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc37d expref: 49 pid: 8468 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.764066:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796514688:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147731.764075:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a736f800/0xe64d3fbf12a7e6d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc250 expref: 48 pid: 10613 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.764083:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796514816:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147731.764109:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 47 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.764117:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d99400, rc 0) 00000100:00100000:3.0:1746147731.764154:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:32427:x1830967794115968:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5357us (5463us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.764161:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16835 00000100:00100000:2.0:1746147731.767194:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796514944:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147731.767215:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147731.767268:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1957:x1830967794116224:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3588us (3957us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.767278:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8599 00000100:00100000:0.0:1746147731.769251:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.769328:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.769403:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794116480 00000100:00100000:3.0:1746147731.769414:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794116480 00000100:00100000:2.0:1746147731.769436:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794116736 00000100:00100000:2.0:1746147731.769441:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794116736 00002000:00100000:3.0:1746147731.769465:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2248704->2252799) req@ffff88009fd19f80 x1830967794116480/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.769465:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009c9a9180 x1830967794116736/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.769475:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19f80 with x1830967794116480 ext(2248704->2252799) 00002000:00100000:2.0:1746147731.769480:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a9180 with x1830967794116736 ext(4194304->5017599) 00002000:00010000:3.0:1746147731.769481:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd19f80 00002000:00010000:2.0:1746147731.769485:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9a9180 00000100:00100000:2.0:1746147731.769526:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7581 00000100:00100000:2.0:1746147731.769535:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1957:x1830967794116736:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147731.769723:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7582 00000100:00100000:3.0:1746147731.769730:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1960:x1830967794116480:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147731.769875:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1960:x1830967794116480:12345-192.168.202.10@tcp:3:cat.0 Request processed in 144us (634us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147731.769881:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7582 00002000:00100000:3.0:1746147731.769916:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (2248704->2252799) req@ffff88009fd19f80 x1830967794116480/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/4536 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.769923:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19f80 with x1830967794116480 ext(2248704->2252799) 00002000:00010000:3.0:1746147731.769926:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd19f80 00000100:00100000:0.0:1746147731.772038:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.772079:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.772176:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794116864 00000100:00100000:1.0:1746147731.772185:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794116864 00000100:00100000:2.0:1746147731.772199:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794116992 00000100:00100000:2.0:1746147731.772204:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794116992 00000100:00100000:2.0:1746147731.772250:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16836 00000100:00100000:2.0:1746147731.772258:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794116864:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:0.0:1746147731.772261:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16837 00000100:00100000:0.0:1746147731.772269:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+35:1960:x1830967794116992:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147731.772277:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147731.772277:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147731.772294:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b87a00/0xe64d3fbf12a7e869 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc392 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147731.772294:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943d8800/0xe64d3fbf12a7e870 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc399 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.772316:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.772318:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147731.772327:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b87a00/0xe64d3fbf12a7e869 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc392 expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147731.772343:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b87a00/0xe64d3fbf12a7e869 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc392 expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147731.772346:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796515072:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147731.772353:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b87a00, rc 0) 00000100:00100000:2.0:1746147731.772387:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794116864:12345-192.168.202.10@tcp:101:cat.0 Request processed in 130us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147731.772393:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16836 00000100:00100000:0.0:1746147731.772694:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f8600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147731.776270:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.776377:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794117248 00000100:00100000:1.0:1746147731.776386:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794117248 00002000:00100000:1.0:1746147731.776431:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2465792->2469887) req@ffff88009c9ab480 x1830967794117248/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.776449:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9ab480 with x1830967794117248 ext(2465792->2469887) 00002000:00010000:1.0:1746147731.776455:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9ab480 00000100:00100000:1.0:1746147731.776565:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7583 00000100:00100000:1.0:1746147731.776574:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1958:x1830967794117248:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147731.777087:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1958:x1830967794117248:12345-192.168.202.10@tcp:3:cat.0 Request processed in 512us (828us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147731.777095:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7583 00002000:00100000:1.0:1746147731.777102:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2465792->2469887) req@ffff88009c9ab480 x1830967794117248/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/4536 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.777109:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9ab480 with x1830967794117248 ext(2465792->2469887) 00002000:00010000:1.0:1746147731.777112:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9ab480 00000100:00100000:1.0:1746147731.777533:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796515072:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147731.777565:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800943d8800/0xe64d3fbf12a7e870 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc399 expref: 36 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.777577:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943d8800/0xe64d3fbf12a7e870 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc399 expref: 36 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147731.777591:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943d8800, rc 0) 00000100:00100000:1.0:1746147731.777612:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+35:1960:x1830967794116992:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5346us (5534us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147731.777618:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16837 00000100:00100000:2.0:1746147731.777814:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1957:x1830967794116736:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8279us (8484us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147731.777821:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7581 00002000:00100000:2.0:1746147731.777827:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009c9a9180 x1830967794116736/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.777834:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a9180 with x1830967794116736 ext(4194304->5017599) 00002000:00010000:2.0:1746147731.777836:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9a9180 00000100:00100000:0.0:1746147731.784028:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.784303:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794117504 00000100:00100000:2.0:1746147731.784314:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794117504 00002000:00100000:2.0:1746147731.784361:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009c9ab800 x1830967794117504/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.784371:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9ab800 with x1830967794117504 ext(2097152->3145727) 00002000:00010000:2.0:1746147731.784376:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9ab800 00000100:00100000:2.0:1746147731.784399:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7584 00000100:00100000:2.0:1746147731.784407:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794117504:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147731.797837:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794117504:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13418us (13806us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147731.797850:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7584 00002000:00100000:0.0:1746147731.797862:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009c9ab800 x1830967794117504/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147731.797871:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9ab800 with x1830967794117504 ext(2097152->3145727) 00002000:00010000:0.0:1746147731.797877:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9ab800 00010000:00010000:1.0:1746147731.799461:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147731.803960:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.804058:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794117632 00000100:00100000:1.0:1746147731.804074:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794117632 00000100:00100000:1.0:1746147731.805034:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16838 00000100:00100000:1.0:1746147731.805046:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+35:32425:x1830967794117632:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147731.805066:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147731.805088:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc3a0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.805118:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 45 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.805130:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147731.805132:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147731.805136:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 36 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.805167:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 45 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.805180:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 45 pid: 8468 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746147731.805193:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796515200:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147731.805289:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147731.806693:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796515200:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147731.806720:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 36 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.806736:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a9200, rc 0) 00000100:00100000:1.0:1746147731.806772:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+36:32425:x1830967794117632:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1730us (2825us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.806780:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16838 00000100:00100000:0.0:1746147731.807510:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.807563:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794117760 00000100:00100000:2.0:1746147731.807571:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794117760 00002000:00100000:2.0:1746147731.807619:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2248704->2469887) req@ffff88009c9a8000 x1830967794117760/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.807629:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a8000 with x1830967794117760 ext(2248704->2469887) 00010000:00010000:2.0:1746147731.807640:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 46 pid: 8468 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.807653:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 46 pid: 8468 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746147731.807673:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c9a8000 00000100:00100000:2.0:1746147731.807698:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1527 00000100:00100000:2.0:1746147731.807705:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1960:x1830967794117760:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147731.811349:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+48:1960:x1830967794117760:12345-192.168.202.10@tcp:4:cat.0 Request processed in 3631us (3829us total) trans 21474841642 rc 0/0 00000100:00100000:2.0:1746147731.811363:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1527 00002000:00100000:2.0:1746147731.811375:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2248704->2469887) req@ffff88009c9a8000 x1830967794117760/t21474841642(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:352/0 lens 488/448 e 0 to 0 dl 1746147742 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.811385:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a8000 with x1830967794117760 ext(2248704->2469887) 00010000:00010000:2.0:1746147731.811396:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 48 pid: 8468 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746147731.811412:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 48 pid: 8468 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746147731.811419:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c9a8000 00000100:00100000:0.0:1746147731.812639:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.812709:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794117888 00000100:00100000:1.0:1746147731.812718:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794117888 00000100:00100000:1.0:1746147731.812769:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16839 00000100:00100000:1.0:1746147731.812778:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+36:32429:x1830967794117888:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147731.812796:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147731.812813:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc3a7 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.812838:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147731.812844:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 37 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.812849:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147731.812852:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2437120->3133439] (req 2437120->3133439) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 37 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.812923:0:9615:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 37 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.812937:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2437120->3133439] (req 2437120->3133439) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 37 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147731.812952:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8a00, rc 0) 00000100:00100000:1.0:1746147731.812992:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+37:32429:x1830967794117888:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 215us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147731.812998:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16839 00000100:00100000:0.0:1746147731.813276:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.813585:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794118016 00000100:00100000:3.0:1746147731.813589:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794118016 00010000:00010000:3.0:1746147731.813611:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 48 pid: 8468 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.813742:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8600 00000100:00100000:3.0:1746147731.813748:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2139500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+48:1959:x1830967794118016:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147731.813758:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147731.813777:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 48 pid: 8468 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.813787:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 48 pid: 8468 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.813806:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e85b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2248704->2469887) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc38b expref: 48 pid: 8468 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746147731.814011:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.814013:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.814019:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 36 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.814028:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 36 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.814057:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 36 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.814073:0:7096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 36 pid: 9615 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746147731.814318:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796515456:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147731.814610:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147731.816569:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796515456:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147731.816598:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147731.816705:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2139500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1959:x1830967794118016:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2954us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.816715:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8600 00000100:00100000:2.0:1746147731.821454:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.821530:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794118272 00000100:00100000:0.0:1746147731.821541:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794118272 00002000:00100000:0.0:1746147731.821587:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880094338700 x1830967794118272/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147731.821597:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094338700 with x1830967794118272 ext(2097152->3145727) 00010000:00010000:0.0:1746147731.821606:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 37 pid: 9615 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746147731.821621:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 37 pid: 9615 timeout: 910 lvb_type: 0 00002000:00010000:0.0:1746147731.821628:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094338700 00000100:00100000:0.0:1746147731.821753:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1528 00000100:00100000:0.0:1746147731.821761:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+37:1960:x1830967794118272:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147731.823380:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.823429:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147731.823503:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794118528 00000100:00100000:0.0:1746147731.823510:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794118528 00002000:00100000:0.0:1746147731.823542:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880094339180 x1830967794118528/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147731.823552:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094339180 with x1830967794118528 ext(3145728->4194303) 00010000:00010000:0.0:1746147731.823560:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 39 pid: 9615 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746147731.823574:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 39 pid: 9615 timeout: 910 lvb_type: 0 00002000:00010000:0.0:1746147731.823580:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094339180 00000100:00100000:0.0:1746147731.823595:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794118784 00000100:00100000:0.0:1746147731.823596:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794118784 00002000:00100000:0.0:1746147731.823605:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009433a680 x1830967794118784/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147731.823611:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433a680 with x1830967794118784 ext(3145728->4194303) 00002000:00010000:0.0:1746147731.823614:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009433a680 00000100:00100000:0.0:1746147731.823623:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1529 00000100:00100000:0.0:1746147731.823629:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+39:1960:x1830967794118528:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147731.824713:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7585 00000100:00100000:3.0:1746147731.824723:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794118784:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147731.839842:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+39:1960:x1830967794118272:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 18068us (18384us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147731.839856:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1528 00002000:00100000:1.0:1746147731.839868:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880094338700 x1830967794118272/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147731.839913:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094338700 with x1830967794118272 ext(2097152->3145727) 00010000:00010000:1.0:1746147731.839924:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 39 pid: 9615 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746147731.839943:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 39 pid: 9615 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746147731.839951:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094338700 00000100:00100000:0.0:1746147731.841837:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+37:1960:x1830967794118528:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 18196us (18452us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147731.841848:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1529 00002000:00100000:0.0:1746147731.841860:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880094339180 x1830967794118528/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147731.841876:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094339180 with x1830967794118528 ext(3145728->4194303) 00010000:00010000:0.0:1746147731.841904:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 37 pid: 9615 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746147731.841920:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 37 pid: 9615 timeout: 911 lvb_type: 0 00002000:00010000:0.0:1746147731.841927:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094339180 00000100:00100000:3.0:1746147731.842634:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794118784:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 17907us (19198us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147731.842643:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7585 00002000:00100000:3.0:1746147731.842651:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009433a680 x1830967794118784/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147731.842669:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433a680 with x1830967794118784 ext(3145728->4194303) 00002000:00010000:3.0:1746147731.842674:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009433a680 00000100:00100000:0.0:1746147731.847424:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147731.847531:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794118912 00000100:00100000:3.0:1746147731.847542:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794118912 00010000:00010000:3.0:1746147731.847585:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 37 pid: 9615 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147731.847630:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8601 00000100:00100000:3.0:1746147731.847639:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2139f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+37:1959:x1830967794118912:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147731.847666:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147731.847691:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 37 pid: 9615 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147731.847704:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 37 pid: 9615 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147731.847731:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a9200/0xe64d3fbf12a7e877 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a0 expref: 37 pid: 9615 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147731.847750:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.847752:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147731.847760:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 36 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.847769:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 36 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147731.847802:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 36 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147731.847816:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796515584:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147731.847934:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147731.851728:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.851814:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794119168 00000100:00100000:2.0:1746147731.851826:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794119168 00000100:00100000:3.0:1746147731.851842:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796515584:192.168.202.10@tcp:105: 00002000:00100000:2.0:1746147731.851867:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2437120->2441215) req@ffff8800a2138700 x1830967794119168/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746147731.851868:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746147731.851879:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2138700 with x1830967794119168 ext(2437120->2441215) 00002000:00010000:2.0:1746147731.851916:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2138700 00000100:00100000:2.0:1746147731.851941:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7586 00000100:00100000:2.0:1746147731.851948:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+37:1959:x1830967794119168:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147731.851957:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2139f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+37:1959:x1830967794118912:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4317us (4544us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.851968:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8601 00000100:00100000:2.0:1746147731.852113:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+36:1959:x1830967794119168:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 164us (396us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147731.852120:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7586 00002000:00100000:2.0:1746147731.852125:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2437120->2441215) req@ffff8800a2138700 x1830967794119168/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/4536 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.852132:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2138700 with x1830967794119168 ext(2437120->2441215) 00002000:00010000:2.0:1746147731.852135:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2138700 00000100:00100000:0.0:1746147731.857034:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.857135:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794119424 00000100:00100000:2.0:1746147731.857146:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794119424 00002000:00100000:2.0:1746147731.857188:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a213bb80 x1830967794119424/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.857196:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a213bb80 with x1830967794119424 ext(3145728->4194303) 00002000:00010000:2.0:1746147731.857201:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a213bb80 00000100:00100000:2.0:1746147731.857227:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7587 00000100:00100000:2.0:1746147731.857233:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+36:1957:x1830967794119424:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147731.861857:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.861996:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794119680 00000100:00100000:2.0:1746147731.862006:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794119680 00002000:00100000:2.0:1746147731.862056:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3129344->3133439) req@ffff8800a213b480 x1830967794119680/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.862067:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a213b480 with x1830967794119680 ext(3129344->3133439) 00002000:00010000:2.0:1746147731.862072:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a213b480 00000100:00100000:2.0:1746147731.862101:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7588 00000100:00100000:2.0:1746147731.862109:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+38:1959:x1830967794119680:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147731.862278:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+38:1959:x1830967794119680:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 168us (432us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147731.862286:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7588 00002000:00100000:2.0:1746147731.862292:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3129344->3133439) req@ffff8800a213b480 x1830967794119680/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/4536 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.862299:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a213b480 with x1830967794119680 ext(3129344->3133439) 00002000:00010000:2.0:1746147731.862301:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a213b480 00000100:00100000:2.0:1746147731.866863:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+36:1957:x1830967794119424:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 9619us (9830us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147731.866873:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7587 00002000:00100000:2.0:1746147731.866905:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a213bb80 x1830967794119424/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.867255:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a213bb80 with x1830967794119424 ext(3145728->4194303) 00002000:00010000:2.0:1746147731.867261:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a213bb80 00000100:00100000:0.0:1746147731.881027:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.881122:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794119936 00000100:00100000:2.0:1746147731.881130:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794119936 00002000:00100000:2.0:1746147731.881174:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a2139180 x1830967794119936/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/0 e 0 to 0 dl 1746147742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.881183:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2139180 with x1830967794119936 ext(4194304->5017599) 00002000:00010000:2.0:1746147731.881189:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2139180 00000100:00100000:2.0:1746147731.881223:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7589 00000100:00100000:2.0:1746147731.881229:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794119936:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147731.889490:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794119936:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8252us (8462us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147731.889502:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7589 00002000:00100000:2.0:1746147731.889512:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a2139180 x1830967794119936/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:352/0 lens 488/440 e 0 to 0 dl 1746147742 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147731.889521:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2139180 with x1830967794119936 ext(4194304->5017599) 00002000:00010000:2.0:1746147731.889525:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2139180 00000100:00100000:0.0:1746147731.991334:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.992166:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794120064 00000100:00100000:2.0:1746147731.992179:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794120064 00000100:00100000:2.0:1746147731.992784:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12074 00000100:00100000:2.0:1746147731.992793:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+10:32436:x1830967794120064:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147731.992814:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147731.992830:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87200/0xe64d3fbf12a7e885 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc3ae expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.992880:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87600/0xe64d3fbf12a7e88c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.993499:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87600/0xe64d3fbf12a7e88c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.993511:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87600/0xe64d3fbf12a7e88c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.993524:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87800/0xe64d3fbf12a7e893 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.993529:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87800/0xe64d3fbf12a7e893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.993537:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87800/0xe64d3fbf12a7e893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.993629:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.993639:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136272000/0xe64d3fbf12a7e7c1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ff expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.993646:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7e7e4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc314 expref: 13 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.993651:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 5/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147731.993689:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7e7e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc314 expref: 13 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.993700:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7e7e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc314 expref: 13 pid: 5744 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147731.993710:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796515712:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147731.994418:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136272000/0xe64d3fbf12a7e7c1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ff expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147731.994426:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136272000/0xe64d3fbf12a7e7c1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ff expref: 326 pid: 5744 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147731.994434:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796515840:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147731.994614:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147731.995629:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147731.995702:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796515712:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147731.995745:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794120192 00000100:00100000:3.0:1746147731.995750:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794120192 00010000:00010000:3.0:1746147731.995773:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7e7e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc314 expref: 14 pid: 5744 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147731.995839:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8602 00000100:00100000:3.0:1746147731.995845:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967794120192:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147731.995854:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147731.995859:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7e7e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc314 expref: 14 pid: 5744 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147731.995866:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7e7e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc314 expref: 14 pid: 5744 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147731.995880:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136273a00/0xe64d3fbf12a7e7e4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc314 expref: 14 pid: 5744 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147731.995918:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147731.995922:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.995930:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.995937:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147731.995941:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147731.996351:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794120192:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 504us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147731.996357:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8602 00000100:00100000:2.0:1746147731.996795:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796515840:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147731.996817:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147731.997369:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147731.997878:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794120448 00000100:00100000:1.0:1746147731.997908:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794120448 00000100:00100000:1.0:1746147731.997945:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5036 00000100:00100000:1.0:1746147731.997951:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:15394:x1830967794120448:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147731.998140:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:15394:x1830967794120448:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 188us (770us total) trans 8589946102 rc 0/0 00000100:00100000:1.0:1746147731.998145:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5036 00000100:00100000:0.0:1746147732.005360:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.005420:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794120576 00000100:00100000:1.0:1746147732.005428:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794120576 00010000:00010000:1.0:1746147732.006144:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136272000/0xe64d3fbf12a7e7c1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ff expref: 328 pid: 5744 timeout: 911 lvb_type: 0 00000100:00080000:2.0:1746147732.006226:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147732.006258:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8603 00000100:00100000:1.0:1746147732.006265:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:1959:x1830967794120576:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.006278:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147732.006283:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136272000/0xe64d3fbf12a7e7c1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ff expref: 328 pid: 5744 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.006297:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136272000/0xe64d3fbf12a7e7c1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ff expref: 328 pid: 5744 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.006315:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136272000/0xe64d3fbf12a7e7c1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc2ff expref: 328 pid: 5744 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.006330:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147732.006334:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147732.006342:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147732.006348:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147732.006364:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147732.006443:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006449:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:3.0:1746147732.006484:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:3.0:1746147732.006488:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147732.006502:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006509:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006516:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87600/0xe64d3fbf12a7e88c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006521:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87600/0xe64d3fbf12a7e88c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006526:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87600/0xe64d3fbf12a7e88c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006530:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b87600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147732.006533:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87600/0xe64d3fbf12a7e88c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006540:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87600/0xe64d3fbf12a7e88c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006547:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147732.006549:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147732.006552:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87600/0xe64d3fbf12a7e88c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006556:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87600/0xe64d3fbf12a7e88c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006569:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87800/0xe64d3fbf12a7e893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006573:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87800/0xe64d3fbf12a7e893 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006577:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87800/0xe64d3fbf12a7e893 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006581:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b87800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147732.006583:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87800/0xe64d3fbf12a7e893 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006587:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87800/0xe64d3fbf12a7e893 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006592:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a0003300) 00010000:00010000:3.0:1746147732.006594:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147732.006596:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87800/0xe64d3fbf12a7e893 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006601:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87800/0xe64d3fbf12a7e893 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.006628:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87200/0xe64d3fbf12a7e885 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ae expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.006637:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ae expref: 11 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.006642:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147732.006644:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147732.006646:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b87e00, rc 0) 00000100:00100000:1.0:1746147732.006780:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:1959:x1830967794120576:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 515us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.006904:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8603 00000100:00100000:3.0:1746147732.007205:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+11:32436:x1830967794120064:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 14412us (15882us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.007212:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12074 00000100:00100000:0.0:1746147732.007361:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.007439:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.007513:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794120960 00000100:00100000:2.0:1746147732.007518:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794120960 00000100:00100000:2.0:1746147732.007539:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16840 00000100:00100000:2.0:1746147732.007543:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1960:x1830967794120960:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147732.007555:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.007567:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98400/0xe64d3fbf12a7e8a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc3bc expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.007601:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094338a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796515968:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147732.007667:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147732.007776:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794120832 00000100:00100000:3.0:1746147732.007779:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794120832 00000100:00100000:3.0:1746147732.007969:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12075 00000100:00100000:3.0:1746147732.007974:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32440:x1830967794120832:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147732.007985:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.007997:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcc400/0xe64d3fbf12a7e8a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc3b5 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.008056:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.008066:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ae expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.008072:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.008089:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ae expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.008097:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ae expref: 10 pid: 17544 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.008104:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796516096:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.008154:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.011227:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.011271:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.011289:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094338a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796515968:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147732.011317:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98400/0xe64d3fbf12a7e8a1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3bc expref: 48 pid: 9615 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147732.011322:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147732.011330:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98400/0xe64d3fbf12a7e8a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3bc expref: 48 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.011355:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d98400, rc 0) 00000100:00100000:2.0:1746147732.011398:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1960:x1830967794120960:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3853us (3957us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147732.011405:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16840 00000100:00100000:2.0:1746147732.011423:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794121088 00000100:00100000:2.0:1746147732.011429:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794121088 00000100:00100000:2.0:1746147732.011469:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794121216 00000100:00100000:2.0:1746147732.011471:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794121216 00000100:00100000:2.0:1746147732.011482:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794121472 00000100:00100000:2.0:1746147732.011484:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794121472 00000100:00100000:3.0:1746147732.011532:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16841 00000100:00100000:3.0:1746147732.011540:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32435:x1830967794121088:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147732.011552:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.011563:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc3c3 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.011583:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a237f800/0xe64d3fbf12a7e84d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc376 expref: 27 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.011590:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e862 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc384 expref: 31 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.011596:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.011597:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.011600:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [217088->561151] (req 217088->561151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.011620:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e862 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc384 expref: 31 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.011630:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e862 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc384 expref: 31 pid: 9615 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746147732.011638:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796516224:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147732.011723:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a237f800/0xe64d3fbf12a7e84d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc376 expref: 27 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.011730:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a237f800/0xe64d3fbf12a7e84d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc376 expref: 27 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.011738:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796516352:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.011760:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147732.011777:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16842 00000100:00100000:3.0:1746147732.011786:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967794121216:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147732.011797:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.011802:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02f8400/0xe64d3fbf12a7e8bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc3ca expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.011812:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.011818:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02f8400/0xe64d3fbf12a7e8bd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ca expref: 7 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.011825:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02f8400/0xe64d3fbf12a7e8bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ca expref: 7 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.011840:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02f8400, rc 0) 00000100:00100000:3.0:1746147732.011856:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967794121216:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 75us (586us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147732.011862:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16842 00000100:00080000:3.0:1746147732.011920:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147732.012000:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16843 00000100:00100000:2.0:1746147732.012005:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967794121472:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147732.012011:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.012019:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98000/0xe64d3fbf12a7e8c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc3d8 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.012028:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.012029:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.012035:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98000/0xe64d3fbf12a7e8c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d8 expref: 7 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.012044:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98000/0xe64d3fbf12a7e8c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d8 expref: 7 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.012051:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d98000, rc 0) 00000100:00100000:2.0:1746147732.012065:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967794121472:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 60us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.012070:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16843 00000100:00080000:3.0:1746147732.012118:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147732.012809:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.012876:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796516096:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147732.012924:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147732.013511:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.013537:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.013874:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794121856 00000100:00100000:1.0:1746147732.013929:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794121856 00010000:00010000:1.0:1746147732.013984:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ae expref: 11 pid: 17544 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746147732.014017:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8604 00000100:00100000:1.0:1746147732.014026:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794121856:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.014041:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147732.014050:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ae expref: 11 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.014060:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ae expref: 11 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.014086:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e89a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ae expref: 11 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.014120:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147732.014135:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147732.014140:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147732.014147:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147732.014155:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147732.014179:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147732.014231:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794121856:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 206us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.014238:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8604 00010000:00010000:1.0:1746147732.014277:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147732.014284:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:1.0:1746147732.014304:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147732.014464:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcc400/0xe64d3fbf12a7e8a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3b5 expref: 330 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.014483:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3b5 expref: 329 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.014489:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147732.014492:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147732.014494:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffcd800, rc 0) 00000100:00100000:1.0:1746147732.014530:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:32440:x1830967794120832:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 6554us (7167us total) trans 8589946103 rc 0/0 00000100:00100000:1.0:1746147732.014536:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12075 00000100:00100000:3.0:1746147732.014547:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794121728 00000100:00100000:2.0:1746147732.014548:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794121344 00000100:00100000:3.0:1746147732.014553:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794121728 00000100:00100000:2.0:1746147732.014553:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794121344 00000100:00100000:2.0:1746147732.014579:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794121600 00000100:00100000:2.0:1746147732.014581:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794121600 00000100:00100000:0.0:1746147732.014764:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796516224:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.014777:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796516352:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147732.014798:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [217088->561151] (req 217088->561151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 27 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.014809:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffcda00, rc 0) 00000100:00100000:0.0:1746147732.014844:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32435:x1830967794121088:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3306us (3629us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147732.014849:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16841 00000100:00100000:0.0:1746147732.014862:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16844 00000100:00100000:0.0:1746147732.014867:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794121344:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147732.014876:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147732.014907:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943d8a00/0xe64d3fbf12a7e8d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc3d1 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.014919:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.014920:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.014925:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943d8a00/0xe64d3fbf12a7e8d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d1 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.014935:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800943d8a00/0xe64d3fbf12a7e8d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d1 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.014941:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943d8a00, rc 0) 00000100:00100000:0.0:1746147732.014953:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794121344:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 87us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147732.014960:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16844 00000100:00100000:0.0:1746147732.014967:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16845 00000100:00100000:0.0:1746147732.014971:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794121728:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147732.014975:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147732.014980:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943d8200/0xe64d3fbf12a7e8d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc3e6 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147732.015006:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796516480:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147732.015038:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147732.015143:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16846 00000100:00100000:2.0:1746147732.015149:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+6:1957:x1830967794121600:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147732.015157:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.015165:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e8e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc3df expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.015177:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.015178:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.015182:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e8e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3df expref: 7 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.015192:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e8e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3df expref: 7 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.015199:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d99200, rc 0) 00000100:00100000:2.0:1746147732.015214:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967794121600:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 65us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.015218:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16846 00000100:00080000:3.0:1746147732.015286:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147732.017556:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.018639:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.018779:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794121984 00000100:00100000:3.0:1746147732.018791:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794121984 00010000:00010000:3.0:1746147732.018836:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e862 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc384 expref: 32 pid: 9615 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746147732.018908:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8605 00000100:00100000:3.0:1746147732.018919:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2378850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794121984:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.018934:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.018960:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e862 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc384 expref: 32 pid: 9615 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.018973:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e862 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc384 expref: 32 pid: 9615 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.019004:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9600/0xe64d3fbf12a7e862 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc384 expref: 32 pid: 9615 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.019021:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.019072:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2378850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794121984:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 153us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.019078:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8605 00000100:00100000:2.0:1746147732.019328:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.019450:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794122240 00000100:00100000:1.0:1746147732.019456:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794122240 00010000:00010000:1.0:1746147732.019473:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a237f800/0xe64d3fbf12a7e84d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc376 expref: 27 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746147732.019490:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8606 00000100:00100000:1.0:1746147732.019496:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967794122240:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.019504:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147732.019517:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a237f800/0xe64d3fbf12a7e84d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc376 expref: 27 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.019526:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a237f800/0xe64d3fbf12a7e84d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc376 expref: 27 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.019542:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a237f800/0xe64d3fbf12a7e84d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc376 expref: 27 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.019558:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.019560:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.019568:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 26 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.019577:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 26 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.019614:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 26 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.019627:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796516608:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147732.019701:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.020015:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794122112 00000100:00100000:0.0:1746147732.020020:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794122112 00000100:00100000:0.0:1746147732.020052:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16847 00000100:00100000:0.0:1746147732.020059:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:32441:x1830967794122112:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147732.020075:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147732.020088:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7e8e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc3ed expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.020109:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 26 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.020115:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147732.020116:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147732.020119:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7e8e7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ed expref: 32 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.020142:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 26 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.020154:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 26 pid: 8184 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746147732.020163:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796516736:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.020219:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f8600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.020329:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796516480:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147732.020355:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800943d8200/0xe64d3fbf12a7e8d9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3e6 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.020367:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943d8200/0xe64d3fbf12a7e8d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3e6 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.020382:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943d8200, rc 0) 00000100:00100000:0.0:1746147732.020407:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794121728:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 5433us (6895us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147732.020414:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16845 00000100:00100000:0.0:1746147732.022815:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.022944:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796516608:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147732.022967:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147732.023098:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794122496 00000100:00100000:2.0:1746147732.023106:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794122496 00002000:00100000:2.0:1746147732.023153:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x455:0x0] (217088->221183) req@ffff8800949d6a00 x1830967794122496/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.023163:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d6a00 with x1830967794122496 ext(217088->221183) 00010000:00010000:2.0:1746147732.023173:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 27 pid: 8184 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.023187:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 27 pid: 8184 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746147732.023193:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949d6a00 00000100:00100000:2.0:1746147732.023219:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1530 00000100:00100000:2.0:1746147732.023227:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967794122496:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147732.023538:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967794122240:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4037us (4206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.023547:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8606 00000100:00100000:2.0:1746147732.025141:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794122496:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 1903us (2324us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147732.025152:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1530 00002000:00100000:2.0:1746147732.025165:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x455:0x0] (217088->221183) req@ffff8800949d6a00 x1830967794122496/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.025174:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d6a00 with x1830967794122496 ext(217088->221183) 00010000:00010000:2.0:1746147732.025185:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 26 pid: 8184 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.025199:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 26 pid: 8184 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746147732.025205:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949d6a00 00000100:00100000:2.0:1746147732.027430:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796516736:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147732.027479:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7e8e7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ed expref: 32 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.027505:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943d8c00, rc 0) 00000100:00100000:2.0:1746147732.027563:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:32441:x1830967794122112:12345-192.168.202.10@tcp:101:cat.0 Request processed in 7501us (8925us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.027572:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16847 00000100:00100000:0.0:1746147732.027913:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.028357:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794122752 00000100:00100000:2.0:1746147732.028366:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794122752 00000100:00100000:2.0:1746147732.028424:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12076 00000100:00100000:2.0:1746147732.028433:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32436:x1830967794122752:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147732.028455:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.028472:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e8ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc3f4 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.028593:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99000/0xe64d3fbf12a7e8f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.028609:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99000/0xe64d3fbf12a7e8f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.028621:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99000/0xe64d3fbf12a7e8f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.028639:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e8fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.028644:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e8fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.028650:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e8fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.028814:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d98400/0xe64d3fbf12a7e903 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.028826:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d98400/0xe64d3fbf12a7e903 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.028834:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d98400/0xe64d3fbf12a7e903 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:2.0:1746147732.028844:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147732.028981:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99000/0xe64d3fbf12a7e8f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.028989:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99000/0xe64d3fbf12a7e8f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.028995:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99000/0xe64d3fbf12a7e8f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.029002:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0d99000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147732.029005:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99000/0xe64d3fbf12a7e8f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.029012:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99000/0xe64d3fbf12a7e8f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.029023:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147732.029026:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147732.029030:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99000/0xe64d3fbf12a7e8f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.029035:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99000/0xe64d3fbf12a7e8f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.029067:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e8fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.029073:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e8fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.029077:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e8fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.029081:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0d99e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147732.029084:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e8fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.029089:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e8fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.029095:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a0003a00) 00010000:00010000:2.0:1746147732.029097:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147732.029099:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e8fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.029103:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99e00/0xe64d3fbf12a7e8fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.031146:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99400/0xe64d3fbf12a7e8ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3f4 expref: 13 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.031170:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d98400/0xe64d3fbf12a7e903 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3f4 expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.031178:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147732.031181:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147732.031184:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d98400, rc 0) 00000100:00100000:2.0:1746147732.031280:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+12:32436:x1830967794122752:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 2845us (3392us total) trans 8589946104 rc 0/0 00000100:00100000:2.0:1746147732.031289:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12076 00000100:00100000:2.0:1746147732.032561:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.032691:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794122880 00000100:00100000:0.0:1746147732.032702:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794122880 00000100:00100000:0.0:1746147732.032755:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16848 00000100:00100000:0.0:1746147732.032763:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:32440:x1830967794122880:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147732.032779:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147732.032794:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc3fb expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.032822:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095235200/0xe64d3fbf12a7e4b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0a5 expref: 25 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.032831:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9ec00/0xe64d3fbf12a7e5d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc19a expref: 6 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.032838:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e51a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0eb expref: 33 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.032844:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.032845:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.032849:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [1589248->1921023] (req 1589248->1921023) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.032877:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e51a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0eb expref: 33 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.032913:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e51a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0eb expref: 33 pid: 6715 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746147732.032925:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796516864:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147732.033003:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9ec00/0xe64d3fbf12a7e5d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc19a expref: 6 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.033009:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9ec00/0xe64d3fbf12a7e5d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc19a expref: 6 pid: 8468 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746147732.033014:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796516992:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147732.033029:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095235200/0xe64d3fbf12a7e4b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0a5 expref: 25 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.033034:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095235200/0xe64d3fbf12a7e4b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0a5 expref: 25 pid: 8184 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746147732.033038:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796517120:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.033048:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147732.036504:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.036726:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.036755:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.036800:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794123392 00000100:00100000:2.0:1746147732.036811:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794123392 00000100:00100000:1.0:1746147732.036875:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794123520 00000100:00100000:1.0:1746147732.036905:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794123520 00000100:00100000:3.0:1746147732.037020:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794123136 00000100:00100000:3.0:1746147732.037025:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794123136 00002000:00100000:3.0:1746147732.037074:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x455:0x0] (557056->561151) req@ffff880094ef8e00 x1830967794123136/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.037084:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef8e00 with x1830967794123136 ext(557056->561151) 00010000:00010000:3.0:1746147732.037095:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 26 pid: 8184 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.037109:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 26 pid: 8184 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746147732.037115:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094ef8e00 00000100:00100000:3.0:1746147732.037152:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1531 00000100:00100000:3.0:1746147732.037162:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794123136:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147732.037761:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 908 00000100:00100000:1.0:1746147732.037771:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+13:1957:x1830967794123520:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.037785:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147732.037808:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d98400/0xe64d3fbf12a7e903 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3f4 expref: 13 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.037845:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147732.037849:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147732.037907:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967794123520:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 139us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.037914:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 908 00000100:00100000:2.0:1746147732.037989:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12077 00000100:00100000:2.0:1746147732.038001:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+11:32436:x1830967794123392:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147732.038027:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.038045:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99000/0xe64d3fbf12a7e918 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc402 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.038162:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.038179:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3b5 expref: 328 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.038186:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 4/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.038221:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3b5 expref: 328 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.038232:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3b5 expref: 328 pid: 17544 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.038246:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796517248:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.038317:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.038444:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796516992:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.038456:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796517120:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.038464:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796516864:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147732.038469:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147732.038486:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [1589248->1921023] (req 1589248->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.038493:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794123648 00000100:00100000:3.0:1746147732.038498:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794123648 00010000:00010000:0.0:1746147732.038499:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943d9200, rc 0) 00000100:00100000:1.0:1746147732.038507:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.038517:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794123776 00000100:00100000:0.0:1746147732.038517:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:32440:x1830967794122880:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5755us (5962us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147732.038520:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9ec00/0xe64d3fbf12a7e5d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc19a expref: 7 pid: 8468 timeout: 911 lvb_type: 1 00000100:00100000:1.0:1746147732.038520:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794123776 00000100:00100000:0.0:1746147732.038523:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16848 00010000:00010000:1.0:1746147732.038534:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095235200/0xe64d3fbf12a7e4b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0a5 expref: 27 pid: 8184 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.038552:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8607 00000100:00100000:3.0:1746147732.038560:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794123648:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147732.038560:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8608 00000100:00100000:1.0:1746147732.038565:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967794123776:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.038570:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147732.038572:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147732.038587:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095235200/0xe64d3fbf12a7e4b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0a5 expref: 27 pid: 8184 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.038596:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095235200/0xe64d3fbf12a7e4b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0a5 expref: 27 pid: 8184 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.038598:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9ec00/0xe64d3fbf12a7e5d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc19a expref: 7 pid: 8468 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746147732.038609:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095235200/0xe64d3fbf12a7e4b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0a5 expref: 27 pid: 8184 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.038611:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9ec00/0xe64d3fbf12a7e5d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc19a expref: 7 pid: 8468 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746147732.038618:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147732.038635:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794123776:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 70us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.038641:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8608 00010000:00010000:3.0:1746147732.038645:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d9ec00/0xe64d3fbf12a7e5d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc19a expref: 7 pid: 8468 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.038674:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.038736:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794123648:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 175us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.038744:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8607 00000100:00100000:3.0:1746147732.038921:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794123136:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 1759us (2427us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147732.038928:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1531 00002000:00100000:3.0:1746147732.038936:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x455:0x0] (557056->561151) req@ffff880094ef8e00 x1830967794123136/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.038944:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef8e00 with x1830967794123136 ext(557056->561151) 00010000:00010000:3.0:1746147732.038951:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 25 pid: 8184 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.038965:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 25 pid: 8184 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746147732.038971:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094ef8e00 00000100:00100000:0.0:1746147732.039818:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.039841:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.039867:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794123904 00000100:00100000:2.0:1746147732.039875:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794123904 00000100:00100000:1.0:1746147732.039915:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794124032 00000100:00100000:1.0:1746147732.039919:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794124032 00010000:00010000:2.0:1746147732.039922:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e51a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0eb expref: 33 pid: 6715 timeout: 911 lvb_type: 1 00000100:00100000:1.0:1746147732.039945:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16849 00000100:00100000:1.0:1746147732.039950:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794124032:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147732.039962:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147732.039963:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8609 00000100:00100000:2.0:1746147732.039970:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794123904:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.039972:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800950f4800/0xe64d3fbf12a7e926 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc409 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.039981:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147732.039985:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.039991:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800950f4800/0xe64d3fbf12a7e926 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc409 expref: 26 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.039996:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e51a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0eb expref: 33 pid: 6715 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746147732.040000:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800950f4800/0xe64d3fbf12a7e926 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc409 expref: 26 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.040006:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e51a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0eb expref: 33 pid: 6715 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746147732.040009:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950f4800, rc 0) 00010000:00010000:2.0:1746147732.040023:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e51a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc0eb expref: 33 pid: 6715 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746147732.040035:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.040037:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147732.040043:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794124032:12345-192.168.202.10@tcp:101:cat.0 Request processed in 92us (201us total) trans 0 rc 301/301 00010000:00010000:2.0:1746147732.040045:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1921023) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 32 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.040049:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16849 00010000:00010000:2.0:1746147732.040053:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1921023) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 32 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.041504:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 32 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.041523:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796517376:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147732.042741:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.043622:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.043683:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.043998:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796517248:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147732.044024:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147732.044056:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794124544 00000100:00100000:2.0:1746147732.044062:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794124544 00002000:00100000:2.0:1746147732.044112:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x455:0x0] (217088->561151) req@ffff88009fe42300 x1830967794124544/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.044121:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe42300 with x1830967794124544 ext(217088->561151) 00010000:00010000:2.0:1746147732.044130:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 25 pid: 8184 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.044141:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 25 pid: 8184 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746147732.044147:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe42300 00000100:00100000:2.0:1746147732.044172:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1532 00000100:00100000:2.0:1746147732.044182:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794124544:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:3.0:1746147732.044281:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794124416 00000100:00100000:3.0:1746147732.044287:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794124416 00000100:00100000:3.0:1746147732.044643:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5037 00000100:00100000:3.0:1746147732.044664:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32435:x1830967794124416:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147732.046588:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32435:x1830967794124416:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 1928us (2964us total) trans 8589946105 rc 0/0 00000100:00100000:3.0:1746147732.046600:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5037 00000100:00080000:3.0:1746147732.046639:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147732.049126:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.049485:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.049527:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.049587:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796517376:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147732.049601:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794124800 00010000:00010000:2.0:1746147732.049604:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.049607:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794124800 00000100:00100000:2.0:1746147732.049639:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794123904:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 9670us (9823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.049642:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16850 00000100:00100000:2.0:1746147732.049648:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8609 00000100:00100000:3.0:1746147732.049649:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32444:x1830967794124800:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147732.049670:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147732.049674:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794124672 00000100:00100000:2.0:1746147732.049677:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794124672 00010000:00010000:3.0:1746147732.049684:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02f9e00/0xe64d3fbf12a7e92d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc410 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.049691:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3b5 expref: 329 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.049705:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1746147732.049705:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8610 00010000:00010000:3.0:1746147732.049710:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02f9e00/0xe64d3fbf12a7e92d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc410 expref: 28 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.049710:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:1959:x1830967794124672:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147732.049718:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.049720:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02f9e00/0xe64d3fbf12a7e92d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc410 expref: 28 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.049723:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3b5 expref: 329 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.049732:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3b5 expref: 329 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.049734:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02f9e00, rc 0) 00010000:00010000:2.0:1746147732.049748:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffcd800/0xe64d3fbf12a7e8af lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3b5 expref: 329 pid: 17544 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.049752:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32444:x1830967794124800:12345-192.168.202.10@tcp:101:cat.0 Request processed in 104us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.049756:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16850 00010000:00010000:2.0:1746147732.049764:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147732.049768:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.049776:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147732.049781:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147732.049823:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794125056 00000100:00100000:1.0:1746147732.049827:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794125056 00002000:00100000:1.0:1746147732.049849:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1589248->1593343) req@ffff88009fe43b80 x1830967794125056/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.049857:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe43b80 with x1830967794125056 ext(1589248->1593343) 00002000:00010000:1.0:1746147732.049861:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe43b80 00000100:00100000:1.0:1746147732.049875:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7590 00000100:00100000:1.0:1746147732.049879:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794125056:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147732.050031:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794125056:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 150us (502us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147732.050036:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7590 00002000:00100000:1.0:1746147732.050040:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1589248->1593343) req@ffff88009fe43b80 x1830967794125056/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.050046:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe43b80 with x1830967794125056 ext(1589248->1593343) 00002000:00010000:1.0:1746147732.050049:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe43b80 00010000:00010000:2.0:1746147732.050475:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147732.050493:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:1959:x1830967794124672:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 782us (1375us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147732.050497:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147732.050499:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8610 00010000:00010000:3.0:1746147732.050505:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147732.050520:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147732.050526:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147732.050531:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147732.050537:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b87e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147732.050540:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147732.050545:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147732.050553:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147732.050556:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147732.050559:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147732.050567:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b87e00/0xe64d3fbf12a7e91f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147732.050600:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99000/0xe64d3fbf12a7e918 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc402 expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.050606:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d99000/0xe64d3fbf12a7e918 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc402 expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.050612:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d99000, rc 0) 00000100:00100000:3.0:1746147732.050629:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+11:32436:x1830967794123392:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 12632us (13911us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147732.050635:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12077 00000100:00100000:3.0:1746147732.052041:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967794124544:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 7858us (8354us total) trans 17179874402 rc 0/0 00000100:00100000:3.0:1746147732.052049:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1532 00002000:00100000:3.0:1746147732.052056:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x455:0x0] (217088->561151) req@ffff88009fe42300 x1830967794124544/t17179874402(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/448 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.052064:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe42300 with x1830967794124544 ext(217088->561151) 00010000:00010000:3.0:1746147732.052070:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 28 pid: 8184 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.052082:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 28 pid: 8184 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746147732.052087:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe42300 00000100:00100000:0.0:1746147732.057279:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.057359:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794125312 00000100:00100000:3.0:1746147732.057370:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794125312 00000100:00100000:3.0:1746147732.058043:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5038 00000100:00100000:3.0:1746147732.058052:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094979c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+11:32436:x1830967794125312:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147732.058403:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094979c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+12:32436:x1830967794125312:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 352us (1136us total) trans 8589946106 rc 0/0 00000100:00100000:3.0:1746147732.058409:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5038 00000100:00100000:0.0:1746147732.060847:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.061785:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794125440 00000100:00100000:2.0:1746147732.061797:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794125440 00010000:00010000:2.0:1746147732.061845:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 28 pid: 8184 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.061928:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8611 00000100:00100000:2.0:1746147732.061939:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2378450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967794125440:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147732.061956:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147732.061979:0:20557:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147732 -> 1746147733 00002000:00010000:2.0:1746147732.061982:0:20557:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147732 -> 1746147733 00010000:00010000:2.0:1746147732.061989:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 28 pid: 8184 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.062003:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 28 pid: 8184 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.062030:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffcda00/0xe64d3fbf12a7e8b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 217088->561151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3c3 expref: 28 pid: 8184 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.062051:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.062053:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.062062:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7e8e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ed expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.062070:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7e8e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ed expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.062078:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.062079:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.062082:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02f9e00/0xe64d3fbf12a7e92d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc410 expref: 27 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.062088:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02f9e00/0xe64d3fbf12a7e92d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc410 expref: 27 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.062123:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02f9e00/0xe64d3fbf12a7e92d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc410 expref: 27 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.062137:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796517504:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147732.062257:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7e8e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ed expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.062267:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796517632:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147732.062294:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.068303:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.068861:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796517504:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147732.068871:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796517632:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147732.068927:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794125696 00000100:00100000:3.0:1746147732.068939:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794125696 00002000:00100000:3.0:1746147732.068987:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1916928->1921023) req@ffff88009fe41880 x1830967794125696/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.069001:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41880 with x1830967794125696 ext(1916928->1921023) 00002000:00010000:3.0:1746147732.069011:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe41880 00000100:00100000:3.0:1746147732.069046:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7591 00000100:00100000:3.0:1746147732.069053:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967794125696:12345-192.168.202.10@tcp:3:multiop.0 00010000:00010000:2.0:1746147732.069111:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147732.069332:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2378450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794125440:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7394us (8492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.069340:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967794125696:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 286us (1047us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147732.069343:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8611 00000100:00100000:3.0:1746147732.069347:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7591 00002000:00100000:3.0:1746147732.069352:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1916928->1921023) req@ffff88009fe41880 x1830967794125696/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.069359:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41880 with x1830967794125696 ext(1916928->1921023) 00002000:00010000:3.0:1746147732.069361:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe41880 00000100:00100000:0.0:1746147732.071267:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.071564:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.071677:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794125952 00000100:00100000:3.0:1746147732.071684:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794125952 00000100:00100000:3.0:1746147732.071730:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5039 00000100:00100000:3.0:1746147732.071737:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32440:x1830967794125952:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:2.0:1746147732.071801:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794126208 00000100:00100000:2.0:1746147732.071809:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794126208 00002000:00100000:2.0:1746147732.071848:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fe42a00 x1830967794126208/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.071858:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe42a00 with x1830967794126208 ext(0->1048575) 00002000:00010000:2.0:1746147732.071864:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe42a00 00000100:00100000:2.0:1746147732.071907:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7592 00000100:00100000:2.0:1746147732.071914:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794126208:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147732.074319:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:32440:x1830967794125952:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 2575us (3051us total) trans 8589946107 rc 0/0 00000100:00100000:3.0:1746147732.074329:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5039 00000100:00100000:0.0:1746147732.074546:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.074574:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794126464 00000100:00100000:0.0:1746147732.074581:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794126464 00002000:00100000:0.0:1746147732.074619:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fe43480 x1830967794126464/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147732.074630:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe43480 with x1830967794126464 ext(0->1048575) 00002000:00010000:0.0:1746147732.074636:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe43480 00000100:00100000:0.0:1746147732.074666:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7593 00000100:00100000:0.0:1746147732.074674:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794126464:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147732.075931:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.075967:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794126592 00000100:00100000:1.0:1746147732.075976:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794126592 00002000:00100000:1.0:1746147732.076009:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88012f515c00 x1830967794126592/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 504/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.076019:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f515c00 with x1830967794126592 ext(1048576->2097151) 00002000:00010000:1.0:1746147732.076024:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f515c00 00000100:00100000:1.0:1746147732.076049:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7594 00000100:00100000:1.0:1746147732.076055:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967794126592:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147732.091688:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967794126464:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 17001us (17134us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147732.091701:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7593 00002000:00100000:1.0:1746147732.091714:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fe43480 x1830967794126464/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.091730:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe43480 with x1830967794126464 ext(0->1048575) 00002000:00010000:1.0:1746147732.091735:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe43480 00000100:00100000:2.0:1746147732.091748:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794126208:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19834us (20187us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147732.091754:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7592 00002000:00100000:2.0:1746147732.091759:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fe42a00 x1830967794126208/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.091765:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe42a00 with x1830967794126208 ext(0->1048575) 00002000:00010000:2.0:1746147732.091768:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe42a00 00000100:00100000:1.0:1746147732.096780:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794126592:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 20713us (20843us total) trans 0 rc 716800/716800 00000100:00100000:1.0:1746147732.096794:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7594 00002000:00100000:1.0:1746147732.096807:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88012f515c00 x1830967794126592/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 504/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 716800/716800 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.096817:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f515c00 with x1830967794126592 ext(1048576->2097151) 00002000:00010000:1.0:1746147732.096824:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f515c00 00000100:00100000:0.0:1746147732.102679:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.104145:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794126848 00000100:00100000:2.0:1746147732.104157:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794126848 00000100:00100000:2.0:1746147732.104488:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16851 00000100:00100000:2.0:1746147732.104499:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32444:x1830967794126848:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147732.104520:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.104542:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e934 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc417 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.104579:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.104586:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147732.104588:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147732.104591:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e934 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc417 expref: 28 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.104733:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1921023) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 31 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.104749:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1921023) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 31 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.104761:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796517760:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.105556:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147732.106820:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796517760:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147732.106850:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e934 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc417 expref: 28 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.106866:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffffc00, rc 0) 00000100:00100000:2.0:1746147732.107141:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32444:x1830967794126848:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2642us (4470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.107149:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16851 00000100:00100000:0.0:1746147732.107506:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.107555:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.107625:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794126976 00000100:00100000:1.0:1746147732.107632:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794126976 00002000:00100000:1.0:1746147732.107680:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1589248->1921023) req@ffff88012e384a80 x1830967794126976/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.107690:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e384a80 with x1830967794126976 ext(1589248->1921023) 00010000:00010000:1.0:1746147732.107697:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 32 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.107710:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 32 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746147732.107716:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e384a80 00000100:00100000:2.0:1746147732.107727:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794127104 00000100:00100000:2.0:1746147732.107730:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794127104 00000100:00100000:1.0:1746147732.107743:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1533 00000100:00100000:2.0:1746147732.107746:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16852 00000100:00100000:1.0:1746147732.107748:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1957:x1830967794126976:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:2.0:1746147732.107750:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:32441:x1830967794127104:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147732.107762:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.107776:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7e93b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc41e expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.107793:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147732.107797:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7e93b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc41e expref: 34 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.107805:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7e93b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc41e expref: 34 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.107812:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd6c400, rc 0) 00000100:00100000:2.0:1746147732.107831:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32441:x1830967794127104:12345-192.168.202.10@tcp:101:cat.0 Request processed in 81us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.107836:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16852 00000100:00100000:1.0:1746147732.112298:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967794126976:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 4537us (4730us total) trans 17179874403 rc 0/0 00000100:00100000:1.0:1746147732.112313:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1533 00002000:00100000:1.0:1746147732.112326:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1589248->1921023) req@ffff88012e384a80 x1830967794126976/t17179874403(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/448 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.112336:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e384a80 with x1830967794126976 ext(1589248->1921023) 00010000:00010000:1.0:1746147732.112347:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 35 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.112364:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 35 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746147732.112372:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e384a80 00000100:00100000:0.0:1746147732.115694:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.115826:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794127232 00000100:00100000:2.0:1746147732.115836:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794127232 00010000:00010000:2.0:1746147732.115877:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 35 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.115956:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8612 00000100:00100000:2.0:1746147732.115965:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967794127232:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147732.115983:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147732.116006:0:20557:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147730 -> 1746147733 00002000:00010000:2.0:1746147732.116009:0:20557:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147730 -> 1746147733 00010000:00010000:2.0:1746147732.116015:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1589248->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 35 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.116031:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1589248->1921023) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 35 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.116054:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943d9200/0xe64d3fbf12a7e911 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1589248->1921023) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3fb expref: 35 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.116082:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.116084:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.116091:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e934 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc417 expref: 27 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.116251:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e934 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc417 expref: 27 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.116262:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.116263:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.116267:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7e93b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc41e expref: 34 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.116273:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7e93b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc41e expref: 34 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.116307:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7e93b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc41e expref: 34 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.116329:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796517888:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147732.116427:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e934 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc417 expref: 27 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.116435:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796518016:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147732.116455:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147732.120435:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796517888:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147732.120449:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796518016:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147732.120477:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147732.120527:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794127232:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4562us (4842us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.120538:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8612 00000100:00100000:0.0:1746147732.121560:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.121723:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794127616 00000100:00100000:1.0:1746147732.121730:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794127616 00002000:00100000:1.0:1746147732.121773:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88012e386d80 x1830967794127616/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.121783:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e386d80 with x1830967794127616 ext(1048576->2097151) 00002000:00010000:1.0:1746147732.121788:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e386d80 00000100:00100000:1.0:1746147732.121822:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7595 00000100:00100000:1.0:1746147732.121829:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794127616:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147732.123332:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.123918:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794127744 00000100:00100000:3.0:1746147732.123927:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794127744 00002000:00100000:3.0:1746147732.123968:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88012e387b80 x1830967794127744/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.123978:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e387b80 with x1830967794127744 ext(1048576->2097151) 00002000:00010000:3.0:1746147732.123984:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e387b80 00000100:00100000:3.0:1746147732.124016:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7596 00000100:00100000:3.0:1746147732.124024:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967794127744:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147732.133439:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794127616:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 11597us (11868us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147732.133451:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7595 00002000:00100000:1.0:1746147732.133463:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88012e386d80 x1830967794127616/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.133480:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e386d80 with x1830967794127616 ext(1048576->2097151) 00002000:00010000:1.0:1746147732.133486:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e386d80 00000100:00100000:3.0:1746147732.134363:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967794127744:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10338us (11037us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147732.134370:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7596 00002000:00100000:3.0:1746147732.134375:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88012e387b80 x1830967794127744/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.134383:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e387b80 with x1830967794127744 ext(1048576->2097151) 00002000:00010000:3.0:1746147732.134386:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e387b80 00000100:00100000:0.0:1746147732.141689:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.141747:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.141982:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794128128 00000100:00100000:2.0:1746147732.141993:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794128128 00000100:00100000:2.0:1746147732.142041:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16853 00000100:00100000:2.0:1746147732.142048:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:32441:x1830967794128128:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147732.142067:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.142087:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7e942 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc425 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.142115:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 35 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.142127:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147732.142129:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147732.142132:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7e942 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc425 expref: 48 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.142161:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 35 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.142172:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 35 pid: 9615 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.142184:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796518144:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.142861:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794128000 00000100:00100000:3.0:1746147732.143138:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794128000 00002000:00100000:3.0:1746147732.143212:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88012e387800 x1830967794128000/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 504/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.143221:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e387800 with x1830967794128000 ext(2097152->3145727) 00010000:00010000:3.0:1746147732.143228:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 36 pid: 9615 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.143240:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 36 pid: 9615 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746147732.143245:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e387800 00000100:00100000:3.0:1746147732.143260:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1534 00000100:00100000:3.0:1746147732.143266:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+36:1958:x1830967794128000:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147732.143894:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00080000:0.0:1746147732.143952:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147732.145909:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.146064:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796518144:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147732.146095:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7e942 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc425 expref: 48 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.146119:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009359be00, rc 0) 00000100:00100000:3.0:1746147732.146161:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+48:32441:x1830967794128128:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4112us (4413us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.146211:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794128256 00000100:00100000:1.0:1746147732.146218:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794128256 00002000:00100000:1.0:1746147732.146260:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2437120->3133439) req@ffff88012e384000 x1830967794128256/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.146269:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e384000 with x1830967794128256 ext(2437120->3133439) 00010000:00010000:1.0:1746147732.146276:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 38 pid: 9615 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.146279:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16853 00010000:00010000:1.0:1746147732.146287:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 38 pid: 9615 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746147732.146293:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e384000 00000100:00100000:1.0:1746147732.146309:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1535 00000100:00100000:1.0:1746147732.146315:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+38:1959:x1830967794128256:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147732.148806:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+38:1958:x1830967794128000:12345-192.168.202.10@tcp:3:cat.0 Request processed in 5526us (7115us total) trans 0 rc 352256/352256 00000100:00100000:3.0:1746147732.148819:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1534 00002000:00100000:3.0:1746147732.148832:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88012e387800 x1830967794128000/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 504/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 352256/352256 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.148843:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e387800 with x1830967794128000 ext(2097152->3145727) 00010000:00010000:3.0:1746147732.148854:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 38 pid: 9615 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.148874:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 38 pid: 9615 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746147732.148882:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e387800 00000100:00100000:0.0:1746147732.154314:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.155360:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794128384 00000100:00100000:3.0:1746147732.155371:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794128384 00000100:00100000:3.0:1746147732.156147:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16854 00000100:00100000:3.0:1746147732.156159:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+38:32444:x1830967794128384:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147732.156179:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.156199:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02f9800/0xe64d3fbf12a7e949 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc42c expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.156226:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147732.156229:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147732.156233:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02f9800/0xe64d3fbf12a7e949 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc42c expref: 39 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.156406:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02f9800/0xe64d3fbf12a7e949 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc42c expref: 39 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.156424:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02f9800, rc 0) 00000100:00100000:3.0:1746147732.157163:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+39:32444:x1830967794128384:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1003us (2856us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.157170:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16854 00000100:00100000:1.0:1746147732.157933:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+39:1959:x1830967794128256:12345-192.168.202.10@tcp:4:cat.0 Request processed in 11614us (12052us total) trans 21474841643 rc 0/0 00000100:00100000:1.0:1746147732.157943:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1535 00002000:00100000:1.0:1746147732.157952:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2437120->3133439) req@ffff88012e384000 x1830967794128256/t21474841643(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/448 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.157961:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e384000 with x1830967794128256 ext(2437120->3133439) 00010000:00010000:1.0:1746147732.157971:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 39 pid: 9615 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.157987:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 39 pid: 9615 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746147732.157994:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e384000 00000100:00100000:0.0:1746147732.161374:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.161406:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794128512 00000100:00100000:0.0:1746147732.161415:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794128512 00010000:00010000:0.0:1746147732.161451:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 39 pid: 9615 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746147732.161478:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8613 00000100:00100000:0.0:1746147732.161484:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+39:1957:x1830967794128512:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147732.161496:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147732.161514:0:20557:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147732 -> 1746147733 00010000:00010000:0.0:1746147732.161520:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 39 pid: 9615 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746147732.161531:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 39 pid: 9615 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746147732.161553:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e87e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2437120->3133439) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3a7 expref: 39 pid: 9615 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746147732.161570:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.161572:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.161580:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7e942 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc425 expref: 47 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.161587:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7e942 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc425 expref: 47 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.161599:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.161600:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.161603:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02f9800/0xe64d3fbf12a7e949 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc42c expref: 38 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.161609:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02f9800/0xe64d3fbf12a7e949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc42c expref: 38 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.161638:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02f9800/0xe64d3fbf12a7e949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc42c expref: 38 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147732.161659:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796518272:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147732.161912:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7e942 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc425 expref: 47 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147732.161921:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796518400:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147732.161952:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147732.180550:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796518272:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147732.180587:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796518400:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147732.180611:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147732.180661:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+38:1957:x1830967794128512:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 19166us (19491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.180672:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8613 00000100:00100000:1.0:1746147732.180733:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.180798:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.180817:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794128768 00000100:00100000:1.0:1746147732.180824:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794128768 00002000:00100000:1.0:1746147732.180866:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88012f517800 x1830967794128768/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.180876:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f517800 with x1830967794128768 ext(3145728->4194303) 00002000:00010000:1.0:1746147732.180907:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f517800 00000100:00100000:1.0:1746147732.180923:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794129024 00000100:00100000:1.0:1746147732.180926:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794129024 00002000:00100000:1.0:1746147732.180941:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88012f515f80 x1830967794129024/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.180947:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f515f80 with x1830967794129024 ext(2097152->3145727) 00002000:00010000:1.0:1746147732.180950:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f515f80 00000100:00100000:1.0:1746147732.180963:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7597 00000100:00100000:1.0:1746147732.180969:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+38:1960:x1830967794128768:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147732.183944:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7598 00000100:00100000:1.0:1746147732.183962:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+48:1960:x1830967794129024:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147732.187743:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.187773:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794129280 00000100:00100000:1.0:1746147732.187781:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794129280 00002000:00100000:1.0:1746147732.187826:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88012f514e00 x1830967794129280/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.187837:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514e00 with x1830967794129280 ext(3145728->4194303) 00002000:00010000:1.0:1746147732.187843:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f514e00 00000100:00100000:1.0:1746147732.187910:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7599 00000100:00100000:1.0:1746147732.187918:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+50:1960:x1830967794129280:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147732.203816:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+50:1960:x1830967794129024:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19850us (23007us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147732.203828:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7598 00002000:00100000:2.0:1746147732.203841:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88012f515f80 x1830967794129024/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.203851:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f515f80 with x1830967794129024 ext(2097152->3145727) 00002000:00010000:2.0:1746147732.203857:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f515f80 00000100:00100000:1.0:1746147732.206619:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+38:1960:x1830967794128768:12345-192.168.202.10@tcp:3:cat.0 Request processed in 25636us (25873us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147732.206633:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7597 00002000:00100000:1.0:1746147732.206644:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88012f517800 x1830967794128768/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.206664:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f517800 with x1830967794128768 ext(3145728->4194303) 00002000:00010000:1.0:1746147732.206671:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f517800 00000100:00100000:1.0:1746147732.207196:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+48:1960:x1830967794129280:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19278us (19464us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147732.207202:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7599 00002000:00100000:1.0:1746147732.207208:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88012f514e00 x1830967794129280/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.207215:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514e00 with x1830967794129280 ext(3145728->4194303) 00002000:00010000:1.0:1746147732.207219:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f514e00 00000100:00100000:2.0:1746147732.225223:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.226131:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794129536 00000100:00100000:3.0:1746147732.226143:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794129536 00000100:00100000:3.0:1746147732.226189:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12078 00000100:00100000:3.0:1746147732.226197:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:32449:x1830967794129536:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147732.226220:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.226240:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8a00/0xe64d3fbf12a7e950 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc433 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.226331:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8800/0xe64d3fbf12a7e957 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147732.226346:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8800/0xe64d3fbf12a7e957 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147732.226357:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8800/0xe64d3fbf12a7e957 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147732.226368:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147732.226474:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8a00/0xe64d3fbf12a7e950 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc433 expref: 332 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.226491:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8800/0xe64d3fbf12a7e957 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc433 expref: 331 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.226499:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147732.226502:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147732.226505:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a59f8800, rc 0) 00000100:00100000:3.0:1746147732.226569:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+331:32449:x1830967794129536:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 372us (1354us total) trans 8589946108 rc 0/0 00000100:00100000:3.0:1746147732.226575:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12078 00000100:00100000:0.0:1746147732.230440:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.230471:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794129664 00000100:00100000:0.0:1746147732.230478:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794129664 00000100:00100000:0.0:1746147732.230516:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16855 00000100:00100000:0.0:1746147732.230522:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32449:x1830967794129664:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147732.230535:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147732.230549:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc43a expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.230576:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7e82a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc353 expref: 35 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.230584:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e8e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3df expref: 5 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.230592:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b87a00/0xe64d3fbf12a7e869 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc392 expref: 27 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.230597:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.230598:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.230601:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3366912->3452927] (req 3366912->3452927) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 35 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.230624:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b87a00/0xe64d3fbf12a7e869 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc392 expref: 27 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.230634:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b87a00/0xe64d3fbf12a7e869 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc392 expref: 27 pid: 8468 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746147732.230644:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796518528:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147732.230725:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e8e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3df expref: 5 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.230732:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e8e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3df expref: 5 pid: 9615 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746147732.230740:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796518656:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147732.236024:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7e82a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc353 expref: 35 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.236042:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7e82a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc353 expref: 35 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746147732.236057:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796518784:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147732.236092:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.245207:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796518528:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.245219:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796518656:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.245226:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796518784:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147732.245253:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3366912->3452927] (req 3366912->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 35 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.245267:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a9e00, rc 0) 00000100:00100000:0.0:1746147732.245302:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:32449:x1830967794129664:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 14780us (14869us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147732.245309:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16855 00000100:00100000:1.0:1746147732.248130:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.248157:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.248186:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.248240:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794129792 00000100:00100000:3.0:1746147732.248252:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794129792 00010000:00010000:3.0:1746147732.248418:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e8e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3df expref: 6 pid: 9615 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746147732.248442:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8614 00000100:00100000:3.0:1746147732.248450:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794129792:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.248462:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.248479:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e8e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3df expref: 6 pid: 9615 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.248488:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e8e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3df expref: 6 pid: 9615 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.248507:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d99200/0xe64d3fbf12a7e8e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3df expref: 6 pid: 9615 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.248518:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.248556:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+5:1959:x1830967794129792:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 107us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.248561:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8614 00000100:00100000:3.0:1746147732.248574:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794130048 00000100:00100000:3.0:1746147732.248577:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794130048 00010000:00010000:3.0:1746147732.248586:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7e82a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc353 expref: 35 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.248597:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794129920 00000100:00100000:3.0:1746147732.248599:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794129920 00010000:00010000:3.0:1746147732.248608:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b87a00/0xe64d3fbf12a7e869 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc392 expref: 28 pid: 8468 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746147732.248625:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8615 00000100:00100000:3.0:1746147732.248629:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967794130048:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.248635:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.248641:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7e82a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc353 expref: 35 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.248648:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7e82a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc353 expref: 35 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.248669:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8000/0xe64d3fbf12a7e82a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc353 expref: 35 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.248678:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.248696:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794130048:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 66us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.248701:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8615 00000100:00100000:2.0:1746147732.248716:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8616 00000100:00100000:2.0:1746147732.248729:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967794129920:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147732.248743:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147732.248763:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b87a00/0xe64d3fbf12a7e869 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc392 expref: 28 pid: 8468 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746147732.249356:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b87a00/0xe64d3fbf12a7e869 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc392 expref: 28 pid: 8468 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746147732.249377:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b87a00/0xe64d3fbf12a7e869 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc392 expref: 28 pid: 8468 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746147732.249390:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.249391:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.249398:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3452927) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.249406:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3452927) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.250315:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.250331:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796518912:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147732.250408:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147732.257670:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.257702:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794130304 00000100:00100000:1.0:1746147732.257710:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794130304 00002000:00100000:1.0:1746147732.257756:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3366912->3371007) req@ffff88012f514380 x1830967794130304/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.257766:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514380 with x1830967794130304 ext(3366912->3371007) 00002000:00010000:1.0:1746147732.257772:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f514380 00000100:00100000:1.0:1746147732.257792:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7600 00000100:00100000:1.0:1746147732.257800:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794130304:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147732.257954:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796518912:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147732.257975:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147732.258020:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794129920:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 9294us (9834us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.258029:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8616 00000100:00100000:1.0:1746147732.258216:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794130304:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 415us (553us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147732.258223:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7600 00002000:00100000:1.0:1746147732.258228:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3366912->3371007) req@ffff88012f514380 x1830967794130304/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.258235:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514380 with x1830967794130304 ext(3366912->3371007) 00002000:00010000:1.0:1746147732.258238:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f514380 00000100:00100000:1.0:1746147732.262419:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.262451:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794130560 00000100:00100000:1.0:1746147732.262460:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794130560 00002000:00100000:1.0:1746147732.262501:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3448832->3452927) req@ffff88012f517480 x1830967794130560/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.262510:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f517480 with x1830967794130560 ext(3448832->3452927) 00002000:00010000:1.0:1746147732.262516:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f517480 00000100:00100000:1.0:1746147732.262535:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7601 00000100:00100000:1.0:1746147732.263406:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967794130560:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147732.263578:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967794130560:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 1036us (1165us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147732.263586:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7601 00002000:00100000:1.0:1746147732.263592:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3448832->3452927) req@ffff88012f517480 x1830967794130560/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.263599:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f517480 with x1830967794130560 ext(3448832->3452927) 00002000:00010000:1.0:1746147732.263602:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f517480 00000100:00100000:1.0:1746147732.283492:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.283681:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794130816 00000100:00100000:0.0:1746147732.283692:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794130816 00000100:00100000:0.0:1746147732.283745:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12079 00000100:00100000:0.0:1746147732.283753:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32453:x1830967794130816:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147732.283771:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147732.283787:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e96c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc441 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.283871:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e973 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147732.283906:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e973 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147732.283920:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e973 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147732.283930:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147732.284880:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7e96c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc441 expref: 17 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.284912:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e973 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc441 expref: 16 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.284920:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147732.284922:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147732.284925:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a9400, rc 0) 00000100:00100000:0.0:1746147732.286030:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32453:x1830967794130816:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2275us (2548us total) trans 8589946109 rc 0/0 00000100:00100000:0.0:1746147732.286037:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12079 00000001:00080000:3.0:1746147732.292608:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841627 is committed 00000001:00080000:3.0:1746147732.292621:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841643 is committed 00000001:00080000:3.0:1746147732.292629:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841640 is committed 00000001:00080000:3.0:1746147732.292668:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841642 is committed 00000100:00100000:0.0:1746147732.333196:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.333226:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794130944 00000100:00100000:0.0:1746147732.333233:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794130944 00000100:00100000:0.0:1746147732.333268:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16856 00000100:00100000:0.0:1746147732.333275:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32453:x1830967794130944:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147732.333289:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147732.333304:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc448 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.333327:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7e942 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc425 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.333339:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02f9800/0xe64d3fbf12a7e949 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc42c expref: 9 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.333344:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.333346:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.333349:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3088384->3145727] (req 3088384->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 9 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.333374:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02f9800/0xe64d3fbf12a7e949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc42c expref: 9 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.333383:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02f9800/0xe64d3fbf12a7e949 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc42c expref: 9 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746147732.333394:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796519040:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147732.333465:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7e942 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc425 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.333472:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7e942 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc425 expref: 15 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746147732.333480:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796519168:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.333496:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ea0300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147732.336409:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.336477:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794131072 00000100:00100000:2.0:1746147732.336488:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794131072 00000100:00100000:1.0:1746147732.336525:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147732.336528:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02f9800/0xe64d3fbf12a7e949 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc42c expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746147732.336528:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796519040:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.336541:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796519168:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.336552:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794131200 00000100:00100000:2.0:1746147732.336554:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794131200 00000100:00100000:1.0:1746147732.336561:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8617 00010000:00010000:2.0:1746147732.336565:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7e942 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc425 expref: 16 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746147732.336568:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3088384->3145727] (req 3088384->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 10 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.336572:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794131072:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147732.336580:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8618 00010000:00010000:0.0:1746147732.336581:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8400, rc 0) 00000100:00100000:2.0:1746147732.336586:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+16:1960:x1830967794131200:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.336590:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147732.336598:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147732.336615:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7e942 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc425 expref: 16 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.336617:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02f9800/0xe64d3fbf12a7e949 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc42c expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.336623:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7e942 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc425 expref: 16 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746147732.336624:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32453:x1830967794130944:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3350us (3436us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147732.336631:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16856 00010000:00010000:1.0:1746147732.336634:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02f9800/0xe64d3fbf12a7e949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc42c expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.336743:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009359be00/0xe64d3fbf12a7e942 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc425 expref: 16 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.336753:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02f9800/0xe64d3fbf12a7e949 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc42c expref: 9 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.336754:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.336755:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.336762:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 8 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.336770:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 8 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.336780:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147732.336795:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 8 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.336802:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796519296:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147732.336810:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1959:x1830967794131072:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 242us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.336816:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8617 00000100:00100000:2.0:1746147732.336842:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.339072:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796519296:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147732.339092:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147732.339123:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+15:1960:x1830967794131200:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2537us (2599us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147732.339133:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8618 00000100:00100000:1.0:1746147732.349514:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.349627:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794131456 00000100:00100000:2.0:1746147732.349635:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794131456 00002000:00100000:2.0:1746147732.349681:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3088384->3092479) req@ffff880135811f80 x1830967794131456/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.349689:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135811f80 with x1830967794131456 ext(3088384->3092479) 00002000:00010000:2.0:1746147732.349694:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135811f80 00000100:00100000:2.0:1746147732.349712:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7602 00000100:00100000:2.0:1746147732.349719:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1959:x1830967794131456:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147732.349904:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1959:x1830967794131456:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 164us (376us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147732.349910:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7602 00002000:00100000:2.0:1746147732.349916:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3088384->3092479) req@ffff880135811f80 x1830967794131456/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.349923:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135811f80 with x1830967794131456 ext(3088384->3092479) 00002000:00010000:2.0:1746147732.349926:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135811f80 00000100:00100000:0.0:1746147732.352801:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.352825:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794131584 00000100:00100000:0.0:1746147732.352830:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794131584 00000100:00100000:0.0:1746147732.352861:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16857 00000100:00100000:0.0:1746147732.352868:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32453:x1830967794131584:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147732.352879:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147732.352909:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc44f expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.353053:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.353061:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147732.353063:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147732.353066:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->3637247] (req 3145728->3637247) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 28 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.353090:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3452927) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 33 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.353100:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3452927) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 33 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746147732.353126:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796519424:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.353188:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.355210:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.355233:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794131712 00000100:00100000:3.0:1746147732.355238:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794131712 00002000:00100000:3.0:1746147732.355264:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3366912->3452927) req@ffff8800954c1500 x1830967794131712/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.355272:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1500 with x1830967794131712 ext(3366912->3452927) 00000100:00100000:2.0:1746147732.355277:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796519424:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147732.355278:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 34 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.355289:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 34 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746147732.355294:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800954c1500 00010000:00010000:2.0:1746147732.355297:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->3637247] (req 3145728->3637247) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 28 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.355308:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1536 00010000:00010000:2.0:1746147732.355310:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179fc00, rc 0) 00000100:00100000:3.0:1746147732.355312:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794131712:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:2.0:1746147732.355348:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32453:x1830967794131584:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2480us (2551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.355354:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16857 00000100:00100000:3.0:1746147732.362659:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967794131712:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 7329us (7435us total) trans 17179874404 rc 0/0 00000100:00100000:3.0:1746147732.362670:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1536 00002000:00100000:3.0:1746147732.362679:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3366912->3452927) req@ffff8800954c1500 x1830967794131712/t17179874404(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/448 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.362688:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1500 with x1830967794131712 ext(3366912->3452927) 00010000:00010000:3.0:1746147732.362696:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 36 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.363790:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 36 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746147732.363798:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800954c1500 00000100:00100000:2.0:1746147732.365935:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.365959:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794131840 00000100:00100000:2.0:1746147732.365965:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794131840 00010000:00010000:2.0:1746147732.365991:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 36 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.366026:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8619 00000100:00100000:2.0:1746147732.366033:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967794131840:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147732.366044:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147732.366058:0:7097:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147732 -> 1746147733 00002000:00010000:2.0:1746147732.366061:0:7097:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147732 -> 1746147733 00010000:00010000:2.0:1746147732.366066:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 36 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.366075:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3452927) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 36 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.366722:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a9e00/0xe64d3fbf12a7e965 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3452927) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc43a expref: 36 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.366735:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.366737:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.366747:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 27 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.367227:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 27 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.367259:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 27 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.367271:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796519552:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147732.367331:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147732.375177:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.375330:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796519552:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147732.375346:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147732.375379:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967794131840:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 9347us (9447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147732.375407:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794132096 00000100:00100000:0.0:1746147732.375414:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794132096 00002000:00100000:0.0:1746147732.375446:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3633152->3637247) req@ffff88012ee58e00 x1830967794132096/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147732.375454:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58e00 with x1830967794132096 ext(3633152->3637247) 00002000:00010000:0.0:1746147732.375457:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee58e00 00000100:00100000:0.0:1746147732.375474:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7603 00000100:00100000:0.0:1746147732.375480:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967794132096:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147732.375597:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967794132096:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 117us (425us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147732.375600:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8619 00000100:00100000:0.0:1746147732.375602:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7603 00002000:00100000:0.0:1746147732.375607:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3633152->3637247) req@ffff88012ee58e00 x1830967794132096/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147732.375618:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58e00 with x1830967794132096 ext(3633152->3637247) 00002000:00010000:0.0:1746147732.375620:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee58e00 00000001:00080000:2.0:1746147732.381415:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874396 is committed 00000001:00080000:2.0:1746147732.381427:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874390 is committed 00000001:00080000:2.0:1746147732.381434:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874403 is committed 00000001:00080000:2.0:1746147732.381440:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874398 is committed 00000001:00080000:2.0:1746147732.381460:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874400 is committed 00000001:00080000:2.0:1746147732.381472:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874402 is committed 00000100:00100000:0.0:1746147732.443763:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.443819:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.443855:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794132224 00000100:00100000:2.0:1746147732.443863:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794132224 00000100:00100000:1.0:1746147732.443905:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794132352 00000100:00100000:1.0:1746147732.443910:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794132352 00000100:00100000:2.0:1746147732.443929:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16858 00000100:00100000:2.0:1746147732.443935:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794132224:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147732.443945:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16859 00000100:00100000:1.0:1746147732.443950:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+15:1959:x1830967794132352:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147732.443951:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147732.443958:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.443966:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136404000/0xe64d3fbf12a7e98f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc456 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.443968:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094109800/0xe64d3fbf12a7e996 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc45d expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.444006:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796519808:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147732.444007:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796519680:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147732.444068:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147732.444068:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.445626:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.445692:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:1.0:1746147732.445994:0:8468:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime: 1746147732 -> 1746147733 00002000:00010000:1.0:1746147732.445997:0:8468:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime: 1746147732 -> 1746147733 00000100:00100000:1.0:1746147732.446014:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796519808:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147732.446037:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094109800/0xe64d3fbf12a7e996 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc45d expref: 16 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.446049:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094109800/0xe64d3fbf12a7e996 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc45d expref: 16 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.446061:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094109800, rc 0) 00000100:00100000:1.0:1746147732.446089:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+15:1959:x1830967794132352:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2139us (2270us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147732.446096:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16859 00000100:00100000:0.0:1746147732.446294:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.446577:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794132736 00000100:00100000:2.0:1746147732.446583:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794132736 00002000:00100000:2.0:1746147732.446614:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3637248->4194303) req@ffff8800954c0700 x1830967794132736/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.446623:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c0700 with x1830967794132736 ext(3637248->4194303) 00002000:00010000:2.0:1746147732.446627:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c0700 00000100:00100000:2.0:1746147732.446657:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794132608 00000100:00100000:2.0:1746147732.446660:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794132608 00002000:00100000:2.0:1746147732.446676:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800954c1880 x1830967794132608/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.446685:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1880 with x1830967794132608 ext(2097152->3145727) 00002000:00010000:2.0:1746147732.446688:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c1880 00000100:00100000:2.0:1746147732.446710:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7604 00000100:00100000:2.0:1746147732.446715:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794132736:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147732.447170:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7605 00000100:00100000:1.0:1746147732.447177:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794132608:12345-192.168.202.10@tcp:3:cat.0 00002000:00010000:3.0:1746147732.447308:0:7050:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147732 -> 1746147733 00000100:00100000:3.0:1746147732.447318:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796519680:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147732.447338:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136404000/0xe64d3fbf12a7e98f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc456 expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.447348:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136404000/0xe64d3fbf12a7e98f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc456 expref: 22 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.447359:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136404000, rc 0) 00000100:00100000:3.0:1746147732.447385:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794132224:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3450us (3631us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147732.447390:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16858 00000100:00100000:0.0:1746147732.447538:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.447598:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794133248 00000100:00100000:3.0:1746147732.447601:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794133248 00002000:00100000:3.0:1746147732.447620:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3203072->4194303) req@ffff8800954c1c00 x1830967794133248/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.447627:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1c00 with x1830967794133248 ext(3203072->4194303) 00002000:00010000:3.0:1746147732.447630:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800954c1c00 00000100:00100000:3.0:1746147732.447640:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794133120 00000100:00100000:3.0:1746147732.447642:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794133120 00002000:00100000:3.0:1746147732.447663:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3203071) req@ffff8800954c1f80 x1830967794133120/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 504/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.447670:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1f80 with x1830967794133120 ext(2097152->3203071) 00002000:00010000:3.0:1746147732.447672:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800954c1f80 00000100:00100000:3.0:1746147732.447683:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7606 00000100:00100000:3.0:1746147732.447687:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794133248:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147732.448949:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7607 00000100:00100000:0.0:1746147732.448958:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794133120:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147732.460055:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794132736:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13332us (14424us total) trans 0 rc 557056/557056 00000100:00100000:2.0:1746147732.460065:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7604 00002000:00100000:2.0:1746147732.460075:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3637248->4194303) req@ffff8800954c0700 x1830967794132736/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 557056/557056 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.460089:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c0700 with x1830967794132736 ext(3637248->4194303) 00002000:00010000:2.0:1746147732.460094:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c0700 00000100:00100000:0.0:1746147732.460827:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.460902:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794133504 00000100:00100000:2.0:1746147732.460909:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794133504 00000100:00100000:2.0:1746147732.460948:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16860 00000100:00100000:2.0:1746147732.460954:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+15:32456:x1830967794133504:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147732.460968:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.460983:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc464 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.461005:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 11 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.461010:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147732.461012:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147732.461014:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3928064->4194303] (req 3928064->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 16 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.461039:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 11 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.461075:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 11 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.461086:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796519936:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.461712:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.463661:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.463707:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.463781:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794133632 00000100:00100000:1.0:1746147732.463785:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794133760 00000100:00100000:2.0:1746147732.463789:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794133632 00000100:00100000:1.0:1746147732.463789:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794133760 00000100:00100000:2.0:1746147732.463829:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16861 00000100:00100000:2.0:1746147732.463836:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794133632:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147732.463838:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16862 00000100:00100000:1.0:1746147732.463843:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1960:x1830967794133760:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147732.463849:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147732.463851:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.463862:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136404c00/0xe64d3fbf12a7e9a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc46b expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.463862:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bc91000/0xe64d3fbf12a7e9ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc472 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.463928:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796520064:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147732.463987:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147732.464373:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796520192:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147732.464510:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.465403:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.465434:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796519936:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.465452:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794133888 00010000:00010000:3.0:1746147732.465455:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3928064->4194303] (req 3928064->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 18 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.465456:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794133888 00010000:00010000:3.0:1746147732.465468:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136404800, rc 0) 00002000:00100000:2.0:1746147732.465481:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3088384->3145727) req@ffff88012f516680 x1830967794133888/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.465489:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f516680 with x1830967794133888 ext(3088384->3145727) 00000100:00100000:3.0:1746147732.465537:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:32456:x1830967794133504:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4582us (4710us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.465543:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16860 00000100:00100000:3.0:1746147732.465592:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796520192:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147732.465609:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136404c00/0xe64d3fbf12a7e9a4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc46b expref: 22 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.465617:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136404c00/0xe64d3fbf12a7e9a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc46b expref: 22 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.465629:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136404c00, rc 0) 00000100:00100000:3.0:1746147732.465657:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794133632:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1813us (2000us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147732.465663:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16861 00010000:00010000:2.0:1746147732.465668:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 12 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.465679:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 12 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746147732.465685:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f516680 00000100:00100000:2.0:1746147732.465699:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1537 00000100:00100000:2.0:1746147732.465704:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794133888:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147732.466029:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796520064:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147732.466044:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bc91000/0xe64d3fbf12a7e9ab lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc472 expref: 17 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.466053:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bc91000/0xe64d3fbf12a7e9ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc472 expref: 17 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.466065:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc91000, rc 0) 00000100:00100000:1.0:1746147732.466083:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+16:1960:x1830967794133760:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2240us (2376us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147732.466089:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16862 00000100:00100000:2.0:1746147732.469052:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794133888:12345-192.168.202.10@tcp:4:cat.0 Request processed in 3340us (3644us total) trans 21474841644 rc 0/0 00000100:00100000:2.0:1746147732.469066:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1537 00002000:00100000:2.0:1746147732.469240:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3088384->3145727) req@ffff88012f516680 x1830967794133888/t21474841644(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/448 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.469249:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f516680 with x1830967794133888 ext(3088384->3145727) 00010000:00010000:2.0:1746147732.469256:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 14 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.469267:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 14 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746147732.469273:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f516680 00000100:00100000:1.0:1746147732.469456:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1959:x1830967794132608:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22278us (23761us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147732.469462:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7605 00002000:00100000:1.0:1746147732.469468:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800954c1880 x1830967794132608/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.469476:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1880 with x1830967794132608 ext(2097152->3145727) 00002000:00010000:1.0:1746147732.469479:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c1880 00000100:00100000:0.0:1746147732.469802:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.469907:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794134016 00000100:00100000:1.0:1746147732.469913:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794134016 00000100:00100000:1.0:1746147732.469946:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16863 00000100:00100000:1.0:1746147732.469952:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32463:x1830967794134016:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147732.469964:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147732.469975:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc479 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.469998:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 7 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.470005:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147732.470006:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147732.470009:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.470033:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 7 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.470041:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 7 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746147732.470050:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796520320:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.470257:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794133248:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22568us (23961us total) trans 0 rc 991232/991232 00000100:00100000:3.0:1746147732.470264:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7606 00002000:00100000:3.0:1746147732.470270:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3203072->4194303) req@ffff8800954c1c00 x1830967794133248/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.470278:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1c00 with x1830967794133248 ext(3203072->4194303) 00010000:00010000:3.0:1746147732.470283:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 12 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.470297:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 12 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746147732.470302:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800954c1c00 00000100:00100000:1.0:1746147732.472159:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.472685:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796520320:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147732.472775:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.472788:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6543c00, rc 0) 00000100:00100000:0.0:1746147732.472827:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:32463:x1830967794134016:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2874us (3026us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147732.472834:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16863 00000100:00100000:3.0:1746147732.472839:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.472913:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794134144 00000100:00100000:3.0:1746147732.472918:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794134144 00002000:00100000:3.0:1746147732.472943:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3637247) req@ffff8800a02afb80 x1830967794134144/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.472951:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02afb80 with x1830967794134144 ext(3145728->3637247) 00010000:00010000:3.0:1746147732.472956:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 8 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.472966:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 8 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746147732.472971:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a02afb80 00000100:00100000:3.0:1746147732.472997:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1538 00000100:00100000:3.0:1746147732.473003:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1957:x1830967794134144:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147732.473080:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794133120:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24123us (25541us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147732.473088:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7607 00002000:00100000:2.0:1746147732.473098:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3203071) req@ffff8800954c1f80 x1830967794133120/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 504/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.473105:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1f80 with x1830967794133120 ext(2097152->3203071) 00010000:00010000:2.0:1746147732.473111:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.473119:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746147732.473125:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800954c1f80 00000100:00100000:0.0:1746147732.474712:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.474758:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794134400 00000100:00100000:1.0:1746147732.474763:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794134400 00002000:00100000:1.0:1746147732.474793:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88012f516300 x1830967794134400/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.474801:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f516300 with x1830967794134400 ext(4194304->5017599) 00010000:00010000:1.0:1746147732.474807:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.474816:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746147732.474823:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f516300 00000100:00100000:1.0:1746147732.474847:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1539 00000100:00100000:1.0:1746147732.474853:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794134400:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147732.479311:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.481871:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794134528 00000100:00100000:2.0:1746147732.481879:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794134528 00010000:00010000:2.0:1746147732.481922:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.481954:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8620 00000100:00100000:2.0:1746147732.481961:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794134528:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147732.481972:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147732.481988:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.481997:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.482016:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7e981 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc448 expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746147732.482150:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147732.482506:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.482509:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.482515:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.482518:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1957:x1830967794134144:12345-192.168.202.10@tcp:4:cat.0 Request processed in 9512us (9678us total) trans 17179874405 rc 0/0 00010000:00010000:2.0:1746147732.482522:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.482529:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1538 00002000:00100000:3.0:1746147732.482540:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3637247) req@ffff8800a02afb80 x1830967794134144/t17179874405(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/448 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147732.482552:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147732.482555:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a02afb80 with x1830967794134144 ext(3145728->3637247) 00010000:00010000:3.0:1746147732.482562:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 12 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.482566:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796520448:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147732.482574:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 12 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746147732.482581:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a02afb80 00000100:00100000:2.0:1746147732.482610:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.482688:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794134656 00000100:00100000:0.0:1746147732.482692:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794134656 00000100:00100000:0.0:1746147732.482780:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16864 00000100:00100000:0.0:1746147732.482786:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32462:x1830967794134656:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147732.482798:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147732.482808:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e9b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc480 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.482822:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.482828:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147732.482829:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147732.482832:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e9b9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc480 expref: 11 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.482845:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.482853:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 15 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746147732.482861:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796520576:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.482878:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ea0300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147732.483451:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794134400:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8597us (8741us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147732.483458:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1539 00002000:00100000:1.0:1746147732.483464:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88012f516300 x1830967794134400/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.483646:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f516300 with x1830967794134400 ext(4194304->5017599) 00010000:00010000:1.0:1746147732.483663:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.483673:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746147732.483679:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f516300 00000100:00100000:2.0:1746147732.485465:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796520448:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147732.485482:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147732.485511:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794134528:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3550us (6206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.485521:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8620 00000100:00100000:1.0:1746147732.485600:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796520576:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147732.485622:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e9b9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc480 expref: 10 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.485634:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8200, rc 0) 00000100:00100000:1.0:1746147732.485679:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32462:x1830967794134656:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2893us (3529us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.485689:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16864 00000100:00100000:0.0:1746147732.486339:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.486412:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794134912 00000100:00100000:1.0:1746147732.486417:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794134912 00002000:00100000:1.0:1746147732.486443:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3928064->3932159) req@ffff880135849f80 x1830967794134912/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.486451:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849f80 with x1830967794134912 ext(3928064->3932159) 00010000:00010000:1.0:1746147732.486457:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 16 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.486467:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 16 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746147732.486473:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135849f80 00000100:00100000:1.0:1746147732.486494:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1540 00000100:00100000:1.0:1746147732.486500:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+16:1960:x1830967794134912:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147732.486656:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+16:1960:x1830967794134912:12345-192.168.202.10@tcp:3:cat.0 Request processed in 147us (309us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147732.486662:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1540 00002000:00100000:1.0:1746147732.486667:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3928064->3932159) req@ffff880135849f80 x1830967794134912/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.486674:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849f80 with x1830967794134912 ext(3928064->3932159) 00010000:00010000:1.0:1746147732.486678:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 16 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.486694:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 16 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746147732.486700:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135849f80 00000100:00100000:0.0:1746147732.490224:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.490278:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794135168 00000100:00100000:1.0:1746147732.490283:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794135168 00002000:00100000:1.0:1746147732.490310:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3928064->4194303) req@ffff88009aee9180 x1830967794135168/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.490315:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee9180 with x1830967794135168 ext(3928064->4194303) 00010000:00010000:1.0:1746147732.490320:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 16 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.490329:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 16 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746147732.490333:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aee9180 00000100:00100000:1.0:1746147732.490358:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1541 00000100:00100000:1.0:1746147732.490362:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+16:1958:x1830967794135168:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147732.490749:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.490867:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794135296 00000100:00100000:3.0:1746147732.490871:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794135296 00010000:00010000:3.0:1746147732.490916:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.490934:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8621 00000100:00100000:3.0:1746147732.490940:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794135296:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.490948:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.490965:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.490975:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.490994:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013179fc00/0xe64d3fbf12a7e988 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3637247) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc44f expref: 10 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.491009:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.491012:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.491018:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.491025:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.491051:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.491061:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796520704:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147732.491124:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4163300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147732.491345:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.491395:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794135424 00000100:00100000:1.0:1746147732.491398:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794135424 00000100:00100000:1.0:1746147732.491419:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16865 00000100:00100000:1.0:1746147732.491423:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:32456:x1830967794135424:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147732.491431:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147732.491441:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc487 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.491456:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.491461:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.491462:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.491466:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [4194304->4657151] (req 4194304->4657151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.491481:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.491490:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 23 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746147732.491497:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796520832:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147732.491530:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147732.493755:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796520704:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147732.493768:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.493805:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967794135296:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2864us (3055us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.493813:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8621 00000100:00100000:0.0:1746147732.495274:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.495333:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794135680 00000100:00100000:3.0:1746147732.495338:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794135680 00002000:00100000:3.0:1746147732.495365:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88012da3c450 x1830967794135680/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.495374:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da3c450 with x1830967794135680 ext(2097152->3145727) 00010000:00010000:3.0:1746147732.495381:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 24 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.495391:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 24 pid: 8468 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746147732.495402:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012da3c450 00000100:00100000:3.0:1746147732.495420:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1542 00000100:00100000:3.0:1746147732.495426:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794135680:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147732.495605:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796520832:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147732.495621:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [4194304->4657151] (req 4194304->4657151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.495632:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc90600, rc 0) 00000100:00100000:2.0:1746147732.495832:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32456:x1830967794135424:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4407us (4486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.495832:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1958:x1830967794135168:12345-192.168.202.10@tcp:4:cat.0 Request processed in 5468us (5615us total) trans 21474841645 rc 0/0 00000100:00100000:2.0:1746147732.495838:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16865 00000100:00100000:1.0:1746147732.495838:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1541 00002000:00100000:1.0:1746147732.495843:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3928064->4194303) req@ffff88009aee9180 x1830967794135168/t21474841645(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/448 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.495849:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee9180 with x1830967794135168 ext(3928064->4194303) 00010000:00010000:1.0:1746147732.495854:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 18 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.495866:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 18 pid: 7050 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746147732.495872:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aee9180 00000100:00100000:0.0:1746147732.498175:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.498243:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794135808 00000100:00100000:3.0:1746147732.498248:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794135808 00010000:00010000:3.0:1746147732.498267:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 18 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.498288:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8622 00000100:00100000:3.0:1746147732.498294:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1959:x1830967794135808:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.498304:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.498318:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 18 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.498326:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 18 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.498343:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7e99d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc464 expref: 18 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.498379:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.498381:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.498388:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e9b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc480 expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.498399:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e9b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc480 expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.498483:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e9b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc480 expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.498494:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796520960:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147732.498563:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4163300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147732.503009:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796520960:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147732.503029:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.503069:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1959:x1830967794135808:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4772us (4896us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.503080:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8622 00000100:00100000:3.0:1746147732.504792:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794135680:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9363us (9517us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147732.504795:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.504800:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1542 00002000:00100000:3.0:1746147732.504809:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88012da3c450 x1830967794135680/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.504817:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da3c450 with x1830967794135680 ext(2097152->3145727) 00010000:00010000:3.0:1746147732.504825:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 23 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.504837:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 23 pid: 8468 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746147732.504844:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012da3c450 00000100:00100000:2.0:1746147732.506252:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794136064 00000100:00100000:2.0:1746147732.506260:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794136064 00002000:00100000:2.0:1746147732.506295:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009aee8a80 x1830967794136064/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.506302:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee8a80 with x1830967794136064 ext(2097152->3145727) 00002000:00010000:2.0:1746147732.506305:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aee8a80 00000100:00100000:2.0:1746147732.506322:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7608 00000100:00100000:2.0:1746147732.506328:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794136064:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147732.512831:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.513031:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794136192 00000100:00100000:2.0:1746147732.513039:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794136192 00000100:00100000:2.0:1746147732.513085:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16866 00000100:00100000:2.0:1746147732.513092:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:32463:x1830967794136192:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147732.513107:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.513121:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7e9c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc48e expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.513140:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.513141:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.513147:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7e9c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc48e expref: 18 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.513158:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7e9c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc48e expref: 18 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.513167:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bce00, rc 0) 00000100:00100000:2.0:1746147732.513214:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:32463:x1830967794136192:12345-192.168.202.10@tcp:101:cat.0 Request processed in 121us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.513219:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16866 00000100:00100000:1.0:1746147732.513269:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.513310:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794136320 00000100:00100000:3.0:1746147732.513314:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794136320 00010000:00010000:3.0:1746147732.513332:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 23 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.513363:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8623 00000100:00100000:3.0:1746147732.513368:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794136320:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.513377:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.513394:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 23 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.513404:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 23 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.513420:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7e9b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc479 expref: 23 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.513435:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.513436:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.513440:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.513446:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.513476:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.513486:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796521088:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147732.513870:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4163300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147732.514579:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794136064:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8249us (9784us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147732.514587:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7608 00002000:00100000:2.0:1746147732.514595:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009aee8a80 x1830967794136064/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.514609:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee8a80 with x1830967794136064 ext(2097152->3145727) 00002000:00010000:2.0:1746147732.514612:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aee8a80 00000100:00100000:3.0:1746147732.516403:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796521088:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147732.516417:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.516456:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794136320:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3086us (3186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.516464:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8623 00000100:00100000:0.0:1746147732.521399:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.521456:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.521471:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794136576 00000100:00100000:2.0:1746147732.521479:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794136576 00002000:00100000:2.0:1746147732.521520:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4653056->4657151) req@ffff88009aee9c00 x1830967794136576/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147732.521525:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794136704 00000100:00100000:3.0:1746147732.521528:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794136704 00002000:00100000:2.0:1746147732.521529:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee9c00 with x1830967794136576 ext(4653056->4657151) 00002000:00010000:2.0:1746147732.521533:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aee9c00 00000100:00100000:3.0:1746147732.521556:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16867 00000100:00100000:2.0:1746147732.521557:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7609 00000100:00100000:3.0:1746147732.521560:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32462:x1830967794136704:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147732.521562:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794136576:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:3.0:1746147732.521570:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.521583:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4200/0xe64d3fbf12a7e9ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc495 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.521600:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.521606:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147732.521607:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147732.521609:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4200/0xe64d3fbf12a7e9ce lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc495 expref: 10 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.521631:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 22 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.521638:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 22 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.521645:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796521216:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.521712:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794136576:12345-192.168.202.10@tcp:3:cat.0 Request processed in 148us (322us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147732.521716:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4163300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147732.521719:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7609 00002000:00100000:2.0:1746147732.521725:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4653056->4657151) req@ffff88009aee9c00 x1830967794136576/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.521732:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee9c00 with x1830967794136576 ext(4653056->4657151) 00010000:00010000:2.0:1746147732.521737:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 22 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.521747:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 22 pid: 8468 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746147732.521753:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aee9c00 00000100:00100000:0.0:1746147732.524988:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.525025:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.525059:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.525081:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794136960 00000100:00100000:3.0:1746147732.525087:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794136960 00002000:00100000:3.0:1746147732.525116:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009aee8380 x1830967794136960/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.525123:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee8380 with x1830967794136960 ext(2097152->3145727) 00002000:00010000:3.0:1746147732.525127:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aee8380 00000100:00100000:2.0:1746147732.525128:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794137344 00000100:00100000:2.0:1746147732.525133:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794137344 00000100:00100000:3.0:1746147732.525143:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794137472 00000100:00100000:3.0:1746147732.525146:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794137472 00002000:00100000:2.0:1746147732.525150:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009aee9880 x1830967794137344/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.525158:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009aeeb800 x1830967794137472/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.525158:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee9880 with x1830967794137344 ext(3145728->4194303) 00002000:00010000:2.0:1746147732.525161:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aee9880 00002000:00100000:3.0:1746147732.525165:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeeb800 with x1830967794137472 ext(3145728->4194303) 00010000:00010000:3.0:1746147732.525170:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 22 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.525181:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 22 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.525189:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7610 00002000:00010000:3.0:1746147732.525191:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aeeb800 00000100:00100000:2.0:1746147732.525195:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1959:x1830967794136960:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147732.525210:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1543 00000100:00100000:3.0:1746147732.525214:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794137472:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147732.525585:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7611 00000100:00100000:0.0:1746147732.525593:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794137344:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147732.527917:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.527997:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796521216:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147732.528021:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4200/0xe64d3fbf12a7e9ce lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc495 expref: 10 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.528036:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c9f4200, rc 0) 00000100:00100000:2.0:1746147732.528063:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32462:x1830967794136704:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6502us (6606us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.528071:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16867 00000100:00100000:1.0:1746147732.528143:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794137600 00000100:00100000:1.0:1746147732.528148:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794137600 00002000:00100000:1.0:1746147732.528172:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4657151) req@ffff88009aeead80 x1830967794137600/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.528180:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeead80 with x1830967794137600 ext(4194304->4657151) 00010000:00010000:1.0:1746147732.528185:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 24 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.528197:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 24 pid: 8468 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746147732.528203:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aeead80 00000100:00100000:1.0:1746147732.528216:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1544 00000100:00100000:1.0:1746147732.528222:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794137600:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147732.534351:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794137472:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9128us (9283us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147732.534361:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1543 00002000:00100000:3.0:1746147732.534372:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009aeeb800 x1830967794137472/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.534377:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeeb800 with x1830967794137472 ext(3145728->4194303) 00010000:00010000:3.0:1746147732.534386:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 24 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.534398:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 24 pid: 8468 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746147732.534403:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aeeb800 00000100:00100000:3.0:1746147732.537272:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1959:x1830967794136960:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12070us (12283us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147732.537281:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7610 00002000:00100000:3.0:1746147732.537290:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009aee8380 x1830967794136960/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.537298:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee8380 with x1830967794136960 ext(2097152->3145727) 00002000:00010000:3.0:1746147732.537303:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aee8380 00000100:00100000:1.0:1746147732.537318:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1960:x1830967794137344:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11718us (12284us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147732.537329:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7611 00002000:00100000:1.0:1746147732.537347:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009aee9880 x1830967794137344/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.537362:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee9880 with x1830967794137344 ext(3145728->4194303) 00002000:00010000:1.0:1746147732.537367:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aee9880 00000100:00100000:1.0:1746147732.541197:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794137600:12345-192.168.202.10@tcp:4:cat.0 Request processed in 12968us (13281us total) trans 17179874406 rc 0/0 00000100:00100000:1.0:1746147732.541208:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1544 00002000:00100000:1.0:1746147732.541217:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4657151) req@ffff88009aeead80 x1830967794137600/t17179874406(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/448 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.541226:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeead80 with x1830967794137600 ext(4194304->4657151) 00010000:00010000:1.0:1746147732.541233:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 24 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.541246:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 24 pid: 8468 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746147732.541252:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aeead80 00000100:00100000:0.0:1746147732.544185:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.544328:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794137728 00000100:00100000:2.0:1746147732.544340:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794137728 00000100:00100000:2.0:1746147732.544399:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16868 00000100:00100000:2.0:1746147732.544406:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32463:x1830967794137728:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147732.544422:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.544437:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308bda00/0xe64d3fbf12a7e9d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc49c expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.544460:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147732.544465:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bda00/0xe64d3fbf12a7e9d5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc49c expref: 25 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.544479:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801308bda00/0xe64d3fbf12a7e9d5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc49c expref: 25 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.544488:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bda00, rc 0) 00000100:00100000:2.0:1746147732.544538:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:32463:x1830967794137728:12345-192.168.202.10@tcp:101:cat.0 Request processed in 132us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.544544:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16868 00000100:00100000:0.0:1746147732.547569:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.547690:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794137856 00000100:00100000:3.0:1746147732.547700:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794137856 00010000:00010000:3.0:1746147732.547739:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 25 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.547770:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8624 00000100:00100000:3.0:1746147732.547779:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794137856:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.547793:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.547817:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 25 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.547829:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 25 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.547853:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bc90600/0xe64d3fbf12a7e9c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4657151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc487 expref: 25 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.547915:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.547918:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.547927:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4200/0xe64d3fbf12a7e9ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc495 expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.547936:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4200/0xe64d3fbf12a7e9ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc495 expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.547944:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.547945:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.547948:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308bda00/0xe64d3fbf12a7e9d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc49c expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.547956:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bda00/0xe64d3fbf12a7e9d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc49c expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.547988:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801308bda00/0xe64d3fbf12a7e9d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc49c expref: 24 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.548000:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796521344:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147732.548457:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4200/0xe64d3fbf12a7e9ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc495 expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.548466:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796521472:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147732.548792:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4163900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147732.550902:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796521344:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147732.550916:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796521472:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147732.550936:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.550989:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794137856:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3211us (3430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.551000:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8624 00000100:00100000:0.0:1746147732.554575:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.554629:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.554678:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794138112 00000100:00100000:1.0:1746147732.554693:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794138112 00002000:00100000:1.0:1746147732.554747:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009aee8000 x1830967794138112/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.554757:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee8000 with x1830967794138112 ext(3145728->4194303) 00002000:00010000:1.0:1746147732.554762:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aee8000 00000100:00100000:1.0:1746147732.554809:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794138368 00000100:00100000:1.0:1746147732.554813:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794138368 00002000:00100000:1.0:1746147732.554833:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009aeea300 x1830967794138368/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.554844:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeea300 with x1830967794138368 ext(3145728->4194303) 00002000:00010000:1.0:1746147732.554847:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aeea300 00000100:00100000:3.0:1746147732.554853:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7612 00000100:00100000:3.0:1746147732.555002:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794138112:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147732.555515:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7613 00000100:00100000:2.0:1746147732.555528:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794138368:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147732.556861:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.556959:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794138624 00000100:00100000:1.0:1746147732.556964:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794138624 00002000:00100000:1.0:1746147732.556987:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009aeeb480 x1830967794138624/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.556994:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeeb480 with x1830967794138624 ext(3145728->4194303) 00002000:00010000:1.0:1746147732.556997:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeeb480 00000100:00100000:1.0:1746147732.557011:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7614 00000100:00100000:1.0:1746147732.557016:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794138624:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147732.571189:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794138112:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16182us (16951us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147732.571205:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7612 00002000:00100000:3.0:1746147732.571217:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009aee8000 x1830967794138112/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.571226:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee8000 with x1830967794138112 ext(3145728->4194303) 00002000:00010000:3.0:1746147732.571232:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aee8000 00000100:00100000:2.0:1746147732.573310:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794138368:12345-192.168.202.10@tcp:3:cat.0 Request processed in 17773us (18668us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147732.573322:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7613 00002000:00100000:2.0:1746147732.573332:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009aeea300 x1830967794138368/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.573341:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeea300 with x1830967794138368 ext(3145728->4194303) 00002000:00010000:2.0:1746147732.573346:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aeea300 00000100:00100000:0.0:1746147732.576815:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794138624:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19785us (19943us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147732.576828:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7614 00002000:00100000:0.0:1746147732.576841:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009aeeb480 x1830967794138624/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147732.576851:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeeb480 with x1830967794138624 ext(3145728->4194303) 00002000:00010000:0.0:1746147732.576857:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeeb480 00000100:00100000:1.0:1746147732.578002:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.578245:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794138752 00000100:00100000:0.0:1746147732.578254:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794138752 00000100:00100000:0.0:1746147732.578295:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12080 00000100:00100000:0.0:1746147732.578303:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+12:32465:x1830967794138752:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147732.578326:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147732.578344:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7e9dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc4a3 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.578407:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7e9e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147732.578421:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7e9e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147732.578433:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7e9e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147732.578446:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a000/0xe64d3fbf12a7e9ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147732.578451:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a000/0xe64d3fbf12a7e9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147732.578456:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a000/0xe64d3fbf12a7e9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147732.578737:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147732.578748:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8800/0xe64d3fbf12a7e957 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc433 expref: 330 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.578756:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e973 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc441 expref: 15 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.578766:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147732.578798:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e973 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc441 expref: 15 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.578811:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e973 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc441 expref: 15 pid: 17544 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746147732.578823:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeeaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796521600:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147732.578944:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8800/0xe64d3fbf12a7e957 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc433 expref: 330 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.578952:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8800/0xe64d3fbf12a7e957 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc433 expref: 330 pid: 5744 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746147732.578960:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeea680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796521728:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.578981:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ea0300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.582799:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.582821:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeeaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796521600:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.582829:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeea680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796521728:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147732.582854:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:3.0:1746147732.583543:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794139264 00000100:00100000:3.0:1746147732.583552:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794139264 00000100:00100000:1.0:1746147732.583678:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.583828:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794139136 00000100:00100000:3.0:1746147732.583831:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794139136 00000100:00100000:3.0:1746147732.583980:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5040 00000100:00100000:3.0:1746147732.583989:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:27450:x1830967794139264:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147732.584048:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5041 00000100:00100000:2.0:1746147732.584056:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+331:7670:x1830967794139136:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147732.584367:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+332:7670:x1830967794139136:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 311us (689us total) trans 8589946111 rc 0/0 00000100:00100000:2.0:1746147732.584373:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5041 00000100:00100000:3.0:1746147732.584427:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:27450:x1830967794139264:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 439us (1639us total) trans 8589946110 rc 0/0 00000100:00100000:3.0:1746147732.584432:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5040 00000100:00100000:1.0:1746147732.587620:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.587694:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794139520 00000100:00100000:0.0:1746147732.587703:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794139520 00002000:00100000:0.0:1746147732.587750:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880135811880 x1830967794139520/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147732.587759:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135811880 with x1830967794139520 ext(4194304->5017599) 00002000:00010000:0.0:1746147732.587765:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135811880 00000100:00100000:0.0:1746147732.587793:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7615 00000100:00100000:0.0:1746147732.587802:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794139520:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147732.590177:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.590251:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.590318:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794139648 00000100:00100000:3.0:1746147732.590327:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794139648 00000100:00100000:1.0:1746147732.590356:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794139776 00000100:00100000:1.0:1746147732.590360:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794139776 00010000:00010000:3.0:1746147732.590362:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8800/0xe64d3fbf12a7e957 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc433 expref: 332 pid: 5744 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.590371:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e973 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc441 expref: 17 pid: 17544 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.590399:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8625 00000100:00100000:3.0:1746147732.590407:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2378050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+332:1960:x1830967794139648:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.590421:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.590426:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8800/0xe64d3fbf12a7e957 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc433 expref: 332 pid: 5744 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.590440:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8800/0xe64d3fbf12a7e957 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc433 expref: 332 pid: 5744 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.590460:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8800/0xe64d3fbf12a7e957 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc433 expref: 332 pid: 5744 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.590479:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147732.590483:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.590490:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.590495:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.590499:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.590529:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2378050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+331:1960:x1830967794139648:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 123us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.590534:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8625 00000100:00100000:3.0:1746147732.590570:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8626 00000100:00100000:3.0:1746147732.590574:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794139776:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.590578:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.590581:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e973 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc441 expref: 17 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.590589:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e973 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc441 expref: 17 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.590598:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a9400/0xe64d3fbf12a7e973 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc441 expref: 17 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.590606:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147732.590608:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.590615:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.590620:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.591050:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.591069:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794139776:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 493us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.591074:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8626 00010000:00010000:2.0:1746147732.591125:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591131:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147732.591172:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147732.591177:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147732.591193:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591203:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591213:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7e9e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591218:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7e9e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591224:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7e9e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591234:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a029a200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147732.591238:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7e9e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591244:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7e9e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591255:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147732.591258:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147732.591261:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7e9e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591265:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7e9e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591283:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a000/0xe64d3fbf12a7e9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591287:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a000/0xe64d3fbf12a7e9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591291:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a000/0xe64d3fbf12a7e9ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591295:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a029a000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147732.591296:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a000/0xe64d3fbf12a7e9ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591300:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a000/0xe64d3fbf12a7e9ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591304:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06ee500) 00010000:00010000:2.0:1746147732.591306:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147732.591308:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a000/0xe64d3fbf12a7e9ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591311:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a000/0xe64d3fbf12a7e9ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.591394:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7e9dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4a3 expref: 14 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.591410:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4a3 expref: 13 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.591415:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147732.591417:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147732.591420:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a029a400, rc 0) 00000100:00100000:2.0:1746147732.591450:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+13:32465:x1830967794138752:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 13148us (13453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.591456:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12080 00000100:00100000:0.0:1746147732.599804:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.599957:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794140032 00000100:00100000:2.0:1746147732.599967:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794140032 00002000:00100000:2.0:1746147732.600012:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009aeeaa00 x1830967794140032/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.600023:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeeaa00 with x1830967794140032 ext(4194304->5017599) 00002000:00010000:2.0:1746147732.600028:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeeaa00 00000100:00100000:2.0:1746147732.600064:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7616 00000100:00100000:2.0:1746147732.600071:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794140032:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147732.600766:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794139520:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12962us (13154us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147732.600775:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7615 00002000:00100000:1.0:1746147732.600781:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880135811880 x1830967794139520/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.600788:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135811880 with x1830967794139520 ext(4194304->5017599) 00002000:00010000:1.0:1746147732.600792:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135811880 00000100:00100000:0.0:1746147732.605043:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.605079:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.605104:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.605138:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.605160:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794140160 00000100:00100000:2.0:1746147732.605161:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794140288 00000100:00100000:3.0:1746147732.605170:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794140160 00000100:00100000:2.0:1746147732.605170:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794140288 00000100:00100000:1.0:1746147732.605205:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794140416 00000100:00100000:2.0:1746147732.605213:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794140544 00000100:00100000:1.0:1746147732.605213:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794140416 00000100:00100000:2.0:1746147732.605216:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794140544 00000100:00100000:3.0:1746147732.605223:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16869 00000100:00100000:3.0:1746147732.605231:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+7:1958:x1830967794140288:12345-192.168.202.10@tcp:101:mirror_io.0 00000100:00100000:2.0:1746147732.605235:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16870 00000100:00100000:2.0:1746147732.605240:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+7:1958:x1830967794140160:12345-192.168.202.10@tcp:101:mirror_io.0 00000100:00100000:1.0:1746147732.605240:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16871 00000100:00100000:1.0:1746147732.605245:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794140544:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147732.605251:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.605251:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147732.605252:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.605266:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b200/0xe64d3fbf12a7e9f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc4b1 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.605266:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308bc800/0xe64d3fbf12a7e9ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc4aa expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.605266:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095060000/0xe64d3fbf12a7ea06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc4bf expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.605288:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.605288:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.605288:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.605290:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.605290:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.605290:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.605298:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b200/0xe64d3fbf12a7e9f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b1 expref: 9 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.605298:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bc800/0xe64d3fbf12a7e9ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4aa expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.605298:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095060000/0xe64d3fbf12a7ea06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4bf expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.605314:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b200/0xe64d3fbf12a7e9f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b1 expref: 9 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.605314:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801308bc800/0xe64d3fbf12a7e9ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4aa expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.605314:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095060000/0xe64d3fbf12a7ea06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4bf expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.605325:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb1b200, rc 0) 00010000:00010000:2.0:1746147732.605325:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bc800, rc 0) 00010000:00010000:1.0:1746147732.605325:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095060000, rc 0) 00000100:00100000:3.0:1746147732.605368:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967794140288:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 138us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.605373:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16869 00000100:00100000:3.0:1746147732.605388:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16872 00000100:00100000:3.0:1746147732.605392:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794140416:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147732.605397:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.605404:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb1a600/0xe64d3fbf12a7ea0d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc4b8 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.605414:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.605415:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.605419:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1a600/0xe64d3fbf12a7ea0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b8 expref: 9 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.605427:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1a600/0xe64d3fbf12a7ea0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b8 expref: 9 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.605433:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb1a600, rc 0) 00000100:00100000:2.0:1746147732.605466:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967794140160:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 224us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.605472:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16870 00000100:00100000:1.0:1746147732.605544:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967794140544:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 298us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.605550:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16871 00000100:00100000:3.0:1746147732.605597:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794140416:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 203us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.605601:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16872 00000100:00100000:2.0:1746147732.613957:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794140032:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13874us (14151us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147732.613971:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7616 00002000:00100000:2.0:1746147732.613983:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009aeeaa00 x1830967794140032/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.613992:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeeaa00 with x1830967794140032 ext(4194304->5017599) 00002000:00010000:2.0:1746147732.613998:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeeaa00 00000100:00100000:0.0:1746147732.616108:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.616253:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794140800 00000100:00100000:2.0:1746147732.616263:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794140800 00000100:00100000:2.0:1746147732.616312:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12081 00000100:00100000:2.0:1746147732.616321:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+13:32465:x1830967794140800:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147732.616343:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.616364:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ea14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc4c6 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.616461:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7ea1b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.616476:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4a3 expref: 14 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.616483:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7ea1b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.616513:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4a3 expref: 14 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.616523:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4a3 expref: 14 pid: 17544 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.616534:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796521856:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.616622:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147732.622256:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796521856:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147732.622324:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7ea1b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147732.624009:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.624286:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794140928 00000100:00100000:3.0:1746147732.624295:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794140928 00010000:00010000:3.0:1746147732.624331:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4a3 expref: 15 pid: 17544 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.624359:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8627 00000100:00100000:3.0:1746147732.624366:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+15:1960:x1830967794140928:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.624380:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.624386:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4a3 expref: 15 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.624397:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4a3 expref: 15 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.624420:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7e9f1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4a3 expref: 15 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.624439:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147732.624444:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7ea1b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.624453:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7ea1b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.624460:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7ea1b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.624489:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147732.624619:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7ea1b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.624626:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7ea1b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147732.624921:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147732.625084:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ea14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4c6 expref: 16 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.625108:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7ea1b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4c6 expref: 15 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.625114:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147732.625117:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147732.625119:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bca00, rc 0) 00000100:00100000:3.0:1746147732.625176:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+15:1960:x1830967794140928:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 810us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.625187:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8627 00000100:00100000:2.0:1746147732.625590:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+14:32465:x1830967794140800:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 9269us (9489us total) trans 8589946112 rc 0/0 00000100:00100000:2.0:1746147732.625596:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12081 00000100:00100000:0.0:1746147732.626820:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.627042:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794141184 00000100:00100000:2.0:1746147732.627050:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794141184 00000100:00100000:2.0:1746147732.627086:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12082 00000100:00100000:2.0:1746147732.627093:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+14:32465:x1830967794141184:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147732.627117:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.627121:0:17544:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147732.627145:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7ea1b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4c6 expref: 14 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.627161:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147732.627165:0:17544:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147732.627176:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd800/0xe64d3fbf12a7ea29 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc4cd expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.627258:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ea30 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.627274:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ea30 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.627282:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ea30 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147732.627292:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147732.627393:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd800/0xe64d3fbf12a7ea29 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4cd expref: 16 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.627404:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ea30 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4cd expref: 15 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.628230:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147732.628233:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147732.628236:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bd000, rc 0) 00000100:00100000:2.0:1746147732.628307:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+15:32465:x1830967794141184:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 1211us (1491us total) trans 8589946113 rc 0/0 00000100:00100000:2.0:1746147732.628315:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12082 00000100:00100000:0.0:1746147732.628870:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.628914:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794141440 00000100:00100000:2.0:1746147732.628920:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794141440 00000100:00100000:2.0:1746147732.628957:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12083 00000100:00100000:2.0:1746147732.628964:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32467:x1830967794141440:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147732.628980:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.628994:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc000/0xe64d3fbf12a7ea3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc4d4 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.629063:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.629076:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ea30 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4cd expref: 14 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.629083:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147732.629109:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ea30 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4cd expref: 14 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.629120:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ea30 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4cd expref: 14 pid: 17544 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.629132:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796521984:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.629966:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.630242:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.630261:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.630294:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.630438:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794141568 00000100:00100000:2.0:1746147732.630444:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794141568 00000100:00100000:1.0:1746147732.630470:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794141696 00000100:00100000:1.0:1746147732.630474:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794141696 00000100:00100000:3.0:1746147732.630506:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794141824 00000100:00100000:3.0:1746147732.630510:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794141824 00000100:00100000:2.0:1746147732.630528:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16873 00000100:00100000:2.0:1746147732.630535:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794141568:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:2.0:1746147732.630567:0:10613:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ea4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.630584:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7e8e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ed expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.630590:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308bc800/0xe64d3fbf12a7e9ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4aa expref: 8 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.630602:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02f9e00/0xe64d3fbf12a7e92d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc410 expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.630607:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.630610:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.630612:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ea4c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.630691:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16874 00000100:00100000:3.0:1746147732.630696:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16875 00000100:00100000:1.0:1746147732.630697:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794141696:12345-192.168.202.10@tcp:1:mirror_io.0 00000100:00100000:3.0:1746147732.630703:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794141824:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147732.630718:0:8184:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ea53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.630719:0:7050:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fb1bc00/0xe64d3fbf12a7ea5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.630728:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7e7cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc306 expref: 9 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.630734:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e815 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc33e expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.630735:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98000/0xe64d3fbf12a7e8c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d8 expref: 10 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.630741:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e7d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc30d expref: 17 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.630741:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943d8a00/0xe64d3fbf12a7e8d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d1 expref: 10 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.630746:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.630747:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.630748:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb1bc00/0xe64d3fbf12a7ea5a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.630748:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e831 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc361 expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.630754:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.630755:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.630757:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ea53 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.630763:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e7d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc30d expref: 17 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.630772:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e7d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc30d expref: 17 pid: 10613 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746147732.630772:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc361 expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.630778:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02f9e00/0xe64d3fbf12a7e92d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc410 expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.630780:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e831 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc361 expref: 9 pid: 9615 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746147732.630786:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02f9e00/0xe64d3fbf12a7e92d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc410 expref: 9 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.630789:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796522112:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147732.630790:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135813480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796522240:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.630794:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796522368:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147732.630855:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98000/0xe64d3fbf12a7e8c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d8 expref: 10 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.630862:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98000/0xe64d3fbf12a7e8c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d8 expref: 10 pid: 9615 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746147732.630863:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801308bc800/0xe64d3fbf12a7e9ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4aa expref: 8 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.630863:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800943d8a00/0xe64d3fbf12a7e8d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d1 expref: 10 pid: 8184 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147732.630870:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796522496:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147732.630870:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801308bc800/0xe64d3fbf12a7e9ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4aa expref: 8 pid: 8468 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746147732.630871:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800943d8a00/0xe64d3fbf12a7e8d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d1 expref: 10 pid: 8184 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746147732.630877:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796522752:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147732.630897:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135813b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796522624:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147732.631032:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7e7cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc306 expref: 9 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.631050:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7e7cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc306 expref: 9 pid: 10613 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.631063:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796522880:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147732.631090:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7e8e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ed expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.631104:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7e8e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ed expref: 23 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.631106:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e815 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc33e expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.631112:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796523008:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147732.631114:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e815 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc33e expref: 17 pid: 10613 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.631121:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4163b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147732.631123:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796523136:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.631134:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147732.631142:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.631291:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.631314:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796521984:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147732.631330:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147732.631331:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.631344:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794141952 00000100:00100000:3.0:1746147732.631348:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794141952 00000100:00100000:3.0:1746147732.631374:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16876 00000100:00100000:3.0:1746147732.631378:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794141952:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147732.631409:0:6715:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b000/0xe64d3fbf12a7ea61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.631422:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e934 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc417 expref: 9 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147732.631425:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147732.631429:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b200/0xe64d3fbf12a7e9f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b1 expref: 9 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.631435:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7e93b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc41e expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.631440:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.631441:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.631444:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b000/0xe64d3fbf12a7ea61 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.631459:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794142080 00000100:00100000:0.0:1746147732.631459:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147732.631461:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7e93b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc41e expref: 23 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.631462:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794142080 00010000:00010000:3.0:1746147732.631470:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7e93b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc41e expref: 23 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.631478:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796523264:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147732.631479:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794142336 00000100:00100000:1.0:1746147732.631480:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794142336 00000100:00100000:1.0:1746147732.631489:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16877 00000100:00100000:1.0:1746147732.631493:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794142080:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147732.631508:0:21480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7ea68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.631510:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b200/0xe64d3fbf12a7e9f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b1 expref: 10 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.631517:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4200/0xe64d3fbf12a7e9ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc495 expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.631521:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b200/0xe64d3fbf12a7e9f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b1 expref: 10 pid: 7050 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746147732.631524:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1a600/0xe64d3fbf12a7ea0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b8 expref: 10 pid: 7050 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147732.631528:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796523392:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147732.631530:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308bda00/0xe64d3fbf12a7e9d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc49c expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.631536:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.631538:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.631540:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7ea68 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.631554:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801308bda00/0xe64d3fbf12a7e9d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc49c expref: 23 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.631557:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e934 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc417 expref: 9 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.631561:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801308bda00/0xe64d3fbf12a7e9d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc49c expref: 23 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.631565:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e934 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc417 expref: 9 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746147732.631569:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135812d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796523520:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.631572:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796523648:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.631593:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4163a80 going to sleep for 11 seconds 00010000:00010000:1.0:1746147732.631594:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb1a600/0xe64d3fbf12a7ea0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b8 expref: 10 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.631601:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1a600/0xe64d3fbf12a7ea0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b8 expref: 10 pid: 7050 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746147732.631608:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794142208 00000100:00100000:1.0:1746147732.631608:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135811500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796523776:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.631610:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794142208 00010000:00010000:3.0:1746147732.631625:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ea30 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4cd expref: 15 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.631625:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4200/0xe64d3fbf12a7e9ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc495 expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.631631:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4200/0xe64d3fbf12a7e9ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc495 expref: 9 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.631640:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8628 00000100:00100000:1.0:1746147732.631642:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135812a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796523904:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.631645:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+15:1960:x1830967794142208:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.631665:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147732.631665:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943ccd80 going to sleep for 11 seconds 00010000:00010000:3.0:1746147732.631670:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ea30 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4cd expref: 15 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.631678:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ea30 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4cd expref: 15 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.631694:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ea30 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4cd expref: 15 pid: 17544 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.631709:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147732.631713:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.631720:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.631725:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.631734:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.631753:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794142208:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 107us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.631758:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8628 00010000:00010000:3.0:1746147732.631774:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.631779:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:3.0:1746147732.631793:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:0.0:1746147732.631909:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16878 00000100:00100000:0.0:1746147732.631917:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794142336:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147732.631935:0:8470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7ea76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.631940:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc000/0xe64d3fbf12a7ea3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4d4 expref: 19 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.631945:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e9b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc480 expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.631951:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4d4 expref: 18 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.631958:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095060000/0xe64d3fbf12a7ea06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4bf expref: 11 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.631961:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147732.631963:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147732.631965:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bde00, rc 0) 00010000:00010000:0.0:1746147732.631965:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7e9c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc48e expref: 17 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.631970:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.631971:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.631973:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7ea76 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.631986:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32467:x1830967794141440:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3023us (3118us total) trans 8589946114 rc 0/0 00010000:00010000:0.0:1746147732.631987:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7e9c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc48e expref: 17 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.631992:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12083 00010000:00010000:0.0:1746147732.631995:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7e9c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc48e expref: 17 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746147732.632003:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796524032:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147732.632192:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095060000/0xe64d3fbf12a7ea06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4bf expref: 11 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.632203:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095060000/0xe64d3fbf12a7ea06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4bf expref: 11 pid: 8184 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746147732.632368:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796524160:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.632380:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796522112:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147732.632401:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e9b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc480 expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.632408:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e9b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc480 expref: 9 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746147732.632485:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796524288:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.632502:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ea0300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147732.635913:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135813480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796522240:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.635988:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796522368:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.636250:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796522752:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.636533:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796522496:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.643734:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.643800:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.643851:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.643939:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.643964:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.643988:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794142464 00000100:00100000:3.0:1746147732.643997:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794142464 00010000:00010000:3.0:1746147732.644032:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e831 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc361 expref: 10 pid: 9615 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746147732.644057:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794142720 00000100:00100000:3.0:1746147732.644060:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794142720 00000100:00100000:0.0:1746147732.644067:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796523008:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147732.644071:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bc800/0xe64d3fbf12a7e9ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4aa expref: 11 pid: 8468 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746147732.644080:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794142592 00000100:00100000:3.0:1746147732.644082:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794142592 00010000:00010000:3.0:1746147732.644092:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e7d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc30d expref: 18 pid: 10613 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746147732.644100:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794142848 00000100:00100000:3.0:1746147732.644101:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794142848 00010000:00010000:0.0:1746147732.644107:0:10613:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ea4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.644109:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98000/0xe64d3fbf12a7e8c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d8 expref: 12 pid: 9615 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746147732.644118:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794142976 00000100:00100000:3.0:1746147732.644120:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794142976 00010000:00010000:3.0:1746147732.644127:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02f9e00/0xe64d3fbf12a7e92d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc410 expref: 10 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.644138:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8629 00000100:00100000:3.0:1746147732.644144:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1957:x1830967794142464:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.644157:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.644179:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e831 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc361 expref: 10 pid: 9615 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.644188:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc361 expref: 10 pid: 9615 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746147732.644193:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796523264:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147732.644194:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8630 00000100:00100000:1.0:1746147732.644202:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794142720:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.644209:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.644210:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095092a00/0xe64d3fbf12a7e831 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc361 expref: 10 pid: 9615 timeout: 911 lvb_type: 1 00002000:00010000:1.0:1746147732.644220:0:7095:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 1991 -> 2045 00010000:00010000:1.0:1746147732.644224:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801308bc800/0xe64d3fbf12a7e9ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4aa expref: 11 pid: 8468 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746147732.644231:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801308bc800/0xe64d3fbf12a7e9ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4aa expref: 11 pid: 8468 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.644234:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147732.644242:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308bc800/0xe64d3fbf12a7e9ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4aa expref: 11 pid: 8468 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746147732.644252:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796523648:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147732.644253:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147732.644273:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794142720:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 72us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.644277:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1957:x1830967794142464:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 134us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.644279:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8630 00000100:00100000:3.0:1746147732.644282:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8629 00000100:00100000:3.0:1746147732.644294:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8631 00000100:00100000:3.0:1746147732.644298:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1960:x1830967794142592:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.644304:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147732.644312:0:7312:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:3.0:1746147732.644316:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e7d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc30d expref: 18 pid: 10613 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.644323:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e7d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc30d expref: 18 pid: 10613 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.644335:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095092800/0xe64d3fbf12a7e7d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc30d expref: 18 pid: 10613 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.644343:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.644358:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1960:x1830967794142592:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 59us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.644376:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8632 00000100:00100000:3.0:1746147732.644379:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8631 00000100:00100000:1.0:1746147732.644382:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794142848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.644388:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147732.644389:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8633 00000100:00100000:3.0:1746147732.644393:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1957:x1830967794142976:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.644396:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98000/0xe64d3fbf12a7e8c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d8 expref: 12 pid: 9615 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.644398:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.644403:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02f9e00/0xe64d3fbf12a7e92d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc410 expref: 10 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.644404:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98000/0xe64d3fbf12a7e8c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d8 expref: 12 pid: 9615 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.644411:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02f9e00/0xe64d3fbf12a7e92d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc410 expref: 10 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.644414:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0d98000/0xe64d3fbf12a7e8c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d8 expref: 12 pid: 9615 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.644420:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02f9e00/0xe64d3fbf12a7e92d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc410 expref: 10 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.644426:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147732.644428:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.644874:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1957:x1830967794142976:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 479us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.644874:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794142848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 491us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.644880:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8633 00000100:00100000:1.0:1746147732.644903:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8632 00000100:00100000:3.0:1746147732.644930:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796522880:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.644945:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796524032:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147732.644954:0:7050:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fb1bc00/0xe64d3fbf12a7ea5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.644966:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135812d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796523520:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147732.644975:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135811500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796523776:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147732.644994:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135813b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796522624:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147732.645002:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796523136:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147732.645015:0:8184:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ea53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.645450:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.645468:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796524160:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.645473:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.645476:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796524288:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.645484:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.645494:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147732.645499:0:8470:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7ea76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.645504:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794143104 00000100:00100000:3.0:1746147732.645508:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794143104 00010000:00010000:3.0:1746147732.645521:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800943d8a00/0xe64d3fbf12a7e8d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d1 expref: 11 pid: 8184 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746147732.645529:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796523392:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.645534:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794143232 00000100:00100000:3.0:1746147732.645536:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794143232 00010000:00010000:3.0:1746147732.645543:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7e7cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc306 expref: 9 pid: 10613 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746147732.645547:0:6715:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b000/0xe64d3fbf12a7ea61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.645552:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794144128 00000100:00100000:3.0:1746147732.645554:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794144128 00010000:00010000:3.0:1746147732.645562:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bda00/0xe64d3fbf12a7e9d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc49c expref: 24 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.645570:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794143488 00000100:00100000:3.0:1746147732.645571:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794143488 00010000:00010000:3.0:1746147732.645578:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7e8e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ed expref: 25 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.645587:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8634 00000100:00100000:3.0:1746147732.645592:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967794143104:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.645599:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.645610:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800943d8a00/0xe64d3fbf12a7e8d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d1 expref: 11 pid: 8184 timeout: 911 lvb_type: 1 00000100:00100000:1.0:1746147732.645613:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8635 00010000:00010000:3.0:1746147732.645618:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800943d8a00/0xe64d3fbf12a7e8d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d1 expref: 11 pid: 8184 timeout: 911 lvb_type: 1 00000100:00100000:1.0:1746147732.645618:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1957:x1830967794143232:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.645624:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.645631:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943d8a00/0xe64d3fbf12a7e8d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3d1 expref: 11 pid: 8184 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746147732.645632:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7e7cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc306 expref: 9 pid: 10613 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.645640:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147732.645644:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7e7cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc306 expref: 9 pid: 10613 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.645666:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801308bc400/0xe64d3fbf12a7e7cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc306 expref: 9 pid: 10613 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.645669:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967794143104:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 77us (220us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147732.645674:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147732.645675:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8634 00010000:00010000:1.0:1746147732.645676:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.645680:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb1bc00/0xe64d3fbf12a7ea5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.645684:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8636 00000100:00100000:3.0:1746147732.645690:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794144128:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.645690:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb1bc00/0xe64d3fbf12a7ea5a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.645697:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.645707:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801308bda00/0xe64d3fbf12a7e9d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc49c expref: 25 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.645707:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147732.645715:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801308bda00/0xe64d3fbf12a7e9d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc49c expref: 25 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746147732.645720:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1957:x1830967794143232:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 102us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.645725:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8635 00010000:00010000:3.0:1746147732.645729:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308bda00/0xe64d3fbf12a7e9d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc49c expref: 25 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746147732.645733:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8637 00010000:00010000:3.0:1746147732.645737:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147732.645737:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794143488:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.645742:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147732.645748:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794144128:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 60us (264us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147732.645748:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7e8e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ed expref: 24 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.645753:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8636 00010000:00010000:1.0:1746147732.645756:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7e8e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ed expref: 24 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.645766:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7e8e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc3ed expref: 23 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.645767:0:7050:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fb1bc00/0xe64d3fbf12a7ea5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.645773:0:7050:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb1bc00/0xe64d3fbf12a7ea5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.645773:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.645774:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.645777:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ea4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.645782:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ea4c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.645790:0:7050:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fb1bc00/0xe64d3fbf12a7ea5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.645792:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147732.645797:0:7050:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb1bc00/0xe64d3fbf12a7ea5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.645803:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794143488:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 66us (309us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147732.645805:0:7050:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fb1bc00/0xe64d3fbf12a7ea5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.645807:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8637 00010000:00010000:3.0:1746147732.645811:0:7050:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb1bc00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147732.645815:0:7050:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb1bc00/0xe64d3fbf12a7ea5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.645824:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135812a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796523904:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147732.645827:0:7050:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb1bc00/0xe64d3fbf12a7ea5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.645836:0:7050:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fb1bc00/0xe64d3fbf12a7ea5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.645839:0:21480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7ea68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.645841:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb1bc00/0xe64d3fbf12a7ea5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.645879:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794141824:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 15177us (15585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.645907:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16875 00000100:00100000:3.0:1746147732.645935:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.645974:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.645996:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.646006:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794143744 00000100:00100000:3.0:1746147732.646008:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794143744 00010000:00010000:3.0:1746147732.646019:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1a600/0xe64d3fbf12a7ea0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b8 expref: 10 pid: 7050 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746147732.646021:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794144000 00000100:00100000:2.0:1746147732.646025:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794144000 00000100:00100000:3.0:1746147732.646030:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794144384 00000100:00100000:3.0:1746147732.646032:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794144384 00010000:00010000:2.0:1746147732.646038:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095060000/0xe64d3fbf12a7ea06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4bf expref: 9 pid: 8184 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.646039:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b200/0xe64d3fbf12a7e9f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b1 expref: 11 pid: 7050 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746147732.646048:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8638 00000100:00100000:2.0:1746147732.646051:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794143744:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147732.646056:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147732.646059:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8639 00010000:00010000:2.0:1746147732.646062:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1a600/0xe64d3fbf12a7ea0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b8 expref: 11 pid: 7050 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746147732.646067:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794144000:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147732.646068:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb1a600/0xe64d3fbf12a7ea0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b8 expref: 11 pid: 7050 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.646074:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147732.646076:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1a600/0xe64d3fbf12a7ea0d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b8 expref: 11 pid: 7050 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746147732.646083:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095060000/0xe64d3fbf12a7ea06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4bf expref: 9 pid: 8184 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746147732.646085:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147732.646089:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095060000/0xe64d3fbf12a7ea06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4bf expref: 9 pid: 8184 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746147732.646097:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794143744:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 46us (162us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147732.646099:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095060000/0xe64d3fbf12a7ea06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4bf expref: 9 pid: 8184 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746147732.646101:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8638 00010000:00010000:3.0:1746147732.646105:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147732.646108:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8640 00000100:00100000:2.0:1746147732.646112:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794144384:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147732.646117:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147732.646118:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794144000:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 51us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.646123:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8639 00010000:00010000:2.0:1746147732.646126:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b200/0xe64d3fbf12a7e9f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b1 expref: 9 pid: 7050 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746147732.646134:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b200/0xe64d3fbf12a7e9f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b1 expref: 9 pid: 7050 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746147732.646144:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b200/0xe64d3fbf12a7e9f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4b1 expref: 9 pid: 7050 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746147732.646152:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147732.646165:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794144384:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 53us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.646171:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8640 00000100:00100000:3.0:1746147732.646249:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.646260:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794143360 00000100:00100000:1.0:1746147732.646263:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794143360 00010000:00010000:0.0:1746147732.646267:0:10613:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ea4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.646275:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147732.646275:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e815 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc33e expref: 17 pid: 10613 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746147732.646276:0:10613:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ea4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.646295:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147732.646295:0:10613:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ea4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.646298:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794143616 00000100:00100000:1.0:1746147732.646300:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794143616 00010000:00010000:0.0:1746147732.646301:0:10613:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ea4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.646308:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7e93b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc41e expref: 22 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746147732.646308:0:10613:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ea4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.646314:0:10613:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a029b400 already unused, calling callback (ffffffffa087ad70) 00000100:00100000:3.0:1746147732.646315:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147732.646316:0:10613:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ea4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.646322:0:10613:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ea4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.646334:0:10613:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ea4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.646340:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ea4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147732.646398:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794141568:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 15861us (16157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147732.646405:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16873 00000100:00100000:1.0:1746147732.646727:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794143872 00000100:00100000:2.0:1746147732.646729:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794144256 00000100:00100000:1.0:1746147732.646731:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794143872 00000100:00100000:2.0:1746147732.646733:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794144256 00000100:00100000:3.0:1746147732.646739:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8641 00010000:00010000:1.0:1746147732.646742:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e934 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc417 expref: 9 pid: 7050 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.646745:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1959:x1830967794143360:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147732.646748:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7e9c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc48e expref: 18 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.646750:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147732.646752:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8642 00000100:00100000:1.0:1746147732.646756:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794143616:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.646757:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e815 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc33e expref: 18 pid: 10613 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.646761:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8643 00010000:00010000:1.0:1746147732.646761:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.646765:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e815 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc33e expref: 18 pid: 10613 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.646765:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794143872:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.646767:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7e93b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc41e expref: 22 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.646773:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147732.646774:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7e93b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc41e expref: 22 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.646780:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8600/0xe64d3fbf12a7e815 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc33e expref: 18 pid: 10613 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.646783:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e934 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc417 expref: 9 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.646783:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd6c400/0xe64d3fbf12a7e93b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc41e expref: 22 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.646789:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.646790:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.646790:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e934 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc417 expref: 9 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.646793:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ea53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.646799:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ea53 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.646800:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147732.646806:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffffc00/0xe64d3fbf12a7e934 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc417 expref: 9 pid: 7050 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.646814:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.646815:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147732.646815:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794143616:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 57us (538us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147732.646816:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.646818:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b000/0xe64d3fbf12a7ea61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.646821:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8642 00010000:00010000:2.0:1746147732.646823:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b000/0xe64d3fbf12a7ea61 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.646824:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1959:x1830967794143360:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 80us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.646829:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8641 00000100:00100000:1.0:1746147732.646832:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8644 00000100:00100000:1.0:1746147732.646836:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+16:1959:x1830967794144256:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.646841:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147732.646843:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147732.646848:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7e9c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc48e expref: 16 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.646855:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7e9c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc48e expref: 16 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.646861:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1959:x1830967794143872:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 95us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.646864:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147732.646864:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7e9c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc48e expref: 16 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.646866:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8643 00010000:00010000:1.0:1746147732.646872:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.646874:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794144512 00000100:00100000:3.0:1746147732.646876:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794144512 00010000:00010000:3.0:1746147732.646905:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4200/0xe64d3fbf12a7e9ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc495 expref: 8 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746147732.646905:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+15:1959:x1830967794144256:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 68us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.646911:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8644 00000100:00100000:1.0:1746147732.646919:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8645 00000100:00100000:1.0:1746147732.646923:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1957:x1830967794144512:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.646928:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147732.646935:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4200/0xe64d3fbf12a7e9ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc495 expref: 8 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.646942:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4200/0xe64d3fbf12a7e9ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc495 expref: 8 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.646947:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147732.646952:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c9f4200/0xe64d3fbf12a7e9ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc495 expref: 8 pid: 8468 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.646960:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794144640 00010000:00010000:1.0:1746147732.646960:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.646961:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147732.646963:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794144640 00010000:00010000:1.0:1746147732.646965:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7ea68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.646970:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7ea68 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.646974:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e9b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc480 expref: 8 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.646980:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147732.646992:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1957:x1830967794144512:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 69us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.646995:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8646 00000100:00100000:1.0:1746147732.646999:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8645 00000100:00100000:2.0:1746147732.647000:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1959:x1830967794144640:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147732.647005:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147732.647012:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e9b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc480 expref: 8 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.647012:0:21480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7ea68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647019:0:21480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7ea68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.647020:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e9b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc480 expref: 8 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.647031:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8200/0xe64d3fbf12a7e9b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc480 expref: 8 pid: 8468 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.647032:0:21480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7ea68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.647038:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.647038:0:21480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7ea68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.647040:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.647042:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7ea76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647043:0:21480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7ea68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.647047:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7ea76 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647048:0:21480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a925ec00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147732.647051:0:21480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7ea68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.647059:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147732.647061:0:21480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7ea68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647069:0:21480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7ea68 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.647073:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1959:x1830967794144640:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 72us (125us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147732.647075:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7ea68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.647078:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8646 00010000:00010000:0.0:1746147732.647102:0:6715:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b000/0xe64d3fbf12a7ea61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.647105:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794142080:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 15611us (15681us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.647110:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16877 00010000:00010000:0.0:1746147732.647111:0:6715:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b000/0xe64d3fbf12a7ea61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.647128:0:6715:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b000/0xe64d3fbf12a7ea61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647129:0:8184:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ea53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.647135:0:6715:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b000/0xe64d3fbf12a7ea61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647136:0:8184:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ea53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.647141:0:6715:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b000/0xe64d3fbf12a7ea61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647148:0:8184:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ea53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647154:0:8184:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ea53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647160:0:8184:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ea53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647170:0:8184:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc1f800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147732.647172:0:8184:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ea53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647177:0:8184:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ea53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647184:0:8184:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ea53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647189:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ea53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.647197:0:6715:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb1b000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147732.647200:0:6715:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b000/0xe64d3fbf12a7ea61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.647207:0:6715:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b000/0xe64d3fbf12a7ea61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.647219:0:6715:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b000/0xe64d3fbf12a7ea61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.647221:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794141696:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 16524us (16959us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147732.647225:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b000/0xe64d3fbf12a7ea61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147732.647226:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16874 00000100:00100000:0.0:1746147732.647266:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+5:1959:x1830967794141952:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 15885us (15973us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147732.647273:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16876 00010000:00010000:0.0:1746147732.647298:0:8470:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7ea76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.647306:0:8470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7ea76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.647323:0:8470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7ea76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.647329:0:8470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7ea76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.647336:0:8470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7ea76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.647346:0:8470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8ea800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147732.647349:0:8470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7ea76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.647355:0:8470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7ea76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.647364:0:8470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7ea76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.647370:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7ea76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147732.647402:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794142336:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 15486us (15942us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147732.647409:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16878 00000100:00100000:3.0:1746147732.647610:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.647795:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794144768 00000100:00100000:1.0:1746147732.647798:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794144768 00000100:00100000:1.0:1746147732.647831:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16879 00000100:00100000:1.0:1746147732.647836:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:32467:x1830967794144768:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147732.647849:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147732.647859:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc4db expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147732.647869:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x68141995, atime: 0x68141992, ctime: 0x68141995, blocks: 0x81f 00010000:00010000:1.0:1746147732.647904:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.647906:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.647912:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 8 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647923:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 8 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.647932:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925f600, rc 0) 00000100:00100000:1.0:1746147732.648105:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32467:x1830967794144768:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 268us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.648110:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16879 00000100:00100000:0.0:1746147732.650700:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.651099:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794145024 00000100:00100000:3.0:1746147732.651111:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794145024 00000100:00100000:3.0:1746147732.651169:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12084 00000100:00100000:3.0:1746147732.651179:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+14:32465:x1830967794145024:12345-192.168.202.10@tcp:36:mirror_io.0 00000100:00100000:1.0:1746147732.651745:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147732.652010:0:17544:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746147732.652041:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7e616 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1bd expref: 14 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.652064:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7e5fa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc1b6 expref: 13 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.652080:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147732.652084:0:17544:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.652146:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+12:32465:x1830967794145024:12345-192.168.202.10@tcp:36:mirror_io.0 Request processed in 968us (1455us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746147732.652153:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12084 00000100:00100000:3.0:1746147732.652175:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794145280 00000100:00100000:3.0:1746147732.652179:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794145280 00000100:00100000:3.0:1746147732.652204:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12085 00000100:00100000:3.0:1746147732.652209:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+331:32471:x1830967794145280:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147732.652226:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.652240:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e6a00/0xe64d3fbf12a7ea84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc4e2 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.652314:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e7a00/0xe64d3fbf12a7ea8b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.652327:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e7a00/0xe64d3fbf12a7ea8b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147732.652336:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e7a00/0xe64d3fbf12a7ea8b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:3.0:1746147732.652350:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:1.0:1746147732.652435:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147732.652459:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e6a00/0xe64d3fbf12a7ea84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e2 expref: 334 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.652472:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e7a00/0xe64d3fbf12a7ea8b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e2 expref: 333 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.652478:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147732.652481:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147732.652482:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915e7a00, rc 0) 00000100:00100000:3.0:1746147732.652503:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:32471:x1830967794145280:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 294us (761us total) trans 8589946115 rc 0/0 00000100:00100000:3.0:1746147732.652511:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12085 00000100:00100000:2.0:1746147732.652832:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794145536 00000100:00100000:2.0:1746147732.652837:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794145536 00002000:00100000:2.0:1746147732.652874:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1634304->1638399) req@ffff880135811500 x1830967794145536/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.652922:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135811500 with x1830967794145536 ext(1634304->1638399) 00002000:00010000:2.0:1746147732.652927:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135811500 00000100:00100000:2.0:1746147732.652948:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7617 00000100:00100000:2.0:1746147732.652956:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1960:x1830967794145536:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147732.653127:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1960:x1830967794145536:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 170us (691us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147732.653134:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7617 00002000:00100000:2.0:1746147732.653140:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1634304->1638399) req@ffff880135811500 x1830967794145536/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.653146:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135811500 with x1830967794145536 ext(1634304->1638399) 00002000:00010000:2.0:1746147732.653149:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135811500 00000100:00100000:0.0:1746147732.653930:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.654161:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794145792 00000100:00100000:3.0:1746147732.654169:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794145792 00000100:00100000:3.0:1746147732.654209:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5042 00000100:00100000:3.0:1746147732.654216:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+12:32465:x1830967794145792:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147732.654398:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41587371-240a-4781-aecb-638f17200fbd+13:32465:x1830967794145792:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 181us (471us total) trans 8589946116 rc 0/0 00000100:00100000:3.0:1746147732.654405:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5042 00000100:00100000:0.0:1746147732.655735:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.655855:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794146048 00000100:00100000:1.0:1746147732.655862:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794146048 00002000:00100000:1.0:1746147732.655939:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1757184->1761279) req@ffff880094690000 x1830967794146048/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.655949:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094690000 with x1830967794146048 ext(1757184->1761279) 00002000:00010000:1.0:1746147732.655954:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094690000 00000100:00100000:1.0:1746147732.655997:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7618 00000100:00100000:1.0:1746147732.656005:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1958:x1830967794146048:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147732.656191:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1958:x1830967794146048:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 185us (460us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147732.656199:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7618 00002000:00100000:1.0:1746147732.656205:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1757184->1761279) req@ffff880094690000 x1830967794146048/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.656213:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094690000 with x1830967794146048 ext(1757184->1761279) 00002000:00010000:1.0:1746147732.656216:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094690000 00000100:00100000:2.0:1746147732.658064:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.658196:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794146304 00000100:00100000:0.0:1746147732.658206:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794146304 00000100:00100000:0.0:1746147732.658272:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5043 00000100:00100000:0.0:1746147732.658282:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+13:32465:x1830967794146304:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:0.0:1746147732.658524:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+14:32465:x1830967794146304:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 243us (466us total) trans 8589946117 rc 0/0 00000100:00100000:0.0:1746147732.658535:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5043 00000100:00100000:0.0:1746147732.693304:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.694154:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794146432 00000100:00100000:2.0:1746147732.694167:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794146432 00000100:00100000:2.0:1746147732.694219:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16880 00000100:00100000:2.0:1746147732.694230:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+15:32471:x1830967794146432:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147732.694253:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.694276:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5400/0xe64d3fbf12a7ea99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc4e9 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147732.694305:0:6715:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x68141994, atime: 0x68141994, ctime: 0x68141994, blocks: 0x821 00010000:00010000:2.0:1746147732.694330:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.694332:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.694342:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5400/0xe64d3fbf12a7ea99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1089536->1650687) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e9 expref: 16 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.694360:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5400/0xe64d3fbf12a7ea99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1089536->1650687) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e9 expref: 16 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.694371:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c9f5400, rc 0) 00000100:00100000:2.0:1746147732.694729:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+16:32471:x1830967794146432:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 500us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.694735:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16880 00000100:00100000:0.0:1746147732.696979:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.697191:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794146688 00000100:00100000:2.0:1746147732.697203:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794146688 00002000:00100000:2.0:1746147732.697259:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1089536->1093631) req@ffff880094692a00 x1830967794146688/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.697270:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094692a00 with x1830967794146688 ext(1089536->1093631) 00002000:00010000:2.0:1746147732.697276:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094692a00 00000100:00100000:2.0:1746147732.697303:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7619 00000100:00100000:2.0:1746147732.697312:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+16:1960:x1830967794146688:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147732.697574:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+16:1960:x1830967794146688:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 260us (602us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147732.697582:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7619 00002000:00100000:2.0:1746147732.697589:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1089536->1093631) req@ffff880094692a00 x1830967794146688/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.697596:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094692a00 with x1830967794146688 ext(1089536->1093631) 00002000:00010000:2.0:1746147732.697599:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094692a00 00000100:00100000:1.0:1746147732.705328:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.705417:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794146944 00000100:00100000:2.0:1746147732.705426:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794146944 00002000:00100000:2.0:1746147732.705469:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1646592->1650687) req@ffff880135812d80 x1830967794146944/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.705477:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812d80 with x1830967794146944 ext(1646592->1650687) 00002000:00010000:2.0:1746147732.705481:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135812d80 00000100:00100000:2.0:1746147732.705505:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7620 00000100:00100000:2.0:1746147732.705512:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+16:1958:x1830967794146944:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147732.705748:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+16:1958:x1830967794146944:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 236us (427us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147732.705759:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7620 00002000:00100000:2.0:1746147732.705765:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1646592->1650687) req@ffff880135812d80 x1830967794146944/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.705771:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812d80 with x1830967794146944 ext(1646592->1650687) 00002000:00010000:2.0:1746147732.705774:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135812d80 00000100:00100000:0.0:1746147732.727469:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.727507:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.727534:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.727548:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.727577:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.727613:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794147072 00000100:00100000:2.0:1746147732.727624:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794147072 00000100:00100000:2.0:1746147732.727676:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794147328 00000100:00100000:2.0:1746147732.727679:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794147328 00000100:00100000:2.0:1746147732.727710:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794147584 00000100:00100000:2.0:1746147732.727713:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794147584 00000100:00100000:2.0:1746147732.727724:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794147200 00000100:00100000:2.0:1746147732.727725:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794147200 00000100:00100000:2.0:1746147732.727734:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794147456 00000100:00100000:2.0:1746147732.727735:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794147456 00000100:00100000:2.0:1746147732.727747:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16881 00000100:00100000:2.0:1746147732.727755:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794147072:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147732.727755:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16882 00000100:00100000:1.0:1746147732.727764:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794147328:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:0.0:1746147732.727764:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16883 00000100:00100000:0.0:1746147732.727768:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794147584:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147732.727774:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147732.727774:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147732.727774:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.727792:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7eaae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc4f0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.727792:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaa0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc4fe expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.727792:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7eaa7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc50c expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147732.727815:0:6715:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x68141995, atime: 0x68141994, ctime: 0x68141995, blocks: 0x7fd 00002000:00010000:0.0:1746147732.727815:0:10613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x456:0x0] initial LVB size: 4194304, mtime: 0x68141995, atime: 0x68141995, ctime: 0x68141995, blocks: 0x1029 00010000:00010000:0.0:1746147732.727823:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.727825:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.727826:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.727827:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.727833:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7eaa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc50c expref: 11 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.727834:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7eaae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f0 expref: 10 pid: 6715 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147732.727842:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796524416:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147732.727846:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7eaa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc50c expref: 11 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.727847:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7eaae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f0 expref: 10 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.727855:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c9f5000, rc 0) 00010000:00010000:0.0:1746147732.727855:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8eba00, rc 0) 00000100:00100000:0.0:1746147732.727909:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794147584:12345-192.168.202.10@tcp:101:cat.0 Request processed in 139us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147732.727919:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16883 00000100:00100000:3.0:1746147732.727926:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16884 00000100:00100000:3.0:1746147732.727934:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794147200:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:0.0:1746147732.727934:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16885 00000100:00100000:0.0:1746147732.727938:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794147456:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147732.727940:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147732.727944:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.727949:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915e6200/0xe64d3fbf12a7eab5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc4f7 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.727954:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eabc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc505 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147732.727965:0:7050:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x68141994, atime: 0x68141993, ctime: 0x68141994, blocks: 0x81b 00002000:00010000:0.0:1746147732.727966:0:10613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x458:0x0] initial LVB size: 5013696, mtime: 0x68141995, atime: 0x68141995, ctime: 0x68141995, blocks: 0x1691 00010000:00010000:0.0:1746147732.727973:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.727974:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.727974:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.727975:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.727977:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eabc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc505 expref: 11 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.727979:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915e6200/0xe64d3fbf12a7eab5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f7 expref: 11 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.727985:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eabc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc505 expref: 11 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.727989:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915e6200/0xe64d3fbf12a7eab5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f7 expref: 11 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.727992:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8ea600, rc 0) 00010000:00010000:3.0:1746147732.727995:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915e6200, rc 0) 00000100:00100000:2.0:1746147732.728072:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794147072:12345-192.168.202.10@tcp:101:cat.0 Request processed in 318us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.728078:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16881 00000100:00100000:1.0:1746147732.728101:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.728974:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794147456:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1027us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147732.728980:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16885 00000100:00100000:3.0:1746147732.729003:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794147200:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1069us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.729009:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16884 00002000:00010000:1.0:1746147732.731549:0:8184:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime: 1746147732 -> 1746147733 00002000:00010000:1.0:1746147732.731559:0:8184:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime: 1746147732 -> 1746147733 00002000:00010000:1.0:1746147732.731561:0:8184:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime: 1746147732 -> 1746147733 00000100:00100000:1.0:1746147732.731585:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796524416:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147732.731618:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaa0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4fe expref: 10 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.731630:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaa0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4fe expref: 10 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.731735:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925ec00, rc 0) 00000100:00100000:1.0:1746147732.731971:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794147328:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4207us (4461us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147732.731983:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16882 00000100:00100000:0.0:1746147732.739001:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.739066:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.739221:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794147840 00000100:00100000:1.0:1746147732.739225:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794148096 00000100:00100000:2.0:1746147732.739232:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794147840 00000100:00100000:1.0:1746147732.739236:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794148096 00002000:00100000:2.0:1746147732.739280:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880094692d80 x1830967794147840/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.739283:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880094690a80 x1830967794148096/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.739291:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094692d80 with x1830967794147840 ext(0->1048575) 00002000:00100000:1.0:1746147732.739291:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094690a80 with x1830967794148096 ext(1048576->2097151) 00002000:00010000:2.0:1746147732.739296:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094692d80 00002000:00010000:1.0:1746147732.739297:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094690a80 00000100:00100000:2.0:1746147732.739525:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7621 00000100:00100000:2.0:1746147732.739534:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794147840:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147732.739678:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7622 00000100:00100000:1.0:1746147732.739685:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794148096:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147732.742449:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.742485:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.742573:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794148224 00000100:00100000:3.0:1746147732.742583:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794148352 00000100:00100000:1.0:1746147732.742584:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794148224 00000100:00100000:3.0:1746147732.742589:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794148352 00000100:00100000:0.0:1746147732.742590:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.742605:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794148480 00000100:00100000:0.0:1746147732.742609:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794148480 00000100:00100000:1.0:1746147732.742628:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16886 00000100:00100000:3.0:1746147732.742634:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16887 00000100:00100000:1.0:1746147732.742635:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967794148224:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:0.0:1746147732.742639:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16888 00000100:00100000:3.0:1746147732.742641:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+16:1958:x1830967794148352:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:0.0:1746147732.742644:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967794148480:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147732.742658:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.742662:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147732.742662:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147732.742672:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a925ea00/0xe64d3fbf12a7eac3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc513 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.742675:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915e6c00/0xe64d3fbf12a7eaca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc51a expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.742675:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8eae00/0xe64d3fbf12a7ead1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc521 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.742692:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.742692:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.742694:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.742694:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.742702:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915e6c00/0xe64d3fbf12a7eaca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc51a expref: 17 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.742702:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925ea00/0xe64d3fbf12a7eac3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc513 expref: 24 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.742716:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a925ea00/0xe64d3fbf12a7eac3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc513 expref: 24 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.742718:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915e6c00/0xe64d3fbf12a7eaca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc51a expref: 17 pid: 7050 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147732.742722:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094691180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796524544:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147732.742724:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925ea00, rc 0) 00010000:00010000:3.0:1746147732.742727:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915e6c00, rc 0) 00000100:00100000:3.0:1746147732.742769:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1958:x1830967794148352:12345-192.168.202.10@tcp:101:cat.0 Request processed in 129us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.742775:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16887 00000100:00100000:1.0:1746147732.742781:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794148224:12345-192.168.202.10@tcp:101:cat.0 Request processed in 146us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.742787:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16886 00000100:00100000:0.0:1746147732.742788:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147732.742833:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.742843:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794148608 00000100:00100000:3.0:1746147732.742846:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794148608 00000100:00100000:3.0:1746147732.742860:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16889 00000100:00100000:3.0:1746147732.742864:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794148608:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:0.0:1746147732.742868:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147732.742870:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.742877:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915e7200/0xe64d3fbf12a7ead8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc528 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.742904:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147732.742904:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794148736 00010000:00010000:3.0:1746147732.742906:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147732.742907:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794148736 00010000:00010000:3.0:1746147732.742910:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800915e7200/0xe64d3fbf12a7ead8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc528 expref: 25 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.742920:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915e7200/0xe64d3fbf12a7ead8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc528 expref: 25 pid: 21480 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147732.742924:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16890 00010000:00010000:3.0:1746147732.742928:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915e7200, rc 0) 00000100:00100000:1.0:1746147732.742929:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1958:x1830967794148736:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147732.742935:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147732.742944:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a925fa00/0xe64d3fbf12a7eadf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc52f expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.742945:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794148608:12345-192.168.202.10@tcp:101:cat.0 Request processed in 80us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.742952:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16889 00010000:00010000:1.0:1746147732.742954:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.742956:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.742960:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a925fa00/0xe64d3fbf12a7eadf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc52f expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.742969:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a925fa00/0xe64d3fbf12a7eadf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc52f expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.742976:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925fa00, rc 0) 00000100:00100000:1.0:1746147732.743007:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1958:x1830967794148736:12345-192.168.202.10@tcp:101:cat.0 Request processed in 77us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.743012:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16890 00002000:00010000:0.0:1746147732.747582:0:10613:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime: 1746147730 -> 1746147733 00000100:00100000:0.0:1746147732.747617:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094691180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796524544:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147732.747666:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8eae00/0xe64d3fbf12a7ead1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc521 expref: 24 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.747682:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8eae00/0xe64d3fbf12a7ead1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc521 expref: 24 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147732.747714:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8eae00, rc 0) 00000100:00100000:0.0:1746147732.747775:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794148480:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5129us (5183us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147732.747784:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16888 00000100:00100000:1.0:1746147732.755048:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794148096:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15355us (15973us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147732.755059:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7622 00002000:00100000:1.0:1746147732.755070:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880094690a80 x1830967794148096/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.755079:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094690a80 with x1830967794148096 ext(1048576->2097151) 00002000:00010000:1.0:1746147732.755085:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094690a80 00000100:00100000:2.0:1746147732.756917:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794147840:12345-192.168.202.10@tcp:3:cat.0 Request processed in 17379us (17923us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147732.756927:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7621 00002000:00100000:2.0:1746147732.756935:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880094692d80 x1830967794147840/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.756942:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094692d80 with x1830967794147840 ext(0->1048575) 00002000:00010000:2.0:1746147732.756945:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094692d80 00000100:00100000:0.0:1746147732.757625:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.757694:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794148992 00000100:00100000:2.0:1746147732.757701:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794148992 00002000:00100000:2.0:1746147732.757729:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880094691180 x1830967794148992/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.757735:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094691180 with x1830967794148992 ext(0->1048575) 00002000:00010000:2.0:1746147732.757739:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094691180 00000100:00100000:2.0:1746147732.758204:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7623 00000100:00100000:2.0:1746147732.758211:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794148992:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147732.758709:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.758774:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.758833:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794149248 00000100:00100000:1.0:1746147732.758837:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794149248 00002000:00100000:1.0:1746147732.758856:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009ce60e00 x1830967794149248/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.758863:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60e00 with x1830967794149248 ext(1048576->2097151) 00002000:00010000:1.0:1746147732.758867:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60e00 00000100:00100000:1.0:1746147732.758878:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794149376 00000100:00100000:1.0:1746147732.758880:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794149376 00002000:00100000:1.0:1746147732.758904:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009ce60700 x1830967794149376/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 504/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.758910:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60700 with x1830967794149376 ext(1048576->2097151) 00002000:00010000:1.0:1746147732.758912:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60700 00000100:00100000:1.0:1746147732.758929:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7624 00000100:00100000:1.0:1746147732.758934:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1959:x1830967794149248:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147732.759230:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7625 00000100:00100000:2.0:1746147732.759236:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794149376:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147732.772568:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794149376:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13320us (13782us total) trans 0 rc 487424/487424 00000100:00100000:3.0:1746147732.772580:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7625 00002000:00100000:3.0:1746147732.772592:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009ce60700 x1830967794149376/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 504/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 487424/487424 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.772602:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60700 with x1830967794149376 ext(1048576->2097151) 00002000:00010000:3.0:1746147732.772608:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60700 00000100:00100000:2.0:1746147732.772609:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794148992:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14390us (14976us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147732.772618:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7623 00002000:00100000:2.0:1746147732.772627:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880094691180 x1830967794148992/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.772635:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094691180 with x1830967794148992 ext(0->1048575) 00002000:00010000:2.0:1746147732.772640:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094691180 00000100:00100000:1.0:1746147732.773842:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1959:x1830967794149248:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14905us (15130us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147732.773851:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7624 00002000:00100000:1.0:1746147732.773857:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009ce60e00 x1830967794149248/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.773865:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60e00 with x1830967794149248 ext(1048576->2097151) 00002000:00010000:1.0:1746147732.773868:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60e00 00000100:00100000:0.0:1746147732.775263:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.776111:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794149632 00000100:00100000:1.0:1746147732.776121:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794149632 00000100:00100000:1.0:1746147732.776210:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16891 00000100:00100000:1.0:1746147732.776219:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32478:x1830967794149632:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147732.776240:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147732.776263:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7eae6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc536 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.776294:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5400/0xe64d3fbf12a7ea99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1650687) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e9 expref: 17 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.776301:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147732.776302:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147732.776306:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7eae6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc536 expref: 10 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.776337:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5400/0xe64d3fbf12a7ea99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1650687) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e9 expref: 17 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.776348:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5400/0xe64d3fbf12a7ea99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1650687) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e9 expref: 17 pid: 6715 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746147732.776360:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796524672:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147732.776451:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147732.777819:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796524672:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147732.777848:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7eae6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc536 expref: 10 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.777868:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925fe00, rc 0) 00000100:00100000:1.0:1746147732.777971:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32478:x1830967794149632:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1752us (2713us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.777978:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16891 00000100:00100000:0.0:1746147732.779546:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.779935:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794149760 00000100:00100000:1.0:1746147732.779948:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794149760 00002000:00100000:1.0:1746147732.779983:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1089536->1650687) req@ffff88009ce61f80 x1830967794149760/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.779991:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61f80 with x1830967794149760 ext(1089536->1650687) 00010000:00010000:1.0:1746147732.779998:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5400/0xe64d3fbf12a7ea99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1650687) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e9 expref: 18 pid: 6715 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746147732.780010:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5400/0xe64d3fbf12a7ea99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1650687) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e9 expref: 18 pid: 6715 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746147732.780016:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ce61f80 00000100:00100000:1.0:1746147732.780042:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1545 00000100:00100000:1.0:1746147732.780048:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1960:x1830967794149760:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147732.791119:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.791341:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794149888 00000100:00100000:1.0:1746147732.791351:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794149888 00000100:00100000:1.0:1746147732.791408:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16892 00000100:00100000:1.0:1746147732.791418:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:32481:x1830967794149888:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147732.791439:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147732.791458:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc53d expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.791489:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147732.791494:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaed lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc53d expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.791506:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaed lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc53d expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.791516:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925ec00, rc 0) 00000100:00100000:1.0:1746147732.791571:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32481:x1830967794149888:12345-192.168.202.10@tcp:101:cat.0 Request processed in 155us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.791577:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16892 00000100:00100000:2.0:1746147732.794035:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794149760:12345-192.168.202.10@tcp:4:cat.0 Request processed in 13977us (14487us total) trans 21474841646 rc 0/0 00000100:00100000:2.0:1746147732.794047:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1545 00002000:00100000:2.0:1746147732.794061:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1089536->1650687) req@ffff88009ce61f80 x1830967794149760/t21474841646(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/448 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.794069:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61f80 with x1830967794149760 ext(1089536->1650687) 00010000:00010000:2.0:1746147732.794078:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5400/0xe64d3fbf12a7ea99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1089536->1650687) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e9 expref: 21 pid: 6715 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746147732.794095:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5400/0xe64d3fbf12a7ea99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1089536->1650687) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e9 expref: 21 pid: 6715 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746147732.794106:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ce61f80 00000100:00100000:0.0:1746147732.799136:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.799251:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794150016 00000100:00100000:3.0:1746147732.799261:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794150016 00010000:00010000:3.0:1746147732.799297:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5400/0xe64d3fbf12a7ea99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1089536->1650687) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e9 expref: 21 pid: 6715 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746147732.799340:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8647 00000100:00100000:3.0:1746147732.799348:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794150016:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.799361:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.799383:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5400/0xe64d3fbf12a7ea99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1089536->1650687) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e9 expref: 21 pid: 6715 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.799393:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5400/0xe64d3fbf12a7ea99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1089536->1650687) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e9 expref: 21 pid: 6715 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.799413:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c9f5400/0xe64d3fbf12a7ea99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1089536->1650687) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e9 expref: 21 pid: 6715 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.799950:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.799952:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.799959:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7eae6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc536 expref: 9 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.799967:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7eae6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc536 expref: 9 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.799974:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.799976:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.799979:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc53d expref: 20 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.799984:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc53d expref: 20 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.800016:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc53d expref: 20 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.800027:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796524800:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147732.800118:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7eae6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc536 expref: 9 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.800127:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796524928:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147732.800150:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fe40 going to sleep for 11 seconds 00010000:00010000:2.0:1746147732.801951:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147732.802931:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796524800:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147732.802944:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796524928:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147732.802970:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.803024:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794150016:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3676us (3897us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.803033:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8647 00000100:00100000:0.0:1746147732.805047:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.805210:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794150272 00000100:00100000:2.0:1746147732.805221:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794150272 00002000:00100000:2.0:1746147732.805276:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009ce63800 x1830967794150272/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.805287:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63800 with x1830967794150272 ext(1048576->2097151) 00002000:00010000:2.0:1746147732.805293:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce63800 00000100:00100000:2.0:1746147732.805321:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7626 00000100:00100000:2.0:1746147732.805330:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794150272:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147732.814118:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.814390:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794150656 00000100:00100000:2.0:1746147732.814402:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794150656 00002000:00100000:2.0:1746147732.814449:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009ce60a80 x1830967794150656/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.814457:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60a80 with x1830967794150656 ext(1048576->2097151) 00002000:00010000:2.0:1746147732.814462:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60a80 00000100:00100000:0.0:1746147732.814539:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.814565:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7627 00000100:00100000:2.0:1746147732.814575:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794150656:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147732.814588:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794150784 00000100:00100000:3.0:1746147732.814591:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794150784 00002000:00100000:3.0:1746147732.814608:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009ce60000 x1830967794150784/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 504/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.814614:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60000 with x1830967794150784 ext(1048576->2097151) 00002000:00010000:3.0:1746147732.814617:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce60000 00000100:00100000:3.0:1746147732.814635:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7628 00000100:00100000:3.0:1746147732.814640:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794150784:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147732.817061:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794150272:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11727us (12019us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147732.817070:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7626 00002000:00100000:2.0:1746147732.817078:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009ce63800 x1830967794150272/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.817085:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63800 with x1830967794150272 ext(1048576->2097151) 00002000:00010000:2.0:1746147732.817088:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce63800 00000100:00100000:2.0:1746147732.823853:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794150656:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9271us (9738us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147732.823867:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7627 00002000:00100000:2.0:1746147732.823877:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009ce60a80 x1830967794150656/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.823911:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60a80 with x1830967794150656 ext(1048576->2097151) 00002000:00010000:2.0:1746147732.823917:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60a80 00000100:00100000:0.0:1746147732.824340:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.824472:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794150912 00000100:00100000:2.0:1746147732.824480:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794150912 00000100:00100000:2.0:1746147732.824523:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16893 00000100:00100000:2.0:1746147732.824529:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32481:x1830967794150912:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147732.824543:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.824558:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c0db800/0xe64d3fbf12a7eaf4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc544 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.824582:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 11 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.824589:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147732.824591:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147732.824594:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0db800/0xe64d3fbf12a7eaf4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc544 expref: 24 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.824619:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 11 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.824629:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 11 pid: 8470 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746147732.824638:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796525056:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.824729:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147732.827309:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794150784:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12660us (12763us total) trans 0 rc 921600/921600 00000100:00100000:3.0:1746147732.827319:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7628 00002000:00100000:3.0:1746147732.827327:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009ce60000 x1830967794150784/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 504/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 921600/921600 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.827335:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60000 with x1830967794150784 ext(1048576->2097151) 00010000:00010000:3.0:1746147732.827341:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 10 pid: 8470 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746147732.827354:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 10 pid: 8470 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746147732.827360:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ce60000 00000100:00100000:3.0:1746147732.828438:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796525056:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147732.828459:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c0db800/0xe64d3fbf12a7eaf4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc544 expref: 24 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.828471:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0db800, rc 0) 00000100:00100000:3.0:1746147732.828510:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32481:x1830967794150912:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3980us (4176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.828516:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16893 00000100:00100000:0.0:1746147732.829620:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.829701:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794151040 00000100:00100000:3.0:1746147732.829706:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794151040 00002000:00100000:3.0:1746147732.829736:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1634304->1761279) req@ffff88009ce63100 x1830967794151040/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.829744:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63100 with x1830967794151040 ext(1634304->1761279) 00010000:00010000:3.0:1746147732.829750:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 10 pid: 8470 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147732.829760:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 10 pid: 8470 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746147732.829766:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ce63100 00000100:00100000:3.0:1746147732.829795:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1546 00000100:00100000:3.0:1746147732.829801:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794151040:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147732.834290:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794151040:12345-192.168.202.10@tcp:4:cat.0 Request processed in 4475us (4657us total) trans 17179874407 rc 0/0 00000100:00100000:3.0:1746147732.834304:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1546 00002000:00100000:3.0:1746147732.834318:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1634304->1761279) req@ffff88009ce63100 x1830967794151040/t17179874407(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/448 e 0 to 0 dl 1746147743 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.834328:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63100 with x1830967794151040 ext(1634304->1761279) 00010000:00010000:3.0:1746147732.834339:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 12 pid: 8470 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147732.834355:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 12 pid: 8470 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746147732.834362:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ce63100 00000100:00100000:0.0:1746147732.838136:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.838270:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794151168 00000100:00100000:3.0:1746147732.838280:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794151168 00010000:00010000:3.0:1746147732.838318:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 12 pid: 8470 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147732.838366:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8648 00000100:00100000:3.0:1746147732.838373:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794151168:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.838387:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.838411:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 12 pid: 8470 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147732.838424:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 12 pid: 8470 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147732.838454:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7ea7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->1761279) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4db expref: 12 pid: 8470 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147732.838514:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.838517:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.838525:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c0db800/0xe64d3fbf12a7eaf4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc544 expref: 23 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.838534:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0db800/0xe64d3fbf12a7eaf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc544 expref: 23 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.838575:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c0db800/0xe64d3fbf12a7eaf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc544 expref: 23 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.838587:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796525184:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147732.838975:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147732.841525:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796525184:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147732.841548:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147732.841550:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.841602:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794151168:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3228us (3477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.841613:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8648 00000100:00100000:2.0:1746147732.841732:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794151424 00000100:00100000:2.0:1746147732.841739:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794151424 00002000:00100000:2.0:1746147732.841781:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009ce61880 x1830967794151424/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.841790:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61880 with x1830967794151424 ext(1048576->2097151) 00002000:00010000:2.0:1746147732.841795:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce61880 00000100:00100000:2.0:1746147732.841827:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7629 00000100:00100000:2.0:1746147732.841834:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794151424:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147732.842261:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.842290:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.842319:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.842335:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794151936 00000100:00100000:0.0:1746147732.842338:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794151936 00002000:00100000:0.0:1746147732.842357:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009ce63480 x1830967794151936/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147732.842364:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63480 with x1830967794151936 ext(3145728->4194303) 00002000:00010000:0.0:1746147732.842368:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce63480 00000100:00100000:1.0:1746147732.842381:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794152192 00000100:00100000:0.0:1746147732.842384:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794151680 00000100:00100000:1.0:1746147732.842385:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794152192 00000100:00100000:0.0:1746147732.842387:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794151680 00002000:00100000:0.0:1746147732.842399:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880093cd6300 x1830967794151680/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.842405:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009ce61180 x1830967794152192/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147732.842406:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd6300 with x1830967794151680 ext(2097152->3145727) 00002000:00010000:0.0:1746147732.842408:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd6300 00002000:00100000:1.0:1746147732.842413:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61180 with x1830967794152192 ext(2097152->3145727) 00002000:00010000:1.0:1746147732.842416:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce61180 00000100:00100000:0.0:1746147732.842420:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7630 00000100:00100000:0.0:1746147732.842424:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794151936:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147732.842438:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7631 00000100:00100000:1.0:1746147732.842443:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794151680:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147732.843243:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7632 00000100:00100000:3.0:1746147732.843252:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794152192:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147732.843383:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.843396:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794152320 00000100:00100000:0.0:1746147732.843400:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794152320 00002000:00100000:0.0:1746147732.843418:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880093cd7b80 x1830967794152320/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147732.843425:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd7b80 with x1830967794152320 ext(3145728->4194303) 00002000:00010000:0.0:1746147732.843429:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd7b80 00000100:00100000:0.0:1746147732.844031:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7633 00000100:00100000:0.0:1746147732.844040:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794152320:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147732.854088:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794151424:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12239us (12526us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147732.854102:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7629 00002000:00100000:2.0:1746147732.854117:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009ce61880 x1830967794151424/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.854127:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61880 with x1830967794151424 ext(1048576->2097151) 00002000:00010000:2.0:1746147732.854133:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce61880 00000100:00100000:3.0:1746147732.856002:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794152192:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12739us (13697us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147732.856014:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7632 00002000:00100000:3.0:1746147732.856024:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009ce61180 x1830967794152192/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.856032:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61180 with x1830967794152192 ext(2097152->3145727) 00002000:00010000:3.0:1746147732.856038:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce61180 00000100:00100000:2.0:1746147732.864639:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794152320:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20587us (21243us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147732.864639:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794151680:12345-192.168.202.10@tcp:3:cat.0 Request processed in 22182us (22305us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147732.864661:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7631 00000100:00100000:2.0:1746147732.864668:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7633 00002000:00100000:2.0:1746147732.864675:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880093cd7b80 x1830967794152320/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.864675:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880093cd6300 x1830967794151680/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.864684:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd7b80 with x1830967794152320 ext(3145728->4194303) 00002000:00100000:1.0:1746147732.864688:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd6300 with x1830967794151680 ext(2097152->3145727) 00002000:00010000:2.0:1746147732.864691:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd7b80 00002000:00010000:1.0:1746147732.864692:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd6300 00000100:00100000:2.0:1746147732.869021:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794151936:12345-192.168.202.10@tcp:3:cat.0 Request processed in 26582us (26746us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147732.869034:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7630 00002000:00100000:2.0:1746147732.869047:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009ce63480 x1830967794151936/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.869056:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce63480 with x1830967794151936 ext(3145728->4194303) 00002000:00010000:2.0:1746147732.869063:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce63480 00000100:00100000:0.0:1746147732.878274:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.878409:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794152576 00000100:00100000:3.0:1746147732.878419:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794152576 00000100:00100000:3.0:1746147732.878476:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16894 00000100:00100000:3.0:1746147732.878484:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967794152576:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147732.878505:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.878525:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095234c00/0xe64d3fbf12a7eafb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc54b expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.878548:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.878550:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.878560:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095234c00/0xe64d3fbf12a7eafb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc54b expref: 12 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.878576:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095234c00/0xe64d3fbf12a7eafb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc54b expref: 12 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.878586:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095234c00, rc 0) 00000100:00100000:3.0:1746147732.878656:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1957:x1830967794152576:12345-192.168.202.10@tcp:101:cat.0 Request processed in 173us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.878662:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16894 00000100:00100000:0.0:1746147732.879615:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.879717:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.879780:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794152960 00000100:00100000:2.0:1746147732.879783:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794153216 00000100:00100000:2.0:1746147732.879788:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794153216 00000100:00100000:1.0:1746147732.879793:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794152960 00002000:00100000:2.0:1746147732.879827:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880093cd7100 x1830967794153216/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.879836:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd7100 with x1830967794153216 ext(3145728->4194303) 00002000:00100000:1.0:1746147732.879837:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880093cd4380 x1830967794152960/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746147732.879841:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd7100 00002000:00100000:1.0:1746147732.879848:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4380 with x1830967794152960 ext(2097152->3145727) 00002000:00010000:1.0:1746147732.879853:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd4380 00000100:00100000:2.0:1746147732.880012:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7634 00000100:00100000:2.0:1746147732.880020:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794153216:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147732.880303:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7635 00000100:00100000:3.0:1746147732.880319:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794152960:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147732.883496:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.883547:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794153472 00000100:00100000:2.0:1746147732.883555:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794153472 00002000:00100000:2.0:1746147732.883594:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880135810a80 x1830967794153472/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.883603:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135810a80 with x1830967794153472 ext(4194304->5017599) 00002000:00010000:2.0:1746147732.883608:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135810a80 00000100:00100000:2.0:1746147732.883635:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7636 00000100:00100000:2.0:1746147732.883641:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1957:x1830967794153472:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147732.886672:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.886731:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794153600 00000100:00100000:3.0:1746147732.886740:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794153600 00002000:00100000:3.0:1746147732.886769:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880093cd5f80 x1830967794153600/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.886776:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5f80 with x1830967794153600 ext(2097152->3145727) 00002000:00010000:3.0:1746147732.886781:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd5f80 00000100:00100000:3.0:1746147732.886816:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7637 00000100:00100000:3.0:1746147732.886825:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794153600:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147732.887157:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.887185:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794153728 00000100:00100000:1.0:1746147732.887192:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794153728 00002000:00100000:1.0:1746147732.887225:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880135813b80 x1830967794153728/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.887234:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135813b80 with x1830967794153728 ext(3145728->4194303) 00002000:00010000:1.0:1746147732.887238:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135813b80 00000100:00100000:1.0:1746147732.887257:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7638 00000100:00100000:1.0:1746147732.887264:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794153728:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147732.894421:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.894454:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794153984 00000100:00100000:1.0:1746147732.894463:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794153984 00000100:00100000:1.0:1746147732.894521:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16895 00000100:00100000:1.0:1746147732.894529:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32483:x1830967794153984:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147732.894551:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147732.894571:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc552 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.894600:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7eae6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc536 expref: 11 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.894607:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc53d expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.894614:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.894615:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147732.894619:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1867776->2097151] (req 1867776->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 11 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.894660:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc53d expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.894672:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc53d expref: 23 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147732.894685:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796525312:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147732.894784:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7eae6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc536 expref: 11 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.894792:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7eae6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc536 expref: 11 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147732.894800:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135813800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796525440:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147732.894820:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147732.895134:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794153216:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15113us (15414us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147732.895145:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7634 00002000:00100000:2.0:1746147732.895154:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880093cd7100 x1830967794153216/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.895163:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd7100 with x1830967794153216 ext(3145728->4194303) 00002000:00010000:2.0:1746147732.895168:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd7100 00000100:00100000:3.0:1746147732.901430:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1959:x1830967794152960:12345-192.168.202.10@tcp:3:cat.0 Request processed in 21109us (21809us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147732.901441:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7635 00002000:00100000:3.0:1746147732.901456:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880093cd4380 x1830967794152960/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.901465:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4380 with x1830967794152960 ext(2097152->3145727) 00002000:00010000:3.0:1746147732.901471:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd4380 00000100:00100000:1.0:1746147732.903571:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796525312:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147732.905348:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.905461:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.905486:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794154112 00000100:00100000:1.0:1746147732.905494:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794154112 00010000:00010000:1.0:1746147732.905528:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7eae6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc536 expref: 12 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147732.905601:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135813800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796525440:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147732.905632:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1867776->2097151] (req 1867776->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 12 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.905662:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2a1e00, rc 0) 00000100:00100000:2.0:1746147732.905708:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32483:x1830967794153984:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 11180us (11299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.905720:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16895 00000100:00100000:0.0:1746147732.905753:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794153600:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18923us (19087us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147732.905762:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7637 00002000:00100000:0.0:1746147732.905770:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880093cd5f80 x1830967794153600/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147732.905775:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5f80 with x1830967794153600 ext(2097152->3145727) 00002000:00010000:0.0:1746147732.905779:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd5f80 00000100:00100000:1.0:1746147732.905923:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794154240 00000100:00100000:1.0:1746147732.905930:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794154240 00010000:00010000:1.0:1746147732.905952:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc53d expref: 20 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147732.906302:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8649 00000100:00100000:1.0:1746147732.906310:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967794154112:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147732.906322:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147732.906339:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7eae6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc536 expref: 11 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147732.906350:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7eae6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc536 expref: 11 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147732.906353:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8650 00000100:00100000:2.0:1746147732.906362:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794154240:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147732.906372:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147732.906372:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7eae6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc536 expref: 11 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147732.906390:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc53d expref: 20 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147732.906391:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147732.906401:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc53d expref: 20 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147732.906418:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7eaed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc53d expref: 20 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147732.906424:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1958:x1830967794154112:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 115us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147732.906430:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8649 00010000:00010000:2.0:1746147732.906435:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.906437:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.906443:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 9 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.906451:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 9 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.906480:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 9 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.906491:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796525568:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147732.906544:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147732.907411:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1957:x1830967794153472:12345-192.168.202.10@tcp:3:cat.0 Request processed in 23767us (23924us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746147732.907421:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7636 00002000:00100000:3.0:1746147732.907428:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880135810a80 x1830967794153472/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147732.907436:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135810a80 with x1830967794153472 ext(4194304->5017599) 00002000:00010000:3.0:1746147732.907440:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135810a80 00000100:00100000:2.0:1746147732.912367:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796525568:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147732.912391:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147732.912447:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794154240:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6085us (6984us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.912457:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8650 00000100:00100000:0.0:1746147732.913514:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.913778:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794154368 00000100:00100000:3.0:1746147732.913786:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794154368 00000100:00100000:3.0:1746147732.913833:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16896 00000100:00100000:3.0:1746147732.913840:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32483:x1830967794154368:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147732.913858:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.913876:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc559 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.913923:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c0db800/0xe64d3fbf12a7eaf4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc544 expref: 25 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.913930:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095234c00/0xe64d3fbf12a7eafb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc54b expref: 13 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.913935:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.913937:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.913940:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1544191] (req 1048576->1544191) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.913966:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095234c00/0xe64d3fbf12a7eafb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc54b expref: 13 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.913977:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095234c00/0xe64d3fbf12a7eafb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc54b expref: 13 pid: 8184 timeout: 912 lvb_type: 1 00000100:00100000:3.0:1746147732.913988:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796525696:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147732.913999:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794153728:12345-192.168.202.10@tcp:3:cat.0 Request processed in 26735us (26844us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147732.914007:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7638 00002000:00100000:0.0:1746147732.914016:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880135813b80 x1830967794153728/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147732.914024:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135813b80 with x1830967794153728 ext(3145728->4194303) 00002000:00010000:0.0:1746147732.914028:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135813b80 00010000:00010000:3.0:1746147732.914035:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c0db800/0xe64d3fbf12a7eaf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc544 expref: 24 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.914043:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c0db800/0xe64d3fbf12a7eaf4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc544 expref: 23 pid: 8184 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147732.914050:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796525824:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.914069:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.915863:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.916026:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794154496 00000100:00100000:2.0:1746147732.916034:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794154496 00010000:00010000:2.0:1746147732.916068:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095234c00/0xe64d3fbf12a7eafb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc54b expref: 14 pid: 8184 timeout: 912 lvb_type: 1 00000100:00100000:2.0:1746147732.916096:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8651 00000100:00100000:2.0:1746147732.916104:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1957:x1830967794154496:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147732.916118:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147732.916139:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095234c00/0xe64d3fbf12a7eafb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc54b expref: 14 pid: 8184 timeout: 912 lvb_type: 1 00010000:00010000:2.0:1746147732.916150:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095234c00/0xe64d3fbf12a7eafb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc54b expref: 14 pid: 8184 timeout: 912 lvb_type: 1 00010000:00010000:2.0:1746147732.916175:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147732.916225:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1957:x1830967794154496:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 121us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.916231:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8651 00010000:00010000:3.0:1746147732.916376:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095234c00/0xe64d3fbf12a7eafb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc54b expref: 13 pid: 8184 timeout: 912 lvb_type: 1 00000100:00100000:3.0:1746147732.916404:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796525696:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147732.916416:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796525824:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147732.916443:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->1544191] (req 1048576->1544191) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 12 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.916458:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235a00, rc 0) 00000100:00100000:3.0:1746147732.916663:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32483:x1830967794154368:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2822us (3152us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.916669:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16896 00000100:00100000:0.0:1746147732.917209:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.917259:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794154624 00000100:00100000:2.0:1746147732.917263:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794154624 00010000:00010000:2.0:1746147732.917278:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0db800/0xe64d3fbf12a7eaf4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc544 expref: 24 pid: 8184 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147732.917436:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8652 00000100:00100000:2.0:1746147732.917443:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794154624:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147732.917452:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147732.917462:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c0db800/0xe64d3fbf12a7eaf4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc544 expref: 24 pid: 8184 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147732.917471:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c0db800/0xe64d3fbf12a7eaf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc544 expref: 24 pid: 8184 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147732.917485:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c0db800/0xe64d3fbf12a7eaf4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc544 expref: 24 pid: 8184 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147732.917507:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.917510:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.917517:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 11 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.917525:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 11 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.917553:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 11 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.917564:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796525952:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147732.917998:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.919511:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.919603:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794154752 00000100:00100000:3.0:1746147732.919614:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794154752 00000100:00100000:3.0:1746147732.919679:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16897 00000100:00100000:3.0:1746147732.919688:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1958:x1830967794154752:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147732.919707:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.919724:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7eb10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc560 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.919797:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796526080:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147732.919907:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.923240:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.923304:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794154880 00000100:00100000:2.0:1746147732.923313:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794154880 00000100:00100000:2.0:1746147732.923366:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16898 00000100:00100000:2.0:1746147732.923374:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794154880:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147732.923393:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.923411:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0976600/0xe64d3fbf12a7eb17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc567 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.923461:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796526208:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147732.923532:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147732.923932:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796525952:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147732.923953:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.923988:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794154624:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6543us (6777us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.923999:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8652 00000100:00100000:3.0:1746147732.924068:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796526080:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147732.924098:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7eb10 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc560 expref: 13 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.924113:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095235600/0xe64d3fbf12a7eb10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc560 expref: 13 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.924153:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235600, rc 0) 00000100:00100000:3.0:1746147732.924180:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1958:x1830967794154752:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4492us (4679us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147732.924188:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16897 00000100:00100000:0.0:1746147732.924303:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.924847:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794155008 00000100:00100000:3.0:1746147732.924853:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794155008 00000100:00100000:3.0:1746147732.924906:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16899 00000100:00100000:3.0:1746147732.924913:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794155008:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147732.924923:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147732.924935:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095235400/0xe64d3fbf12a7eb1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc56e expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.924969:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796526336:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147732.925018:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147732.926373:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.926577:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794155264 00000100:00100000:2.0:1746147732.926583:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794155264 00002000:00100000:2.0:1746147732.926617:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (1540096->1544191) req@ffff880093cd5500 x1830967794155264/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.926626:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5500 with x1830967794155264 ext(1540096->1544191) 00002000:00010000:2.0:1746147732.926631:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd5500 00000100:00100000:2.0:1746147732.926658:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7639 00000100:00100000:2.0:1746147732.926664:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794155264:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147732.926814:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794155264:12345-192.168.202.10@tcp:3:cat.0 Request processed in 150us (445us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147732.926820:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7639 00002000:00100000:2.0:1746147732.926825:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (1540096->1544191) req@ffff880093cd5500 x1830967794155264/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.926833:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5500 with x1830967794155264 ext(1540096->1544191) 00002000:00010000:2.0:1746147732.926836:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd5500 00000100:00100000:3.0:1746147732.927130:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8184:1830967796526208:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147732.927156:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0976600/0xe64d3fbf12a7eb17 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc567 expref: 20 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.927168:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0976600/0xe64d3fbf12a7eb17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc567 expref: 20 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147732.927179:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0976600, rc 0) 00000100:00100000:3.0:1746147732.927206:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794154880:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3833us (3981us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147732.927212:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16898 00000100:00100000:2.0:1746147732.927585:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796526336:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147732.927604:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095235400/0xe64d3fbf12a7eb1e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc56e expref: 24 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.927612:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095235400/0xe64d3fbf12a7eb1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc56e expref: 24 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.927938:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095235400, rc 0) 00000100:00100000:2.0:1746147732.927969:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794155008:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3056us (3667us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147732.927975:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16899 00000100:00100000:0.0:1746147732.931770:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.931827:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794155520 00000100:00100000:2.0:1746147732.931837:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794155520 00002000:00100000:2.0:1746147732.931900:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880093cd4e00 x1830967794155520/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.931910:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4e00 with x1830967794155520 ext(4194304->5017599) 00002000:00010000:2.0:1746147732.931915:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd4e00 00000100:00100000:2.0:1746147732.931948:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7640 00000100:00100000:2.0:1746147732.931956:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794155520:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147732.938832:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794155520:12345-192.168.202.10@tcp:3:cat.0 Request processed in 6865us (7060us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147732.938844:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7640 00002000:00100000:2.0:1746147732.938856:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880093cd4e00 x1830967794155520/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/440 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.938865:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4e00 with x1830967794155520 ext(4194304->5017599) 00002000:00010000:2.0:1746147732.938872:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd4e00 00000100:00100000:0.0:1746147732.944143:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.944200:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.944264:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794155648 00000100:00100000:2.0:1746147732.944274:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794155648 00000100:00100000:2.0:1746147732.944324:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794155776 00000100:00100000:2.0:1746147732.944326:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794155776 00000100:00100000:2.0:1746147732.944344:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16900 00000100:00100000:2.0:1746147732.944351:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1957:x1830967794155648:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147732.944362:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16901 00000100:00100000:1.0:1746147732.944370:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794155776:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147732.944372:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147732.944378:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.944390:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab800/0xe64d3fbf12a7eb25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc575 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.944390:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a002de00/0xe64d3fbf12a7eb2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc57c expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.944440:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796526464:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147732.944440:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796526592:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147732.944522:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147732.944528:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147732.947816:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796526592:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147732.947850:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a002de00/0xe64d3fbf12a7eb2c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc57c expref: 24 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.947866:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a002de00/0xe64d3fbf12a7eb2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc57c expref: 24 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.947924:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a002de00, rc 0) 00000100:00100000:1.0:1746147732.947973:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794155776:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3602us (3771us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147732.947981:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16901 00000100:00100000:2.0:1746147732.948059:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796526464:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147732.948079:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab800/0xe64d3fbf12a7eb25 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc575 expref: 20 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.948087:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab800/0xe64d3fbf12a7eb25 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc575 expref: 20 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.948100:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a66ab800, rc 0) 00000100:00100000:2.0:1746147732.948120:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1957:x1830967794155648:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3769us (3988us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147732.948125:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16900 00000100:00100000:0.0:1746147732.950383:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.950440:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.950505:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794155904 00000100:00100000:1.0:1746147732.950515:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794155904 00000100:00100000:2.0:1746147732.950520:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794156032 00000100:00100000:2.0:1746147732.950524:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794156032 00000100:00100000:1.0:1746147732.950568:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16902 00000100:00100000:2.0:1746147732.950574:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16903 00000100:00100000:1.0:1746147732.950575:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1957:x1830967794155904:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147732.950580:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794156032:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147732.950591:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147732.950591:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.950608:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc58a expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147732.950608:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a002ca00/0xe64d3fbf12a7eb3a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc583 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147732.950668:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796526848:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147732.950668:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796526720:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147732.950741:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147732.950745:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147732.952188:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796526720:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147732.952217:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a002ca00/0xe64d3fbf12a7eb3a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc583 expref: 20 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.952229:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a002ca00/0xe64d3fbf12a7eb3a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc583 expref: 20 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147732.952251:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a002ca00, rc 0) 00000100:00100000:1.0:1746147732.952289:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1957:x1830967794155904:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1714us (1917us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147732.952296:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16902 00000100:00100000:2.0:1746147732.952421:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796526848:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147732.952447:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb33 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc58a expref: 24 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.952458:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc58a expref: 24 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.952472:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a66aba00, rc 0) 00000100:00100000:2.0:1746147732.952624:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794156032:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2042us (2182us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147732.952631:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16903 00000100:00100000:0.0:1746147732.964288:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.964391:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794156160 00000100:00100000:2.0:1746147732.964401:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794156160 00000100:00100000:2.0:1746147732.964456:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16904 00000100:00100000:2.0:1746147732.964464:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32485:x1830967794156160:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147732.964485:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.964503:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc591 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.964538:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eabc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc505 expref: 11 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.964547:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800915e7200/0xe64d3fbf12a7ead8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc528 expref: 24 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.964553:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.964555:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.964558:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2813952->3145727] (req 2813952->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 24 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.964585:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800915e7200/0xe64d3fbf12a7ead8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc528 expref: 24 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.964597:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800915e7200/0xe64d3fbf12a7ead8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc528 expref: 24 pid: 21480 timeout: 912 lvb_type: 1 00000100:00100000:2.0:1746147732.964610:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796526976:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147732.964711:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eabc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc505 expref: 11 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.964719:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eabc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc505 expref: 11 pid: 10613 timeout: 912 lvb_type: 1 00000100:00100000:2.0:1746147732.964726:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796527104:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.964746:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147732.966098:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796526976:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.966107:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796527104:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147732.966131:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2813952->3145727] (req 2813952->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 24 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.966145:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a66abe00, rc 0) 00000100:00100000:2.0:1746147732.966175:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32485:x1830967794156160:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1712us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.966183:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16904 00000100:00100000:0.0:1746147732.968692:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.968875:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794156288 00000100:00100000:3.0:1746147732.968936:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794156288 00010000:00010000:3.0:1746147732.968986:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eabc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc505 expref: 12 pid: 10613 timeout: 912 lvb_type: 1 00000100:00100000:3.0:1746147732.969044:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8653 00000100:00100000:3.0:1746147732.969055:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794156288:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.969073:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.969101:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eabc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc505 expref: 12 pid: 10613 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147732.969119:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eabc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc505 expref: 12 pid: 10613 timeout: 912 lvb_type: 1 00000100:00100000:2.0:1746147732.969141:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147732.969144:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eabc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc505 expref: 12 pid: 10613 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147732.969183:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.969238:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794156288:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 183us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.969245:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8653 00000100:00100000:3.0:1746147732.969547:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794156416 00000100:00100000:3.0:1746147732.969553:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794156416 00010000:00010000:3.0:1746147732.969570:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800915e7200/0xe64d3fbf12a7ead8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc528 expref: 24 pid: 21480 timeout: 912 lvb_type: 1 00000100:00100000:3.0:1746147732.969992:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8654 00000100:00100000:3.0:1746147732.970001:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794156416:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.970010:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.970026:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800915e7200/0xe64d3fbf12a7ead8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc528 expref: 24 pid: 21480 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147732.970037:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800915e7200/0xe64d3fbf12a7ead8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc528 expref: 24 pid: 21480 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147732.970877:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915e7200/0xe64d3fbf12a7ead8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc528 expref: 24 pid: 21480 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147732.970916:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.970918:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147732.970925:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.970933:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147732.970970:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147732.970984:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796527232:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147732.971075:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147732.972815:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796527232:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147732.972840:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147732.972913:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794156416:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2885us (3743us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.972923:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8654 00000100:00100000:0.0:1746147732.973146:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.973195:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794156672 00000100:00100000:2.0:1746147732.973203:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794156672 00002000:00100000:2.0:1746147732.973241:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (2813952->2818047) req@ffff8800a548a680 x1830967794156672/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.973251:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548a680 with x1830967794156672 ext(2813952->2818047) 00002000:00010000:2.0:1746147732.973255:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a548a680 00000100:00100000:2.0:1746147732.973278:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7641 00000100:00100000:2.0:1746147732.973285:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794156672:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147732.973481:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794156672:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 196us (339us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147732.973487:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7641 00002000:00100000:2.0:1746147732.973492:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (2813952->2818047) req@ffff8800a548a680 x1830967794156672/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147732.973505:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548a680 with x1830967794156672 ext(2813952->2818047) 00002000:00010000:2.0:1746147732.973508:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a548a680 00000100:00100000:0.0:1746147732.977457:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147732.977588:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794156800 00000100:00100000:2.0:1746147732.977597:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794156800 00000100:00100000:2.0:1746147732.977719:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16905 00000100:00100000:2.0:1746147732.977728:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:32485:x1830967794156800:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147732.977747:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147732.977765:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc598 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.977796:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7eaa7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc50c expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.977805:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a925fa00/0xe64d3fbf12a7eadf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc52f expref: 20 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.977811:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.977812:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147732.977815:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->2301951] (req 2097152->2301951) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 20 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.977845:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a925fa00/0xe64d3fbf12a7eadf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc52f expref: 20 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.977856:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a925fa00/0xe64d3fbf12a7eadf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc52f expref: 20 pid: 8470 timeout: 912 lvb_type: 1 00000100:00100000:2.0:1746147732.977874:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796527360:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147732.979010:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7eaa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc50c expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147732.979025:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7eaa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc50c expref: 9 pid: 10613 timeout: 912 lvb_type: 1 00000100:00100000:2.0:1746147732.979037:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796527488:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.979751:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147732.981458:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796527360:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147732.981469:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796527488:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147732.981496:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->2301951] (req 2097152->2301951) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 20 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147732.981514:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a66ab400, rc 0) 00000100:00100000:2.0:1746147732.981566:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:32485:x1830967794156800:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3839us (4118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.981575:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16905 00000100:00100000:0.0:1746147732.983005:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147732.983057:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147732.983257:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794156928 00000100:00100000:3.0:1746147732.983266:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794156928 00010000:00010000:3.0:1746147732.983300:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7eaa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc50c expref: 10 pid: 10613 timeout: 912 lvb_type: 1 00000100:00100000:3.0:1746147732.983324:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794157056 00000100:00100000:3.0:1746147732.983326:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794157056 00010000:00010000:3.0:1746147732.983337:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a925fa00/0xe64d3fbf12a7eadf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc52f expref: 20 pid: 8470 timeout: 912 lvb_type: 1 00000100:00100000:3.0:1746147732.983352:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8655 00000100:00100000:3.0:1746147732.983359:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794156928:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147732.983371:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147732.983393:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7eaa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc50c expref: 10 pid: 10613 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147732.983403:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7eaa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc50c expref: 10 pid: 10613 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147732.983427:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7eaa7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc50c expref: 10 pid: 10613 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746147732.983504:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8656 00000100:00100000:0.0:1746147732.983513:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794157056:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147732.983521:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147732.983531:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a925fa00/0xe64d3fbf12a7eadf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc52f expref: 20 pid: 8470 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746147732.983544:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a925fa00/0xe64d3fbf12a7eadf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc52f expref: 20 pid: 8470 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746147732.983556:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a925fa00/0xe64d3fbf12a7eadf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc52f expref: 20 pid: 8470 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746147732.983579:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.983581:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147732.983588:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.983595:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147732.983626:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147732.983638:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a548b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796527616:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147732.983914:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147732.984229:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147732.984233:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794156928:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 865us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147732.984244:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8655 00000100:00100000:0.0:1746147732.987637:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147732.987707:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794157312 00000100:00100000:1.0:1746147732.987716:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794157312 00002000:00100000:1.0:1746147732.987765:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2297856->2301951) req@ffff8800a5489c00 x1830967794157312/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/0 e 0 to 0 dl 1746147743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.987775:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5489c00 with x1830967794157312 ext(2297856->2301951) 00002000:00010000:1.0:1746147732.987781:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5489c00 00000100:00100000:1.0:1746147732.987804:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7642 00000100:00100000:1.0:1746147732.987812:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794157312:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147732.987832:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a548b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796527616:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147732.987855:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147732.987920:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794157056:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4408us (4861us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147732.987933:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8656 00000100:00100000:1.0:1746147732.988007:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794157312:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 194us (379us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147732.988014:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7642 00002000:00100000:1.0:1746147732.988019:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2297856->2301951) req@ffff8800a5489c00 x1830967794157312/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:353/0 lens 488/4536 e 0 to 0 dl 1746147743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147732.988027:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5489c00 with x1830967794157312 ext(2297856->2301951) 00002000:00010000:1.0:1746147732.988030:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5489c00 00000100:00100000:0.0:1746147733.085127:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.085184:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.085254:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794157440 00000100:00100000:1.0:1746147733.085264:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794157440 00000100:00100000:2.0:1746147733.085314:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794157568 00000100:00100000:2.0:1746147733.085323:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794157568 00000100:00100000:1.0:1746147733.085333:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16906 00000100:00100000:1.0:1746147733.085342:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1958:x1830967794157440:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147733.085361:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147733.085376:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16907 00010000:00010000:1.0:1746147733.085381:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a002c400/0xe64d3fbf12a7eb4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc59f expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.085383:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794157568:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.085398:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.085413:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a66aa800/0xe64d3fbf12a7eb56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc5a6 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.085436:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796527744:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147733.085460:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796527872:192.168.202.10@tcp:106: 00000100:00080000:0.0:1746147733.086715:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147733.086722:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147733.087477:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147733.087491:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147733.087540:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796527744:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147733.087543:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796527872:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147733.087569:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a66aa800/0xe64d3fbf12a7eb56 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5a6 expref: 24 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.087569:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a002c400/0xe64d3fbf12a7eb4f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc59f expref: 20 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147733.087581:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a66aa800/0xe64d3fbf12a7eb56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5a6 expref: 24 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.087583:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a002c400/0xe64d3fbf12a7eb4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc59f expref: 20 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.087605:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a002c400, rc 0) 00010000:00010000:2.0:1746147733.087609:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a66aa800, rc 0) 00000100:00100000:1.0:1746147733.087663:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1958:x1830967794157440:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2322us (2547us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147733.087672:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16906 00000100:00100000:2.0:1746147733.087782:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794157568:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2398us (2596us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147733.087790:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16907 00000100:00100000:0.0:1746147733.095746:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.095833:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794157696 00000100:00100000:2.0:1746147733.095845:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794157696 00000100:00100000:2.0:1746147733.096178:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16908 00000100:00100000:2.0:1746147733.096187:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:32494:x1830967794157696:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.096203:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.096219:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc5ad expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.096244:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 8 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.096256:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.096258:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.096261:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb5d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ad expref: 20 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.096286:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 8 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.096296:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 8 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.096307:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796528000:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.096387:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147733.100743:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796528000:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.100773:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb5d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ad expref: 20 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.100786:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147733.100787:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a66aba00, rc 0) 00000100:00100000:2.0:1746147733.100836:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:32494:x1830967794157696:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4650us (5100us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.100844:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16908 00000100:00100000:0.0:1746147733.100926:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794157824 00000100:00100000:0.0:1746147733.100933:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794157824 00002000:00100000:0.0:1746147733.100966:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1867776->2097151) req@ffff880135810e00 x1830967794157824/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147733.100974:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135810e00 with x1830967794157824 ext(1867776->2097151) 00010000:00010000:0.0:1746147733.100979:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 9 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.100990:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 9 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:0.0:1746147733.100996:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135810e00 00000100:00100000:0.0:1746147733.101027:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1547 00000100:00100000:0.0:1746147733.101033:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1957:x1830967794157824:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147733.113178:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967794157824:12345-192.168.202.10@tcp:4:cat.0 Request processed in 12133us (12381us total) trans 21474841647 rc 0/0 00000100:00100000:2.0:1746147733.113190:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1547 00002000:00100000:2.0:1746147733.113203:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1867776->2097151) req@ffff880135810e00 x1830967794157824/t21474841647(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/448 e 0 to 0 dl 1746147744 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.113211:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135810e00 with x1830967794157824 ext(1867776->2097151) 00010000:00010000:2.0:1746147733.113221:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 11 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.113235:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 11 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:2.0:1746147733.113241:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135810e00 00000100:00100000:1.0:1746147733.113459:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.114567:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794158080 00000100:00100000:3.0:1746147733.114576:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794158080 00002000:00100000:3.0:1746147733.114619:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (2072576->2076671) req@ffff880135812680 x1830967794158080/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.114627:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812680 with x1830967794158080 ext(2072576->2076671) 00002000:00010000:3.0:1746147733.114632:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135812680 00000100:00100000:3.0:1746147733.114684:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7643 00000100:00100000:3.0:1746147733.114691:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794158080:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147733.115071:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794158080:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 378us (1610us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147733.115078:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7643 00002000:00100000:3.0:1746147733.115083:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (2072576->2076671) req@ffff880135812680 x1830967794158080/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/4536 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.115089:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812680 with x1830967794158080 ext(2072576->2076671) 00002000:00010000:3.0:1746147733.115092:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135812680 00000100:00100000:0.0:1746147733.119574:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.119754:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794158208 00000100:00100000:2.0:1746147733.119762:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794158208 00010000:00010000:2.0:1746147733.119791:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 11 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.119827:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8657 00000100:00100000:2.0:1746147733.119835:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794158208:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147733.119847:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147733.119866:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 11 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.119881:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 11 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.119926:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a2a1e00/0xe64d3fbf12a7eb02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc552 expref: 11 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.119949:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.119951:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.119957:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ad expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.119964:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ad expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.119991:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ad expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.120002:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796528128:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147733.120869:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147733.122458:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796528128:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147733.122478:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147733.122507:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794158208:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2673us (2940us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.122517:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8657 00000100:00100000:0.0:1746147733.124880:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.125122:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794158464 00000100:00100000:3.0:1746147733.125130:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794158464 00002000:00100000:3.0:1746147733.125166:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a5488700 x1830967794158464/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.125174:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5488700 with x1830967794158464 ext(1048576->2097151) 00002000:00010000:3.0:1746147733.125178:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5488700 00000100:00100000:3.0:1746147733.125210:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7644 00000100:00100000:3.0:1746147733.125217:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1959:x1830967794158464:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147733.134218:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1959:x1830967794158464:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8988us (9331us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147733.134231:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7644 00002000:00100000:3.0:1746147733.134244:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a5488700 x1830967794158464/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.134253:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5488700 with x1830967794158464 ext(1048576->2097151) 00002000:00010000:3.0:1746147733.134259:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5488700 00000100:00100000:0.0:1746147733.146293:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.147469:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794158592 00000100:00100000:2.0:1746147733.147488:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794158592 00000100:00100000:2.0:1746147733.147551:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16909 00000100:00100000:2.0:1746147733.147560:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32494:x1830967794158592:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.147582:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.147603:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a913e600/0xe64d3fbf12a7eb64 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc5b4 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.147653:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 10 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.147660:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.147662:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.147666:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a913e600/0xe64d3fbf12a7eb64 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5b4 expref: 24 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.147699:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 10 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.147710:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 10 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.147723:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796528256:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.148372:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.148520:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.148667:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794158720 00000100:00100000:2.0:1746147733.148673:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794158720 00000100:00100000:0.0:1746147733.148676:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.148702:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794158976 00000100:00100000:2.0:1746147733.148704:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794158976 00000100:00100000:2.0:1746147733.148720:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16910 00000100:00100000:0.0:1746147733.148720:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.148726:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794158720:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.148736:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.148751:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a913ee00/0xe64d3fbf12a7eb6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc5bb expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.148780:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.148782:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.148789:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a913ee00/0xe64d3fbf12a7eb6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5bb expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147733.148803:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a913ee00/0xe64d3fbf12a7eb6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5bb expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147733.148813:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a913ee00, rc 0) 00000100:00100000:2.0:1746147733.148857:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794158720:12345-192.168.202.10@tcp:101:cat.0 Request processed in 129us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.148863:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16910 00000100:00100000:2.0:1746147733.148879:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794158848 00000100:00100000:2.0:1746147733.148904:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794158848 00000100:00100000:2.0:1746147733.148921:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16911 00000100:00100000:2.0:1746147733.148925:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794158976:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.148932:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.148939:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a913e200/0xe64d3fbf12a7eb72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc5c9 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.148974:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796528384:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147733.149029:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147733.149044:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16912 00000100:00100000:2.0:1746147733.149049:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794158848:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.149056:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.149067:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a913f400/0xe64d3fbf12a7eb79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc5c2 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.149093:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796528512:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147733.149781:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147733.152571:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796528256:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.152608:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a913e600/0xe64d3fbf12a7eb64 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5b4 expref: 24 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.152629:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a913e600, rc 0) 00000100:00100000:2.0:1746147733.152695:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32494:x1830967794158592:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5134us (6411us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.152703:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16909 00000100:00100000:0.0:1746147733.153328:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:3.0:1746147733.153346:0:8470:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime: 1746147733 -> 1746147734 00002000:00010000:3.0:1746147733.153350:0:8470:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime: 1746147733 -> 1746147734 00002000:00010000:3.0:1746147733.153353:0:8470:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime: 1746147733 -> 1746147734 00000100:00100000:3.0:1746147733.153376:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796528384:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147733.153408:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a913e200/0xe64d3fbf12a7eb72 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5c9 expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.153420:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a913e200/0xe64d3fbf12a7eb72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5c9 expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.153438:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a913e200, rc 0) 00000100:00100000:3.0:1746147733.153472:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794158976:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4546us (4797us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147733.153478:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16911 00000100:00100000:3.0:1746147733.153505:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794159104 00000100:00100000:3.0:1746147733.153513:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794159104 00002000:00100000:3.0:1746147733.153553:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2076671) req@ffff8800a548aa00 x1830967794159104/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.153562:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548aa00 with x1830967794159104 ext(1048576->2076671) 00010000:00010000:3.0:1746147733.153569:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 13 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.153587:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 13 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746147733.153594:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a548aa00 00000100:00100000:3.0:1746147733.153614:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1548 00000100:00100000:3.0:1746147733.153623:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794159104:12345-192.168.202.10@tcp:4:multiop.0 00002000:00010000:2.0:1746147733.154612:0:21480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime: 1746147733 -> 1746147734 00002000:00010000:2.0:1746147733.154617:0:21480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147733 -> 1746147734 00002000:00010000:2.0:1746147733.154619:0:21480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime: 1746147733 -> 1746147734 00000100:00100000:2.0:1746147733.154635:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796528512:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147733.154670:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a913f400/0xe64d3fbf12a7eb79 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5c2 expref: 13 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147733.154681:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a913f400/0xe64d3fbf12a7eb79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5c2 expref: 13 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147733.157413:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a913f400, rc 0) 00000100:00100000:2.0:1746147733.157490:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794158848:12345-192.168.202.10@tcp:101:cat.0 Request processed in 8433us (8763us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147733.157502:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16912 00000100:00100000:0.0:1746147733.169364:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.171734:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794159360 00000100:00100000:1.0:1746147733.171748:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794159360 00002000:00100000:1.0:1746147733.171795:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a548b100 x1830967794159360/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.171805:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548b100 with x1830967794159360 ext(1048576->2097151) 00002000:00010000:1.0:1746147733.171812:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a548b100 00000100:00100000:1.0:1746147733.171840:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7645 00000100:00100000:1.0:1746147733.171847:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794159360:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147733.181747:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794159104:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 28113us (28407us total) trans 17179874408 rc 0/0 00000100:00100000:3.0:1746147733.181762:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1548 00002000:00100000:3.0:1746147733.181776:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2076671) req@ffff8800a548aa00 x1830967794159104/t17179874408(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/448 e 0 to 0 dl 1746147744 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.181786:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548aa00 with x1830967794159104 ext(1048576->2076671) 00010000:00010000:3.0:1746147733.181796:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 13 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.181814:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 13 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746147733.181821:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a548aa00 00000100:00100000:2.0:1746147733.182629:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794159360:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10776us (13275us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147733.182637:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7645 00002000:00100000:2.0:1746147733.182654:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a548b100 x1830967794159360/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.182663:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548b100 with x1830967794159360 ext(1048576->2097151) 00002000:00010000:2.0:1746147733.182667:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a548b100 00000100:00100000:0.0:1746147733.187158:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.187282:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794159488 00000100:00100000:3.0:1746147733.187292:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794159488 00010000:00010000:3.0:1746147733.187333:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 13 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147733.188021:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8658 00000100:00100000:3.0:1746147733.188032:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794159488:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147733.188047:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147733.188068:0:7095:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147733 -> 1746147734 00002000:00010000:3.0:1746147733.188071:0:7095:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147733 -> 1746147734 00010000:00010000:3.0:1746147733.188077:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 13 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.188089:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 13 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.188111:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095235a00/0xe64d3fbf12a7eb09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1544191) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc559 expref: 13 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.188926:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.188930:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.188942:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a913e600/0xe64d3fbf12a7eb64 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5b4 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.188954:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a913e600/0xe64d3fbf12a7eb64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5b4 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.189014:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147733.189060:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a913e600/0xe64d3fbf12a7eb64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5b4 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.189079:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796528640:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147733.189162:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147733.189594:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794159616 00000100:00100000:2.0:1746147733.189601:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794159616 00000100:00100000:2.0:1746147733.189640:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16913 00000100:00100000:2.0:1746147733.189658:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32498:x1830967794159616:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.189672:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.189685:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7eb80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc5d0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.189701:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.189702:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.189706:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7eb80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5d0 expref: 14 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.189717:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7eb80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5d0 expref: 14 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.189724:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5653800, rc 0) 00000100:00100000:2.0:1746147733.189752:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32498:x1830967794159616:12345-192.168.202.10@tcp:101:cat.0 Request processed in 95us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.189759:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16913 00000100:00100000:3.0:1746147733.190120:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796528640:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147733.190137:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147733.190155:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794159488:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2126us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.190163:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8658 00000100:00100000:0.0:1746147733.192275:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.192330:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794159872 00000100:00100000:2.0:1746147733.192339:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794159872 00002000:00100000:2.0:1746147733.192384:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a5488000 x1830967794159872/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.192395:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5488000 with x1830967794159872 ext(1048576->2097151) 00002000:00010000:2.0:1746147733.192400:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5488000 00000100:00100000:2.0:1746147733.192434:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7646 00000100:00100000:2.0:1746147733.192443:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794159872:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147733.194258:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.195821:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794160128 00000100:00100000:3.0:1746147733.195837:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794160128 00002000:00100000:3.0:1746147733.195970:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a548ad80 x1830967794160128/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.195981:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548ad80 with x1830967794160128 ext(1048576->2097151) 00002000:00010000:3.0:1746147733.196324:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a548ad80 00000100:00100000:3.0:1746147733.196350:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7647 00000100:00100000:3.0:1746147733.196360:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794160128:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147733.201541:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794159872:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9087us (9263us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147733.201555:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7646 00002000:00100000:2.0:1746147733.201566:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a5488000 x1830967794159872/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.201576:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5488000 with x1830967794159872 ext(1048576->2097151) 00002000:00010000:2.0:1746147733.201582:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5488000 00000100:00100000:3.0:1746147733.203659:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794160128:12345-192.168.202.10@tcp:3:cat.0 Request processed in 7281us (9387us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147733.203673:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7647 00002000:00100000:3.0:1746147733.203683:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a548ad80 x1830967794160128/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.203692:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548ad80 with x1830967794160128 ext(1048576->2097151) 00002000:00010000:3.0:1746147733.203697:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a548ad80 00000100:00100000:0.0:1746147733.207266:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.207329:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.207431:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794160384 00000100:00100000:2.0:1746147733.207441:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794160384 00000100:00100000:3.0:1746147733.208261:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794160256 00000100:00100000:3.0:1746147733.208267:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794160256 00000100:00100000:3.0:1746147733.208304:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16914 00000100:00100000:0.0:1746147733.208311:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16915 00000100:00100000:3.0:1746147733.208312:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967794160384:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:0.0:1746147733.208318:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967794160256:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147733.208330:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147733.208330:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.208348:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7eb87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc5de expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.208348:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348e5200/0xe64d3fbf12a7eb8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc5d7 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.208397:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796528896:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147733.208397:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a548b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796528768:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147733.208757:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.208784:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147733.211783:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a548b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796528768:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147733.211822:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801348e5200/0xe64d3fbf12a7eb8e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5d7 expref: 14 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.211838:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348e5200/0xe64d3fbf12a7eb8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5d7 expref: 14 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.211871:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801348e5200, rc 0) 00000100:00100000:1.0:1746147733.211948:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967794160256:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3629us (4617us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147733.211958:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16915 00000100:00100000:3.0:1746147733.212034:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796528896:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147733.212057:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7eb87 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5de expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.212067:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7eb87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5de expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.212078:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55e8400, rc 0) 00000100:00100000:3.0:1746147733.212096:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967794160384:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3786us (4842us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147733.212101:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16914 00000100:00100000:0.0:1746147733.215548:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.215622:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.215709:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.215782:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794160640 00000100:00100000:3.0:1746147733.215795:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794160640 00000100:00100000:2.0:1746147733.215827:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794160768 00000100:00100000:2.0:1746147733.215831:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794160768 00002000:00100000:3.0:1746147733.215842:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3477503) req@ffff8800a548b480 x1830967794160640/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 504/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.215853:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548b480 with x1830967794160640 ext(2097152->3477503) 00002000:00010000:3.0:1746147733.215859:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a548b480 00000100:00100000:2.0:1746147733.215864:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16916 00000100:00100000:3.0:1746147733.215870:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794161024 00000100:00100000:2.0:1746147733.215870:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32498:x1830967794160768:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147733.215873:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794161024 00010000:00010000:2.0:1746147733.215898:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746147733.215899:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3477504->4194303) req@ffff8800943c4000 x1830967794161024/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.215905:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4000 with x1830967794161024 ext(3477504->4194303) 00002000:00010000:3.0:1746147733.215907:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c4000 00010000:00010000:2.0:1746147733.215914:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7eb95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc5e5 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.215925:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7648 00000100:00100000:3.0:1746147733.215930:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794160640:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:2.0:1746147733.215944:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 25 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.215952:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.215953:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.215956:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7eb95 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5e5 expref: 14 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.215991:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 25 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.216003:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 25 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.216015:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796529024:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.216081:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147733.216101:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1549 00000100:00100000:2.0:1746147733.216106:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794161024:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147733.216275:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.216289:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794161280 00000100:00100000:3.0:1746147733.216292:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794161280 00000100:00100000:0.0:1746147733.216332:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.216343:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794161536 00000100:00100000:0.0:1746147733.216345:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794161536 00002000:00100000:0.0:1746147733.216360:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3350528->4194303) req@ffff8800943c4380 x1830967794161536/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147733.216367:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4380 with x1830967794161536 ext(3350528->4194303) 00002000:00010000:0.0:1746147733.216370:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c4380 00002000:00100000:3.0:1746147733.216385:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (2301952->3350527) req@ffff8800943c5880 x1830967794161280/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147733.216388:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7650 00002000:00100000:3.0:1746147733.216392:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5880 with x1830967794161280 ext(2301952->3350527) 00000100:00100000:0.0:1746147733.216393:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794161536:12345-192.168.202.10@tcp:3:cat.0 00002000:00010000:3.0:1746147733.216394:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c5880 00000100:00100000:2.0:1746147733.216417:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7651 00000100:00100000:2.0:1746147733.216424:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794161280:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147733.224073:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.224265:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794161664 00000100:00100000:2.0:1746147733.224270:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796529024:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147733.224273:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794161664 00010000:00010000:2.0:1746147733.224302:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7eb95 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5e5 expref: 14 pid: 8470 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147733.224316:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (2813952->3145727) req@ffff8800943c5180 x1830967794161664/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147733.224324:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5652a00, rc 0) 00002000:00100000:3.0:1746147733.224326:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5180 with x1830967794161664 ext(2813952->3145727) 00010000:00010000:3.0:1746147733.224333:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 28 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.224346:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 28 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746147733.224357:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800943c5180 00000100:00100000:2.0:1746147733.224384:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32498:x1830967794160768:12345-192.168.202.10@tcp:101:cat.0 Request processed in 8510us (8762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.224392:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16916 00000100:00100000:2.0:1746147733.224430:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1550 00000100:00100000:2.0:1746147733.224436:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794161664:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147733.231187:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794161536:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14780us (14841us total) trans 0 rc 843776/843776 00000100:00100000:1.0:1746147733.231199:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7650 00002000:00100000:1.0:1746147733.231211:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3350528->4194303) req@ffff8800943c4380 x1830967794161536/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.231220:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4380 with x1830967794161536 ext(3350528->4194303) 00002000:00010000:1.0:1746147733.231226:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c4380 00000100:00100000:3.0:1746147733.241402:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1957:x1830967794161280:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24966us (25113us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147733.241415:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7651 00002000:00100000:3.0:1746147733.241427:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2301952->3350527) req@ffff8800943c5880 x1830967794161280/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.241437:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5880 with x1830967794161280 ext(2301952->3350527) 00002000:00010000:3.0:1746147733.241443:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c5880 00000100:00100000:3.0:1746147733.241953:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1958:x1830967794160640:12345-192.168.202.10@tcp:3:cat.0 Request processed in 26021us (27369us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147733.241960:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7648 00002000:00100000:3.0:1746147733.241966:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3477503) req@ffff8800a548b480 x1830967794160640/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 504/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.241973:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a548b480 with x1830967794160640 ext(2097152->3477503) 00010000:00010000:3.0:1746147733.241982:0:31356:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 28 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.241996:0:31356:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 28 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746147733.242003:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a548b480 00000100:00100000:3.0:1746147733.242375:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967794161024:12345-192.168.202.10@tcp:3:cat.0 Request processed in 26267us (26665us total) trans 0 rc 716800/716800 00000100:00100000:3.0:1746147733.242384:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1549 00002000:00100000:3.0:1746147733.242390:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3477504->4194303) req@ffff8800943c4000 x1830967794161024/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:H/200/0 rc 716800/716800 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.242397:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4000 with x1830967794161024 ext(3477504->4194303) 00010000:00010000:3.0:1746147733.242401:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 26 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.242409:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 26 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746147733.242414:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800943c4000 00000100:00100000:2.0:1746147733.242725:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794161664:12345-192.168.202.10@tcp:4:cat.0 Request processed in 18287us (18662us total) trans 17179874409 rc 0/0 00000100:00100000:2.0:1746147733.242732:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1550 00002000:00100000:2.0:1746147733.242738:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2813952->3145727) req@ffff8800943c5180 x1830967794161664/t17179874409(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/448 e 0 to 0 dl 1746147744 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.242746:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5180 with x1830967794161664 ext(2813952->3145727) 00010000:00010000:2.0:1746147733.242751:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 26 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.242762:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 26 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:2.0:1746147733.242768:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800943c5180 00000100:00100000:0.0:1746147733.247155:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.247236:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794161792 00000100:00100000:2.0:1746147733.247246:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794161792 00000100:00100000:2.0:1746147733.247349:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16917 00000100:00100000:2.0:1746147733.247358:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32494:x1830967794161792:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.247379:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.247397:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7eb9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc5ec expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.247426:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.247429:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.247433:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7eb9c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ec expref: 27 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.247445:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7eb9c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ec expref: 27 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.247456:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5def400, rc 0) 00000100:00100000:2.0:1746147733.247690:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:32494:x1830967794161792:12345-192.168.202.10@tcp:101:cat.0 Request processed in 333us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.247696:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16917 00000100:00100000:0.0:1746147733.249433:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.249503:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794161920 00000100:00100000:3.0:1746147733.249512:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794161920 00010000:00010000:3.0:1746147733.249546:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 27 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147733.249587:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8659 00000100:00100000:3.0:1746147733.249595:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967794161920:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147733.250030:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147733.250064:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 27 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.250081:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 27 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.250106:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a66abe00/0xe64d3fbf12a7eb41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc591 expref: 27 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.250137:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.250139:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.250265:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7eb95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5e5 expref: 13 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.250275:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7eb95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5e5 expref: 13 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.250283:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.250284:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.250288:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7eb9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ec expref: 26 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.250295:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7eb9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ec expref: 26 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.250327:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7eb9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ec expref: 26 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.250339:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796529152:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147733.250991:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7eb95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5e5 expref: 13 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.251006:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796529280:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147733.251027:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147733.256673:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796529152:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147733.256877:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796529280:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147733.256880:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147733.256928:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147733.256979:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967794161920:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7383us (7554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.256989:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8659 00000100:00100000:2.0:1746147733.257127:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794162176 00000100:00100000:2.0:1746147733.257135:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794162176 00002000:00100000:2.0:1746147733.257178:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800943c7480 x1830967794162176/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.257188:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c7480 with x1830967794162176 ext(2097152->3145727) 00002000:00010000:2.0:1746147733.257193:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c7480 00000100:00100000:2.0:1746147733.257225:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7652 00000100:00100000:2.0:1746147733.257232:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794162176:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147733.258831:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.258903:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794162432 00000100:00100000:3.0:1746147733.258909:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794162432 00002000:00100000:3.0:1746147733.258937:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880135813800 x1830967794162432/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.258945:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135813800 with x1830967794162432 ext(3145728->4194303) 00002000:00010000:3.0:1746147733.258950:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135813800 00000100:00100000:3.0:1746147733.258979:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7653 00000100:00100000:3.0:1746147733.258986:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967794162432:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147733.275785:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794162176:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18541us (18899us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147733.275802:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7652 00002000:00100000:2.0:1746147733.275814:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800943c7480 x1830967794162176/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.275823:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c7480 with x1830967794162176 ext(2097152->3145727) 00002000:00010000:2.0:1746147733.275830:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c7480 00000100:00100000:3.0:1746147733.275949:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967794162432:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16962us (17123us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147733.275955:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7653 00002000:00100000:3.0:1746147733.275961:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880135813800 x1830967794162432/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.275967:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135813800 with x1830967794162432 ext(3145728->4194303) 00002000:00010000:3.0:1746147733.275970:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135813800 00000100:00100000:0.0:1746147733.278560:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.278869:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794162560 00000100:00100000:2.0:1746147733.278879:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794162560 00000100:00100000:2.0:1746147733.278967:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16918 00000100:00100000:2.0:1746147733.278975:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32498:x1830967794162560:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.278993:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.279011:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7eba3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc5f3 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.279041:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.279047:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.279049:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.279052:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7eba3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5f3 expref: 12 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.279081:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.279091:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 19 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.279107:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796529408:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.279192:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.280208:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.280782:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794162688 00000100:00100000:1.0:1746147733.280790:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794162688 00000100:00100000:1.0:1746147733.280841:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16919 00000100:00100000:1.0:1746147733.280848:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32500:x1830967794162688:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147733.280862:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147733.280878:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc5fa expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.280929:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7eaae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f0 expref: 13 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.280937:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a925ea00/0xe64d3fbf12a7eac3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc513 expref: 27 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.280943:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.280945:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.280948:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 5/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [360448->1028095] (req 360448->1028095) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 27 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.280975:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a925ea00/0xe64d3fbf12a7eac3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc513 expref: 27 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.280985:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a925ea00/0xe64d3fbf12a7eac3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc513 expref: 27 pid: 8184 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746147733.280995:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796529536:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147733.281912:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.282092:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794162944 00000100:00100000:3.0:1746147733.282098:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794162944 00010000:00010000:1.0:1746147733.282123:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7eaae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f0 expref: 13 pid: 6715 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147733.282127:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16920 00000100:00100000:3.0:1746147733.282133:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:32494:x1830967794162944:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147733.282135:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7eaae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f0 expref: 13 pid: 6715 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147733.282143:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147733.282151:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796529664:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147733.282155:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ebb1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc601 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.282171:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147733.282173:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147733.282176:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ebb1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc601 expref: 21 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.282185:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ebb1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc601 expref: 21 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.282194:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943ccc00 going to sleep for 11 seconds 00010000:00010000:3.0:1746147733.282195:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55e8400, rc 0) 00000100:00100000:3.0:1746147733.282217:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32494:x1830967794162944:12345-192.168.202.10@tcp:101:cat.0 Request processed in 84us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.282223:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16920 00000100:00100000:2.0:1746147733.282392:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796529408:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.282414:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7eba3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5f3 expref: 12 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.282422:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dee400, rc 0) 00000100:00100000:2.0:1746147733.282438:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32498:x1830967794162560:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3465us (3890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.282443:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16918 00000100:00100000:1.0:1746147733.282588:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796529536:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147733.282938:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.282990:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794162816 00000100:00100000:3.0:1746147733.282993:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794162816 00002000:00100000:3.0:1746147733.283019:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2097152->2301951) req@ffff8800943c5c00 x1830967794162816/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.283026:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5c00 with x1830967794162816 ext(2097152->2301951) 00010000:00010000:3.0:1746147733.283031:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 21 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.283039:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 21 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746147733.283043:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800943c5c00 00000100:00100000:3.0:1746147733.283106:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1551 00000100:00100000:3.0:1746147733.283110:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794162816:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:1.0:1746147733.283628:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796529664:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147733.283667:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [360448->1028095] (req 360448->1028095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 27 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.283682:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0562a00, rc 0) 00000100:00100000:1.0:1746147733.283805:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:32500:x1830967794162688:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2956us (3601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.283815:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16919 00000100:00100000:0.0:1746147733.285601:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.285976:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.286125:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794163072 00000100:00100000:1.0:1746147733.286134:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794163072 00010000:00010000:1.0:1746147733.286164:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925ea00/0xe64d3fbf12a7eac3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc513 expref: 27 pid: 8184 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746147733.286204:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794163200 00000100:00100000:1.0:1746147733.286207:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794163200 00010000:00010000:1.0:1746147733.286219:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7eaae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f0 expref: 14 pid: 6715 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746147733.286235:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8660 00000100:00100000:1.0:1746147733.286241:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794163072:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147733.286251:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147733.286269:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a925ea00/0xe64d3fbf12a7eac3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc513 expref: 27 pid: 8184 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746147733.286279:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a925ea00/0xe64d3fbf12a7eac3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc513 expref: 27 pid: 8184 timeout: 912 lvb_type: 1 00000100:00100000:3.0:1746147733.286281:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8661 00000100:00100000:3.0:1746147733.286292:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1957:x1830967794163200:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147733.286297:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a925ea00/0xe64d3fbf12a7eac3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc513 expref: 27 pid: 8184 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147733.286305:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147733.286324:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7eaae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f0 expref: 14 pid: 6715 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746147733.286331:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147733.286335:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7eaae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f0 expref: 14 pid: 6715 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147733.286352:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c9f5000/0xe64d3fbf12a7eaae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f0 expref: 14 pid: 6715 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746147733.286365:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794163072:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 124us (771us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147733.286369:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.286370:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147733.286371:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8660 00010000:00010000:3.0:1746147733.286376:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 360448->1028095) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.286383:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 360448->1028095) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 25 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.287609:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 360448->1028095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 25 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.287626:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796529792:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147733.289354:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147733.289778:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796529792:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147733.289806:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147733.289858:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967794163200:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3567us (3879us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.289868:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8661 00000100:00100000:0.0:1746147733.290593:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.290914:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794162816:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 7800us (7973us total) trans 21474841648 rc 0/0 00000100:00100000:3.0:1746147733.290923:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1551 00002000:00100000:3.0:1746147733.290933:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2097152->2301951) req@ffff8800943c5c00 x1830967794162816/t21474841648(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/448 e 0 to 0 dl 1746147744 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.290942:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5c00 with x1830967794162816 ext(2097152->2301951) 00010000:00010000:3.0:1746147733.290951:0:31354:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 23 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.290966:0:31354:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 23 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746147733.290972:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800943c5c00 00000100:00100000:3.0:1746147733.291196:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794163456 00000100:00100000:3.0:1746147733.291204:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794163456 00002000:00100000:3.0:1746147733.291239:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (360448->364543) req@ffff8800943c7b80 x1830967794163456/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.291246:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c7b80 with x1830967794163456 ext(360448->364543) 00002000:00010000:3.0:1746147733.291249:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c7b80 00000100:00100000:3.0:1746147733.291266:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7654 00000100:00100000:3.0:1746147733.291273:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794163456:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147733.291435:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794163456:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 162us (845us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147733.291440:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7654 00002000:00100000:3.0:1746147733.291445:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (360448->364543) req@ffff8800943c7b80 x1830967794163456/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/4536 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.291450:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c7b80 with x1830967794163456 ext(360448->364543) 00002000:00010000:3.0:1746147733.291453:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c7b80 00000100:00100000:0.0:1746147733.296606:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.296809:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794163584 00000100:00100000:2.0:1746147733.296818:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794163584 00010000:00010000:2.0:1746147733.296849:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 23 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.296903:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8662 00000100:00100000:2.0:1746147733.296910:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794163584:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147733.296923:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147733.296942:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 23 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.296954:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 23 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.296972:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a66ab400/0xe64d3fbf12a7eb48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc598 expref: 23 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.297562:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.297564:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.297571:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7eba3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5f3 expref: 11 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.297579:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7eba3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5f3 expref: 11 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.297587:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.297588:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.297591:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ebb1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc601 expref: 22 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.297597:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ebb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc601 expref: 22 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.297623:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ebb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc601 expref: 22 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.297634:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796529920:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147733.298063:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7eba3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5f3 expref: 11 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.298073:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796530048:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147733.298253:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.304064:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.304113:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.304134:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796529920:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147733.304145:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796530048:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147733.304168:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147733.304203:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794163840 00000100:00100000:3.0:1746147733.304210:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794163840 00000100:00100000:2.0:1746147733.304217:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967794163584:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7307us (7618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.304227:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8662 00002000:00100000:3.0:1746147733.304247:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (1024000->1028095) req@ffff8800943c6a00 x1830967794163840/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.304257:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c6a00 with x1830967794163840 ext(1024000->1028095) 00002000:00010000:3.0:1746147733.304262:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c6a00 00000100:00100000:3.0:1746147733.304290:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794164096 00000100:00100000:3.0:1746147733.304293:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794164096 00002000:00100000:3.0:1746147733.304303:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800943c5500 x1830967794164096/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.304309:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5500 with x1830967794164096 ext(3145728->4194303) 00002000:00010000:3.0:1746147733.304311:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c5500 00000100:00100000:3.0:1746147733.304319:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7655 00000100:00100000:3.0:1746147733.304324:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794163840:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147733.304394:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7656 00000100:00100000:1.0:1746147733.304404:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794164096:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147733.305009:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794163840:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 684us (952us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147733.305016:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7655 00002000:00100000:3.0:1746147733.305021:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (1024000->1028095) req@ffff8800943c6a00 x1830967794163840/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/4536 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.305027:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c6a00 with x1830967794163840 ext(1024000->1028095) 00002000:00010000:3.0:1746147733.305030:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c6a00 00000100:00100000:0.0:1746147733.312501:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.312951:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.313564:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.314547:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794164480 00000100:00100000:3.0:1746147733.314556:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794164480 00002000:00100000:3.0:1746147733.314593:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800943c4700 x1830967794164480/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.314607:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4700 with x1830967794164480 ext(3145728->4194303) 00002000:00010000:3.0:1746147733.314612:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c4700 00000100:00100000:1.0:1746147733.314682:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794164608 00000100:00100000:1.0:1746147733.314687:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794164608 00000100:00100000:2.0:1746147733.314694:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794164736 00000100:00100000:2.0:1746147733.314698:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794164736 00002000:00100000:1.0:1746147733.314706:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800941b0000 x1830967794164608/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.314713:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b0000 with x1830967794164608 ext(2097152->3145727) 00002000:00100000:2.0:1746147733.314716:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800941b0380 x1830967794164736/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746147733.314716:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b0000 00002000:00100000:2.0:1746147733.314723:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b0380 with x1830967794164736 ext(3145728->4194303) 00002000:00010000:2.0:1746147733.314726:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b0380 00000100:00100000:1.0:1746147733.314738:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7657 00000100:00100000:1.0:1746147733.314744:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794164480:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147733.316165:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794164096:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 11762us (12049us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147733.316213:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7658 00000100:00100000:2.0:1746147733.316222:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794164608:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147733.317391:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7659 00000100:00100000:2.0:1746147733.317399:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794164736:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147733.319406:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7656 00002000:00100000:0.0:1746147733.319421:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800943c5500 x1830967794164096/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147733.319431:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5500 with x1830967794164096 ext(3145728->4194303) 00002000:00010000:0.0:1746147733.319437:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c5500 00000100:00100000:2.0:1746147733.329587:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.329707:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794165120 00000100:00100000:3.0:1746147733.329715:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794165120 00002000:00100000:3.0:1746147733.329751:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88012ee5a300 x1830967794165120/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.329761:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee5a300 with x1830967794165120 ext(4194304->5017599) 00002000:00010000:3.0:1746147733.329766:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee5a300 00000100:00100000:3.0:1746147733.329797:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7660 00000100:00100000:3.0:1746147733.329804:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967794165120:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147733.330069:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794164480:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15323us (17574us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147733.330076:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7657 00002000:00100000:1.0:1746147733.330082:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800943c4700 x1830967794164480/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.330089:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4700 with x1830967794164480 ext(3145728->4194303) 00002000:00010000:1.0:1746147733.330092:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c4700 00000100:00100000:2.0:1746147733.336179:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794164608:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19951us (23221us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147733.336190:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7658 00002000:00100000:2.0:1746147733.336201:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800941b0000 x1830967794164608/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.336209:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b0000 with x1830967794164608 ext(2097152->3145727) 00002000:00010000:2.0:1746147733.336214:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b0000 00000100:00100000:2.0:1746147733.338591:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1958:x1830967794164736:12345-192.168.202.10@tcp:3:cat.0 Request processed in 21184us (25019us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147733.338601:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7659 00002000:00100000:2.0:1746147733.338609:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800941b0380 x1830967794164736/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.338617:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b0380 with x1830967794164736 ext(3145728->4194303) 00002000:00010000:2.0:1746147733.338621:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b0380 00000100:00100000:3.0:1746147733.341249:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967794165120:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11438us (11663us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746147733.341259:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7660 00002000:00100000:3.0:1746147733.341267:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88012ee5a300 x1830967794165120/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.341281:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee5a300 with x1830967794165120 ext(4194304->5017599) 00002000:00010000:3.0:1746147733.341286:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee5a300 00000100:00100000:0.0:1746147733.345744:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.345811:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794165248 00000100:00100000:1.0:1746147733.345819:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794165248 00000100:00100000:1.0:1746147733.345871:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16921 00000100:00100000:1.0:1746147733.345879:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967794165248:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147733.345926:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147733.345941:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0267600/0xe64d3fbf12a7ebb8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc608 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.345996:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796530176:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147733.346081:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943ccf00 going to sleep for 11 seconds 00002000:00010000:1.0:1746147733.351032:0:10613:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime: 1746147733 -> 1746147734 00002000:00010000:1.0:1746147733.351039:0:10613:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime: 1746147732 -> 1746147734 00002000:00010000:1.0:1746147733.351041:0:10613:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime: 1746147733 -> 1746147734 00000100:00100000:1.0:1746147733.351060:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796530176:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147733.351086:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0267600/0xe64d3fbf12a7ebb8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc608 expref: 14 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.351098:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0267600/0xe64d3fbf12a7ebb8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc608 expref: 14 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.351170:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0267600, rc 0) 00000100:00100000:1.0:1746147733.351465:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967794165248:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5586us (6205us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147733.351473:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16921 00000100:00100000:0.0:1746147733.356250:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.356347:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794165376 00000100:00100000:1.0:1746147733.356355:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794165376 00000100:00100000:1.0:1746147733.356404:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16922 00000100:00100000:1.0:1746147733.356411:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32502:x1830967794165376:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147733.356426:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147733.356441:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc60f expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.356466:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 360448->1028095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 25 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.356473:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147733.356475:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147733.356478:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [520192->1048575] (req 520192->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 14 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.356504:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 360448->1028095) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 25 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.356514:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 360448->1028095) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 25 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147733.356525:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796530304:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147733.356599:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943ccf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.364027:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.364089:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794165632 00000100:00100000:3.0:1746147733.364097:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794165632 00000100:00100000:0.0:1746147733.364123:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00100000:3.0:1746147733.364136:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800941b1c00 x1830967794165632/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.364145:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b1c00 with x1830967794165632 ext(4194304->5017599) 00002000:00010000:3.0:1746147733.364149:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800941b1c00 00000100:00100000:3.0:1746147733.364164:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794165760 00000100:00100000:3.0:1746147733.364166:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794165760 00002000:00100000:3.0:1746147733.364176:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (360448->1028095) req@ffff8800941b2300 x1830967794165760/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.364181:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b2300 with x1830967794165760 ext(360448->1028095) 00010000:00010000:3.0:1746147733.364188:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 360448->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 26 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.364200:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 360448->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 26 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746147733.364205:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800941b2300 00000100:00100000:3.0:1746147733.364223:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1552 00000100:00100000:3.0:1746147733.364228:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794165760:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147733.364392:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796530304:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147733.364411:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [520192->1048575] (req 520192->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 15 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.364423:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0266e00, rc 0) 00000100:00100000:2.0:1746147733.364749:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7661 00000100:00100000:2.0:1746147733.364756:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1957:x1830967794165632:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147733.365243:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32502:x1830967794165376:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 8831us (8999us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.365250:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16922 00000100:00100000:3.0:1746147733.376494:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794165760:12345-192.168.202.10@tcp:4:cat.0 Request processed in 12257us (12361us total) trans 17179874410 rc 0/0 00000100:00100000:3.0:1746147733.376510:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1552 00002000:00100000:3.0:1746147733.376521:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (360448->1028095) req@ffff8800941b2300 x1830967794165760/t17179874410(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/448 e 0 to 0 dl 1746147744 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.376530:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b2300 with x1830967794165760 ext(360448->1028095) 00010000:00010000:3.0:1746147733.376539:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 360448->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 28 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.376554:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 360448->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 28 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746147733.376561:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800941b2300 00000100:00100000:0.0:1746147733.378494:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.378739:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1957:x1830967794165632:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13982us (14716us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147733.378750:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7661 00002000:00100000:2.0:1746147733.378757:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800941b1c00 x1830967794165632/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.378765:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b1c00 with x1830967794165632 ext(4194304->5017599) 00002000:00010000:2.0:1746147733.378770:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800941b1c00 00000100:00100000:3.0:1746147733.378922:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794165888 00000100:00100000:3.0:1746147733.378929:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794165888 00010000:00010000:3.0:1746147733.378951:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 360448->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 28 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147733.378986:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8663 00000100:00100000:3.0:1746147733.378992:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967794165888:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147733.379003:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147733.379015:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 360448->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 28 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.379024:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 360448->1028095) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 28 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.379047:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0562a00/0xe64d3fbf12a7ebaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 360448->1028095) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5fa expref: 28 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.379065:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.379067:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.379074:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.379082:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.379108:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.379118:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796530432:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147733.379171:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.380912:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.380959:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794166144 00000100:00100000:2.0:1746147733.380964:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794166144 00002000:00100000:2.0:1746147733.380991:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (520192->524287) req@ffff8800941b2d80 x1830967794166144/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.380999:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b2d80 with x1830967794166144 ext(520192->524287) 00002000:00010000:2.0:1746147733.381003:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800941b2d80 00000100:00100000:2.0:1746147733.381017:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7662 00000100:00100000:2.0:1746147733.381023:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794166144:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147733.381123:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796530432:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147733.381141:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147733.381446:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794166144:12345-192.168.202.10@tcp:3:cat.0 Request processed in 421us (535us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147733.381453:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7662 00000100:00100000:3.0:1746147733.381456:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967794165888:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2464us (2966us total) trans 0 rc 0/0 00002000:00100000:2.0:1746147733.381458:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (520192->524287) req@ffff8800941b2d80 x1830967794166144/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/4536 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147733.381463:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8663 00002000:00100000:2.0:1746147733.381464:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b2d80 with x1830967794166144 ext(520192->524287) 00002000:00010000:2.0:1746147733.381467:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800941b2d80 00000100:00100000:0.0:1746147733.390995:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.391040:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794166272 00000100:00100000:1.0:1746147733.391047:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794166272 00000100:00100000:1.0:1746147733.391151:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16923 00000100:00100000:1.0:1746147733.391158:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32502:x1830967794166272:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147733.391174:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147733.391189:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc616 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.391213:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915e6200/0xe64d3fbf12a7eab5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f7 expref: 13 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.391220:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915e6c00/0xe64d3fbf12a7eaca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc51a expref: 21 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.391225:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.391227:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.391230:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->1363967] (req 1048576->1363967) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.391253:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800915e6c00/0xe64d3fbf12a7eaca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc51a expref: 21 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.391264:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800915e6c00/0xe64d3fbf12a7eaca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc51a expref: 21 pid: 7050 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746147733.391274:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796530560:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147733.391760:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800915e6200/0xe64d3fbf12a7eab5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f7 expref: 13 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.391768:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800915e6200/0xe64d3fbf12a7eab5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f7 expref: 13 pid: 7050 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746147733.391780:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796530688:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147733.391797:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943ccf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147733.394466:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796530560:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147733.394477:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796530688:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147733.394497:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->1363967] (req 1048576->1363967) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.394510:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0267000, rc 0) 00000100:00100000:1.0:1746147733.394553:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32502:x1830967794166272:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3394us (3566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.394560:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16923 00000100:00100000:0.0:1746147733.397994:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.398046:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.398106:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794166400 00000100:00100000:1.0:1746147733.398114:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794166400 00010000:00010000:1.0:1746147733.398144:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800915e6200/0xe64d3fbf12a7eab5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f7 expref: 13 pid: 7050 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746147733.398170:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794166528 00000100:00100000:1.0:1746147733.398172:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794166528 00010000:00010000:1.0:1746147733.398185:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800915e6c00/0xe64d3fbf12a7eaca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc51a expref: 22 pid: 7050 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746147733.398194:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8664 00000100:00100000:0.0:1746147733.398203:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794166400:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147733.398216:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147733.398236:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800915e6200/0xe64d3fbf12a7eab5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f7 expref: 13 pid: 7050 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746147733.398245:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800915e6200/0xe64d3fbf12a7eab5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f7 expref: 13 pid: 7050 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746147733.398264:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915e6200/0xe64d3fbf12a7eab5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4f7 expref: 13 pid: 7050 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746147733.398273:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8665 00000100:00100000:1.0:1746147733.398279:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794166528:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147733.398279:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147733.398286:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147733.398296:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800915e6c00/0xe64d3fbf12a7eaca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc51a expref: 22 pid: 7050 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746147733.398304:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800915e6c00/0xe64d3fbf12a7eaca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc51a expref: 22 pid: 7050 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746147733.398306:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794166400:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 106us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147733.398312:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8664 00010000:00010000:1.0:1746147733.398316:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915e6c00/0xe64d3fbf12a7eaca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc51a expref: 22 pid: 7050 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746147733.398593:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.398595:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.398601:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 11 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.398609:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 11 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.398636:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 11 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.398658:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796530816:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147733.399149:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943ccf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147733.401142:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796530816:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147733.401159:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147733.401189:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794166528:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2910us (3142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.401197:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8665 00000100:00100000:0.0:1746147733.408845:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.410162:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794166784 00000100:00100000:2.0:1746147733.410172:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794166784 00002000:00100000:2.0:1746147733.410211:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1359872->1363967) req@ffff8800941b1f80 x1830967794166784/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.410219:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b1f80 with x1830967794166784 ext(1359872->1363967) 00002000:00010000:2.0:1746147733.410224:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b1f80 00000100:00100000:2.0:1746147733.410253:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7663 00000100:00100000:2.0:1746147733.410258:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794166784:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147733.410414:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794166784:12345-192.168.202.10@tcp:3:cat.0 Request processed in 154us (1575us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147733.410427:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7663 00002000:00100000:2.0:1746147733.410432:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1359872->1363967) req@ffff8800941b1f80 x1830967794166784/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/4536 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.410439:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b1f80 with x1830967794166784 ext(1359872->1363967) 00002000:00010000:2.0:1746147733.410442:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800941b1f80 00000100:00100000:0.0:1746147733.421094:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.421513:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794166912 00000100:00100000:3.0:1746147733.421522:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794166912 00000100:00100000:3.0:1746147733.421573:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12086 00000100:00100000:3.0:1746147733.421580:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+14:32508:x1830967794166912:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147733.421604:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.421619:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7ebcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc61d expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.421682:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ebd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.421693:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ebd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.421703:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ebd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.421715:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ebdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.421720:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ebdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.421725:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ebdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.422322:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.422333:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4d4 expref: 17 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.422340:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e7a00/0xe64d3fbf12a7ea8b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e2 expref: 332 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.422346:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.422377:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e7a00/0xe64d3fbf12a7ea8b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e2 expref: 332 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.422388:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e7a00/0xe64d3fbf12a7ea8b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e2 expref: 332 pid: 17544 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147733.422399:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796530944:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147733.423395:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4d4 expref: 17 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.423404:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4d4 expref: 17 pid: 17544 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147733.423411:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796531072:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147733.424120:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.425600:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.425776:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796530944:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147733.425944:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794167168 00000100:00100000:1.0:1746147733.425951:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794167168 00000100:00100000:1.0:1746147733.425996:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5044 00000100:00100000:1.0:1746147733.426003:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094979450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:15394:x1830967794167168:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000001:00080000:1.0:1746147733.426287:0:14549:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589946118 00000100:00100000:1.0:1746147733.426375:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094979450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:15394:x1830967794167168:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 371us (783us total) trans 8589946119 rc 0/0 00000100:00100000:1.0:1746147733.426382:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5044 00000020:00080000:1.0:1746147733.426386:0:14549:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1746147733.426774:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796531072:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147733.426802:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147733.427311:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.427494:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794167424 00000100:00100000:3.0:1746147733.427499:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794167424 00000100:00100000:3.0:1746147733.427533:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5045 00000100:00100000:3.0:1746147733.427539:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:23727:x1830967794167424:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147733.427648:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:23727:x1830967794167424:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 99us (327us total) trans 8589946120 rc 0/0 00000100:00100000:3.0:1746147733.427655:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5045 00000100:00100000:0.0:1746147733.428065:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.428265:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794167552 00000100:00100000:1.0:1746147733.428269:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794167552 00010000:00010000:1.0:1746147733.428286:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e7a00/0xe64d3fbf12a7ea8b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e2 expref: 335 pid: 17544 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147733.428312:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8666 00000100:00100000:1.0:1746147733.428317:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:1959:x1830967794167552:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147733.428325:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147733.428330:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e7a00/0xe64d3fbf12a7ea8b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e2 expref: 335 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.428338:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e7a00/0xe64d3fbf12a7ea8b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e2 expref: 335 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.428354:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915e7a00/0xe64d3fbf12a7ea8b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4e2 expref: 335 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.428365:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147733.428369:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.428377:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.428381:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.428386:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147733.428415:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:1959:x1830967794167552:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 98us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.428421:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8666 00000100:00100000:0.0:1746147733.429463:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.429839:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794167680 00000100:00100000:3.0:1746147733.429844:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794167680 00010000:00010000:3.0:1746147733.429866:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4d4 expref: 19 pid: 17544 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147733.429911:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8667 00000100:00100000:3.0:1746147733.429916:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794167680:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147733.429926:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147733.429930:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4d4 expref: 19 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.429938:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4d4 expref: 19 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.429952:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ea45 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc4d4 expref: 19 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.429961:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147733.429964:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.429971:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.429976:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.430007:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147733.430037:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794167680:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 121us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.430043:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8667 00010000:00010000:2.0:1746147733.430150:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430157:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147733.430188:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147733.430192:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147733.430203:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430211:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430219:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ebd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430225:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ebd4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430230:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ebd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430234:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0300a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147733.430237:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ebd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430246:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ebd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430254:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147733.430256:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147733.430258:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ebd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430262:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ebd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430273:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ebdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430277:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ebdb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430281:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ebdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430284:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0301c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147733.430286:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ebdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430289:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ebdb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430293:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcc4300) 00010000:00010000:2.0:1746147733.430295:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147733.430296:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ebdb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430300:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ebdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.430326:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7ebcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc61d expref: 16 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.430335:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc61d expref: 15 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.430340:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.430341:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147733.430343:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009527b800, rc 0) 00000100:00100000:2.0:1746147733.430365:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+15:32508:x1830967794166912:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 8786us (9279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.430370:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12086 00000100:00100000:0.0:1746147733.433779:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.434193:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794167808 00000100:00100000:1.0:1746147733.434201:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794167808 00000100:00100000:1.0:1746147733.434434:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16924 00000100:00100000:1.0:1746147733.434442:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+5:1960:x1830967794167808:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147733.434459:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147733.434476:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0267a00/0xe64d3fbf12a7ebe9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc624 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.434527:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796531200:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147733.434955:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.435212:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.435226:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.435497:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.435606:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.435648:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794167936 00000100:00100000:2.0:1746147733.435652:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794167936 00000100:00100000:2.0:1746147733.435736:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794168192 00000100:00100000:2.0:1746147733.435739:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794168192 00000100:00100000:0.0:1746147733.436004:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.436045:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794168448 00000100:00100000:3.0:1746147733.436048:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794168448 00000100:00100000:3.0:1746147733.436067:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794168064 00000100:00100000:3.0:1746147733.436069:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794168064 00000100:00100000:3.0:1746147733.436078:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16925 00000100:00100000:3.0:1746147733.436083:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794167936:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147733.436091:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.436101:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7ebf0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc62b expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.436128:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796531328:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147733.436159:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095567840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147733.436172:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16926 00000100:00100000:3.0:1746147733.436176:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794168192:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147733.436181:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.436189:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7ebf7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc639 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.436199:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.436201:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.436208:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7ebf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc639 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.436221:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7ebf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc639 expref: 8 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.436233:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009527a800, rc 0) 00000100:00100000:3.0:1746147733.436251:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794168192:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 75us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.436257:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16926 00000100:00100000:3.0:1746147733.436270:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16927 00000100:00100000:3.0:1746147733.436274:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794168448:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147733.436279:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.436285:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009527a000/0xe64d3fbf12a7ebfe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc647 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.436293:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.436295:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.436298:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009527a000/0xe64d3fbf12a7ebfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc647 expref: 10 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.436307:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009527a000/0xe64d3fbf12a7ebfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc647 expref: 10 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.436313:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009527a000, rc 0) 00000100:00100000:3.0:1746147733.436327:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794168448:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 52us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.436331:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16927 00000100:00100000:3.0:1746147733.436341:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16928 00000100:00100000:3.0:1746147733.436346:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794168064:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147733.436352:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.436358:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009527a200/0xe64d3fbf12a7ec05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc632 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.436368:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.436369:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.436373:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009527a200/0xe64d3fbf12a7ec05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc632 expref: 10 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.436380:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009527a200/0xe64d3fbf12a7ec05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc632 expref: 10 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.436386:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009527a200, rc 0) 00000100:00100000:3.0:1746147733.436398:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794168064:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 52us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.436403:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16928 00000100:00100000:1.0:1746147733.437030:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794168320 00000100:00100000:1.0:1746147733.437034:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794168320 00000100:00100000:1.0:1746147733.437224:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16929 00000100:00100000:1.0:1746147733.437230:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794168320:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147733.437236:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147733.437243:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0267800/0xe64d3fbf12a7ec0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc640 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.437257:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.437258:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.437263:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0267800/0xe64d3fbf12a7ec0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc640 expref: 9 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.437270:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0267800/0xe64d3fbf12a7ec0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc640 expref: 9 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.437276:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0267800, rc 0) 00000100:00100000:1.0:1746147733.437290:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794168320:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 62us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.437295:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16929 00000100:00100000:1.0:1746147733.437539:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796531200:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147733.437556:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0267a00/0xe64d3fbf12a7ebe9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc624 expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.437564:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0267a00/0xe64d3fbf12a7ebe9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc624 expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.437737:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0267a00, rc 0) 00000100:00100000:1.0:1746147733.437765:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794167808:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 3324us (3991us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147733.437770:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16924 00002000:00010000:3.0:1746147733.439458:0:21480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime: 1746147732 -> 1746147734 00002000:00010000:3.0:1746147733.439463:0:21480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime: 1746147731 -> 1746147734 00002000:00010000:3.0:1746147733.439465:0:21480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime: 1746147732 -> 1746147734 00000100:00100000:3.0:1746147733.439479:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796531328:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147733.439501:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7ebf0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc62b expref: 9 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.439509:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7ebf0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc62b expref: 9 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.439529:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009527be00, rc 0) 00000100:00100000:3.0:1746147733.439555:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794167936:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 3472us (4343us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147733.439561:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16925 00000100:00100000:0.0:1746147733.441420:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.441463:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794168704 00000100:00100000:2.0:1746147733.441471:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794168704 00000100:00100000:2.0:1746147733.441521:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12087 00000100:00100000:2.0:1746147733.441528:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+15:32508:x1830967794168704:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147733.441542:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.441556:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dee800/0xe64d3fbf12a7ec13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc64e expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.441634:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.441657:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc61d expref: 16 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.441664:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.441687:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc61d expref: 16 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.441696:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc61d expref: 16 pid: 17544 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.441705:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796531456:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.441778:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.444426:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796531456:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147733.444448:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:2.0:1746147733.444574:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.444797:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794168832 00000100:00100000:1.0:1746147733.444802:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794168832 00010000:00010000:1.0:1746147733.444828:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc61d expref: 17 pid: 17544 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147733.444860:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8668 00000100:00100000:1.0:1746147733.444866:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+17:1959:x1830967794168832:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147733.444876:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147733.444881:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc61d expref: 17 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.445157:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc61d expref: 17 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.445176:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009527b800/0xe64d3fbf12a7ebe2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc61d expref: 17 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.445198:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147733.445203:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.445210:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.445215:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.445857:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147733.445920:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+16:1959:x1830967794168832:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1053us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.445928:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8668 00010000:00010000:0.0:1746147733.446148:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147733.446155:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147733.446172:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147733.446285:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dee800/0xe64d3fbf12a7ec13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc64e expref: 17 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.446301:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc64e expref: 16 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.446308:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147733.446310:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147733.446312:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5def800, rc 0) 00000100:00100000:0.0:1746147733.446343:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+16:32508:x1830967794168704:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 4816us (4928us total) trans 8589946121 rc 0/0 00000100:00100000:0.0:1746147733.446349:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12087 00000100:00100000:0.0:1746147733.451319:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.451426:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794168960 00000100:00100000:2.0:1746147733.451433:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794168960 00000100:00100000:2.0:1746147733.452161:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12088 00000100:00100000:2.0:1746147733.452169:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+16:32508:x1830967794168960:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147733.452195:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.452211:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dee600/0xe64d3fbf12a7ec28 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc655 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.452281:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ec2f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.452294:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc64e expref: 17 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.452300:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ec2f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.452328:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc64e expref: 17 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.452337:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc64e expref: 17 pid: 17544 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.452346:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796531584:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.452429:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.454711:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.454769:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794169088 00000100:00100000:1.0:1746147733.454778:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794169088 00000100:00100000:2.0:1746147733.454803:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796531584:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147733.454804:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc64e expref: 18 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.454823:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ec2f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:1.0:1746147733.457583:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8669 00000100:00100000:1.0:1746147733.457598:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+18:1959:x1830967794169088:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147733.457616:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147733.457625:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc64e expref: 18 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.457637:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc64e expref: 18 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.457669:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def800/0xe64d3fbf12a7ec1a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc64e expref: 18 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.457701:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147733.457705:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ec2f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.457713:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ec2f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.457718:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ec2f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.457737:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147733.457752:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ec2f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.457758:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ec2f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147733.457795:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:1.0:1746147733.457795:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+17:1959:x1830967794169088:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 203us (3090us total) trans 0 rc 0/0 00000004:00200000:2.0:1746147733.457799:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1746147733.457801:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8669 00000004:00010000:2.0:1746147733.457812:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ec2f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.457837:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dee600/0xe64d3fbf12a7ec28 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc655 expref: 17 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.457862:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ec2f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc655 expref: 16 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.458356:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.458358:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147733.458360:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5defc00, rc 0) 00000100:00100000:2.0:1746147733.458394:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+16:32508:x1830967794168960:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 6225us (7083us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.458400:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12088 00000100:00100000:0.0:1746147733.461410:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.461501:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794169216 00000100:00100000:3.0:1746147733.461509:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794169216 00000100:00100000:3.0:1746147733.461555:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16930 00000100:00100000:3.0:1746147733.461561:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794169216:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147733.461575:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.461589:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009527aa00/0xe64d3fbf12a7ec36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc65c expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.461627:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796531712:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147733.461706:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095567840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.462213:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.462254:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794169344 00000100:00100000:1.0:1746147733.462258:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794169344 00000100:00100000:1.0:1746147733.462290:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16931 00000100:00100000:1.0:1746147733.462295:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794169344:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147733.462304:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147733.462314:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a7ec3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc663 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.462339:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796531840:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147733.462392:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147733.463328:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796531712:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147733.463357:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009527aa00/0xe64d3fbf12a7ec36 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc65c expref: 8 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.463367:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009527aa00/0xe64d3fbf12a7ec36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc65c expref: 8 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.463389:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009527aa00, rc 0) 00000100:00100000:3.0:1746147733.463415:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794169216:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1854us (2011us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147733.463420:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16930 00000100:00100000:1.0:1746147733.463795:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796531840:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147733.463808:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a7ec3d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc663 expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.463816:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a7ec3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc663 expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.463836:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0267400, rc 0) 00000100:00100000:1.0:1746147733.463868:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794169344:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1572us (1655us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147733.463873:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16931 00000100:00100000:0.0:1746147733.465521:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.465580:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794169600 00000100:00100000:2.0:1746147733.465587:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794169600 00000100:00100000:2.0:1746147733.465636:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12089 00000100:00100000:2.0:1746147733.465656:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+16:32508:x1830967794169600:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147733.465671:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.465686:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ec44 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc66a expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.465768:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7ec4b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.465780:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7ec4b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.465789:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7ec4b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147733.465799:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147733.465931:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ec44 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc66a expref: 19 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.465959:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7ec4b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc66a expref: 18 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.465966:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.465969:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147733.465972:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55e9e00, rc 0) 00000100:00100000:2.0:1746147733.466004:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+18:32508:x1830967794169600:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 350us (488us total) trans 8589946122 rc 0/0 00000100:00100000:2.0:1746147733.466010:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12089 00000100:00100000:0.0:1746147733.468679:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.468719:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.468751:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.468776:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.468784:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794169728 00000100:00100000:0.0:1746147733.468789:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.468792:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794169728 00000100:00100000:0.0:1746147733.468813:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.469089:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794169984 00000100:00100000:3.0:1746147733.469092:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794169984 00000100:00100000:3.0:1746147733.469108:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794170240 00000100:00100000:3.0:1746147733.469110:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794170240 00000100:00100000:3.0:1746147733.469118:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794169856 00000100:00100000:3.0:1746147733.469120:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794169856 00000100:00100000:3.0:1746147733.469129:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794170112 00000100:00100000:3.0:1746147733.469131:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794170112 00000100:00100000:3.0:1746147733.469140:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794170368 00000100:00100000:3.0:1746147733.469142:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794170368 00000100:00100000:3.0:1746147733.469153:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16932 00000100:00100000:3.0:1746147733.469160:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794169728:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:3.0:1746147733.469197:0:21480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ec59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.469214:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.469221:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147733.469223:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147733.469226:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ec59 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.469253:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.469265:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 13 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147733.469277:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796531968:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147733.469342:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095567840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147733.469356:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16933 00000100:00100000:1.0:1746147733.469368:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794169984:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:1.0:1746147733.469390:0:4592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0266400/0xe64d3fbf12a7ec60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.469584:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ad expref: 20 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.469591:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009527a200/0xe64d3fbf12a7ec05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc632 expref: 10 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.469599:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a913ee00/0xe64d3fbf12a7eb6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5bb expref: 11 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.469605:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.469606:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.469608:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0266400/0xe64d3fbf12a7ec60 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.469625:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a913ee00/0xe64d3fbf12a7eb6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5bb expref: 11 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.469634:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a913ee00/0xe64d3fbf12a7eb6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5bb expref: 11 pid: 8470 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746147733.469655:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796532096:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147733.469691:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009527a200/0xe64d3fbf12a7ec05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc632 expref: 10 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.469699:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009527a200/0xe64d3fbf12a7ec05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc632 expref: 10 pid: 8184 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746147733.469712:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796532224:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147733.469735:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ad expref: 20 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.469742:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ad expref: 20 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147733.469748:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796532352:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147733.469762:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147733.469770:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16934 00000100:00100000:3.0:1746147733.469777:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794170240:12345-192.168.202.10@tcp:1:lfs.0 00000100:00100000:1.0:1746147733.469779:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16935 00000100:00100000:1.0:1746147733.469785:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794169856:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:3.0:1746147733.469792:0:8184:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ec67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.469800:0:4591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7ec6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.469802:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7eb95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5e5 expref: 13 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.469809:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0267800/0xe64d3fbf12a7ec0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc640 expref: 9 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.469810:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 11 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.469815:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147733.469816:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147733.469817:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7eb9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ec expref: 26 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.469818:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7ec6e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.469821:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.469823:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.469825:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ec67 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.469831:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 11 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.469838:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7eb9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ec expref: 26 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.469844:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 11 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.469846:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7eb9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ec expref: 26 pid: 8470 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147733.469851:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135813480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796532480:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147733.469853:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796532608:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147733.469870:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cccc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147733.469879:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0267800/0xe64d3fbf12a7ec0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc640 expref: 9 pid: 4592 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147733.469900:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16936 00010000:00010000:3.0:1746147733.469904:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0267800/0xe64d3fbf12a7ec0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc640 expref: 9 pid: 4592 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746147733.469905:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794170112:12345-192.168.202.10@tcp:1:lfs.0 00000100:00100000:3.0:1746147733.469912:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796532736:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147733.469922:0:22183:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ec75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.469931:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a913e600/0xe64d3fbf12a7eb64 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5b4 expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.469933:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7eb95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5e5 expref: 13 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.469940:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7eb95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5e5 expref: 13 pid: 8470 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147733.469947:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796532864:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147733.469957:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095567cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147733.469971:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16937 00000100:00100000:3.0:1746147733.469976:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794170368:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:3.0:1746147733.469989:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0028800/0xe64d3fbf12a7ec7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.469998:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7eba3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5f3 expref: 11 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.470004:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009527a000/0xe64d3fbf12a7ebfe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc647 expref: 10 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.470015:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ebb1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc601 expref: 20 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.470020:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.470022:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.470024:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0028800/0xe64d3fbf12a7ec7c lrc: 6/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.470035:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ebb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc601 expref: 20 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.470042:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ebb1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc601 expref: 20 pid: 8184 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147733.470048:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796532992:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147733.470064:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009527a000/0xe64d3fbf12a7ebfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc647 expref: 10 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.470071:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009527a000/0xe64d3fbf12a7ebfe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc647 expref: 10 pid: 8184 timeout: 912 lvb_type: 1 00000100:00100000:3.0:1746147733.470077:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796533120:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147733.470089:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7eba3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5f3 expref: 11 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.470100:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7eba3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5f3 expref: 11 pid: 8470 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147733.470107:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796533248:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147733.470114:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095567b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147733.470394:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7ebf7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc639 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.470401:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7eb80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5d0 expref: 13 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.470407:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.470408:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.470410:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ec75 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.470426:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7eb80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5d0 expref: 13 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.470435:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7eb80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5d0 expref: 13 pid: 21480 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147733.470443:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a548b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796533376:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147733.470482:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7ebf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc639 expref: 9 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.470490:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7ebf7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc639 expref: 9 pid: 8184 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746147733.470496:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5489500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796533504:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147733.470516:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a913e600/0xe64d3fbf12a7eb64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5b4 expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.470522:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a913e600/0xe64d3fbf12a7eb64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5b4 expref: 26 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147733.470529:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5489880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796533632:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147733.470540:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147733.482960:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796532096:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147733.483063:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796532224:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147733.483073:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796532352:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147733.483075:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796531968:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147733.483095:0:4592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0266400/0xe64d3fbf12a7ec60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.483097:0:21480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ec59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.483118:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135813480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796532480:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147733.483127:0:4591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7ec6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147733.483133:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.483186:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.483202:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.483229:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.483240:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794170496 00000100:00100000:0.0:1746147733.483241:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.483245:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794170496 00000100:00100000:0.0:1746147733.483253:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.483266:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794170624 00000100:00100000:0.0:1746147733.483269:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794170624 00002000:00100000:1.0:1746147733.483278:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (520192->1048575) req@ffff88009fe97b80 x1830967794170496/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.483285:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe97b80 with x1830967794170496 ext(520192->1048575) 00010000:00010000:0.0:1746147733.483288:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009527a200/0xe64d3fbf12a7ec05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc632 expref: 11 pid: 8184 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746147733.483291:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 14 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.483300:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 14 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:1.0:1746147733.483305:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe97b80 00000100:00100000:0.0:1746147733.483305:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794171136 00000100:00100000:0.0:1746147733.483307:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794171136 00010000:00010000:0.0:1746147733.483314:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0267800/0xe64d3fbf12a7ec0c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc640 expref: 10 pid: 4592 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746147733.483315:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794170880 00000100:00100000:1.0:1746147733.483317:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794170880 00000100:00100000:0.0:1746147733.483324:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794170752 00000100:00100000:0.0:1746147733.483325:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794170752 00002000:00100000:1.0:1746147733.483326:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1363967) req@ffff8800a0436a00 x1830967794170880/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746147733.483331:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a913ee00/0xe64d3fbf12a7eb6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5bb expref: 13 pid: 8470 timeout: 912 lvb_type: 1 00002000:00100000:1.0:1746147733.483332:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0436a00 with x1830967794170880 ext(1048576->1363967) 00010000:00010000:1.0:1746147733.483336:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 13 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746147733.483338:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794171392 00000100:00100000:0.0:1746147733.483340:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794171392 00010000:00010000:1.0:1746147733.483346:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 13 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.483346:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009527a000/0xe64d3fbf12a7ebfe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc647 expref: 12 pid: 8184 timeout: 912 lvb_type: 1 00002000:00010000:1.0:1746147733.483351:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0436a00 00000100:00100000:0.0:1746147733.483356:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8670 00000100:00100000:1.0:1746147733.483359:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1553 00000100:00100000:0.0:1746147733.483362:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794170624:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147733.483363:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1957:x1830967794170496:12345-192.168.202.10@tcp:4:cat.0 00010000:00010000:0.0:1746147733.483373:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147733.483375:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8671 00000100:00100000:3.0:1746147733.483379:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794171136:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147733.483386:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147733.483391:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009527a200/0xe64d3fbf12a7ec05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc632 expref: 12 pid: 8184 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147733.483395:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0267800/0xe64d3fbf12a7ec0c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc640 expref: 10 pid: 4592 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746147733.483399:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009527a200/0xe64d3fbf12a7ec05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc632 expref: 12 pid: 8184 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147733.483402:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0267800/0xe64d3fbf12a7ec0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc640 expref: 10 pid: 4592 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746147733.483416:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009527a200/0xe64d3fbf12a7ec05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc632 expref: 12 pid: 8184 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147733.483418:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147733.483429:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147733.483447:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794170624:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.483497:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8672 00000100:00100000:2.0:1746147733.483504:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794170752:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147733.483510:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147733.483518:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a913ee00/0xe64d3fbf12a7eb6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5bb expref: 13 pid: 8470 timeout: 912 lvb_type: 1 00010000:00010000:2.0:1746147733.483526:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a913ee00/0xe64d3fbf12a7eb6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5bb expref: 13 pid: 8470 timeout: 912 lvb_type: 1 00010000:00010000:2.0:1746147733.483536:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a913ee00/0xe64d3fbf12a7eb6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5bb expref: 13 pid: 8470 timeout: 912 lvb_type: 1 00010000:00010000:2.0:1746147733.483560:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147733.483596:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794171136:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 215us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.483602:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8671 00000100:00100000:3.0:1746147733.483618:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8673 00000100:00100000:3.0:1746147733.483622:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794171392:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147733.483631:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147733.483653:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009527a000/0xe64d3fbf12a7ebfe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc647 expref: 11 pid: 8184 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147733.483661:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009527a000/0xe64d3fbf12a7ebfe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc647 expref: 11 pid: 8184 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147733.483671:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147733.483679:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794170752:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 176us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.483684:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794171392:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 62us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.483684:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8672 00000100:00100000:3.0:1746147733.483689:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8673 00000100:00100000:3.0:1746147733.483706:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796532992:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147733.483714:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009527a000/0xe64d3fbf12a7ebfe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc647 expref: 10 pid: 8184 timeout: 912 lvb_type: 1 00000100:00100000:2.0:1746147733.483718:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796532608:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147733.483726:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796533120:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.483726:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0267800/0xe64d3fbf12a7ec0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc640 expref: 9 pid: 4592 timeout: 912 lvb_type: 1 00000100:00100000:2.0:1746147733.483734:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796532736:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.483741:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796532864:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147733.483744:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1554 00000100:00100000:3.0:1746147733.483749:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794170880:12345-192.168.202.10@tcp:4:cat.0 00010000:00010000:2.0:1746147733.483755:0:8184:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ec67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.483799:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.483817:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794171264 00000100:00100000:1.0:1746147733.483820:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794171264 00010000:00010000:1.0:1746147733.483832:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ebb1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc601 expref: 21 pid: 8184 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.483842:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.484500:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8670 00000100:00100000:1.0:1746147733.484724:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794171008 00000100:00100000:1.0:1746147733.484727:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794171008 00000100:00100000:2.0:1746147733.484729:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8674 00000100:00100000:2.0:1746147733.484736:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794171264:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147733.484740:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ad expref: 22 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.484743:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147733.484752:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ebb1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc601 expref: 22 pid: 8184 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147733.484760:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8675 00010000:00010000:2.0:1746147733.484760:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ebb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc601 expref: 22 pid: 8184 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147733.484765:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794171008:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147733.484771:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147733.484771:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ebb1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc601 expref: 22 pid: 8184 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.484778:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ad expref: 21 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.484778:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147733.484789:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ad expref: 21 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.484792:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794171264:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 58us (993us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147733.484798:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7eb5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ad expref: 21 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.484805:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.484807:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.484810:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0266400/0xe64d3fbf12a7ec60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.484818:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0266400/0xe64d3fbf12a7ec60 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.484845:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8674 00010000:00010000:3.0:1746147733.485115:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147733.485270:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794171008:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 503us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.485275:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8675 00000100:00100000:2.0:1746147733.485417:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796533248:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.485431:0:20619:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0028800/0xe64d3fbf12a7ec7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.485453:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a548b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796533376:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.485459:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5489500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796533504:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.485464:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5489880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796533632:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.485475:0:22183:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ec75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147733.485696:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.485748:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.485834:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794171520 00000100:00100000:2.0:1746147733.485837:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794171520 00010000:00010000:2.0:1746147733.485850:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7eb95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5e5 expref: 16 pid: 8470 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.485862:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794171904 00000100:00100000:2.0:1746147733.485863:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794171904 00010000:00010000:2.0:1746147733.485870:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7eb80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5d0 expref: 17 pid: 21480 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.485880:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8676 00000100:00100000:2.0:1746147733.485901:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794171520:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147733.485908:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147733.485919:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7eb95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5e5 expref: 17 pid: 8470 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.485931:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7eb95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5e5 expref: 17 pid: 8470 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.485943:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7eb95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5e5 expref: 17 pid: 8470 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.485951:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147733.485966:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794171520:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 82us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.485970:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8676 00000100:00100000:2.0:1746147733.485981:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8677 00000100:00100000:2.0:1746147733.485985:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1958:x1830967794171904:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147733.485985:0:4592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0266400/0xe64d3fbf12a7ec60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.485990:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147733.485994:0:4592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0266400/0xe64d3fbf12a7ec60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.485999:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7eb80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5d0 expref: 15 pid: 21480 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.486006:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7eb80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5d0 expref: 15 pid: 21480 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.486013:0:4592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0266400/0xe64d3fbf12a7ec60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.486015:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7eb80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5d0 expref: 15 pid: 21480 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.486020:0:4592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0266400/0xe64d3fbf12a7ec60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.486022:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147733.486027:0:4592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0266400/0xe64d3fbf12a7ec60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.486032:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794171904:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 47us (284us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147733.486032:0:4592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0266400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147733.486036:0:4592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0266400/0xe64d3fbf12a7ec60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.486039:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8677 00010000:00010000:1.0:1746147733.486043:0:4592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0266400/0xe64d3fbf12a7ec60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.486052:0:4592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0266400/0xe64d3fbf12a7ec60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.486056:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0266400/0xe64d3fbf12a7ec60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.486097:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794169984:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 16734us (17376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.486104:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16933 00000100:00100000:3.0:1746147733.490848:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.490867:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.490880:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.490913:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.490963:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794171648 00000100:00100000:0.0:1746147733.490969:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794171648 00010000:00010000:0.0:1746147733.490997:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7eb9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ec expref: 27 pid: 8470 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746147733.491028:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794172032 00000100:00100000:0.0:1746147733.491030:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794172032 00010000:00010000:0.0:1746147733.491040:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a913e600/0xe64d3fbf12a7eb64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5b4 expref: 28 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746147733.491051:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794171776 00000100:00100000:0.0:1746147733.491053:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794171776 00010000:00010000:0.0:1746147733.491061:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7ebf7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc639 expref: 9 pid: 8184 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746147733.491068:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794172160 00000100:00100000:0.0:1746147733.491070:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794172160 00010000:00010000:0.0:1746147733.491078:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7eba3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5f3 expref: 13 pid: 8470 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746147733.491088:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8678 00000100:00100000:0.0:1746147733.491094:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794171648:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147733.491104:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147733.491120:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7eb9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ec expref: 28 pid: 8470 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.491130:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7eb9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ec expref: 28 pid: 8470 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.491151:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7eb9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5ec expref: 28 pid: 8470 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.491161:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.491163:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.491168:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ec67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491175:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ec67 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491196:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147733.491230:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794171648:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 135us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147733.491236:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8678 00000100:00100000:0.0:1746147733.491248:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8679 00000100:00100000:0.0:1746147733.491253:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794172032:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147733.491259:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147733.491270:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a913e600/0xe64d3fbf12a7eb64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5b4 expref: 26 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.491277:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a913e600/0xe64d3fbf12a7eb64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5b4 expref: 26 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.491287:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a913e600/0xe64d3fbf12a7eb64 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5b4 expref: 26 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.491295:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147733.491307:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794172032:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 54us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147733.491312:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8679 00000100:00100000:0.0:1746147733.491321:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8680 00000100:00100000:0.0:1746147733.491326:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794171776:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147733.491331:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147733.491338:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7ebf7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc639 expref: 9 pid: 8184 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746147733.491345:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7ebf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc639 expref: 9 pid: 8184 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746147733.491355:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7ebf7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc639 expref: 9 pid: 8184 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746147733.491362:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.491363:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.491365:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ec75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491371:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ec75 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491385:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147733.491399:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794171776:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 73us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147733.491404:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8680 00000100:00100000:0.0:1746147733.491412:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8681 00000100:00100000:0.0:1746147733.491417:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794172160:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147733.491423:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147733.491433:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7eba3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5f3 expref: 13 pid: 8470 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.491440:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7eba3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5f3 expref: 13 pid: 8470 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.491452:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7eba3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc5f3 expref: 13 pid: 8470 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.491459:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.491460:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.491462:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0028800/0xe64d3fbf12a7ec7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491468:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0028800/0xe64d3fbf12a7ec7c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491480:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147733.491492:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794172160:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 75us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147733.491497:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8681 00010000:00010000:0.0:1746147733.491537:0:8184:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ec67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491545:0:8184:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ec67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491558:0:8184:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ec67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491569:0:8184:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ec67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491575:0:8184:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ec67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491580:0:8184:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e93c000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147733.491583:0:8184:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ec67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491590:0:8184:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ec67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491597:0:8184:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ec67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491603:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ec67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147733.491636:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794170240:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 21860us (22884us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147733.491651:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16934 00010000:00010000:0.0:1746147733.491674:0:22183:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ec75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491680:0:22183:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ec75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491693:0:22183:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ec75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491699:0:22183:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ec75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491704:0:22183:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ec75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491709:0:22183:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0300a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147733.491711:0:22183:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ec75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491717:0:22183:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ec75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491726:0:22183:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ec75 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.491731:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0300a00/0xe64d3fbf12a7ec75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147733.491754:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794170112:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 21849us (22964us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147733.491758:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16936 00010000:00010000:2.0:1746147733.491850:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0028800/0xe64d3fbf12a7ec7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.491859:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0028800/0xe64d3fbf12a7ec7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.491870:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0028800/0xe64d3fbf12a7ec7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.491876:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0028800/0xe64d3fbf12a7ec7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.491881:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0028800/0xe64d3fbf12a7ec7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.491919:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0028800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147733.491921:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0028800/0xe64d3fbf12a7ec7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.491926:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0028800/0xe64d3fbf12a7ec7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.491935:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0028800/0xe64d3fbf12a7ec7c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.491939:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0028800/0xe64d3fbf12a7ec7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.491976:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794170368:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 21999us (23161us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.491981:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16937 00000100:00100000:1.0:1746147733.491997:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1957:x1830967794170496:12345-192.168.202.10@tcp:4:cat.0 Request processed in 8632us (8864us total) trans 17179874411 rc 0/0 00000100:00100000:1.0:1746147733.492006:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1553 00002000:00100000:1.0:1746147733.492014:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (520192->1048575) req@ffff88009fe97b80 x1830967794170496/t17179874411(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/448 e 0 to 0 dl 1746147744 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.492022:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe97b80 with x1830967794170496 ext(520192->1048575) 00010000:00010000:1.0:1746147733.492030:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 14 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.492040:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 14 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:1.0:1746147733.492046:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe97b80 00000100:00100000:3.0:1746147733.498526:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794170880:12345-192.168.202.10@tcp:4:cat.0 Request processed in 14768us (15313us total) trans 21474841649 rc 0/0 00000100:00100000:3.0:1746147733.498536:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1554 00002000:00100000:3.0:1746147733.498546:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1363967) req@ffff8800a0436a00 x1830967794170880/t21474841649(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/448 e 0 to 0 dl 1746147744 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.498556:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0436a00 with x1830967794170880 ext(1048576->1363967) 00010000:00010000:3.0:1746147733.498564:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 12 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.498576:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 12 pid: 10613 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746147733.498581:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0436a00 00000100:00100000:0.0:1746147733.506992:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.507204:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794172288 00000100:00100000:0.0:1746147733.507212:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794172288 00010000:00010000:0.0:1746147733.507241:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 14 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746147733.507273:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8682 00000100:00100000:0.0:1746147733.507280:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794172288:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147733.507292:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147733.507311:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 14 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.507322:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 14 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.507341:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7ebbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc60f expref: 14 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.507353:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.507355:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.507359:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ec59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.507366:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ec59 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.507384:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147733.507417:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794172288:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 137us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147733.507425:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8682 00010000:00010000:3.0:1746147733.507500:0:21480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ec59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.507509:0:21480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ec59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.507527:0:21480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ec59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.507533:0:21480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ec59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.507539:0:21480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ec59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.507544:0:21480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5def000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147733.507547:0:21480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ec59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.507559:0:21480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ec59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.507568:0:21480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ec59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.507573:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ec59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.507612:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+5:1959:x1830967794169728:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 38452us (38940us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.507619:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16932 00000100:00100000:1.0:1746147733.513237:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.514129:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794172416 00000100:00100000:2.0:1746147733.514137:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794172416 00010000:00010000:2.0:1746147733.514166:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 12 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.514195:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8683 00000100:00100000:2.0:1746147733.514202:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1958:x1830967794172416:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147733.514213:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147733.514230:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 12 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.514241:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 12 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.514260:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0267000/0xe64d3fbf12a7ebc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc616 expref: 12 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.514270:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.514272:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.514276:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7ec6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.514284:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7ec6e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.514309:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147733.514342:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967794172416:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 140us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.514347:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8683 00010000:00010000:1.0:1746147733.514489:0:4591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7ec6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.514497:0:4591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7ec6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.514514:0:4591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7ec6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.514520:0:4591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7ec6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.514527:0:4591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7ec6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.514533:0:4591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0266800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147733.514536:0:4591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7ec6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.514543:0:4591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7ec6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.514553:0:4591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7ec6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.514559:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0266800/0xe64d3fbf12a7ec6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.514597:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794169856:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 44812us (45819us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.514604:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16935 00000100:00100000:0.0:1746147733.523246:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.523353:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794172672 00000100:00100000:2.0:1746147733.523361:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794172672 00000100:00100000:2.0:1746147733.523397:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12090 00000100:00100000:2.0:1746147733.523404:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+18:32508:x1830967794172672:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:2.0:1746147733.523623:0:5744:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147733.523677:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ec2f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc655 expref: 18 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.523690:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.523694:0:5744:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147733.523718:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147733.523728:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb871 expref: 17 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.523735:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7d92e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb894 expref: 333 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.523741:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563800/0xe64d3fbf12a7db9d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba0e expref: 333 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.523747:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dc5a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba85 expref: 17 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.523754:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147733.523780:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dc5a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba85 expref: 17 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.523790:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dc5a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba85 expref: 17 pid: 14547 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.523801:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796533760:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.523974:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563800/0xe64d3fbf12a7db9d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba0e expref: 333 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.523982:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563800/0xe64d3fbf12a7db9d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba0e expref: 333 pid: 14546 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.523990:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796533888:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.524014:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7d92e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb894 expref: 333 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.524022:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7d92e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb894 expref: 333 pid: 5744 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.524029:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796534016:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.524051:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb871 expref: 17 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.524063:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb871 expref: 17 pid: 17544 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.524069:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5b480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796534144:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.524083:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.526325:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.526358:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.526383:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.526435:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.526497:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794172800 00000100:00100000:1.0:1746147733.526497:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794173056 00000100:00100000:2.0:1746147733.526502:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794172800 00000100:00100000:1.0:1746147733.526502:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794173056 00010000:00010000:2.0:1746147733.526524:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dc5a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba85 expref: 18 pid: 14547 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.526524:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7d92e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb894 expref: 334 pid: 5744 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147733.526546:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794172928 00000100:00100000:2.0:1746147733.526548:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794173184 00000100:00100000:1.0:1746147733.526548:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794172928 00000100:00100000:2.0:1746147733.526550:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794173184 00010000:00010000:1.0:1746147733.526555:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563800/0xe64d3fbf12a7db9d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba0e expref: 335 pid: 14546 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.526557:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb871 expref: 19 pid: 17544 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147733.526564:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8684 00000100:00100000:2.0:1746147733.526567:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8685 00000100:00100000:1.0:1746147733.526569:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:1959:x1830967794173056:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147733.526571:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794172800:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147733.526578:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147733.526578:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147733.526583:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dc5a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba85 expref: 19 pid: 14547 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.526583:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7d92e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb894 expref: 335 pid: 5744 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.526590:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7d92e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb894 expref: 335 pid: 5744 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.526599:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dc5a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba85 expref: 19 pid: 14547 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746147733.526637:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8686 00000100:00100000:3.0:1746147733.526654:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:1960:x1830967794172928:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147733.526661:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147733.526665:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563800/0xe64d3fbf12a7db9d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba0e expref: 335 pid: 14546 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746147733.526861:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8687 00000100:00100000:0.0:1746147733.526868:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794173184:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147733.526874:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147733.526874:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147733.526878:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147733.526878:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb871 expref: 19 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.526935:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147733.526940:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.526944:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147733.526949:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147733.526953:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563800/0xe64d3fbf12a7db9d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba0e expref: 335 pid: 14546 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.526962:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147733.526964:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.526968:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147733.526973:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794172800:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 401us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.526979:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8685 00000100:00100000:3.0:1746147733.526980:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:1960:x1830967794172928:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 328us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.526985:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8686 00010000:00010000:2.0:1746147733.527038:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31c00/0xe64d3fbf12a7dc5a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba85 expref: 18 pid: 14547 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.527050:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796533760:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.527058:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0563800/0xe64d3fbf12a7db9d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafba0e expref: 334 pid: 14546 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147733.527058:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:1959:x1830967794173056:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 488us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.527063:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8684 00000100:00100000:2.0:1746147733.527065:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796533888:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.527072:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7d92e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb894 expref: 332 pid: 5744 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.527082:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796534016:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.527088:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5b480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796534144:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.527111:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147733.527151:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb871 expref: 17 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.527162:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a221e400/0xe64d3fbf12a7d8e8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb871 expref: 17 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746147733.527181:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147733.527184:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147733.527190:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147733.527196:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147733.527214:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147733.527230:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794173184:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 363us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147733.527235:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8687 00010000:00010000:2.0:1746147733.527350:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147733.527357:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000040:00080000:3.0:1746147733.528107:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3676, 88 off307856 00000004:00080000:3.0:1746147733.528116:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812702230595ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147733.528155:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3684, 88 off308208 00000004:00080000:3.0:1746147733.528160:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812702275310ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147733.528180:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3685, 88 off308296 00000004:00080000:3.0:1746147733.528183:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812702298850ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147733.528190:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3677, 88 off307944 00000004:00080000:3.0:1746147733.528192:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812702307740ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147733.528198:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3678, 88 off308032 00000004:00080000:3.0:1746147733.528200:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812702315435ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147733.528206:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3686, 88 off308384 00000004:00080000:3.0:1746147733.528209:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812702324332ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147733.528215:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3687, 88 off308472 00000004:00080000:3.0:1746147733.528218:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812702333318ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147733.528223:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3688, 88 off308560 00000004:00080000:3.0:1746147733.528226:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812702341437ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147733.528232:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3679, 88 off308120 00000004:00080000:3.0:1746147733.528235:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812702350493ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147733.528241:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3689, 88 off308648 00000004:00080000:3.0:1746147733.528244:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812702359147ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147733.528250:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3680, 88 off308208 00000004:00080000:3.0:1746147733.528253:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812702368277ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147733.528259:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3690, 88 off308736 00000004:00080000:3.0:1746147733.528262:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812702377189ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147733.528268:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3681, 88 off308296 00000004:00080000:3.0:1746147733.528270:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812702385675ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147733.528275:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3682, 88 off308384 00000004:00080000:3.0:1746147733.528278:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812702393150ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147733.528283:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3683, 88 off308472 00000004:00080000:3.0:1746147733.528286:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812702401822ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147733.528292:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3684, 88 off308560 00000004:00080000:3.0:1746147733.528294:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812702409813ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147733.528300:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3691, 88 off308824 00000004:00080000:3.0:1746147733.528303:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812702418103ns, next at 756024029964ns, rc = 0 00000004:00010000:3.0:1746147733.558234:0:5744:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a0435880 reply state ffff88012f36a400 transno 8589946123 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:3.0:1746147733.558251:0:5744:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746147733.558373:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+19:32508:x1830967794172672:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 34964us (35132us total) trans 8589946123 rc 0/0 00000100:00100000:3.0:1746147733.558388:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12090 00000001:00080000:0.0:1746147733.558410:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946121 is committed 00000001:00080000:0.0:1746147733.558421:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946109 is committed 00000001:00080000:0.0:1746147733.558429:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946119 is committed 00000001:00080000:0.0:1746147733.558449:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946123 is committed 00000004:00080000:0.0:1746147733.558453:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2759 committed 00000004:00080000:0.0:1746147733.558470:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2752 committed 00000004:00080000:0.0:1746147733.558476:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2751 committed 00000004:00080000:0.0:1746147733.558478:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2750 committed 00000004:00080000:0.0:1746147733.558480:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2749 committed 00000004:00080000:0.0:1746147733.558481:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2758 committed 00000004:00080000:0.0:1746147733.558482:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2748 committed 00010000:00010000:2.0:1746147733.558484:0:3288:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00000004:00080000:0.0:1746147733.558484:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2757 committed 00000004:00080000:0.0:1746147733.558486:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2747 committed 00000004:00080000:0.0:1746147733.558487:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2756 committed 00000004:00080000:0.0:1746147733.558490:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2755 committed 00000004:00080000:0.0:1746147733.558491:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2754 committed 00000004:00080000:0.0:1746147733.558492:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2746 committed 00010000:00010000:2.0:1746147733.558493:0:3288:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00000004:00080000:0.0:1746147733.558494:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2745 committed 00000004:00080000:0.0:1746147733.558495:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2753 committed 00000004:00080000:0.0:1746147733.558497:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2752 committed 00000004:00080000:0.0:1746147733.558498:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2744 committed 00010000:00010000:2.0:1746147733.558499:0:3288:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147733.558504:0:3288:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e127e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147733.558508:0:3288:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147733.558515:0:3288:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00000001:00080000:0.0:1746147733.558522:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946120 is committed 00010000:00010000:2.0:1746147733.558530:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.558533:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147733.558537:0:3288:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147733.558541:0:3288:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ec83 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147733.558668:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796534528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147733.558687:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796534272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.558714:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.558760:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796535040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.558773:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147733.558787:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796534528 00000100:00100000:1.0:1746147733.558795:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796534528 00000100:00100000:1.0:1746147733.558832:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796535040 00000100:00100000:1.0:1746147733.558834:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796535040 00000100:00100000:1.0:1746147733.558847:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16938 00000100:00100000:1.0:1746147733.558852:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3301:x1830967796534528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.558860:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147733.558866:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796534656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.558904:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.558925:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796535168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.558939:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.558957:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796534656 00000100:00100000:0.0:1746147733.558960:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796534656 00000100:00100000:0.0:1746147733.558973:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796535168 00000100:00100000:0.0:1746147733.558975:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796535168 00000100:00100000:0.0:1746147733.558984:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16939 00000100:00100000:0.0:1746147733.558988:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3301:x1830967796535040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147733.559061:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3301:x1830967796534528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 209us (346us total) trans 17179874412 rc 0/0 00000100:00100000:1.0:1746147733.559066:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16938 00000100:00100000:1.0:1746147733.559075:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16940 00000100:00100000:1.0:1746147733.559078:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3301:x1830967796534656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.559118:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3301:x1830967796535040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (343us total) trans 17179874413 rc 0/0 00000100:00100000:0.0:1746147733.559122:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16939 00000100:00100000:0.0:1746147733.559131:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16941 00000100:00100000:0.0:1746147733.559135:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3301:x1830967796535168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147733.559152:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3301:x1830967796534656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (267us total) trans 17179874414 rc 0/0 00000100:00100000:1.0:1746147733.559156:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16940 00000100:00080000:1.0:1746147733.559170:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147733.559187:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147733.559198:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796534784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.559209:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3301:x1830967796535168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (268us total) trans 17179874415 rc 0/0 00000100:00100000:1.0:1746147733.559213:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.559214:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16941 00000100:00100000:0.0:1746147733.559221:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796534272 00000100:00100000:1.0:1746147733.559222:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147733.559224:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796534272 00000100:00100000:1.0:1746147733.559226:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796534400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.559233:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796534784 00000100:00100000:0.0:1746147733.559235:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796534784 00000100:00100000:1.0:1746147733.559239:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147733.559462:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796535680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147733.559485:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.559517:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796534400 00000100:00100000:0.0:1746147733.559521:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796534400 00000100:00100000:2.0:1746147733.559525:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796535424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147733.559541:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16942 00000100:00100000:0.0:1746147733.559545:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3303:x1830967796534272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147733.559552:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16943 00000100:00100000:2.0:1746147733.559557:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3303:x1830967796534784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147733.559648:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796534784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (423us total) trans 17179874417 rc 0/0 00000100:00100000:0.0:1746147733.559648:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796534272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (451us total) trans 17179874416 rc 0/0 00000100:00100000:0.0:1746147733.559653:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16942 00000100:00100000:2.0:1746147733.559655:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16943 00000100:00100000:2.0:1746147733.559663:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16944 00000100:00100000:2.0:1746147733.559667:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3303:x1830967796534400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.559679:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796535552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147733.559752:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3303:x1830967796534400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (511us total) trans 17179874418 rc 0/0 00000100:00100000:2.0:1746147733.559757:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16944 00000100:00100000:1.0:1746147733.561309:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796534912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147733.561496:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796536192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147733.561520:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147733.561581:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796535680 00000100:00100000:1.0:1746147733.561586:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796535680 00000100:00100000:1.0:1746147733.561620:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796536192 00000100:00100000:1.0:1746147733.561622:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796536192 00000100:00100000:1.0:1746147733.561632:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16945 00000100:00100000:1.0:1746147733.561649:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3302:x1830967796535680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147733.561898:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3302:x1830967796535680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 244us (2395us total) trans 21474841650 rc 0/0 00000100:00100000:1.0:1746147733.561905:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16945 00000100:00100000:0.0:1746147733.561907:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147733.561917:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796535552 00000100:00100000:1.0:1746147733.561919:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796535552 00000100:00100000:1.0:1746147733.561931:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16946 00000100:00100000:0.0:1746147733.561933:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796536064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147733.561935:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3302:x1830967796536192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147733.561953:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147733.561984:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0435180/2, rc 0, transno 17179874414 00000100:00100000:0.0:1746147733.561994:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796534656:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147733.562004:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0437100/2, rc 0, transno 17179874415 00000100:00100000:0.0:1746147733.562007:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796535168:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147733.562015:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0434e00/2, rc 0, transno 17179874412 00000100:00100000:0.0:1746147733.562017:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796534528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147733.562022:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3302:x1830967796536192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (501us total) trans 21474841651 rc 0/0 00000004:00080000:0.0:1746147733.562024:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0434000/2, rc 0, transno 17179874413 00000100:00100000:1.0:1746147733.562026:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16946 00000100:00100000:0.0:1746147733.562027:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796535040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147733.562034:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796536064 00000100:00100000:1.0:1746147733.562036:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796536064 00000100:00100000:1.0:1746147733.562049:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16947 00000100:00100000:1.0:1746147733.562053:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3301:x1830967796535552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147733.562119:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.562130:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3301:x1830967796535552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (224us total) trans 21474841652 rc 0/0 00000100:00100000:1.0:1746147733.562136:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16947 00000100:00100000:1.0:1746147733.562144:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16948 00000100:00100000:1.0:1746147733.562148:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3301:x1830967796536064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147733.562178:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147733.562200:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0437800/2, rc 0, transno 17179874416 00000100:00100000:1.0:1746147733.562217:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3301:x1830967796536064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (263us total) trans 21474841653 rc 0/0 00000100:00100000:0.0:1746147733.562218:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796534272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147733.562222:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16948 00000004:00080000:0.0:1746147733.562227:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0436300/2, rc 0, transno 17179874417 00000100:00100000:1.0:1746147733.562228:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796534912 00000100:00100000:1.0:1746147733.562230:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796534912 00000100:00100000:0.0:1746147733.562230:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796534784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.562238:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796535296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147733.562245:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16949 00000100:00100000:1.0:1746147733.562249:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3303:x1830967796534912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.562256:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.562268:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796535808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147733.562281:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.562290:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796536320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.562301:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147733.562316:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0436d80/2, rc 0, transno 17179874418 00000100:00100000:0.0:1746147733.562319:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796534400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.562332:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796535296 00000100:00100000:0.0:1746147733.562335:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796535296 00000100:00100000:0.0:1746147733.562348:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796535808 00000100:00100000:0.0:1746147733.562349:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796535808 00000100:00100000:1.0:1746147733.562354:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796534912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (175us total) trans 17179874419 rc 0/0 00000100:00100000:0.0:1746147733.562354:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796536320 00000100:00100000:0.0:1746147733.562355:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796536320 00000100:00100000:1.0:1746147733.562359:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16949 00000100:00100000:0.0:1746147733.562363:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16950 00000100:00100000:0.0:1746147733.562368:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3303:x1830967796535296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147733.562369:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16951 00000100:00100000:1.0:1746147733.562373:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3303:x1830967796535808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147733.562404:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16952 00000100:00100000:1.0:1746147733.562408:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796536320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.562479:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3303:x1830967796535296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (222us total) trans 21474841654 rc 0/0 00000100:00100000:1.0:1746147733.562484:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3303:x1830967796536320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (182us total) trans 17179874420 rc 0/0 00000100:00100000:0.0:1746147733.562485:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16950 00000100:00100000:1.0:1746147733.562490:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16952 00000100:00080000:1.0:1746147733.562513:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1746147733.562531:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02adc00/2, rc 0, transno 21474841654 00000100:00100000:1.0:1746147733.562535:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796535296:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147733.562542:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d7ed80/2, rc 0, transno 17179874420 00000100:00100000:1.0:1746147733.562545:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796536320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147733.562551:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0437480/2, rc 0, transno 17179874419 00000100:00100000:1.0:1746147733.562553:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796534912:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147733.562566:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02aea00/2, rc 0, transno 21474841652 00000100:00100000:1.0:1746147733.562569:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796535552:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147733.562574:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02ad880/2, rc 0, transno 21474841653 00000100:00100000:1.0:1746147733.562576:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796536064:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147733.562675:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147733.562695:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796535936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147733.562714:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147733.562733:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796535424 00000100:00100000:2.0:1746147733.562737:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796535424 00000100:00100000:2.0:1746147733.562750:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796535936 00000100:00100000:2.0:1746147733.562752:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796535936 00000100:00100000:2.0:1746147733.562761:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16953 00000100:00100000:2.0:1746147733.562765:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3304:x1830967796535424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147733.562872:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3304:x1830967796535424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (196us total) trans 21474841655 rc 0/0 00000100:00100000:2.0:1746147733.562877:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16953 00000100:00100000:2.0:1746147733.563008:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16954 00000100:00100000:2.0:1746147733.563013:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3304:x1830967796535936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147733.563092:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3304:x1830967796535936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (376us total) trans 21474841656 rc 0/0 00000100:00100000:2.0:1746147733.563097:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16954 00000004:00080000:2.0:1746147733.563121:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02aed80/2, rc 0, transno 21474841655 00000100:00100000:2.0:1746147733.563124:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796535424:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147733.563130:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02af480/2, rc 0, transno 21474841656 00000100:00100000:2.0:1746147733.563133:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796535936:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147733.563202:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02ae300/2, rc 0, transno 21474841650 00000100:00100000:3.0:1746147733.563206:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796535680:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147733.563212:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02ac380/2, rc 0, transno 21474841651 00000100:00100000:3.0:1746147733.563214:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796536192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147733.563228:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794173312 00000100:00100000:3.0:1746147733.563231:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794173312 00000100:00100000:3.0:1746147733.563270:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12091 00000100:00100000:3.0:1746147733.563275:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+7:32508:x1830967794173312:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147733.563289:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.563312:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092c25000/0xe64d3fbf12a7ec8a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc671 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.563361:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092c25000/0xe64d3fbf12a7ec8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc671 expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.563374:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092c25000/0xe64d3fbf12a7ec8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc671 expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.563391:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147733.563394:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147733.563397:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092c25000, rc 0) 00000100:00100000:3.0:1746147733.563432:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+8:32508:x1830967794173312:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 157us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.563437:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12091 00002000:00010000:1.0:1746147733.563966:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:1.0:1746147733.563970:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147733.563972:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147733.563974:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147733.563976:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:1.0:1746147733.565206:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796535808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2827us (2918us total) trans 21474841657 rc 0/0 00000100:00100000:1.0:1746147733.565216:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16951 00000004:00080000:2.0:1746147733.565487:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02af100/2, rc 0, transno 21474841657 00000100:00100000:2.0:1746147733.565493:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796535808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147733.569436:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.569548:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794173440 00000100:00100000:2.0:1746147733.569558:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794173440 00000100:00100000:2.0:1746147733.569622:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12092 00000100:00100000:2.0:1746147733.569669:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32508:x1830967794173440:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147733.569693:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.569713:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ec91 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc678 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.569803:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ec98 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.569817:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ec98 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.569833:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ec98 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147733.570070:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147733.570075:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147733.570091:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ec98 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.570114:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ec91 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc678 expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.570143:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ec98 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc678 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.570151:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.570154:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147733.570158:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55e8400, rc 0) 00000100:00100000:2.0:1746147733.570265:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+9:32508:x1830967794173440:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 589us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.570273:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12092 00000100:00100000:2.0:1746147733.573683:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.573714:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.573819:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.573849:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794173568 00000100:00100000:2.0:1746147733.573859:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794173568 00000100:00100000:2.0:1746147733.573921:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794173696 00000100:00100000:2.0:1746147733.573923:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794173696 00000100:00100000:2.0:1746147733.573934:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794173824 00000100:00100000:2.0:1746147733.573935:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794173824 00000100:00100000:2.0:1746147733.573947:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16955 00000100:00100000:2.0:1746147733.573953:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+5:1960:x1830967794173568:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:3.0:1746147733.573960:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16956 00000100:00100000:3.0:1746147733.573969:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794173696:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147733.573971:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.573978:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.573990:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7ec9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc67f expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.573993:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092c24000/0xe64d3fbf12a7eca6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc686 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147733.574014:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x68141996, atime: 0x68141993, ctime: 0x68141996, blocks: 0x81b 00002000:00010000:2.0:1746147733.574014:0:20619:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x68141996, atime: 0x68141996, ctime: 0x68141996, blocks: 0x7fd 00010000:00010000:3.0:1746147733.574030:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.574030:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.574032:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.574033:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.574041:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092c24000/0xe64d3fbf12a7eca6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc686 expref: 8 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147733.574041:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7ec9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc67f expref: 6 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147733.574054:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7ec9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc67f expref: 6 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.574055:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092c24000/0xe64d3fbf12a7eca6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc686 expref: 8 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.574064:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092c24000, rc 0) 00010000:00010000:2.0:1746147733.574064:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d5000, rc 0) 00000100:00100000:3.0:1746147733.574122:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794173696:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 154us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.574128:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16956 00000100:00100000:1.0:1746147733.574136:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16957 00000100:00100000:1.0:1746147733.574148:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794173824:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147733.574154:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147733.574163:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a913e600/0xe64d3fbf12a7ecad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc68d expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147733.574174:0:9615:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x68141995, atime: 0x68141995, ctime: 0x68141995, blocks: 0x821 00010000:00010000:1.0:1746147733.574181:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.574182:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.574186:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a913e600/0xe64d3fbf12a7ecad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc68d expref: 8 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.574201:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a913e600/0xe64d3fbf12a7ecad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc68d expref: 8 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.574208:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a913e600, rc 0) 00000100:00100000:1.0:1746147733.574243:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794173824:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 96us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.574248:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16957 00000100:00100000:0.0:1746147733.574673:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.574693:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.574730:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.575051:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794174080 00000100:00100000:3.0:1746147733.575060:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794174080 00000100:00100000:3.0:1746147733.575086:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794173952 00000100:00100000:3.0:1746147733.575088:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794173952 00000100:00100000:3.0:1746147733.575098:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794174208 00000100:00100000:3.0:1746147733.575100:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794174208 00000100:00100000:3.0:1746147733.575115:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16958 00000100:00100000:3.0:1746147733.575121:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794174080:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147733.575130:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.575141:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092c24600/0xe64d3fbf12a7ecb4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc69b expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.575155:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16959 00002000:00010000:3.0:1746147733.575158:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x458:0x0] initial LVB size: 5013696, mtime: 0x68141996, atime: 0x68141995, ctime: 0x68141996, blocks: 0x1691 00000100:00100000:1.0:1746147733.575162:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794173952:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147733.575167:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.575169:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.575169:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.575174:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092c24600/0xe64d3fbf12a7ecb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc69b expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.575183:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009579fc00/0xe64d3fbf12a7ecbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc694 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.575189:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092c24600/0xe64d3fbf12a7ecb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc69b expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147733.575193:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16960 00002000:00010000:1.0:1746147733.575195:0:8469:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x68141996, atime: 0x68141995, ctime: 0x68141996, blocks: 0x81f 00010000:00010000:3.0:1746147733.575197:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092c24600, rc 0) 00010000:00010000:1.0:1746147733.575202:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.575204:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147733.575206:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794174208:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147733.575208:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009579fc00/0xe64d3fbf12a7ecbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc694 expref: 10 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.575218:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009579fc00/0xe64d3fbf12a7ecbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc694 expref: 10 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147733.575222:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147733.575225:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009579fc00, rc 0) 00000100:00100000:3.0:1746147733.575227:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794174080:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 107us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.575232:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16958 00010000:00010000:0.0:1746147733.575240:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ecc2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc6a2 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.575241:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794173952:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 81us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.575250:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16959 00000100:00100000:2.0:1746147733.575419:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794173568:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1463us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.575424:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16955 00002000:00010000:0.0:1746147733.575532:0:10613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x456:0x0] initial LVB size: 4194304, mtime: 0x68141996, atime: 0x68141996, ctime: 0x68141996, blocks: 0x1029 00010000:00010000:0.0:1746147733.575550:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.575552:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.575560:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ecc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a2 expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147733.575573:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ecc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a2 expref: 9 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147733.575582:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e127e00, rc 0) 00000100:00100000:0.0:1746147733.575614:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794174208:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 413us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147733.575621:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16960 00000100:00100000:0.0:1746147733.583550:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.583587:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.583617:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.583655:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.584519:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794174720 00000100:00100000:1.0:1746147733.584528:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794174720 00000100:00100000:1.0:1746147733.584580:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794174592 00000100:00100000:1.0:1746147733.584582:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794174592 00000100:00100000:1.0:1746147733.584591:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794174976 00000100:00100000:1.0:1746147733.584593:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794174976 00000100:00100000:1.0:1746147733.584617:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794175104 00000100:00100000:1.0:1746147733.584619:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794175104 00000100:00100000:1.0:1746147733.584634:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7664 00000100:00100000:1.0:1746147733.584649:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794174720:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:1.0:1746147733.584681:0:31360:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ecc9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.584693:0:31360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.584695:0:31360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.584699:0:31360:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ecc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.584716:0:31360:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ecc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.584835:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7665 00000100:00100000:3.0:1746147733.584851:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794174592:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:3.0:1746147733.584913:0:2402:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092c25e00/0xe64d3fbf12a7ecd0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.584924:0:2402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.584926:0:2402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.584930:0:2402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092c25e00/0xe64d3fbf12a7ecd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.584941:0:2402:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092c25e00/0xe64d3fbf12a7ecd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.585069:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7666 00000100:00100000:2.0:1746147733.585077:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794174976:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:2.0:1746147733.585097:0:31355:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7ecd7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.585104:0:31355:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.585105:0:31355:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.585107:0:31355:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7ecd7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.585116:0:31355:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7ecd7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.586397:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7667 00000100:00100000:1.0:1746147733.586407:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794175104:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:1.0:1746147733.586426:0:31358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7ecde lrc: 3/1,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.586436:0:31358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.586438:0:31358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.586441:0:31358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7ecde lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.586449:0:31358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7ecde lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147733.587031:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.587061:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.587071:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794175488 00000100:00100000:0.0:1746147733.587076:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794175488 00000100:00100000:0.0:1746147733.587102:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794175744 00000100:00100000:0.0:1746147733.587103:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794175744 00000100:00100000:0.0:1746147733.587118:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7668 00000100:00100000:0.0:1746147733.587123:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794175488:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:0.0:1746147733.587136:0:31356:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7ece5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.587144:0:31356:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.587146:0:31356:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.587148:0:31356:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7ece5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.587156:0:31356:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7ece5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.587630:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7669 00000100:00100000:3.0:1746147733.587656:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794175744:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:3.0:1746147733.587687:0:31359:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092c25800/0xe64d3fbf12a7ecec lrc: 3/1,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.587703:0:31359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.587705:0:31359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.587708:0:31359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092c25800/0xe64d3fbf12a7ecec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.587718:0:31359:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092c25800/0xe64d3fbf12a7ecec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147733.589301:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.590032:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.590055:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794176000 00000100:00100000:0.0:1746147733.590061:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794176000 00000100:00100000:0.0:1746147733.590094:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794176256 00000100:00100000:0.0:1746147733.590096:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794176256 00000100:00100000:0.0:1746147733.590120:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7670 00000100:00100000:0.0:1746147733.590126:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794176000:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:0.0:1746147733.590151:0:31357:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009cef4600/0xe64d3fbf12a7ecf3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.590162:0:31357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.590163:0:31357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.590167:0:31357:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cef4600/0xe64d3fbf12a7ecf3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.590178:0:31357:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cef4600/0xe64d3fbf12a7ecf3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.590915:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7671 00000100:00100000:1.0:1746147733.590923:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794176256:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:1.0:1746147733.590941:0:21458:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a213dc00/0xe64d3fbf12a7ecfa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.590949:0:21458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.590951:0:21458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.590954:0:21458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a213dc00/0xe64d3fbf12a7ecfa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.590962:0:21458:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a213dc00/0xe64d3fbf12a7ecfa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.600647:0:31356:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7ece5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.600663:0:31356:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7ece5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.600670:0:31356:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7ece5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.600682:0:31356:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5653800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147733.600685:0:31356:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7ece5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.600692:0:31356:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7ece5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.600707:0:31356:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7ece5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.600713:0:31356:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5653800/0xe64d3fbf12a7ece5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31356 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.600779:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794175488:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 13650us (13743us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147733.600789:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7668 00010000:00010000:3.0:1746147733.602277:0:2402:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092c25e00/0xe64d3fbf12a7ecd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.602288:0:2402:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092c25e00/0xe64d3fbf12a7ecd0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.602294:0:2402:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092c25e00/0xe64d3fbf12a7ecd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.602300:0:2402:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092c25e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147733.602303:0:2402:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092c25e00/0xe64d3fbf12a7ecd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.602309:0:2402:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092c25e00/0xe64d3fbf12a7ecd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.602320:0:2402:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092c25e00/0xe64d3fbf12a7ecd0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.602325:0:2402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092c25e00/0xe64d3fbf12a7ecd0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.602399:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41587371-240a-4781-aecb-638f17200fbd+15:1959:x1830967794174592:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 17551us (18809us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147733.602407:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7665 00010000:00010000:3.0:1746147733.610381:0:31359:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092c25800/0xe64d3fbf12a7ecec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.610395:0:31359:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092c25800/0xe64d3fbf12a7ecec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.610404:0:31359:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092c25800/0xe64d3fbf12a7ecec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.610411:0:31359:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092c25800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147733.610414:0:31359:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092c25800/0xe64d3fbf12a7ecec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.610422:0:31359:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092c25800/0xe64d3fbf12a7ecec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.610438:0:31359:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092c25800/0xe64d3fbf12a7ecec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.610444:0:31359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092c25800/0xe64d3fbf12a7ecec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.610528:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794175744:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 22886us (23462us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147733.610538:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7669 00010000:00010000:3.0:1746147733.617919:0:31355:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7ecd7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.617932:0:31355:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7ecd7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.617939:0:31355:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7ecd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.617945:0:31355:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d4400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147733.617948:0:31355:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7ecd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.617955:0:31355:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7ecd7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.617968:0:31355:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7ecd7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.617973:0:31355:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d4400/0xe64d3fbf12a7ecd7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.618060:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794174976:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 32979us (34437us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147733.618070:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7666 00010000:00010000:1.0:1746147733.619575:0:31358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7ecde lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.619587:0:31358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7ecde lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.619594:0:31358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7ecde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.619600:0:31358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a213de00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147733.619603:0:31358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7ecde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.619609:0:31358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7ecde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.619621:0:31358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7ecde lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.619626:0:31358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7ecde lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.619696:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794175104:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 33289us (36037us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147733.619703:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7667 00010000:00010000:3.0:1746147733.626343:0:31360:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ecc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.626362:0:31360:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ecc9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.626369:0:31360:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ecc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.626375:0:31360:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0301c00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147733.626378:0:31360:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ecc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.626385:0:31360:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ecc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.626401:0:31360:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ecc9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.626450:0:31360:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0301c00/0xe64d3fbf12a7ecc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31360 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.626837:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794174720:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 42191us (43290us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147733.626846:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7664 00010000:00010000:2.0:1746147733.629646:0:21458:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a213dc00/0xe64d3fbf12a7ecfa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.629661:0:21458:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a213dc00/0xe64d3fbf12a7ecfa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.629671:0:21458:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a213dc00/0xe64d3fbf12a7ecfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.629677:0:21458:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a213dc00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147733.629680:0:21458:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a213dc00/0xe64d3fbf12a7ecfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.629691:0:21458:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a213dc00/0xe64d3fbf12a7ecfa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.629705:0:21458:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a213dc00/0xe64d3fbf12a7ecfa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.630606:0:21458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a213dc00/0xe64d3fbf12a7ecfa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.630681:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794176256:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 39756us (40646us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147733.630689:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7671 00010000:00010000:1.0:1746147733.630770:0:31357:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009cef4600/0xe64d3fbf12a7ecf3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.630778:0:31357:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cef4600/0xe64d3fbf12a7ecf3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.630784:0:31357:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cef4600/0xe64d3fbf12a7ecf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.630789:0:31357:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cef4600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147733.630792:0:31357:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cef4600/0xe64d3fbf12a7ecf3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.630798:0:31357:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cef4600/0xe64d3fbf12a7ecf3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.630808:0:31357:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cef4600/0xe64d3fbf12a7ecf3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.630814:0:31357:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cef4600/0xe64d3fbf12a7ecf3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.630847:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794176000:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 40720us (41550us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147733.630852:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7670 00000100:00100000:0.0:1746147733.636023:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.636104:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794176512 00000100:00100000:2.0:1746147733.636112:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794176512 00000100:00100000:2.0:1746147733.636251:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12093 00000100:00100000:2.0:1746147733.636259:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+9:32508:x1830967794176512:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:2.0:1746147733.636305:0:17544:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147733.636325:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e8400/0xe64d3fbf12a7ec98 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc678 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.636351:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.636358:0:17544:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147733.636390:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ed01 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.636399:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ed01 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.636411:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ed01 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00010000:2.0:1746147733.636556:0:17544:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a0226a00 reply state ffff8800a5cc1000 transno 8589946124 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ed01 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:2.0:1746147733.636562:0:17544:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147733.636624:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+10:32508:x1830967794176512:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 366us (608us total) trans 8589946124 rc 0/0 00000100:00100000:2.0:1746147733.636630:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12093 00010000:00010000:2.0:1746147733.637958:0:3288:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ed01 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.637968:0:3288:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ed01 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.637974:0:3288:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ed01 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.637979:0:3288:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55e9800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147733.637983:0:3288:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ed01 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.637989:0:3288:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ed01 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.637998:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.638000:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147733.638003:0:3288:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ed01 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.638007:0:3288:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9800/0xe64d3fbf12a7ed01 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147733.638135:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.638201:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.638351:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.638397:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794176768 00000100:00100000:3.0:1746147733.638402:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794176768 00000100:00100000:0.0:1746147733.638406:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.638417:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.638435:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.638436:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794177024 00000100:00100000:3.0:1746147733.638438:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794177024 00000100:00100000:3.0:1746147733.638451:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794177280 00000100:00100000:3.0:1746147733.638453:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794177280 00000100:00100000:1.0:1746147733.638459:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794176640 00000100:00100000:3.0:1746147733.638462:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794176896 00000100:00100000:3.0:1746147733.638464:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794176896 00000100:00100000:1.0:1746147733.638464:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794176640 00000100:00100000:2.0:1746147733.638466:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794177152 00000100:00100000:2.0:1746147733.638468:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794177152 00000100:00100000:3.0:1746147733.638474:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16961 00000100:00100000:3.0:1746147733.638479:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794176768:12345-192.168.202.10@tcp:2:lfs.0 00000100:00100000:1.0:1746147733.638487:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16962 00000100:00100000:2.0:1746147733.638492:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16963 00000100:00100000:1.0:1746147733.638493:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794177024:12345-192.168.202.10@tcp:2:lfs.0 00000100:00100000:2.0:1746147733.638496:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794177280:12345-192.168.202.10@tcp:2:lfs.0 00000100:00100000:2.0:1746147733.638523:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16964 00000100:00100000:2.0:1746147733.638528:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794176896:12345-192.168.202.10@tcp:2:lfs.0 00000100:00100000:2.0:1746147733.638563:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16965 00000100:00100000:2.0:1746147733.638567:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794176640:12345-192.168.202.10@tcp:2:lfs.0 00002000:00010000:3.0:1746147733.638608:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147733.638608:0:4591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147733.638611:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:1.0:1746147733.638611:0:4591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:3.0:1746147733.638613:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147731 -> 1746147734 00002000:00010000:1.0:1746147733.638613:0:4591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147733 -> 1746147734 00002000:00010000:3.0:1746147733.638615:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:1.0:1746147733.638615:0:4591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:3.0:1746147733.638616:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2075 -> 2075 00002000:00010000:1.0:1746147733.638617:0:4591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:2.0:1746147733.638619:0:7050:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147733.638621:0:7050:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.638622:0:7050:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.638624:0:7050:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.638626:0:7050:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 2045 -> 2045 00000100:00100000:3.0:1746147733.638721:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794176768:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 240us (586us total) trans 21474841658 rc 0/0 00000100:00100000:1.0:1746147733.638723:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794177024:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 228us (520us total) trans 17179874421 rc 0/0 00000100:00100000:0.0:1746147733.638725:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16966 00000100:00100000:3.0:1746147733.638728:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16961 00000100:00100000:0.0:1746147733.638731:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794177152:12345-192.168.202.10@tcp:2:lfs.0 00000100:00100000:1.0:1746147733.638734:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16962 00002000:00010000:0.0:1746147733.638790:0:21480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:0.0:1746147733.638792:0:21480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147733.638794:0:21480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147733 -> 1746147734 00002000:00010000:0.0:1746147733.638800:0:21480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147733.638801:0:21480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:2.0:1746147733.638812:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794176640:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 243us (404us total) trans 17179874422 rc 0/0 00000100:00100000:0.0:1746147733.638814:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794177152:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 85us (378us total) trans 17179874423 rc 0/0 00000100:00100000:2.0:1746147733.638817:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16965 00000100:00100000:0.0:1746147733.638819:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16966 00002000:00010000:2.0:1746147733.638905:0:6715:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147733.638907:0:6715:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147733 -> 1746147734 00002000:00010000:2.0:1746147733.638909:0:6715:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147733 -> 1746147734 00002000:00010000:2.0:1746147733.638911:0:6715:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147733 -> 1746147734 00002000:00010000:2.0:1746147733.638912:0:6715:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147733.638928:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794176896:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 400us (509us total) trans 21474841659 rc 0/0 00000100:00100000:2.0:1746147733.638936:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16964 00002000:00010000:2.0:1746147733.638985:0:10613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147733.638987:0:10613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.638988:0:10613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.638990:0:10613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.638991:0:10613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746147733.639006:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794177280:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 509us (655us total) trans 21474841660 rc 0/0 00000100:00100000:2.0:1746147733.639010:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16963 00000100:00100000:0.0:1746147733.640469:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.640635:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794177536 00000100:00100000:1.0:1746147733.640650:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794177536 00000100:00100000:1.0:1746147733.640688:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5046 00000100:00100000:1.0:1746147733.640694:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+9:32508:x1830967794177536:12345-192.168.202.10@tcp:35:lfs.0 00000004:00010000:1.0:1746147733.640736:0:14549:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x3bf:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7ec4b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc66a expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.640775:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746147733.640785:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092c25000/0xe64d3fbf12a7ec8a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc671 expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.640791:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746147733.640813:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092c25000/0xe64d3fbf12a7ec8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc671 expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.640822:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092c25000/0xe64d3fbf12a7ec8a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc671 expref: 9 pid: 5744 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147733.640832:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5489f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14549:1830967796536448:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147733.640948:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943cc480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147733.642197:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5489f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14549:1830967796536448:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147733.642211:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746147733.642464:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.642531:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794177664 00000100:00100000:2.0:1746147733.642536:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794177664 00010000:00010000:2.0:1746147733.642556:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092c25000/0xe64d3fbf12a7ec8a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc671 expref: 10 pid: 5744 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.642583:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8688 00000100:00100000:2.0:1746147733.642589:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794177664:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147733.642598:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147733.642607:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092c25000/0xe64d3fbf12a7ec8a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc671 expref: 10 pid: 5744 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.642615:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092c25000/0xe64d3fbf12a7ec8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc671 expref: 10 pid: 5744 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.642629:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092c25000/0xe64d3fbf12a7ec8a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc671 expref: 10 pid: 5744 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.642658:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.642663:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746147733.642669:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746147733.642674:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746147733.642688:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147733.642711:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794177664:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 122us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.642716:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8688 00010000:00010000:1.0:1746147733.642784:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746147733.642790:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000040:00080000:1.0:1746147733.643335:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3685, 88 off308648 00000004:00080000:1.0:1746147733.643427:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812817541820ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147733.643652:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3692, 88 off308912 00000004:00080000:1.0:1746147733.643656:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812817771696ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147733.643750:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3693, 88 off309000 00000004:00080000:1.0:1746147733.643753:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812817869013ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147733.643760:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3686, 88 off308736 00000004:00080000:1.0:1746147733.643762:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812817878038ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147733.643769:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3687, 88 off308824 00000004:00080000:1.0:1746147733.643771:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812817886721ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147733.643779:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3694, 88 off309088 00000004:00080000:1.0:1746147733.643781:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812817896895ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147733.643788:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3695, 88 off309176 00000004:00080000:1.0:1746147733.643790:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812817905718ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147733.643795:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3696, 88 off309264 00000004:00080000:1.0:1746147733.643797:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812817912610ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147733.643802:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3688, 88 off308912 00000004:00080000:1.0:1746147733.643805:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812817920441ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147733.643811:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3697, 88 off309352 00000004:00080000:1.0:1746147733.643814:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812817929157ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147733.643819:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3689, 88 off309000 00000004:00080000:1.0:1746147733.643821:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812817937033ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147733.643828:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3698, 88 off309440 00000004:00080000:1.0:1746147733.643830:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812817945855ns, next at 756024029964ns, rc = 0 00000040:00080000:1.0:1746147733.643836:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3690, 88 off309088 00000004:00080000:1.0:1746147733.643838:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812817953796ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147733.643845:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3691, 88 off309176 00000004:00080000:1.0:1746147733.643847:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812817962627ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147733.643854:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3692, 88 off309264 00000004:00080000:1.0:1746147733.643856:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812817971911ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147733.643863:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3693, 88 off309352 00000004:00080000:1.0:1746147733.643865:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812817980885ns, next at 756039729591ns, rc = 0 00000040:00080000:1.0:1746147733.643876:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3699, 88 off309528 00000004:00080000:1.0:1746147733.643879:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812817994346ns, next at 756024029964ns, rc = 0 00000004:00010000:1.0:1746147733.656701:0:14549:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a0227100 reply state ffff8800a0342400 transno 8589946125 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746147733.656713:0:14549:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746147733.656722:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147733.656724:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147733.656731:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7ec4b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc66a expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.656818:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+9:32508:x1830967794177536:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 16124us (16352us total) trans 8589946125 rc 0/0 00000100:00100000:1.0:1746147733.656826:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5046 00000001:00080000:0.0:1746147733.656923:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946125 is committed 00000004:00080000:0.0:1746147733.656929:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2767 committed 00000004:00080000:0.0:1746147733.656936:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2761 committed 00000004:00080000:0.0:1746147733.656941:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2760 committed 00000004:00080000:0.0:1746147733.656943:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2759 committed 00000004:00080000:0.0:1746147733.656944:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2758 committed 00000004:00080000:0.0:1746147733.656945:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2766 committed 00000004:00080000:0.0:1746147733.656947:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2757 committed 00000004:00080000:0.0:1746147733.656948:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2765 committed 00000004:00080000:0.0:1746147733.656949:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2756 committed 00010000:00010000:3.0:1746147733.656951:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00000004:00080000:0.0:1746147733.656951:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2764 committed 00000004:00080000:0.0:1746147733.656953:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2763 committed 00000004:00080000:0.0:1746147733.656954:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2762 committed 00000004:00080000:0.0:1746147733.656956:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2755 committed 00000004:00080000:0.0:1746147733.656957:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2754 committed 00010000:00010000:3.0:1746147733.656958:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00000004:00080000:0.0:1746147733.656959:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2761 committed 00000004:00080000:0.0:1746147733.656960:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2760 committed 00000004:00080000:0.0:1746147733.656962:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2753 committed 00010000:00010000:3.0:1746147733.656963:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147733.656968:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a213d600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147733.656971:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147733.656977:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147733.656987:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147733.656989:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147733.656992:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147733.656996:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a213d600/0xe64d3fbf12a7ed08 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746147733.657064:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796536704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147733.657102:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147733.657123:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796537216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147733.657135:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147733.657145:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796537728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147733.657157:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147733.657166:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796538240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147733.657166:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796536576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147733.657178:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147733.657184:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796536960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147733.657191:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746147733.657195:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796536832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147733.657197:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147733.657207:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147733.657208:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796537472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147733.657215:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796537344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147733.657218:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147733.657226:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147733.657227:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796537984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147733.657234:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796537856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147733.657237:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147733.657244:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147733.657246:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796538496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147733.657252:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796538368:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147733.657257:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147733.657270:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796536704 00000100:00100000:3.0:1746147733.657275:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796536704 00000100:00100000:2.0:1746147733.657275:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796537216 00000100:00100000:2.0:1746147733.657277:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796537216 00000100:00100000:3.0:1746147733.657294:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796537728 00000100:00100000:3.0:1746147733.657296:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796537728 00000100:00100000:3.0:1746147733.657655:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796538240 00000100:00100000:2.0:1746147733.657655:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796536960 00000100:00100000:3.0:1746147733.657658:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796538240 00000100:00100000:2.0:1746147733.657658:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796536960 00000100:00100000:3.0:1746147733.657667:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796536832 00000100:00100000:2.0:1746147733.657667:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796537472 00000100:00100000:2.0:1746147733.657668:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796537472 00000100:00100000:3.0:1746147733.657669:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796536832 00000100:00100000:3.0:1746147733.657674:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796537984 00000100:00100000:2.0:1746147733.657674:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796537344 00000100:00100000:3.0:1746147733.657676:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796537984 00000100:00100000:2.0:1746147733.657676:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796537344 00000100:00100000:2.0:1746147733.657681:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796537856 00000100:00100000:3.0:1746147733.657682:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796538496 00000100:00100000:2.0:1746147733.657682:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796537856 00000100:00100000:3.0:1746147733.657683:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796538496 00000100:00100000:3.0:1746147733.657689:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16967 00000100:00100000:3.0:1746147733.657694:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3301:x1830967796536704:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147733.657827:0:10613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147733.657830:0:10613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:3.0:1746147733.657832:0:10613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:3.0:1746147733.657834:0:10613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:3.0:1746147733.657835:0:10613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2075 -> 2075 00000100:00100000:3.0:1746147733.657854:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3301:x1830967796536704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 160us (752us total) trans 21474841661 rc 0/0 00000100:00100000:2.0:1746147733.658045:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16968 00000100:00100000:2.0:1746147733.658050:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3301:x1830967796537216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147733.658128:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3301:x1830967796537216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (991us total) trans 21474841662 rc 0/0 00000100:00100000:2.0:1746147733.658133:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16968 00000100:00100000:2.0:1746147733.658141:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16969 00000100:00100000:2.0:1746147733.658144:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3301:x1830967796537728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147733.658354:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3301:x1830967796537728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (1196us total) trans 21474841663 rc 0/0 00000100:00100000:2.0:1746147733.658359:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16969 00000100:00100000:2.0:1746147733.658367:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16970 00000100:00100000:2.0:1746147733.658371:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3301:x1830967796538240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147733.658445:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3301:x1830967796538240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (1267us total) trans 17179874424 rc 0/0 00000100:00100000:2.0:1746147733.658450:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16970 00000100:00100000:2.0:1746147733.658459:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16971 00000100:00100000:2.0:1746147733.658463:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3303:x1830967796536960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147733.658525:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:0.0:1746147733.658525:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16972 00002000:00010000:2.0:1746147733.658527:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.658529:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.658531:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.658532:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746147733.658544:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16967 00000100:00100000:2.0:1746147733.658552:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3303:x1830967796536960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1354us total) trans 21474841664 rc 0/0 00000100:00100000:3.0:1746147733.658554:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16973 00000100:00100000:2.0:1746147733.658557:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16971 00000100:00100000:3.0:1746147733.658558:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3301:x1830967796536832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147733.658563:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16974 00000100:00100000:2.0:1746147733.658567:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3301:x1830967796537344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147733.658621:0:10613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147733.658621:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:3.0:1746147733.658623:0:10613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.658623:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:3.0:1746147733.658625:0:10613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.658625:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:3.0:1746147733.658627:0:10613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.658627:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:3.0:1746147733.658628:0:10613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:2.0:1746147733.658628:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:1.0:1746147733.658664:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16975 00000100:00100000:0.0:1746147733.658667:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3303:x1830967796537472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147733.658670:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3303:x1830967796537984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147733.658753:0:21480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:0.0:1746147733.658756:0:21480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147733.658757:0:21480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147733.658759:0:21480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147733.658761:0:21480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:3.0:1746147733.659205:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3301:x1830967796536832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 645us (1996us total) trans 21474841665 rc 0/0 00000100:00100000:2.0:1746147733.659205:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3301:x1830967796537344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 637us (1977us total) trans 17179874425 rc 0/0 00000100:00100000:2.0:1746147733.659210:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16974 00000100:00100000:3.0:1746147733.659212:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16973 00000100:00100000:2.0:1746147733.659219:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16976 00000100:00100000:3.0:1746147733.659221:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16977 00000100:00100000:2.0:1746147733.659224:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3301:x1830967796537856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147733.659225:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3303:x1830967796538496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147733.659267:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147733.659287:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796537088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147733.659305:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3303:x1830967796538496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (2046us total) trans 17179874426 rc 0/0 00000100:00100000:2.0:1746147733.659305:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147733.659310:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16977 00000100:00100000:2.0:1746147733.659314:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796537600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147733.659323:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796536576 00000100:00100000:2.0:1746147733.659324:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147733.659326:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796536576 00000100:00100000:2.0:1746147733.659333:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796538112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147733.659336:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796537088 00000100:00100000:3.0:1746147733.659337:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796537088 00000100:00100000:3.0:1746147733.659342:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796537600 00000100:00100000:3.0:1746147733.659344:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796537600 00000100:00100000:2.0:1746147733.659346:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147733.659349:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796538112 00000100:00100000:3.0:1746147733.659351:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796538112 00000100:00100000:3.0:1746147733.659358:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16978 00000100:00100000:3.0:1746147733.659362:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3304:x1830967796536576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147733.659363:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16979 00000100:00100000:2.0:1746147733.659367:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3304:x1830967796537088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147733.659439:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3303:x1830967796537984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 769us (2200us total) trans 21474841666 rc 0/0 00000100:00100000:0.0:1746147733.659586:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3303:x1830967796537472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 921us (2366us total) trans 21474841667 rc 0/0 00002000:00010000:2.0:1746147733.659743:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147733.659746:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.659748:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.659750:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.659752:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746147733.659770:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3304:x1830967796537088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 403us (464us total) trans 17179874427 rc 0/0 00000100:00100000:3.0:1746147733.659928:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16980 00000100:00100000:1.0:1746147733.659935:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16975 00000100:00100000:3.0:1746147733.659938:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3304:x1830967796537600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147733.659947:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16981 00000100:00100000:1.0:1746147733.659951:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3304:x1830967796538112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147733.660014:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+22:3304:x1830967796537600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (688us total) trans 17179874428 rc 0/0 00000100:00100000:1.0:1746147733.660014:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3304:x1830967796538112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (667us total) trans 21474841668 rc 0/0 00000100:00100000:3.0:1746147733.660019:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16980 00000100:00100000:1.0:1746147733.660021:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16981 00000100:00100000:3.0:1746147733.660048:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.660273:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16972 00000100:00100000:2.0:1746147733.660284:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16979 00000100:00100000:0.0:1746147733.660284:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796538368 00000100:00100000:0.0:1746147733.660286:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796538368 00000100:00100000:0.0:1746147733.660301:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16982 00000100:00100000:0.0:1746147733.660305:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3301:x1830967796538368:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147733.660324:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02afb80/2, rc 0, transno 21474841664 00000100:00100000:2.0:1746147733.660329:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796536960:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147733.660337:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02ad500/2, rc 0, transno 21474841667 00000100:00100000:2.0:1746147733.660340:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796537472:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147733.660347:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02adf80/2, rc 0, transno 21474841666 00000100:00100000:2.0:1746147733.660349:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796537984:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147733.660355:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091630a80/2, rc 0, transno 17179874426 00000100:00100000:2.0:1746147733.660362:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796538496:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147733.660376:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0227480/2, rc 0, transno 17179874427 00000100:00100000:2.0:1746147733.660379:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796537088:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147733.660384:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0224000/2, rc 0, transno 17179874428 00000100:00100000:0.0:1746147733.660385:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3301:x1830967796538368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (336us total) trans 17179874429 rc 0/0 00000100:00100000:2.0:1746147733.660387:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796537600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.660390:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16982 00000004:00080000:2.0:1746147733.660392:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02ace00/2, rc 0, transno 21474841668 00000100:00100000:2.0:1746147733.660394:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796538112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147733.660446:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796538624:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147733.660457:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3301:x1830967796537856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1234us (3211us total) trans 17179874430 rc 0/0 00000100:00100000:0.0:1746147733.660461:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147733.660462:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16976 00000100:00100000:2.0:1746147733.660469:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796538624 00000100:00100000:2.0:1746147733.660472:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796538624 00000100:00100000:2.0:1746147733.660481:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16983 00000100:00100000:2.0:1746147733.660485:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3304:x1830967796538624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147733.660555:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3304:x1830967796538624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (93us total) trans 17179874431 rc 0/0 00000100:00100000:2.0:1746147733.660560:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16983 00002000:00010000:2.0:1746147733.660653:0:10613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147733.660656:0:10613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.660658:0:10613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.660659:0:10613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.660661:0:10613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 2045 -> 2045 00000100:00100000:2.0:1746147733.660685:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3304:x1830967796536576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1322us (1417us total) trans 17179874432 rc 0/0 00000100:00100000:2.0:1746147733.660691:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16978 00000004:00080000:3.0:1746147733.660754:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02ad180/2, rc 0, transno 21474841661 00000100:00100000:3.0:1746147733.660759:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796536704:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147733.660770:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02af800/2, rc 0, transno 21474841662 00000100:00100000:3.0:1746147733.660773:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796537216:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147733.660780:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02ae680/2, rc 0, transno 21474841663 00000100:00100000:3.0:1746147733.660782:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796537728:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147733.660790:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091631180/2, rc 0, transno 17179874424 00000100:00100000:3.0:1746147733.660793:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796538240:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147733.660801:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a02aca80/2, rc 0, transno 21474841665 00000100:00100000:3.0:1746147733.660803:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796536832:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147733.660810:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0227b80/2, rc 0, transno 17179874425 00000100:00100000:3.0:1746147733.660812:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796537344:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147733.660817:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0224380/2, rc 0, transno 17179874430 00000100:00100000:3.0:1746147733.660820:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796537856:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147733.660826:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091630380/2, rc 0, transno 17179874429 00000100:00100000:3.0:1746147733.660828:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796538368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147733.660912:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091631f80/2, rc 0, transno 17179874431 00000100:00100000:0.0:1746147733.660916:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796538624:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147733.660923:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0226d80/2, rc 0, transno 17179874432 00000100:00100000:0.0:1746147733.660926:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796536576:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147733.661348:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.661471:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794177792 00000100:00100000:0.0:1746147733.661475:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794177792 00000100:00100000:0.0:1746147733.661551:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12094 00000100:00100000:0.0:1746147733.661557:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+6:32508:x1830967794177792:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147733.661569:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147733.661582:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7ed0f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc6a9 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.661626:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7ed0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a9 expref: 7 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.661647:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7ed0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a9 expref: 7 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.661661:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147733.661663:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147733.661666:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0298800, rc 0) 00000100:00100000:0.0:1746147733.661846:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+7:32508:x1830967794177792:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 288us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147733.661851:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12094 00000100:00100000:0.0:1746147733.663961:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.664053:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794178048 00000100:00100000:1.0:1746147733.664058:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794178048 00000100:00100000:1.0:1746147733.664135:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5047 00000100:00100000:1.0:1746147733.664143:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+7:32508:x1830967794178048:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:1.0:1746147733.664327:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+8:32508:x1830967794178048:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 185us (371us total) trans 8589946126 rc 0/0 00000100:00100000:1.0:1746147733.664332:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5047 00000100:00100000:0.0:1746147733.681949:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.682018:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794178560 00000100:00100000:2.0:1746147733.682025:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794178560 00000100:00100000:2.0:1746147733.682075:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12095 00000100:00100000:2.0:1746147733.682082:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:32519:x1830967794178560:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.682101:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.682117:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7ed16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc6b7 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147733.682180:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.682216:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794178432 00000100:00100000:3.0:1746147733.682220:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794178432 00010000:00010000:2.0:1746147733.682224:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248e00/0xe64d3fbf12a7ed1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682237:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248e00/0xe64d3fbf12a7ed1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00000100:00100000:3.0:1746147733.682246:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12096 00010000:00010000:2.0:1746147733.682249:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248e00/0xe64d3fbf12a7ed1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:3.0:1746147733.682251:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:32520:x1830967794178432:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147733.682260:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.682260:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7ed24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682265:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7ed24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.682266:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ed2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc6b0 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.682270:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7ed24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.682299:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7ed32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.682305:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7ed32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.682311:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7ed32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.682321:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ed39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.682325:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ed39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.682329:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ed39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147733.682355:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ed40 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682361:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ed40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682368:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ed40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.682372:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ed47 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00000004:00200000:2.0:1746147733.682375:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147733.682378:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ed47 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.682383:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ed47 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147733.682387:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147733.682447:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7ed32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.682452:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7ed32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.682457:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7ed32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147733.682840:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248e00/0xe64d3fbf12a7ed1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682846:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248e00/0xe64d3fbf12a7ed1d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682850:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248e00/0xe64d3fbf12a7ed1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682854:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0248e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147733.682857:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248e00/0xe64d3fbf12a7ed1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682863:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248e00/0xe64d3fbf12a7ed1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682872:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147733.682875:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147733.682877:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248e00/0xe64d3fbf12a7ed1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682882:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248e00/0xe64d3fbf12a7ed1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682918:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7ed24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682922:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7ed24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682926:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7ed24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682929:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0248200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147733.682931:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7ed24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682935:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7ed24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682939:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009320b700) 00010000:00010000:2.0:1746147733.682941:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147733.682942:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7ed24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682946:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7ed24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.682972:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7ed16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b7 expref: 325 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.682980:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ed40 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b7 expref: 324 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.682985:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.682987:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147733.682989:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0249a00, rc 0) 00000100:00100000:2.0:1746147733.683023:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32519:x1830967794178560:12345-192.168.202.10@tcp:101:cat.0 Request processed in 942us (1082us total) trans 8589946128 rc 0/0 00000100:00100000:2.0:1746147733.683028:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12095 00010000:00010000:3.0:1746147733.683298:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00ba400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147733.683301:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7ed32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.683306:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7ed32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.683313:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147733.683316:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147733.683318:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7ed32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.683321:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7ed32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.683350:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ed39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.683355:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ed39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.683359:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ed39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.683363:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5defc00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147733.683365:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ed39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.683368:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ed39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.683373:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009320b700) 00010000:00010000:3.0:1746147733.683375:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147733.683377:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ed39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.683380:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7ed39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.683405:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e93c000/0xe64d3fbf12a7ed2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b0 expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.683414:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ed47 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b0 expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.683419:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147733.683420:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147733.683422:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5def000, rc 0) 00000100:00100000:3.0:1746147733.683455:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32520:x1830967794178432:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1204us (1276us total) trans 8589946127 rc 0/0 00000100:00100000:3.0:1746147733.683461:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12096 00000100:00100000:0.0:1746147733.685164:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.685663:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.685725:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794178816 00000100:00100000:1.0:1746147733.685732:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794178816 00000100:00100000:1.0:1746147733.685768:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794179072 00000100:00100000:1.0:1746147733.685770:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794179072 00000100:00100000:3.0:1746147733.685774:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5048 00000100:00100000:3.0:1746147733.685782:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32519:x1830967794178816:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:1.0:1746147733.685784:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5049 00000100:00100000:1.0:1746147733.685788:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095507850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32520:x1830967794179072:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:1.0:1746147733.685958:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095507850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32520:x1830967794179072:12345-192.168.202.10@tcp:35:cat.0 Request processed in 169us (295us total) trans 8589946129 rc 0/0 00000100:00100000:1.0:1746147733.685963:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5049 00000100:00100000:3.0:1746147733.686203:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32519:x1830967794178816:12345-192.168.202.10@tcp:35:cat.0 Request processed in 421us (1043us total) trans 8589946130 rc 0/0 00000100:00100000:3.0:1746147733.686209:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5048 00000100:00100000:0.0:1746147733.690855:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.690922:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794179200 00000100:00100000:3.0:1746147733.690930:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794179200 00000100:00100000:3.0:1746147733.691015:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16984 00000100:00100000:3.0:1746147733.691022:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32520:x1830967794179200:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147733.691035:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.691050:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7ed5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc6be expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.691063:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147733.691069:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.691071:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.691077:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7ed5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6be expref: 14 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.691081:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794179328 00000100:00100000:2.0:1746147733.691083:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794179328 00010000:00010000:3.0:1746147733.691089:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7ed5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6be expref: 14 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.691097:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5def400, rc 0) 00000100:00100000:2.0:1746147733.691107:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16985 00000100:00100000:2.0:1746147733.691112:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:32519:x1830967794179328:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.691118:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.691125:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0249600/0xe64d3fbf12a7ed63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc6c5 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.691134:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32520:x1830967794179200:12345-192.168.202.10@tcp:101:cat.0 Request processed in 112us (285us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147733.691135:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.691137:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147733.691139:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16984 00010000:00010000:2.0:1746147733.691141:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0249600/0xe64d3fbf12a7ed63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6c5 expref: 26 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.691150:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0249600/0xe64d3fbf12a7ed63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6c5 expref: 26 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.691157:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0249600, rc 0) 00000100:00100000:2.0:1746147733.691178:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32519:x1830967794179328:12345-192.168.202.10@tcp:101:cat.0 Request processed in 60us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.691183:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16985 00000100:00100000:0.0:1746147733.691375:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.691415:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.691668:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794179712 00000100:00100000:3.0:1746147733.691671:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794179712 00000100:00100000:3.0:1746147733.691729:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794179840 00000100:00100000:3.0:1746147733.691731:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794179840 00000100:00100000:2.0:1746147733.691734:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12097 00000100:00100000:2.0:1746147733.691741:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32516:x1830967794179712:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147733.691757:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.691824:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7ed6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc6cc expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.691929:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.691941:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ed40 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b7 expref: 325 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.691947:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ed47 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b0 expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.691952:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.691974:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ed47 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b0 expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.691983:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ed47 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b0 expref: 11 pid: 5744 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.691996:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796538752:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147733.692000:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12098 00000100:00100000:3.0:1746147733.692007:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32517:x1830967794179840:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147733.692019:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.692026:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7ed78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc6d3 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.692052:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ed40 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b7 expref: 326 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.692058:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ed40 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b7 expref: 326 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746147733.692063:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147733.692065:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796538880:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147733.692070:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.692075:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147733.692078:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.694141:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.694183:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.694207:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794180352 00000100:00100000:1.0:1746147733.694213:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794180352 00002000:00100000:1.0:1746147733.694242:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880091631880 x1830967794180352/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.694250:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091631880 with x1830967794180352 ext(0->1048575) 00002000:00010000:1.0:1746147733.694254:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091631880 00000100:00100000:2.0:1746147733.694264:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794180224 00000100:00100000:2.0:1746147733.694268:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794180224 00000100:00100000:1.0:1746147733.694281:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7672 00002000:00100000:2.0:1746147733.694285:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880091632d80 x1830967794180224/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147733.694288:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794180352:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:2.0:1746147733.694296:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091632d80 with x1830967794180224 ext(0->1048575) 00002000:00010000:2.0:1746147733.694299:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091632d80 00000100:00100000:2.0:1746147733.694320:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7673 00000100:00100000:2.0:1746147733.694326:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794180224:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147733.694951:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796538752:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147733.695043:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.695121:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796538880:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147733.695140:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:1.0:1746147733.695490:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794180608 00000100:00100000:1.0:1746147733.695493:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794180608 00010000:00010000:1.0:1746147733.695509:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ed47 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b0 expref: 12 pid: 5744 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147733.695551:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8689 00000100:00100000:1.0:1746147733.695555:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794180608:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147733.695562:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147733.695567:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ed47 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b0 expref: 12 pid: 5744 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.695575:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ed47 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b0 expref: 12 pid: 5744 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.695591:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5def000/0xe64d3fbf12a7ed47 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b0 expref: 12 pid: 5744 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.695601:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147733.695605:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.695612:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.695616:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147733.695939:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794180608:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 382us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.695946:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8689 00000100:00100000:0.0:1746147733.700881:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.700997:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794180480 00000100:00100000:1.0:1746147733.701005:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794180480 00010000:00010000:1.0:1746147733.701034:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ed40 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b7 expref: 327 pid: 17544 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147733.701065:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8690 00000100:00100000:1.0:1746147733.701071:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:1958:x1830967794180480:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147733.701084:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147733.701098:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ed40 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b7 expref: 327 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.701108:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ed40 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b7 expref: 327 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.701128:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7ed40 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6b7 expref: 327 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.701142:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147733.701147:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.701161:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.701167:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.701172:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147733.701176:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147733.701181:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147733.701220:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147733.701256:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:1958:x1830967794180480:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 185us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.701263:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8690 00010000:00010000:2.0:1746147733.701319:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.701326:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147733.701344:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147733.701396:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147733.701402:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147733.701412:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147733.701467:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7ed6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6cc expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.701479:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7ed78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6d3 expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.701496:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6d3 expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.701497:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6cc expref: 11 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.701501:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147733.701503:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147733.701505:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2b0a00, rc 0) 00010000:00010000:2.0:1746147733.701511:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.701513:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147733.701515:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248000, rc 0) 00000100:00100000:3.0:1746147733.701528:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32517:x1830967794179840:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 9522us (10112us total) trans 8589946132 rc 0/0 00000100:00100000:3.0:1746147733.701533:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12098 00000100:00100000:2.0:1746147733.701536:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32516:x1830967794179712:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 9796us (10573us total) trans 8589946131 rc 0/0 00000100:00100000:2.0:1746147733.701541:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12097 00000100:00100000:2.0:1746147733.706153:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794180224:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11817us (11959us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147733.706164:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7673 00002000:00100000:2.0:1746147733.706175:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880091632d80 x1830967794180224/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.706184:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091632d80 with x1830967794180224 ext(0->1048575) 00002000:00010000:2.0:1746147733.706190:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091632d80 00000100:00100000:1.0:1746147733.713703:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794180352:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19408us (19559us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147733.713716:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7672 00002000:00100000:1.0:1746147733.713726:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880091631880 x1830967794180352/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.713734:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091631880 with x1830967794180352 ext(0->1048575) 00002000:00010000:1.0:1746147733.713739:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091631880 00000100:00100000:0.0:1746147733.718662:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.719157:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.719322:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794180736 00000100:00100000:2.0:1746147733.719329:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794180736 00000100:00100000:2.0:1746147733.719376:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12099 00000100:00100000:2.0:1746147733.719382:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32517:x1830967794180736:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147733.719408:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.719423:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7ed94 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc6da expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.719474:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7ed94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6da expref: 327 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.719485:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7ed94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6da expref: 327 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.719498:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.719501:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147733.719503:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248400, rc 0) 00000100:00100000:2.0:1746147733.719539:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32517:x1830967794180736:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 158us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.719544:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12099 00000100:00100000:1.0:1746147733.720756:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794180864 00000100:00100000:1.0:1746147733.720763:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794180864 00000100:00100000:1.0:1746147733.720811:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16986 00000100:00100000:1.0:1746147733.720817:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:32519:x1830967794180864:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147733.720827:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147733.720839:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095464a00/0xe64d3fbf12a7ed9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc6e1 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.720855:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.720857:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.720864:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095464a00/0xe64d3fbf12a7ed9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e1 expref: 20 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.720879:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095464a00/0xe64d3fbf12a7ed9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e1 expref: 20 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.720923:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095464a00, rc 0) 00000100:00100000:1.0:1746147733.720956:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:32519:x1830967794180864:12345-192.168.202.10@tcp:101:cat.0 Request processed in 139us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.720961:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16986 00000100:00100000:0.0:1746147733.723413:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.723484:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794180992 00000100:00100000:3.0:1746147733.723491:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794180992 00000100:00100000:3.0:1746147733.723530:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16987 00000100:00100000:3.0:1746147733.723536:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32520:x1830967794180992:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147733.723549:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.723566:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090038a00/0xe64d3fbf12a7eda2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc6e8 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.723589:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.723591:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.723598:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090038a00/0xe64d3fbf12a7eda2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e8 expref: 12 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.723609:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090038a00/0xe64d3fbf12a7eda2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e8 expref: 12 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.723618:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090038a00, rc 0) 00000100:00100000:3.0:1746147733.723674:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32520:x1830967794180992:12345-192.168.202.10@tcp:101:cat.0 Request processed in 138us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.723680:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16987 00000100:00100000:2.0:1746147733.724663:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.724698:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.724739:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.724758:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794181376 00000100:00100000:2.0:1746147733.724763:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794181376 00000100:00100000:2.0:1746147733.724798:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794181504 00000100:00100000:2.0:1746147733.724800:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794181504 00000100:00100000:2.0:1746147733.724815:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12100 00000100:00100000:2.0:1746147733.724820:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32517:x1830967794181376:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147733.724830:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.724833:0:17544:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147733.724850:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7ed94 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6da expref: 328 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.724867:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.724872:0:17544:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147733.724880:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7eda9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc6ef expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.724941:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.724952:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7ed0f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a9 expref: 7 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.724958:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.724982:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7ed0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a9 expref: 7 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.724992:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7ed0f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a9 expref: 7 pid: 17544 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.725005:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796539008:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.725067:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147733.725134:0:14541:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794181120 00000100:00100000:3.0:1746147733.725138:0:14541:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794181120 00000100:00100000:3.0:1746147733.725158:0:14541:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 222 00000100:00100000:3.0:1746147733.725163:0:14541:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:febf1b7c-e040-48da-83a3-5da159ba5e63+15:1958:x1830967794181120:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1746147733.725188:0:14541:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:febf1b7c-e040-48da-83a3-5da159ba5e63+15:1958:x1830967794181120:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 23us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.725193:0:14541:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 222 00000100:00100000:0.0:1746147733.725258:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12101 00000100:00100000:0.0:1746147733.725265:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32519:x1830967794181504:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147733.725271:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147733.725277:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc6f6 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.725305:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147733.725311:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6f6 expref: 329 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.725320:0:5744:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147733.725329:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6f6 expref: 329 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.725337:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147733.725339:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147733.725341:0:5744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147733.725347:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0299e00, rc 0) 00000100:00100000:0.0:1746147733.725363:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:32519:x1830967794181504:12345-192.168.202.10@tcp:101:cat.0 Request processed in 99us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147733.725367:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12101 00000100:00100000:0.0:1746147733.725736:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.725773:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794181632 00000100:00100000:1.0:1746147733.725777:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794181632 00000100:00100000:1.0:1746147733.725796:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12102 00000100:00100000:1.0:1746147733.725801:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32520:x1830967794181632:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147733.725812:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147733.725818:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7edbe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc6fd expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.725838:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7edbe lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6fd expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.725845:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7edbe lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6fd expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.725852:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147733.725854:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147733.725855:0:5744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.725860:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0266e00, rc 0) 00000100:00100000:1.0:1746147733.725968:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32520:x1830967794181632:12345-192.168.202.10@tcp:101:cat.0 Request processed in 166us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.725974:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12102 00000100:00100000:0.0:1746147733.727219:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.727236:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796539008:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.727254:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00000100:00100000:1.0:1746147733.727449:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794181760 00000100:00100000:1.0:1746147733.727453:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794181760 00010000:00010000:1.0:1746147733.727474:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7ed0f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a9 expref: 8 pid: 17544 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746147733.727504:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8691 00000100:00100000:1.0:1746147733.727510:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794181760:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147733.727518:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147733.727523:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7ed0f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a9 expref: 8 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.727532:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7ed0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a9 expref: 8 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.727547:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7ed0f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a9 expref: 8 pid: 17544 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746147733.727571:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147733.727575:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.727582:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.727587:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147733.727620:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6f6 expref: 328 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.727633:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147733.727859:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794181760:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 348us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.727865:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8691 00010000:00010000:2.0:1746147733.728845:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147733.728854:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 17544 initiator: MDT0 00000040:00080000:2.0:1746147733.729415:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3694, 88 off309440 00000004:00080000:2.0:1746147733.729422:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812903536664ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147733.729489:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3700, 88 off309616 00000004:00080000:2.0:1746147733.729493:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812903608519ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147733.729516:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3701, 88 off309704 00000004:00080000:2.0:1746147733.729519:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812903634259ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147733.729527:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3695, 88 off309528 00000004:00080000:2.0:1746147733.729528:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812903644116ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147733.729533:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3696, 88 off309616 00000004:00080000:2.0:1746147733.729535:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812903651016ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147733.729541:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3702, 88 off309792 00000004:00080000:2.0:1746147733.729543:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812903658386ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147733.729548:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3703, 88 off309880 00000004:00080000:2.0:1746147733.729550:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812903665739ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147733.729556:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3704, 88 off309968 00000004:00080000:2.0:1746147733.729558:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812903673616ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147733.729564:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3697, 88 off309704 00000004:00080000:2.0:1746147733.729566:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812903681304ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147733.729571:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3705, 88 off310056 00000004:00080000:2.0:1746147733.729574:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812903689166ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147733.729579:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3698, 88 off309792 00000004:00080000:2.0:1746147733.729581:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812903696909ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147733.729588:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3706, 88 off310144 00000004:00080000:2.0:1746147733.729590:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812903705464ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147733.729596:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3699, 88 off309880 00000004:00080000:2.0:1746147733.729598:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812903714054ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147733.729604:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3700, 88 off309968 00000004:00080000:2.0:1746147733.729607:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812903722371ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147733.729612:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3701, 88 off310056 00000004:00080000:2.0:1746147733.729614:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812903729956ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147733.729620:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3702, 88 off310144 00000004:00080000:2.0:1746147733.729622:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812903738014ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147733.729628:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3707, 88 off310232 00000004:00080000:2.0:1746147733.729631:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812903747006ns, next at 756024029964ns, rc = 0 00000001:00080000:0.0:1746147733.745178:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946129 is committed 00000001:00080000:0.0:1746147733.745190:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946126 is committed 00000001:00080000:0.0:1746147733.745195:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946133 is committed 00000004:00080000:0.0:1746147733.745199:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2775 committed 00000004:00080000:0.0:1746147733.745206:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2770 committed 00000004:00080000:0.0:1746147733.745211:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2769 committed 00000004:00080000:0.0:1746147733.745212:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2768 committed 00000004:00080000:0.0:1746147733.745213:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2767 committed 00000004:00080000:0.0:1746147733.745215:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2774 committed 00000004:00080000:0.0:1746147733.745216:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2766 committed 00000004:00080000:0.0:1746147733.745217:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2773 committed 00000004:00080000:0.0:1746147733.745219:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2765 committed 00000004:00080000:0.0:1746147733.745220:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2772 committed 00000004:00080000:0.0:1746147733.745221:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2771 committed 00000004:00080000:0.0:1746147733.745222:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2770 committed 00000004:00080000:0.0:1746147733.745224:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2764 committed 00000004:00080000:0.0:1746147733.745225:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2763 committed 00000004:00080000:0.0:1746147733.745226:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2769 committed 00000004:00080000:0.0:1746147733.745227:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2768 committed 00000004:00080000:0.0:1746147733.745228:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2762 committed 00000001:00080000:0.0:1746147733.745232:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946131 is committed 00000100:00100000:0.0:1746147733.745329:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796539136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.745400:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.745422:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796539648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.745437:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.745450:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147733.745454:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796539264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.745466:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.745474:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796539776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.745486:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.745503:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796539520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.745516:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.745526:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796540032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.745537:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.745547:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746147733.745550:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796539392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.745561:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.745569:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796539904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.745580:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.745598:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796539136 00000100:00100000:0.0:1746147733.745603:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796539136 00000100:00100000:0.0:1746147733.745628:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796539648 00000100:00100000:0.0:1746147733.745630:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796539648 00000100:00100000:0.0:1746147733.745651:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796539264 00000100:00100000:0.0:1746147733.745653:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796539264 00000100:00100000:0.0:1746147733.745665:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796539776 00000100:00100000:0.0:1746147733.745666:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796539776 00000100:00100000:0.0:1746147733.745674:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796539520 00000100:00100000:0.0:1746147733.745676:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796539520 00000100:00100000:0.0:1746147733.745684:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796540032 00000100:00100000:0.0:1746147733.745685:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796540032 00000100:00100000:0.0:1746147733.745690:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796539392 00000100:00100000:0.0:1746147733.745692:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796539392 00000100:00100000:0.0:1746147733.745697:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796539904 00000100:00100000:0.0:1746147733.745699:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796539904 00000100:00100000:0.0:1746147733.745707:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16988 00000100:00100000:0.0:1746147733.745712:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3301:x1830967796539136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147733.745866:0:10613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147733.745869:0:10613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147733.745871:0:10613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147733.745873:0:10613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147733.745874:0:10613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 2045 -> 2045 00000100:00100000:0.0:1746147733.745921:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3301:x1830967796539136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 208us (521us total) trans 17179874433 rc 0/0 00000100:00100000:0.0:1746147733.745926:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16988 00000100:00100000:0.0:1746147733.746029:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16989 00000100:00100000:0.0:1746147733.746034:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3301:x1830967796539648:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147733.746150:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6ef expref: 326 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.746160:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147733.746163:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746147733.746167:0:17544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6f6 expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.746176:0:17544:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6f6 expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.746182:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6f6 expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.746189:0:17544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7edbe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6fd expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.746195:0:17544:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7edbe lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6fd expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.746201:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7edbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6fd expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.746224:0:17544:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7edbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6fd expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.746234:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796540160:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147733.746297:0:17544:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6f6 expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.746306:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796540288:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147733.746323:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147733.746341:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16990 00000100:00100000:2.0:1746147733.746348:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3301:x1830967796539264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147733.746359:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16991 00000100:00100000:2.0:1746147733.746363:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3301:x1830967796539776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147733.746373:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16992 00000100:00100000:2.0:1746147733.746377:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3304:x1830967796539520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147733.746530:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16993 00000100:00100000:3.0:1746147733.746537:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+31:3304:x1830967796540032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147733.746825:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16994 00000100:00100000:1.0:1746147733.746831:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3304:x1830967796539392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147733.746842:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16995 00000100:00100000:1.0:1746147733.746846:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3304:x1830967796539904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147733.746855:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796540800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147733.746878:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147733.746879:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796540544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147733.746904:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a548b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796541312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147733.746909:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147733.746916:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796541056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147733.746917:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147733.746925:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147733.746927:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147733.746928:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796540672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147733.746933:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746147733.746937:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796540416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147733.746939:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147733.746944:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796541184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147733.746948:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147733.746954:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796540928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147733.746955:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147733.746964:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.747767:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3301:x1830967796539648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1732us (2328us total) trans 17179874434 rc 0/0 00000100:00100000:0.0:1746147733.747773:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16989 00000100:00100000:0.0:1746147733.747784:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796540800 00000100:00100000:0.0:1746147733.747787:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796540800 00000100:00100000:0.0:1746147733.747798:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796540544 00000100:00100000:0.0:1746147733.747799:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796540544 00000100:00100000:0.0:1746147733.747804:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796541312 00000100:00100000:0.0:1746147733.747805:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796541312 00000100:00100000:0.0:1746147733.747809:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796541056 00000100:00100000:0.0:1746147733.747811:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796541056 00000100:00100000:0.0:1746147733.747815:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796540672 00000100:00100000:0.0:1746147733.747817:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796540672 00000100:00100000:0.0:1746147733.747822:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796540416 00000100:00100000:0.0:1746147733.747823:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796540416 00000100:00100000:0.0:1746147733.747828:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796541184 00000100:00100000:0.0:1746147733.747830:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796541184 00000100:00100000:0.0:1746147733.747835:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796540928 00000100:00100000:0.0:1746147733.747837:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796540928 00000100:00100000:0.0:1746147733.747844:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16996 00000100:00100000:0.0:1746147733.747848:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a548bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3304:x1830967796540800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147733.747907:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16997 00000100:00100000:0.0:1746147733.747912:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3302:x1830967796540544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147733.748005:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147733.748008:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147733.748009:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147733.748011:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147733.748013:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:2.0:1746147733.748694:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147733.748698:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.748700:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.748702:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.748704:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746147733.748722:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3301:x1830967796539264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2375us (3255us total) trans 17179874435 rc 0/0 00000100:00100000:2.0:1746147733.748726:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16990 00000100:00100000:2.0:1746147733.748738:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16998 00000100:00100000:2.0:1746147733.748742:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3304:x1830967796541312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147733.749535:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3302:x1830967796540544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1620us (2622us total) trans 21474841669 rc 0/0 00000100:00100000:0.0:1746147733.749541:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16997 00000100:00100000:0.0:1746147733.749552:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16999 00000100:00100000:0.0:1746147733.749557:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3302:x1830967796541056:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147733.749733:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5488e00/2, rc 0, transno 21474841669 00000100:00100000:3.0:1746147733.749740:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796540544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147733.749817:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3304:x1830967796541312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1075us (2899us total) trans 21474841670 rc 0/0 00000100:00100000:2.0:1746147733.749823:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16998 00000100:00100000:2.0:1746147733.749833:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17000 00000100:00100000:2.0:1746147733.749838:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3304:x1830967796540672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147733.749944:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147733.749946:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.749948:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.749950:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.749951:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746147733.749971:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3304:x1830967796540672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (3031us total) trans 21474841671 rc 0/0 00000100:00100000:2.0:1746147733.749975:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17000 00000100:00100000:2.0:1746147733.749988:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17001 00000100:00100000:2.0:1746147733.749992:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3302:x1830967796540416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147733.750053:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147733.750056:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.750058:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.750059:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:2.0:1746147733.750061:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2075 -> 2075 00000100:00100000:2.0:1746147733.750090:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3302:x1830967796540416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (3141us total) trans 21474841672 rc 0/0 00000100:00100000:2.0:1746147733.750095:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17001 00000100:00100000:2.0:1746147733.750104:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17002 00000100:00100000:2.0:1746147733.750109:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3304:x1830967796541184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147733.750178:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3304:x1830967796541184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (3221us total) trans 21474841673 rc 0/0 00000100:00100000:2.0:1746147733.750183:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17002 00000100:00100000:2.0:1746147733.750192:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17003 00000100:00100000:2.0:1746147733.750196:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3302:x1830967796540928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147733.750256:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:2.0:1746147733.750259:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:2.0:1746147733.750260:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147733.750261:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:2.0:1746147733.750263:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:2.0:1746147733.750280:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3302:x1830967796540928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (3314us total) trans 21474841674 rc 0/0 00000100:00100000:2.0:1746147733.750284:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17003 00000100:00100000:2.0:1746147733.750384:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3301:x1830967796539776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4019us (4896us total) trans 17179874436 rc 0/0 00000100:00100000:2.0:1746147733.750389:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16991 00000100:00100000:2.0:1746147733.750469:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3304:x1830967796539520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4091us (4951us total) trans 17179874437 rc 0/0 00000100:00100000:2.0:1746147733.750475:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16992 00000004:00080000:1.0:1746147733.750547:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5488a80/2, rc 0, transno 21474841671 00000100:00100000:1.0:1746147733.750551:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796540672:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147733.750558:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5489500/2, rc 0, transno 21474841673 00000100:00100000:1.0:1746147733.750560:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796541184:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147733.750567:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a548b800/2, rc 0, transno 21474841670 00000100:00100000:1.0:1746147733.750569:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a548b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796541312:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147733.750579:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093cd5c00/2, rc 0, transno 17179874437 00000100:00100000:1.0:1746147733.750588:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796539520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147733.750762:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+31:3304:x1830967796540032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4225us (5223us total) trans 17179874438 rc 0/0 00000100:00100000:3.0:1746147733.750767:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16993 00000004:00080000:3.0:1746147733.750788:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5489f80/2, rc 0, transno 21474841672 00000100:00100000:3.0:1746147733.750791:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796540416:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147733.750797:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5489180/2, rc 0, transno 21474841674 00000100:00100000:3.0:1746147733.750799:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796540928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147733.750803:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746147733.750811:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796541440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147733.750835:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147733.750971:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3302:x1830967796541056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1414us (4042us total) trans 21474841675 rc 0/0 00000100:00100000:0.0:1746147733.750977:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16999 00000100:00100000:0.0:1746147733.750984:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796541440 00000100:00100000:0.0:1746147733.750988:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796541440 00000100:00100000:0.0:1746147733.751003:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17004 00000100:00100000:0.0:1746147733.751007:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3302:x1830967796541440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147733.751065:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3302:x1830967796541440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (230us total) trans 17179874439 rc 0/0 00000100:00100000:0.0:1746147733.751069:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17004 00000100:00100000:0.0:1746147733.751241:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.751266:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.751282:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794181888 00000100:00100000:0.0:1746147733.751285:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794181888 00000100:00100000:0.0:1746147733.751300:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794182016 00000100:00100000:0.0:1746147733.751302:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794182016 00000100:00100000:0.0:1746147733.751313:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5050 00000100:00100000:0.0:1746147733.751316:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32520:x1830967794181888:12345-192.168.202.10@tcp:49:cat.0 00000100:00100000:0.0:1746147733.751394:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32520:x1830967794181888:12345-192.168.202.10@tcp:49:cat.0 Request processed in 76us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147733.751399:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5050 00000100:00100000:0.0:1746147733.751407:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5051 00000100:00100000:0.0:1746147733.751411:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32519:x1830967794182016:12345-192.168.202.10@tcp:49:cat.0 00000100:00100000:0.0:1746147733.751442:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32519:x1830967794182016:12345-192.168.202.10@tcp:49:cat.0 Request processed in 31us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.751444:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796540160:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147733.751447:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5051 00000100:00100000:2.0:1746147733.751453:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796540288:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147733.751484:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7eda9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6ef expref: 326 pid: 17544 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746147733.751501:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6ef expref: 325 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.751519:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248800, rc 0) 00000100:00100000:2.0:1746147733.751544:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32517:x1830967794181376:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 26725us (26846us total) trans 8589946133 rc 0/0 00000100:00100000:2.0:1746147733.751550:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12100 00000004:00080000:0.0:1746147733.751569:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093cd6680/2, rc 0, transno 17179874435 00000100:00100000:0.0:1746147733.751573:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796539264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147733.751580:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093cd6d80/2, rc 0, transno 17179874436 00000100:00100000:0.0:1746147733.751583:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796539776:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147733.751592:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093cd7800/2, rc 0, transno 17179874433 00000100:00100000:0.0:1746147733.751594:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796539136:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147733.751602:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093cd4000/2, rc 0, transno 17179874434 00000100:00100000:0.0:1746147733.751604:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796539648:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147733.751735:0:7050:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:1.0:1746147733.751738:0:7050:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:1.0:1746147733.751740:0:7050:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:1.0:1746147733.751741:0:7050:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:1.0:1746147733.751743:0:7050:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:1.0:1746147733.751762:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3304:x1830967796539392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4932us (6200us total) trans 17179874440 rc 0/0 00000100:00100000:1.0:1746147733.751768:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16994 00000100:00100000:1.0:1746147733.751855:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3304:x1830967796539904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5007us (6273us total) trans 17179874441 rc 0/0 00000100:00100000:1.0:1746147733.751860:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16995 00000004:00080000:1.0:1746147733.751880:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093cd7480/2, rc 0, transno 17179874440 00000100:00100000:1.0:1746147733.751896:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796539392:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147733.751906:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093cd6a00/2, rc 0, transno 17179874441 00000100:00100000:1.0:1746147733.751909:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796539904:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147733.751914:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093cd5880/2, rc 0, transno 17179874438 00000100:00100000:1.0:1746147733.751916:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796540032:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147733.751978:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135810700/2, rc 0, transno 17179874439 00000100:00100000:3.0:1746147733.751982:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796541440:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147733.751988:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5489880/2, rc 0, transno 21474841675 00000100:00100000:3.0:1746147733.751990:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796541056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147733.752618:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a548bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3304:x1830967796540800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4768us (5738us total) trans 21474841676 rc 0/0 00000100:00100000:0.0:1746147733.752624:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16996 00000004:00080000:1.0:1746147733.752906:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5488380/2, rc 0, transno 21474841676 00000100:00100000:1.0:1746147733.752910:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796540800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147733.758498:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.758571:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794182272 00000100:00100000:1.0:1746147733.758579:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794182272 00002000:00100000:1.0:1746147733.758612:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880135848000 x1830967794182272/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.758620:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848000 with x1830967794182272 ext(1048576->2097151) 00002000:00010000:1.0:1746147733.758624:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135848000 00000100:00100000:1.0:1746147733.758701:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7674 00000100:00100000:1.0:1746147733.758708:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1957:x1830967794182272:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147733.759220:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.759281:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794182400 00000100:00100000:2.0:1746147733.759284:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794182400 00000100:00100000:2.0:1746147733.759305:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17005 00000100:00100000:2.0:1746147733.759309:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32517:x1830967794182400:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147733.759318:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.759331:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc704 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.759350:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009579fc00/0xe64d3fbf12a7ecbb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc694 expref: 10 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147733.759356:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.759358:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.759361:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1101824->1314815] (req 1101824->1314815) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 27 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.759383:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009579fc00/0xe64d3fbf12a7ecbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc694 expref: 10 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147733.759393:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009579fc00/0xe64d3fbf12a7ecbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc694 expref: 10 pid: 8469 timeout: 912 lvb_type: 1 00000100:00100000:2.0:1746147733.759402:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796541568:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.759471:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.760597:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.761001:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796541568:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147733.761024:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1101824->1314815] (req 1101824->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 27 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.761038:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009527a000, rc 0) 00000100:00100000:3.0:1746147733.761068:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:32517:x1830967794182400:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1757us (1848us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.761074:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17005 00000100:00100000:2.0:1746147733.761154:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794182656 00000100:00100000:2.0:1746147733.761159:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794182656 00002000:00100000:2.0:1746147733.761187:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88013584ad80 x1830967794182656/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.761194:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584ad80 with x1830967794182656 ext(1048576->2097151) 00002000:00010000:2.0:1746147733.761198:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013584ad80 00000100:00100000:2.0:1746147733.761210:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7675 00000100:00100000:2.0:1746147733.761215:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794182656:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147733.762259:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.762557:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794182784 00000100:00100000:0.0:1746147733.762561:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794182784 00010000:00010000:0.0:1746147733.762583:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009579fc00/0xe64d3fbf12a7ecbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc694 expref: 11 pid: 8469 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746147733.762601:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8692 00000100:00100000:0.0:1746147733.762606:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794182784:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147733.762614:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147733.762630:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009579fc00/0xe64d3fbf12a7ecbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc694 expref: 11 pid: 8469 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746147733.762649:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009579fc00/0xe64d3fbf12a7ecbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc694 expref: 11 pid: 8469 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746147733.762667:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009579fc00/0xe64d3fbf12a7ecbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc694 expref: 11 pid: 8469 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746147733.762682:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.762683:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147733.762690:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1314815) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.762697:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1314815) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.762723:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147733.762734:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796541696:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147733.762792:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147733.767440:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796541696:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147733.767459:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147733.767509:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794182784:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4901us (5250us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.767519:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8692 00000100:00100000:0.0:1746147733.769009:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.769381:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794183040 00000100:00100000:3.0:1746147733.769388:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794183040 00002000:00100000:3.0:1746147733.769424:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (1101824->1105919) req@ffff880135848e00 x1830967794183040/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.769434:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848e00 with x1830967794183040 ext(1101824->1105919) 00002000:00010000:3.0:1746147733.769438:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135848e00 00000100:00100000:3.0:1746147733.769456:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7676 00000100:00100000:3.0:1746147733.769462:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967794183040:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147733.769610:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967794183040:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 147us (605us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147733.769616:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7676 00002000:00100000:3.0:1746147733.769620:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x457:0x0] (1101824->1105919) req@ffff880135848e00 x1830967794183040/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/4536 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.769628:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848e00 with x1830967794183040 ext(1101824->1105919) 00002000:00010000:3.0:1746147733.769631:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135848e00 00000100:00100000:1.0:1746147733.773240:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1957:x1830967794182272:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14525us (14742us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147733.773251:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7674 00002000:00100000:1.0:1746147733.773259:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880135848000 x1830967794182272/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.773268:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848000 with x1830967794182272 ext(1048576->2097151) 00002000:00010000:1.0:1746147733.773272:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135848000 00000100:00100000:2.0:1746147733.773557:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794182656:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12341us (12962us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147733.773564:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7675 00002000:00100000:2.0:1746147733.773570:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88013584ad80 x1830967794182656/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.773576:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584ad80 with x1830967794182656 ext(1048576->2097151) 00002000:00010000:2.0:1746147733.773578:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013584ad80 00000100:00100000:0.0:1746147733.775785:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.775847:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794183296 00000100:00100000:3.0:1746147733.775853:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794183296 00002000:00100000:3.0:1746147733.775911:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x457:0x0] (1310720->1314815) req@ffff880135848700 x1830967794183296/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.775919:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848700 with x1830967794183296 ext(1310720->1314815) 00002000:00010000:3.0:1746147733.775996:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135848700 00000100:00100000:3.0:1746147733.776251:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7677 00000100:00100000:3.0:1746147733.776259:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967794183296:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147733.776403:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967794183296:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 144us (622us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147733.776409:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7677 00002000:00100000:3.0:1746147733.776415:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x457:0x0] (1310720->1314815) req@ffff880135848700 x1830967794183296/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/4536 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.776421:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135848700 with x1830967794183296 ext(1310720->1314815) 00002000:00010000:3.0:1746147733.776423:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135848700 00000100:00100000:0.0:1746147733.780146:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.780290:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794183424 00000100:00100000:3.0:1746147733.780297:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794183424 00000100:00100000:3.0:1746147733.780335:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17006 00000100:00100000:3.0:1746147733.780342:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32520:x1830967794183424:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147733.780357:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.780374:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7edcc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc70b expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.780397:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.780399:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.780405:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7edcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc70b expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.780419:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7edcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc70b expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.780429:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0000, rc 0) 00000100:00100000:3.0:1746147733.780479:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32520:x1830967794183424:12345-192.168.202.10@tcp:101:cat.0 Request processed in 137us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.780485:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17006 00000100:00100000:0.0:1746147733.787175:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.787269:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794183552 00000100:00100000:2.0:1746147733.787277:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794183552 00000100:00100000:2.0:1746147733.787325:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17007 00000100:00100000:2.0:1746147733.787332:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:32519:x1830967794183552:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.787348:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.787362:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7edd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc712 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.787382:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.787384:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.787391:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7edd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc712 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.787402:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7edd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc712 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.787411:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009527be00, rc 0) 00000100:00100000:2.0:1746147733.787455:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32519:x1830967794183552:12345-192.168.202.10@tcp:101:cat.0 Request processed in 123us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.787460:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17007 00000100:00100000:0.0:1746147733.793378:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.793806:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.794841:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.796473:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794184064 00000100:00100000:1.0:1746147733.796482:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794184064 00002000:00100000:1.0:1746147733.796525:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a5d7c700 x1830967794184064/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.796534:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c700 with x1830967794184064 ext(1048576->2097151) 00002000:00010000:1.0:1746147733.796539:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7c700 00000100:00100000:1.0:1746147733.796579:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794184192 00000100:00100000:1.0:1746147733.796584:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794184192 00002000:00100000:1.0:1746147733.796602:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a5d7d180 x1830967794184192/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.796608:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7d180 with x1830967794184192 ext(1048576->2097151) 00002000:00010000:1.0:1746147733.796612:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7d180 00000100:00100000:1.0:1746147733.796650:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794184320 00000100:00100000:1.0:1746147733.796654:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794184320 00002000:00100000:1.0:1746147733.796672:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a5d7ea00 x1830967794184320/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 504/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.796678:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ea00 with x1830967794184320 ext(1048576->2097151) 00002000:00010000:1.0:1746147733.796681:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7ea00 00000100:00100000:1.0:1746147733.796702:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7678 00000100:00100000:1.0:1746147733.796711:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794184064:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147733.798163:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7679 00000100:00100000:1.0:1746147733.798172:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967794184192:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147733.799249:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7680 00000100:00100000:0.0:1746147733.799261:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967794184320:12345-192.168.202.10@tcp:3:multiop.0 00010000:00010000:1.0:1746147733.803670:0:20300:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147733.816817:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794184064:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20099us (23438us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147733.816828:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7678 00002000:00100000:1.0:1746147733.816838:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a5d7c700 x1830967794184064/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.816847:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c700 with x1830967794184064 ext(1048576->2097151) 00002000:00010000:1.0:1746147733.816852:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7c700 00000100:00100000:1.0:1746147733.819012:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967794184192:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 20835us (25200us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147733.819023:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7679 00002000:00100000:1.0:1746147733.819031:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a5d7d180 x1830967794184192/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.819046:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7d180 with x1830967794184192 ext(1048576->2097151) 00002000:00010000:1.0:1746147733.819051:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7d180 00000100:00100000:1.0:1746147733.820084:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967794184320:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 20826us (25244us total) trans 0 rc 835584/835584 00000100:00100000:1.0:1746147733.820091:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7680 00002000:00100000:1.0:1746147733.820097:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a5d7ea00 x1830967794184320/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 504/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 835584/835584 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.820104:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ea00 with x1830967794184320 ext(1048576->2097151) 00002000:00010000:1.0:1746147733.820108:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7ea00 00000100:00100000:0.0:1746147733.823379:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.823446:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794184448 00000100:00100000:2.0:1746147733.823454:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794184448 00000100:00100000:2.0:1746147733.823610:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17008 00000100:00100000:2.0:1746147733.823618:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32520:x1830967794184448:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.823634:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.823682:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7edda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc719 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.823706:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.823712:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.823714:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.823716:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7edda lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc719 expref: 15 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.823740:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1314815) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.823749:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1314815) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 26 pid: 10613 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746147733.823759:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796541824:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.824870:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.825062:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.825126:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794184576 00000100:00100000:3.0:1746147733.825129:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794184576 00000100:00100000:3.0:1746147733.825154:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17009 00000100:00100000:3.0:1746147733.825163:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32516:x1830967794184576:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147733.825172:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.825183:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc720 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.825203:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ecc2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a2 expref: 11 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.825209:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.825210:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.825213:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3624960->4194303] (req 3624960->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 14 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.825229:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ecc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a2 expref: 11 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.825236:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ecc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a2 expref: 11 pid: 10613 timeout: 912 lvb_type: 1 00000100:00100000:3.0:1746147733.825244:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796541952:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147733.825303:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147733.826146:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796541824:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.826163:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7edda lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc719 expref: 15 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.826179:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009527a800, rc 0) 00000100:00100000:2.0:1746147733.826214:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32520:x1830967794184448:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2596us (2840us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.826220:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17008 00000100:00100000:0.0:1746147733.826534:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.826604:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794184704 00000100:00100000:2.0:1746147733.826608:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794184704 00002000:00100000:2.0:1746147733.826634:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1101824->1314815) req@ffff8800a5d7e300 x1830967794184704/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.826651:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7e300 with x1830967794184704 ext(1101824->1314815) 00010000:00010000:2.0:1746147733.826656:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 27 pid: 10613 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746147733.826666:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 27 pid: 10613 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746147733.826671:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d7e300 00000100:00100000:2.0:1746147733.826683:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1555 00000100:00100000:2.0:1746147733.826688:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794184704:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:2.0:1746147733.827247:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.827322:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794184832 00000100:00100000:0.0:1746147733.827325:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794184832 00000100:00100000:0.0:1746147733.827351:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17010 00000100:00100000:0.0:1746147733.827356:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32519:x1830967794184832:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147733.827363:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147733.827372:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0xe64d3fbf12a7ede8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc727 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.827385:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147733.827389:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0xe64d3fbf12a7ede8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc727 expref: 30 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.827397:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0xe64d3fbf12a7ede8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc727 expref: 30 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.827403:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ee1400, rc 0) 00000100:00100000:0.0:1746147733.827428:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32519:x1830967794184832:12345-192.168.202.10@tcp:101:cat.0 Request processed in 72us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147733.827433:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17010 00000100:00100000:3.0:1746147733.828596:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796541952:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147733.828614:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3624960->4194303] (req 3624960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 14 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.828623:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0c00, rc 0) 00000100:00100000:3.0:1746147733.828717:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32516:x1830967794184576:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3553us (3655us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.828723:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17009 00000100:00100000:2.0:1746147733.828944:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794184704:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 2254us (2410us total) trans 17179874442 rc 0/0 00000100:00100000:2.0:1746147733.828950:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1555 00002000:00100000:2.0:1746147733.828956:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1101824->1314815) req@ffff8800a5d7e300 x1830967794184704/t17179874442(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/448 e 0 to 0 dl 1746147744 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.828969:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7e300 with x1830967794184704 ext(1101824->1314815) 00010000:00010000:2.0:1746147733.828974:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1101824->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 30 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147733.828983:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1101824->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 30 pid: 10613 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746147733.828989:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d7e300 00000100:00100000:0.0:1746147733.829193:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.829451:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794184960 00000100:00100000:3.0:1746147733.829455:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794184960 00010000:00010000:3.0:1746147733.829472:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ecc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a2 expref: 12 pid: 10613 timeout: 912 lvb_type: 1 00000100:00100000:3.0:1746147733.829501:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8693 00000100:00100000:3.0:1746147733.829508:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794184960:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147733.829516:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147733.829530:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ecc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a2 expref: 12 pid: 10613 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147733.829538:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ecc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a2 expref: 12 pid: 10613 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147733.829554:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7ecc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6a2 expref: 12 pid: 10613 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746147733.829578:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.829580:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.829585:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.829591:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.830405:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.830416:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796542080:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147733.831088:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.831240:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.831290:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794185088 00000100:00100000:2.0:1746147733.831293:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794185088 00010000:00010000:2.0:1746147733.831310:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1101824->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 30 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147733.831329:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8694 00000100:00100000:2.0:1746147733.831334:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967794185088:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147733.831343:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147733.831355:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1101824->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 30 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147733.831364:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1101824->1314815) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 30 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147733.831380:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009527a000/0xe64d3fbf12a7edc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1101824->1314815) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc704 expref: 30 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147733.831412:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.831414:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.831419:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7edda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc719 expref: 14 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.831425:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7edda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc719 expref: 14 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.831432:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.831433:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147733.831435:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0xe64d3fbf12a7ede8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc727 expref: 29 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.831441:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0xe64d3fbf12a7ede8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc727 expref: 29 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.831457:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0xe64d3fbf12a7ede8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc727 expref: 29 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.831465:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796542208:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147733.831498:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7edda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc719 expref: 14 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.831505:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796542336:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147733.831521:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.832807:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.832833:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796542208:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147733.832850:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794185344 00000100:00100000:2.0:1746147733.832854:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794185344 00002000:00100000:2.0:1746147733.832879:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3624960->3629055) req@ffff8800943c6d80 x1830967794185344/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.832914:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c6d80 with x1830967794185344 ext(3624960->3629055) 00002000:00010000:2.0:1746147733.832918:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c6d80 00000100:00100000:3.0:1746147733.832924:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796542080:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147733.832936:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7681 00010000:00010000:3.0:1746147733.832939:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147733.832942:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794185344:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147733.832976:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794184960:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3469us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.832984:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8693 00000100:00100000:2.0:1746147733.833076:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794185344:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 133us (273us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147733.833081:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7681 00002000:00100000:2.0:1746147733.833086:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3624960->3629055) req@ffff8800943c6d80 x1830967794185344/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/4536 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.833092:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c6d80 with x1830967794185344 ext(3624960->3629055) 00002000:00010000:2.0:1746147733.833094:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c6d80 00000100:00100000:2.0:1746147733.833121:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796542336:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147733.833132:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147733.833145:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967794185088:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1811us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.833151:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8694 00000100:00100000:0.0:1746147733.834778:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.835057:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.835235:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794185600 00000100:00100000:2.0:1746147733.835241:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794185600 00002000:00100000:2.0:1746147733.835272:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800943c4a80 x1830967794185600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.835285:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4a80 with x1830967794185600 ext(1048576->2097151) 00002000:00010000:2.0:1746147733.835290:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c4a80 00000100:00100000:2.0:1746147733.835349:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794185856 00000100:00100000:2.0:1746147733.835353:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794185856 00002000:00100000:2.0:1746147733.835368:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800943c4e00 x1830967794185856/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.835373:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4e00 with x1830967794185856 ext(1048576->2097151) 00002000:00010000:2.0:1746147733.835376:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c4e00 00000100:00100000:2.0:1746147733.835388:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7682 00000100:00100000:3.0:1746147733.835394:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7683 00000100:00100000:2.0:1746147733.835394:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794185600:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147733.835403:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794185856:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147733.840424:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.840483:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794185984 00000100:00100000:3.0:1746147733.840491:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794185984 00000100:00100000:3.0:1746147733.840533:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17011 00000100:00100000:3.0:1746147733.840541:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32516:x1830967794185984:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147733.840627:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.840655:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc72e expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.840680:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092c24600/0xe64d3fbf12a7ecb4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc69b expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.840686:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.840688:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.840692:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 4/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [4194304->4464639] (req 4194304->4464639) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 18 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.840717:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092c24600/0xe64d3fbf12a7ecb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc69b expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147733.840728:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092c24600/0xe64d3fbf12a7ecb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc69b expref: 9 pid: 8468 timeout: 913 lvb_type: 1 00000100:00100000:3.0:1746147733.840739:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796542464:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147733.840827:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.851160:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.851203:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796542464:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147733.851230:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [4194304->4464639] (req 4194304->4464639) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 18 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147733.851283:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794186112 00000100:00100000:2.0:1746147733.851293:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794186112 00010000:00010000:2.0:1746147733.851320:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092c24600/0xe64d3fbf12a7ecb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc69b expref: 10 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147733.852023:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0200, rc 0) 00000100:00100000:3.0:1746147733.852044:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8695 00000100:00100000:3.0:1746147733.852051:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794186112:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147733.852062:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147733.852081:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092c24600/0xe64d3fbf12a7ecb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc69b expref: 10 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147733.852091:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092c24600/0xe64d3fbf12a7ecb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc69b expref: 10 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147733.852119:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092c24600/0xe64d3fbf12a7ecb4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc69b expref: 10 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147733.852138:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.852139:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.852145:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 18 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.852152:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 18 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.852175:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 18 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.852186:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796542592:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147733.852242:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147733.852266:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32516:x1830967794185984:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 11726us (11849us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.852273:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17011 00000100:00100000:0.0:1746147733.852345:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794185600:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 16950us (17572us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147733.852523:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794185856:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 17121us (17465us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147733.852530:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7683 00002000:00100000:2.0:1746147733.852538:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800943c4e00 x1830967794185856/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.852545:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4e00 with x1830967794185856 ext(1048576->2097151) 00002000:00010000:2.0:1746147733.852548:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c4e00 00000100:00100000:0.0:1746147733.853320:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7682 00002000:00100000:0.0:1746147733.853327:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800943c4a80 x1830967794185600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147733.853334:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c4a80 with x1830967794185600 ext(1048576->2097151) 00002000:00010000:0.0:1746147733.853337:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943c4a80 00000100:00100000:2.0:1746147733.855951:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.856031:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796542592:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147733.856049:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147733.856153:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794186368 00000100:00100000:0.0:1746147733.856160:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794186368 00002000:00100000:0.0:1746147733.856194:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (4460544->4464639) req@ffff8800941b1880 x1830967794186368/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147733.856203:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b1880 with x1830967794186368 ext(4460544->4464639) 00002000:00010000:0.0:1746147733.856207:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800941b1880 00000100:00100000:0.0:1746147733.856232:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7684 00000100:00100000:0.0:1746147733.856239:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794186368:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147733.856374:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794186112:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4322us (5220us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.856383:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8695 00000100:00100000:0.0:1746147733.857297:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794186368:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 1057us (1352us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147733.857305:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7684 00002000:00100000:0.0:1746147733.857311:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (4460544->4464639) req@ffff8800941b1880 x1830967794186368/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/4536 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147733.857318:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800941b1880 with x1830967794186368 ext(4460544->4464639) 00002000:00010000:0.0:1746147733.857321:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800941b1880 00000100:00100000:0.0:1746147733.862654:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.862704:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.863169:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794186496 00000100:00100000:3.0:1746147733.863178:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794186496 00000100:00100000:3.0:1746147733.863213:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794186624 00000100:00100000:3.0:1746147733.863215:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794186624 00000100:00100000:1.0:1746147733.863298:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17012 00000100:00100000:1.0:1746147733.863306:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967794186496:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147733.863322:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147733.863337:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7edf6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc735 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.863378:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796542720:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147733.863440:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147733.863555:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17013 00000100:00100000:3.0:1746147733.863561:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967794186624:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147733.863568:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.863578:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7edfd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc73c expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.863603:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce62680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796542848:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147733.863679:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.865344:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.865392:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.865466:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794187136 00000100:00100000:2.0:1746147733.865471:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794187136 00002000:00100000:2.0:1746147733.865502:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3145728->3624959) req@ffff8800943c5f80 x1830967794187136/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.865511:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5f80 with x1830967794187136 ext(3145728->3624959) 00000100:00100000:3.0:1746147733.865664:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794187008 00000100:00100000:3.0:1746147733.865667:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794187008 00002000:00100000:3.0:1746147733.865682:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88012ee5b480 x1830967794187008/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.865688:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee5b480 with x1830967794187008 ext(2097152->3145727) 00002000:00010000:3.0:1746147733.865690:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee5b480 00000100:00100000:3.0:1746147733.865714:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7685 00000100:00100000:3.0:1746147733.865720:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794187008:12345-192.168.202.10@tcp:3:cat.0 00002000:00010000:2.0:1746147733.866215:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c5f80 00000100:00100000:2.0:1746147733.866230:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7686 00000100:00100000:2.0:1746147733.866236:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794187136:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147733.866460:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796542720:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147733.866533:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7edf6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc735 expref: 30 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.866545:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7edf6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc735 expref: 30 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.866567:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6543c00, rc 0) 00000100:00100000:1.0:1746147733.866599:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967794186496:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3294us (3966us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147733.866606:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17012 00000100:00100000:0.0:1746147733.868865:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.868907:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.868968:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794187520 00000100:00100000:1.0:1746147733.868973:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794187520 00002000:00100000:1.0:1746147733.869004:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88012ee58e00 x1830967794187520/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147733.869013:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58e00 with x1830967794187520 ext(3145728->4194303) 00002000:00010000:1.0:1746147733.869017:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee58e00 00000100:00100000:2.0:1746147733.869020:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce62680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796542848:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147733.869029:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794187392 00000100:00100000:1.0:1746147733.869031:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794187392 00002000:00100000:1.0:1746147733.869041:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88012ee59f80 x1830967794187392/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147733.869045:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7edfd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc73c expref: 22 pid: 10613 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746147733.869047:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee59f80 with x1830967794187392 ext(2097152->3145727) 00002000:00010000:1.0:1746147733.869050:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee59f80 00010000:00010000:2.0:1746147733.869055:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7edfd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc73c expref: 22 pid: 10613 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147733.869065:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7687 00010000:00010000:2.0:1746147733.869069:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0e00, rc 0) 00000100:00100000:1.0:1746147733.869071:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794187520:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147733.869098:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967794186624:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5536us (6392us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147733.869104:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17013 00000100:00100000:3.0:1746147733.869283:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7688 00000100:00100000:3.0:1746147733.869290:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794187392:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147733.876915:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794187136:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10669us (11564us total) trans 0 rc 479232/479232 00000100:00100000:2.0:1746147733.876927:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7686 00002000:00100000:2.0:1746147733.876937:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3145728->3624959) req@ffff8800943c5f80 x1830967794187136/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 479232/479232 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.876945:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943c5f80 with x1830967794187136 ext(3145728->3624959) 00002000:00010000:2.0:1746147733.876951:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943c5f80 00000100:00100000:0.0:1746147733.881008:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.881555:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794187008:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15833us (16161us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147733.881566:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7685 00002000:00100000:3.0:1746147733.881576:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88012ee5b480 x1830967794187008/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.881585:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee5b480 with x1830967794187008 ext(2097152->3145727) 00002000:00010000:3.0:1746147733.881589:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee5b480 00000100:00100000:3.0:1746147733.881932:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794187392:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12643us (13025us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147733.881937:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7688 00002000:00100000:3.0:1746147733.881942:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88012ee59f80 x1830967794187392/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.881948:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee59f80 with x1830967794187392 ext(2097152->3145727) 00002000:00010000:3.0:1746147733.881951:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee59f80 00000100:00100000:2.0:1746147733.882185:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794187776 00000100:00100000:2.0:1746147733.882192:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794187776 00000100:00100000:2.0:1746147733.882239:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17014 00000100:00100000:2.0:1746147733.882245:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32519:x1830967794187776:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.882256:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.882270:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013179e400/0xe64d3fbf12a7ee04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc743 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.882388:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.882395:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.882397:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.882400:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013179e400/0xe64d3fbf12a7ee04 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc743 expref: 30 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.882425:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.882435:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 17 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147733.882446:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796542976:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147733.883303:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147733.884677:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794187520:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15601us (15813us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147733.884689:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7687 00002000:00100000:2.0:1746147733.884697:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88012ee58e00 x1830967794187520/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.884706:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58e00 with x1830967794187520 ext(3145728->4194303) 00010000:00010000:2.0:1746147733.884713:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 16 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147733.884725:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 16 pid: 10613 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746147733.884731:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ee58e00 00000100:00100000:0.0:1746147733.885992:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.886234:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796542976:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147733.886254:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013179e400/0xe64d3fbf12a7ee04 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc743 expref: 30 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.886268:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179e400, rc 0) 00000100:00100000:2.0:1746147733.886301:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32519:x1830967794187776:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4057us (5300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.886308:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17014 00000100:00100000:2.0:1746147733.886330:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794187904 00000100:00100000:2.0:1746147733.886335:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794187904 00002000:00100000:2.0:1746147733.886357:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4464639) req@ffff88012ee5a680 x1830967794187904/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.886365:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee5a680 with x1830967794187904 ext(4194304->4464639) 00010000:00010000:2.0:1746147733.888455:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 16 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147733.888473:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 16 pid: 10613 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746147733.888481:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ee5a680 00000100:00100000:2.0:1746147733.888523:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1556 00000100:00100000:2.0:1746147733.888534:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794187904:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147733.889035:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.889606:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794188032 00000100:00100000:2.0:1746147733.889612:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794188032 00000100:00100000:2.0:1746147733.889647:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17015 00000100:00100000:2.0:1746147733.889652:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32520:x1830967794188032:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147733.889661:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147733.889672:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013179fa00/0xe64d3fbf12a7ee0b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc74a expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.889694:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.889696:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147733.889700:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013179fa00/0xe64d3fbf12a7ee0b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc74a expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.889710:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013179fa00/0xe64d3fbf12a7ee0b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc74a expref: 19 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147733.889719:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179fa00, rc 0) 00000100:00100000:2.0:1746147733.890384:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:32520:x1830967794188032:12345-192.168.202.10@tcp:101:cat.0 Request processed in 730us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147733.890391:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17015 00000100:00100000:2.0:1746147733.896591:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794187904:12345-192.168.202.10@tcp:4:cat.0 Request processed in 7966us (10506us total) trans 17179874443 rc 0/0 00000100:00100000:2.0:1746147733.896604:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1556 00002000:00100000:2.0:1746147733.896615:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4464639) req@ffff88012ee5a680 x1830967794187904/t17179874443(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/448 e 0 to 0 dl 1746147744 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.896624:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee5a680 with x1830967794187904 ext(4194304->4464639) 00010000:00010000:2.0:1746147733.896634:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 19 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147733.896658:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 19 pid: 10613 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746147733.896665:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ee5a680 00000100:00100000:0.0:1746147733.902005:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.902332:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794188160 00000100:00100000:3.0:1746147733.902340:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794188160 00010000:00010000:3.0:1746147733.902371:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 19 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147733.902407:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8696 00000100:00100000:3.0:1746147733.902414:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794188160:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147733.902426:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147733.902444:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 19 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147733.902454:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 19 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147733.902474:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7edef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4464639) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc72e expref: 19 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147733.902491:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.902493:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.902499:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013179e400/0xe64d3fbf12a7ee04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc743 expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.902507:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013179e400/0xe64d3fbf12a7ee04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc743 expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.902514:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.902515:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147733.902518:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013179fa00/0xe64d3fbf12a7ee0b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc74a expref: 18 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.902524:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013179fa00/0xe64d3fbf12a7ee0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc74a expref: 18 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.902549:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013179fa00/0xe64d3fbf12a7ee0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc74a expref: 18 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.902559:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796543104:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147733.902651:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013179e400/0xe64d3fbf12a7ee04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc743 expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147733.902659:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796543232:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147733.902675:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147733.908768:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796543104:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147733.910082:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796543232:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147733.910103:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147733.910341:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794188160:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7924us (8340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147733.910352:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8696 00000100:00100000:0.0:1746147733.911145:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.911204:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794188416 00000100:00100000:2.0:1746147733.911209:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794188416 00002000:00100000:2.0:1746147733.911239:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88012ee58700 x1830967794188416/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.911246:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58700 with x1830967794188416 ext(2097152->3145727) 00002000:00010000:2.0:1746147733.911250:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee58700 00000100:00100000:2.0:1746147733.911277:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7689 00000100:00100000:2.0:1746147733.911283:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794188416:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147733.918532:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.918598:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794188672 00000100:00100000:3.0:1746147733.918606:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794188672 00002000:00100000:3.0:1746147733.918645:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88012ee58000 x1830967794188672/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.918654:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58000 with x1830967794188672 ext(3145728->4194303) 00002000:00010000:3.0:1746147733.918658:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee58000 00000100:00100000:3.0:1746147733.918683:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7690 00000100:00100000:3.0:1746147733.918689:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794188672:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147733.925049:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794188416:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13756us (13895us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147733.925063:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7689 00002000:00100000:2.0:1746147733.925074:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88012ee58700 x1830967794188416/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.925083:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58700 with x1830967794188416 ext(2097152->3145727) 00002000:00010000:2.0:1746147733.925088:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee58700 00000100:00100000:3.0:1746147733.926113:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794188672:12345-192.168.202.10@tcp:3:cat.0 Request processed in 7422us (7587us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147733.926120:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7690 00002000:00100000:3.0:1746147733.926125:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88012ee58000 x1830967794188672/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.926131:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58000 with x1830967794188672 ext(3145728->4194303) 00002000:00010000:3.0:1746147733.926134:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee58000 00000100:00100000:2.0:1746147733.932623:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.932688:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794188800 00000100:00100000:0.0:1746147733.932696:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794188800 00000100:00100000:0.0:1746147733.932741:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17016 00000100:00100000:0.0:1746147733.932748:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32519:x1830967794188800:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147733.932761:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147733.932774:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb1be00/0xe64d3fbf12a7ee12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc751 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.932799:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.932805:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147733.932806:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147733.932809:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb1be00/0xe64d3fbf12a7ee12 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc751 expref: 22 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.932834:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 13 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147733.932847:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 13 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746147733.932856:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796543360:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147733.932933:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.936033:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.936152:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794189056 00000100:00100000:3.0:1746147733.936158:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794189056 00002000:00100000:3.0:1746147733.936190:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88012ee59880 x1830967794189056/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.936206:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee59880 with x1830967794189056 ext(4194304->5017599) 00002000:00010000:3.0:1746147733.936210:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee59880 00000100:00100000:3.0:1746147733.936235:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7691 00000100:00100000:3.0:1746147733.936241:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794189056:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147733.937786:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.937802:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794189184 00000100:00100000:0.0:1746147733.937807:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794189184 00002000:00100000:0.0:1746147733.937828:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3624960->4194303) req@ffff88012ee58380 x1830967794189184/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147733.937836:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58380 with x1830967794189184 ext(3624960->4194303) 00010000:00010000:0.0:1746147733.937842:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 14 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746147733.937854:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 14 pid: 10613 timeout: 913 lvb_type: 0 00002000:00010000:0.0:1746147733.937860:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ee58380 00000100:00100000:0.0:1746147733.937873:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1557 00000100:00100000:0.0:1746147733.937878:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794189184:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147733.939158:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796543360:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147733.939184:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb1be00/0xe64d3fbf12a7ee12 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc751 expref: 22 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.939197:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb1be00, rc 0) 00000100:00100000:1.0:1746147733.939229:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:32519:x1830967794188800:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6481us (6615us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147733.939235:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17016 00000100:00100000:3.0:1746147733.946350:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794189056:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10101us (10315us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746147733.946361:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7691 00002000:00100000:3.0:1746147733.946370:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88012ee59880 x1830967794189056/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.946378:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee59880 with x1830967794189056 ext(4194304->5017599) 00002000:00010000:3.0:1746147733.946383:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee59880 00000100:00100000:0.0:1746147733.951922:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.952015:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794189312 00000100:00100000:1.0:1746147733.952023:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794189312 00000100:00100000:1.0:1746147733.952057:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17017 00000100:00100000:1.0:1746147733.952064:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794189312:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147733.952079:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147733.952095:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ee19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc758 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.952141:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796543488:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147733.952212:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de480 going to sleep for 11 seconds 00002000:00010000:1.0:1746147733.954248:0:10613:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime: 1746147734 -> 1746147735 00000100:00100000:1.0:1746147733.954263:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796543488:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147733.954287:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ee19 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc758 expref: 17 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.954297:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a029b400/0xe64d3fbf12a7ee19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc758 expref: 17 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.954316:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a029b400, rc 0) 00000100:00100000:1.0:1746147733.954343:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794189312:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2280us (2428us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147733.954350:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17017 00000100:00100000:3.0:1746147733.954851:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794189184:12345-192.168.202.10@tcp:4:cat.0 Request processed in 16970us (17066us total) trans 21474841677 rc 0/0 00000100:00100000:3.0:1746147733.954859:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1557 00002000:00100000:3.0:1746147733.954866:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3624960->4194303) req@ffff88012ee58380 x1830967794189184/t21474841677(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:354/0 lens 488/448 e 0 to 0 dl 1746147744 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.954874:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee58380 with x1830967794189184 ext(3624960->4194303) 00010000:00010000:3.0:1746147733.954880:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 16 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147733.954908:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 16 pid: 10613 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746147733.954918:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ee58380 00000100:00100000:0.0:1746147733.956925:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147733.957041:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794189440 00000100:00100000:1.0:1746147733.957047:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794189440 00000100:00100000:1.0:1746147733.957085:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17018 00000100:00100000:1.0:1746147733.957091:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794189440:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147733.957106:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147733.957124:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7ee20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc75f expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.957168:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796543616:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147733.957567:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de480 going to sleep for 11 seconds 00010000:00010000:1.0:1746147733.963049:0:10613:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.10@tcp) returned -22 from glimpse AST (req@ffff880135812300 x1830967796543616) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 17 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147733.963086:0:10613:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 17 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147733.963108:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7ede1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc720 expref: 17 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147733.963124:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796543616:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147733.963144:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.963146:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147733.963152:0:10613:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb1be00/0xe64d3fbf12a7ee12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc751 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.963160:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb1be00/0xe64d3fbf12a7ee12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc751 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147733.963196:0:10613:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb1be00/0xe64d3fbf12a7ee12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc751 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147733.963207:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796543744:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147733.963747:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147733.964278:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.964756:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794189568 00000100:00100000:3.0:1746147733.964763:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794189568 00000100:00100000:3.0:1746147733.964802:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 909 00000100:00100000:3.0:1746147733.964808:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794189568:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147733.964818:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147733.964821:0:7097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie e64d3fbf12a7ede1) 00010000:00010000:3.0:1746147733.964822:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147733.964849:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794189568:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 41us (573us total) trans 0 rc 116/116 00000100:00100000:3.0:1746147733.964855:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 909 00000100:00100000:1.0:1746147733.965665:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796543744:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147733.965694:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7ee20 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc75f expref: 16 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.965706:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a029a400/0xe64d3fbf12a7ee20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc75f expref: 16 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147733.965716:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a029a400, rc 0) 00000100:00100000:1.0:1746147733.965741:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794189440:12345-192.168.202.10@tcp:101:cat.0 Request processed in 8650us (8858us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147733.965747:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17018 00000100:00100000:0.0:1746147733.974428:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.974459:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147733.974494:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147733.974567:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794190080 00000100:00100000:2.0:1746147733.974576:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794190080 00002000:00100000:2.0:1746147733.974617:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880091633800 x1830967794190080/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.974626:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091633800 with x1830967794190080 ext(3145728->4194303) 00002000:00010000:2.0:1746147733.974630:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091633800 00000100:00100000:2.0:1746147733.974653:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794190336 00000100:00100000:2.0:1746147733.974655:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794190336 00002000:00100000:2.0:1746147733.974667:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880091631c00 x1830967794190336/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.974673:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091631c00 with x1830967794190336 ext(3145728->4194303) 00002000:00010000:2.0:1746147733.974676:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091631c00 00000100:00100000:2.0:1746147733.974686:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794189824 00000100:00100000:2.0:1746147733.974687:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794189824 00002000:00100000:2.0:1746147733.974695:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880091633100 x1830967794189824/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/0 e 0 to 0 dl 1746147744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.974702:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091633100 with x1830967794189824 ext(2097152->3145727) 00002000:00010000:2.0:1746147733.974704:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091633100 00000100:00100000:2.0:1746147733.974724:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7692 00000100:00100000:2.0:1746147733.974730:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794190080:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147733.975837:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7693 00000100:00100000:2.0:1746147733.975844:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794190336:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147733.976907:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7694 00000100:00100000:2.0:1746147733.976915:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794189824:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147733.993937:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794190080:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19198us (19507us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147733.993948:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7692 00002000:00100000:2.0:1746147733.993958:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880091633800 x1830967794190080/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147733.993967:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091633800 with x1830967794190080 ext(3145728->4194303) 00002000:00010000:2.0:1746147733.993972:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091633800 00000100:00100000:3.0:1746147733.997524:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794190336:12345-192.168.202.10@tcp:3:cat.0 Request processed in 21671us (23054us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147733.997536:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7693 00002000:00100000:3.0:1746147733.997547:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880091631c00 x1830967794190336/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147733.997555:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091631c00 with x1830967794190336 ext(3145728->4194303) 00002000:00010000:3.0:1746147733.997560:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091631c00 00000100:00100000:2.0:1746147733.998628:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147733.998705:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794190464 00000100:00100000:3.0:1746147733.998711:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794190464 00000100:00100000:3.0:1746147733.998744:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12103 00000100:00100000:3.0:1746147733.998750:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+6:32525:x1830967794190464:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147733.998767:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147733.998783:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094812000/0xe64d3fbf12a7ee27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc766 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.998844:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094813200/0xe64d3fbf12a7ee2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.998854:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094813200/0xe64d3fbf12a7ee2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.998864:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094813200/0xe64d3fbf12a7ee2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.998873:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094812e00/0xe64d3fbf12a7ee35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.998878:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094812e00/0xe64d3fbf12a7ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.998905:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094812e00/0xe64d3fbf12a7ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.998990:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.998998:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6cc expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.999004:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6d3 expref: 324 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.999009:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 5/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147733.999030:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6d3 expref: 324 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.999043:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6d3 expref: 324 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147733.999057:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796543872:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147733.999114:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6cc expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147733.999121:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6cc expref: 8 pid: 17544 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147733.999127:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce61500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796544000:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147733.999139:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb3600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147734.001307:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794189824:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24386us (26804us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147734.001318:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7694 00002000:00100000:2.0:1746147734.001327:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880091633100 x1830967794189824/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:354/0 lens 488/440 e 0 to 0 dl 1746147744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.001334:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091633100 with x1830967794189824 ext(2097152->3145727) 00002000:00010000:2.0:1746147734.001339:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091633100 00000100:00100000:0.0:1746147734.002537:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.003473:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796543872:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.003483:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce61500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796544000:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.003505:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147734.003695:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.003770:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794190720 00000100:00100000:2.0:1746147734.003776:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794190720 00000100:00100000:2.0:1746147734.003815:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794190976 00000100:00100000:2.0:1746147734.003818:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794190976 00000100:00100000:2.0:1746147734.003843:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5052 00000100:00100000:2.0:1746147734.003849:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:23727:x1830967794190720:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147734.004094:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:23727:x1830967794190720:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 244us (1559us total) trans 8589946134 rc 0/0 00000100:00100000:2.0:1746147734.004101:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5052 00000100:00100000:2.0:1746147734.004113:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5053 00000100:00100000:2.0:1746147734.004118:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:27450:x1830967794190976:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147734.004175:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:27450:x1830967794190976:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 57us (481us total) trans 8589946135 rc 0/0 00000100:00100000:2.0:1746147734.004181:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5053 00000100:00080000:0.0:1746147734.004701:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147734.007011:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.007104:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794191232 00000100:00100000:1.0:1746147734.007111:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794191232 00000100:00100000:1.0:1746147734.007145:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12104 00000100:00100000:1.0:1746147734.007152:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32527:x1830967794191232:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147734.007167:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.007182:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7ee43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc76d expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.007276:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029bc00/0xe64d3fbf12a7ee4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007286:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029bc00/0xe64d3fbf12a7ee4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007296:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029bc00/0xe64d3fbf12a7ee4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007305:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7ee51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007311:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7ee51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007316:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7ee51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007410:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a600/0xe64d3fbf12a7ee58 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007418:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a600/0xe64d3fbf12a7ee58 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007423:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a600/0xe64d3fbf12a7ee58 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:1.0:1746147734.007431:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147734.007501:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029bc00/0xe64d3fbf12a7ee4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007506:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029bc00/0xe64d3fbf12a7ee4a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007514:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029bc00/0xe64d3fbf12a7ee4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007519:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a029bc00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147734.007522:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029bc00/0xe64d3fbf12a7ee4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007527:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029bc00/0xe64d3fbf12a7ee4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007536:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147734.007538:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147734.007541:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029bc00/0xe64d3fbf12a7ee4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007545:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029bc00/0xe64d3fbf12a7ee4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007570:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7ee51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007575:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7ee51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007578:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7ee51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007582:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a029b600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147734.007584:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7ee51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007589:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7ee51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007597:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcc4100) 00010000:00010000:1.0:1746147734.007599:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147734.007602:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7ee51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007606:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029b600/0xe64d3fbf12a7ee51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.007643:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a200/0xe64d3fbf12a7ee43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc76d expref: 329 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.007654:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a600/0xe64d3fbf12a7ee58 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc76d expref: 328 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.007659:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147734.007661:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147734.007664:0:5744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147734.007669:0:5744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147734.007673:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a029a600, rc 0) 00000100:00100000:1.0:1746147734.007710:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32527:x1830967794191232:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 559us (708us total) trans 8589946136 rc 0/0 00000100:00100000:1.0:1746147734.007716:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12104 00000100:00100000:0.0:1746147734.008939:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.009004:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794191360 00000100:00100000:3.0:1746147734.009009:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794191360 00010000:00010000:3.0:1746147734.009030:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6cc expref: 10 pid: 17544 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.009053:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8697 00000100:00100000:3.0:1746147734.009058:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794191360:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.009067:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.009072:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6cc expref: 10 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.009136:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6cc expref: 10 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.009152:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248000/0xe64d3fbf12a7ed71 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6cc expref: 10 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.009201:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.009206:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.009212:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.009217:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.009221:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.009252:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794191360:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 194us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.009258:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8697 00000100:00100000:0.0:1746147734.009817:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.009947:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794191488 00000100:00100000:3.0:1746147734.009951:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794191488 00010000:00010000:3.0:1746147734.009964:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6d3 expref: 328 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.009991:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8698 00000100:00100000:3.0:1746147734.009996:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:1959:x1830967794191488:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.010005:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.010009:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6d3 expref: 328 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.010017:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6d3 expref: 328 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.010028:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a2b0a00/0xe64d3fbf12a7ed7f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6d3 expref: 328 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.010210:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.010213:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.010220:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.010226:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.010383:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.010411:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:1959:x1830967794191488:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 415us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.010417:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8698 00010000:00010000:0.0:1746147734.010475:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010481:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:0.0:1746147734.010512:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:0.0:1746147734.010515:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147734.010526:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010534:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010541:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094813200/0xe64d3fbf12a7ee2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010547:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094813200/0xe64d3fbf12a7ee2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010552:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094813200/0xe64d3fbf12a7ee2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010556:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094813200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147734.010560:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094813200/0xe64d3fbf12a7ee2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010565:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094813200/0xe64d3fbf12a7ee2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010572:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147734.010574:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147734.010576:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094813200/0xe64d3fbf12a7ee2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010581:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094813200/0xe64d3fbf12a7ee2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010600:0:17544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094812e00/0xe64d3fbf12a7ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010605:0:17544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094812e00/0xe64d3fbf12a7ee35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010609:0:17544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094812e00/0xe64d3fbf12a7ee35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010613:0:17544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094812e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147734.010615:0:17544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094812e00/0xe64d3fbf12a7ee35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010619:0:17544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094812e00/0xe64d3fbf12a7ee35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010624:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcc4100) 00010000:00010000:0.0:1746147734.010626:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147734.010628:0:17544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094812e00/0xe64d3fbf12a7ee35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010645:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094812e00/0xe64d3fbf12a7ee35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.010667:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094812000/0xe64d3fbf12a7ee27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc766 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.010677:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc766 expref: 7 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.010683:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147734.010684:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147734.010686:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094812800, rc 0) 00000100:00100000:0.0:1746147734.011364:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+7:32525:x1830967794190464:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 12612us (12737us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147734.011370:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12103 00000100:00100000:0.0:1746147734.011850:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.011955:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794191744 00000100:00100000:2.0:1746147734.011960:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794191744 00002000:00100000:2.0:1746147734.011983:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009fd18700 x1830967794191744/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.011990:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18700 with x1830967794191744 ext(4194304->5017599) 00002000:00010000:2.0:1746147734.011994:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd18700 00000100:00100000:2.0:1746147734.012014:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7695 00000100:00100000:2.0:1746147734.012019:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967794191744:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147734.015228:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.015526:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794191872 00000100:00100000:2.0:1746147734.015533:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794191872 00000100:00100000:2.0:1746147734.015572:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17019 00000100:00100000:2.0:1746147734.015577:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:32527:x1830967794191872:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147734.015594:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.015609:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc774 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.015648:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7ec9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc67f expref: 8 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.015657:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0249600/0xe64d3fbf12a7ed63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6c5 expref: 33 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.015664:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7ed5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6be expref: 17 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.015670:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.015672:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.015675:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [557056->700415] (req 557056->700415) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.015702:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7ed5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6be expref: 17 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.015711:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7ed5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6be expref: 17 pid: 8470 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.015722:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796544128:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.016002:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0249600/0xe64d3fbf12a7ed63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6c5 expref: 33 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.016014:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0249600/0xe64d3fbf12a7ed63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6c5 expref: 33 pid: 20619 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.016021:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796544256:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.016068:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7ec9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc67f expref: 8 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.016078:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7ec9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc67f expref: 8 pid: 20619 timeout: 913 lvb_type: 1 00000100:00100000:2.0:1746147734.016199:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796544384:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.016233:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.017831:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.017999:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794192128 00000100:00100000:2.0:1746147734.018004:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794192128 00000100:00100000:2.0:1746147734.018046:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17020 00000100:00100000:2.0:1746147734.018053:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794192128:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147734.018064:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.018078:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c0da600/0xe64d3fbf12a7ee6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc782 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.018095:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.018097:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.018104:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0da600/0xe64d3fbf12a7ee6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc782 expref: 10 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.018121:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c0da600/0xe64d3fbf12a7ee6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc782 expref: 10 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.018131:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0da600, rc 0) 00000100:00100000:2.0:1746147734.018168:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967794192128:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 116us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.018173:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17020 00000100:00080000:0.0:1746147734.018495:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147734.019245:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.019271:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.019327:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794192000 00000100:00100000:3.0:1746147734.019332:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794192000 00000100:00100000:1.0:1746147734.019333:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.019346:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.019350:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794192256 00000100:00100000:3.0:1746147734.019352:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794192256 00000100:00100000:1.0:1746147734.019358:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794192512 00000100:00100000:1.0:1746147734.019361:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794192512 00000100:00100000:3.0:1746147734.019367:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17021 00000100:00100000:3.0:1746147734.019372:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967794192000:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147734.019376:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0249600/0xe64d3fbf12a7ed63 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6c5 expref: 34 pid: 20619 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.019391:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794192640 00000100:00100000:1.0:1746147734.019392:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794192640 00010000:00010000:1.0:1746147734.019399:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7ec9f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc67f expref: 11 pid: 20619 timeout: 913 lvb_type: 1 00000100:00100000:1.0:1746147734.019410:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8699 00000100:00100000:2.0:1746147734.019411:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17022 00000100:00100000:1.0:1746147734.019415:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967794192512:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147734.019416:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967794192256:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147734.019421:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.019425:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.019437:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7ee74 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc789 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.019438:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0249600/0xe64d3fbf12a7ed63 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6c5 expref: 34 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.019446:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0249600/0xe64d3fbf12a7ed63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6c5 expref: 34 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.019448:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.019450:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.019455:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7ee74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc789 expref: 12 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.019460:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147734.019465:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7ee74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc789 expref: 12 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.019472:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0da200, rc 0) 00000100:00100000:1.0:1746147734.019477:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967794192512:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 62us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.019482:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8699 00000100:00100000:2.0:1746147734.019488:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967794192256:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 72us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.019491:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8700 00000100:00100000:2.0:1746147734.019493:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17022 00000100:00100000:1.0:1746147734.019495:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794192640:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147734.019500:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147734.019505:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7ec9f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc67f expref: 11 pid: 20619 timeout: 913 lvb_type: 1 00010000:00010000:1.0:1746147734.019512:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7ec9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc67f expref: 11 pid: 20619 timeout: 913 lvb_type: 1 00010000:00010000:1.0:1746147734.019520:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147734.019530:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794192640:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 35us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.019534:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8700 00000100:00100000:1.0:1746147734.019569:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.019579:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794192384 00000100:00100000:1.0:1746147734.019581:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794192384 00010000:00010000:1.0:1746147734.019592:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7ed5c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6be expref: 18 pid: 8470 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.019603:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8701 00000100:00100000:1.0:1746147734.019607:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794192384:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147734.019612:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147734.019617:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7ed5c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6be expref: 18 pid: 8470 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.019625:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7ed5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6be expref: 18 pid: 8470 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.019645:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.019647:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.019651:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.019659:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.019682:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.019691:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796544512:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147734.019730:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de480 going to sleep for 11 seconds 00010000:00010000:3.0:1746147734.019823:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.019830:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800950f4800/0xe64d3fbf12a7ee7b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc77b expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.019841:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.019842:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.019847:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800950f4800/0xe64d3fbf12a7ee7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc77b expref: 11 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.019857:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800950f4800/0xe64d3fbf12a7ee7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc77b expref: 11 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.019864:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950f4800, rc 0) 00000100:00080000:0.0:1746147734.020394:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147734.020398:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746147734.020421:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5def400/0xe64d3fbf12a7ed5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6be expref: 18 pid: 8470 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746147734.020431:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796544128:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147734.020441:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0249600/0xe64d3fbf12a7ed63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6c5 expref: 32 pid: 20619 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746147734.020453:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796544256:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147734.020462:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d5000/0xe64d3fbf12a7ec9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc67f expref: 11 pid: 20619 timeout: 913 lvb_type: 1 00000100:00100000:0.0:1746147734.020469:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796544384:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147734.020487:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 31 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.020494:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bcc00, rc 0) 00000100:00100000:2.0:1746147734.020708:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1957:x1830967794191744:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8687us (8856us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147734.020716:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7695 00002000:00100000:2.0:1746147734.020723:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009fd18700 x1830967794191744/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.020731:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18700 with x1830967794191744 ext(4194304->5017599) 00002000:00010000:2.0:1746147734.020734:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd18700 00000100:00100000:3.0:1746147734.020774:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967794192000:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1401us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147734.020774:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32527:x1830967794191872:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5196us (5553us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147734.020780:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17019 00000100:00100000:3.0:1746147734.020785:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17021 00000100:00100000:1.0:1746147734.022789:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796544512:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147734.022805:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147734.022847:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794192384:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3238us (3276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.022857:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8701 00000100:00100000:0.0:1746147734.023223:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.023656:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794192896 00000100:00100000:3.0:1746147734.023663:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794192896 00002000:00100000:3.0:1746147734.023694:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (557056->561151) req@ffff88009fd1aa00 x1830967794192896/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.023703:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1aa00 with x1830967794192896 ext(557056->561151) 00002000:00010000:3.0:1746147734.023707:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd1aa00 00000100:00100000:3.0:1746147734.023724:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7696 00000100:00100000:3.0:1746147734.023730:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794192896:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147734.023876:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794192896:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 145us (653us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147734.023904:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7696 00002000:00100000:3.0:1746147734.023909:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (557056->561151) req@ffff88009fd1aa00 x1830967794192896/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/4536 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.023915:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1aa00 with x1830967794192896 ext(557056->561151) 00002000:00010000:3.0:1746147734.023918:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd1aa00 00000100:00100000:0.0:1746147734.024046:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.024337:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794193152 00000100:00100000:2.0:1746147734.024341:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794193152 00000100:00100000:2.0:1746147734.024386:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12105 00000100:00100000:2.0:1746147734.024391:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+7:32525:x1830967794193152:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147734.024400:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.024413:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7ee82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc790 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.024480:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147734.024492:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc766 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.024498:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147734.024520:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc766 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.024530:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc766 expref: 8 pid: 17544 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.024540:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796544640:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.024593:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6e40 going to sleep for 11 seconds 00000100:00080000:0.0:1746147734.024769:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147734.026150:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796544640:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.026166:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147734.026592:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.027197:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794193408 00000100:00100000:2.0:1746147734.027203:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794193408 00002000:00100000:2.0:1746147734.027231:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (696320->700415) req@ffff88009fd1b480 x1830967794193408/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.027239:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1b480 with x1830967794193408 ext(696320->700415) 00002000:00010000:2.0:1746147734.027242:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd1b480 00000100:00100000:2.0:1746147734.027261:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7697 00000100:00100000:2.0:1746147734.027267:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794193408:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147734.028287:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794193408:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 1018us (1693us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147734.028294:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7697 00002000:00100000:2.0:1746147734.028299:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (696320->700415) req@ffff88009fd1b480 x1830967794193408/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/4536 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.028306:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1b480 with x1830967794193408 ext(696320->700415) 00002000:00010000:2.0:1746147734.028309:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd1b480 00000100:00100000:3.0:1746147734.028381:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.028722:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794193536 00000100:00100000:1.0:1746147734.028727:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794193536 00010000:00010000:1.0:1746147734.028749:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc766 expref: 9 pid: 17544 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.028767:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8702 00000100:00100000:1.0:1746147734.028772:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794193536:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147734.028781:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147734.028787:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc766 expref: 9 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.028796:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc766 expref: 9 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.028813:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094812800/0xe64d3fbf12a7ee3c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc766 expref: 9 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.028827:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147734.028831:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147734.028839:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147734.028844:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147734.028859:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147734.028878:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794193536:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 106us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.028900:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8702 00010000:00010000:2.0:1746147734.029546:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147734.029558:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147734.029574:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147734.030202:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc600/0xe64d3fbf12a7ee82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc790 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.030399:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc790 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.030406:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147734.030409:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147734.030411:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bdc00, rc 0) 00000100:00100000:2.0:1746147734.030566:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32525:x1830967794193152:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 6059us (6405us total) trans 8589946137 rc 0/0 00000100:00100000:2.0:1746147734.030572:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12105 00000100:00100000:0.0:1746147734.037988:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.038207:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794193664 00000100:00100000:2.0:1746147734.038219:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794193664 00000100:00100000:2.0:1746147734.038277:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12106 00000100:00100000:2.0:1746147734.038285:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32525:x1830967794193664:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147734.038309:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.038326:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd400/0xe64d3fbf12a7ee97 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc797 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.038402:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ee9e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147734.038414:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc790 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.038422:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ee9e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147734.038445:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147734.038450:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc790 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.039357:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc790 expref: 9 pid: 17544 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.039361:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794193920 00000100:00100000:3.0:1746147734.039366:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794193920 00000100:00100000:2.0:1746147734.039372:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796544768:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.039401:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5054 00000100:00100000:3.0:1746147734.039407:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a9c5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32527:x1830967794193920:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147734.039602:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a9c5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32527:x1830967794193920:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 195us (1158us total) trans 8589946138 rc 0/0 00000100:00100000:3.0:1746147734.039609:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5054 00000100:00100000:2.0:1746147734.039612:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147734.041438:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796544768:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.041456:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ee9e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:0.0:1746147734.041689:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.041879:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794194048 00000100:00100000:3.0:1746147734.041913:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794194048 00010000:00010000:3.0:1746147734.041936:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc790 expref: 10 pid: 17544 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.041971:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8703 00000100:00100000:3.0:1746147734.041977:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794194048:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.041992:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.041997:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc790 expref: 10 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.042006:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc790 expref: 10 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.042024:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bdc00/0xe64d3fbf12a7ee89 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc790 expref: 10 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.042037:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.042041:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ee9e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.042049:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ee9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.042055:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ee9e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.042075:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147734.042099:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ee9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147734.042105:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ee9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:3.0:1746147734.042116:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794194048:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 138us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.042122:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8703 00000004:00200000:2.0:1746147734.042139:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147734.042143:0:17544:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147734.042155:0:17544:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ee9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147734.042183:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd400/0xe64d3fbf12a7ee97 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc797 expref: 9 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.042202:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ee9e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc797 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.042207:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147734.042209:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147734.042211:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bd000, rc 0) 00000100:00100000:2.0:1746147734.042235:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32525:x1830967794193664:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 3951us (4274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.042240:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12106 00000100:00100000:0.0:1746147734.045457:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.045794:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794194176 00000100:00100000:3.0:1746147734.045801:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794194176 00000100:00100000:3.0:1746147734.045845:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17023 00000100:00100000:3.0:1746147734.045852:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794194176:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147734.045865:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.045878:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7eea5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc79e expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147734.045938:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796544896:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147734.046013:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130eb33c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746147734.050671:0:6715:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime: 1746147734 -> 1746147735 00002000:00010000:3.0:1746147734.050677:0:6715:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime: 1746147734 -> 1746147735 00002000:00010000:3.0:1746147734.050679:0:6715:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime: 1746147734 -> 1746147735 00000100:00100000:3.0:1746147734.050700:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796544896:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147734.050729:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7eea5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc79e expref: 11 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.050742:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800950f4600/0xe64d3fbf12a7eea5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc79e expref: 11 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.050755:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950f4600, rc 0) 00000100:00100000:3.0:1746147734.050794:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794194176:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 4941us (5343us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147734.050801:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17023 00000100:00100000:0.0:1746147734.055348:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.055957:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794194432 00000100:00100000:2.0:1746147734.055964:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794194432 00000100:00100000:2.0:1746147734.056013:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12107 00000100:00100000:2.0:1746147734.056019:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32525:x1830967794194432:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147734.056035:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.056055:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd800/0xe64d3fbf12a7eeac lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc7a5 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.056133:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7eeb3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147734.056145:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7eeb3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147734.056154:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7eeb3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000004:00200000:2.0:1746147734.056164:0:17544:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147734.056255:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd800/0xe64d3fbf12a7eeac lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7a5 expref: 11 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.056281:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7eeb3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7a5 expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.056288:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147734.056291:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147734.056295:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bca00, rc 0) 00000100:00100000:2.0:1746147734.056332:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+10:32525:x1830967794194432:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 313us (992us total) trans 8589946139 rc 0/0 00000100:00100000:2.0:1746147734.056339:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12107 00000100:00100000:0.0:1746147734.058335:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.058371:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.058394:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.058410:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794194688 00000100:00100000:1.0:1746147734.058411:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794194944 00000100:00100000:1.0:1746147734.058415:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794194944 00000100:00100000:0.0:1746147734.058415:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794194688 00000100:00100000:1.0:1746147734.058452:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794195200 00000100:00100000:1.0:1746147734.058454:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794195200 00000100:00100000:0.0:1746147734.058457:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17024 00000100:00100000:0.0:1746147734.058461:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794194944:12345-192.168.202.10@tcp:1:lfs.0 00000100:00100000:1.0:1746147734.058471:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17025 00000100:00100000:1.0:1746147734.058476:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794194688:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:0.0:1746147734.058485:0:7050:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eec1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.058495:0:10613:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7eec8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058496:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7edda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc719 expref: 16 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058501:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800950f4800/0xe64d3fbf12a7ee7b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc77b expref: 10 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.058506:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0xe64d3fbf12a7ede8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc727 expref: 29 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.058507:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092c24000/0xe64d3fbf12a7eca6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc686 expref: 13 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.058509:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.058510:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.058512:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eec1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.058519:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090038a00/0xe64d3fbf12a7eda2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e8 expref: 14 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.058527:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095464a00/0xe64d3fbf12a7ed9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e1 expref: 21 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058529:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0xe64d3fbf12a7ede8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc727 expref: 29 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.058532:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.058533:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.058536:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7eec8 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058536:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0xe64d3fbf12a7ede8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc727 expref: 29 pid: 22183 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746147734.058544:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796545024:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.058550:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095464a00/0xe64d3fbf12a7ed9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e1 expref: 21 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.058558:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095464a00/0xe64d3fbf12a7ed9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e1 expref: 21 pid: 7050 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.058567:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796545152:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147734.058593:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800950f4800/0xe64d3fbf12a7ee7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc77b expref: 10 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.058596:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090038a00/0xe64d3fbf12a7eda2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e8 expref: 14 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058599:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800950f4800/0xe64d3fbf12a7ee7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc77b expref: 10 pid: 6715 timeout: 913 lvb_type: 1 00000100:00100000:0.0:1746147734.058603:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796545280:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.058605:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090038a00/0xe64d3fbf12a7eda2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e8 expref: 14 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.058612:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796545408:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147734.058617:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7edda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc719 expref: 16 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058622:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7edda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc719 expref: 16 pid: 22183 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746147734.058627:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796545536:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.058645:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092c24000/0xe64d3fbf12a7eca6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc686 expref: 13 pid: 8468 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147734.058646:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a43c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147734.058653:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092c24000/0xe64d3fbf12a7eca6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc686 expref: 13 pid: 8468 timeout: 913 lvb_type: 1 00000100:00100000:1.0:1746147734.058661:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796545664:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147734.058662:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.058672:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794194560 00000100:00100000:0.0:1746147734.058674:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794194560 00000100:00100000:1.0:1746147734.058676:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65decc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.058685:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17026 00000100:00100000:0.0:1746147734.058688:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794195200:12345-192.168.202.10@tcp:1:lfs.0 00000100:00100000:1.0:1746147734.058691:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17027 00000100:00100000:1.0:1746147734.058697:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794194560:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:0.0:1746147734.058700:0:4591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7eecf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058706:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb1be00/0xe64d3fbf12a7ee12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc751 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.058712:0:9615:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eed6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058713:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7ee74 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc789 expref: 13 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.058715:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.058716:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.058717:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7eecf lrc: 5/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.058721:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.058726:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147734.058726:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7ee74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc789 expref: 13 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.058728:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147734.058730:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eed6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058730:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7ee74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc789 expref: 13 pid: 8184 timeout: 913 lvb_type: 1 00000100:00100000:0.0:1746147734.058734:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796545792:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.058744:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058750:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb1be00/0xe64d3fbf12a7ee12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc751 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.058751:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 29 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746147734.058755:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb1be00/0xe64d3fbf12a7ee12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc751 expref: 21 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746147734.058759:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2138a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796546048:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147734.058764:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796545920:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147734.058765:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147734.058779:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.058810:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.058834:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.058844:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794194816 00000100:00100000:0.0:1746147734.058846:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794194816 00000100:00100000:0.0:1746147734.058855:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794195072 00000100:00100000:0.0:1746147734.058856:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794195072 00000100:00100000:0.0:1746147734.058863:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17028 00000100:00100000:0.0:1746147734.058866:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794194816:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:0.0:1746147734.058877:0:8469:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7eedd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058901:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a913e600/0xe64d3fbf12a7ecad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc68d expref: 14 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.058906:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7edd3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc712 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058910:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7edcc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc70b expref: 14 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.058911:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17029 00010000:00010000:0.0:1746147734.058912:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.058913:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.058914:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7eedd lrc: 6/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.058918:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794195072:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:0.0:1746147734.058924:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7edcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc70b expref: 14 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058929:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7edcc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc70b expref: 14 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.058934:0:22183:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801308bc200/0xe64d3fbf12a7eee4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147734.058937:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a213a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796546176:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.058944:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013179e400/0xe64d3fbf12a7ee04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc743 expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.058951:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c0da600/0xe64d3fbf12a7ee6d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc782 expref: 12 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.058958:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013179fa00/0xe64d3fbf12a7ee0b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc74a expref: 16 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058961:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7edd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc712 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.058962:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.058963:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.058965:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7edd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc712 expref: 21 pid: 22183 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.058967:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bc200/0xe64d3fbf12a7eee4 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147734.058969:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a213ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796546304:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147734.058979:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a913e600/0xe64d3fbf12a7ecad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc68d expref: 14 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.058981:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013179fa00/0xe64d3fbf12a7ee0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc74a expref: 16 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.058983:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a913e600/0xe64d3fbf12a7ecad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc68d expref: 14 pid: 9615 timeout: 913 lvb_type: 1 00000100:00100000:0.0:1746147734.058987:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2138000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796546432:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.058989:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013179fa00/0xe64d3fbf12a7ee0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc74a expref: 16 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746147734.058992:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147734.058997:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796546560:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.059019:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c0da600/0xe64d3fbf12a7ee6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc782 expref: 12 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.059026:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c0da600/0xe64d3fbf12a7ee6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc782 expref: 12 pid: 22183 timeout: 913 lvb_type: 1 00000100:00100000:2.0:1746147734.059034:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796546688:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.059052:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013179e400/0xe64d3fbf12a7ee04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc743 expref: 29 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.059059:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013179e400/0xe64d3fbf12a7ee04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc743 expref: 29 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.059066:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796546816:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.059081:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.061483:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796545792:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147734.061505:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2138a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796546048:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147734.061524:0:4591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7eecf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147734.061585:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a213a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796546176:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147734.061606:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a213ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796546304:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.061621:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796546688:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147734.061630:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2138000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796546432:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147734.061651:0:8469:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7eedd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.061700:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796545024:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147734.061708:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796545920:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.061710:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796545280:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.061718:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796545536:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.061721:0:9615:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eed6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.061735:0:7050:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eec1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.061738:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796545152:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147734.061745:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796545408:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147734.061751:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796545664:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.061767:0:10613:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7eec8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147734.063588:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796546560:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.063599:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796546816:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.063619:0:22183:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801308bc200/0xe64d3fbf12a7eee4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147734.068434:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.070047:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.070295:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794196352 00000100:00100000:1.0:1746147734.070303:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794196352 00010000:00010000:1.0:1746147734.070335:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095464a00/0xe64d3fbf12a7ed9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e1 expref: 22 pid: 7050 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.070526:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794196736 00000100:00100000:1.0:1746147734.070529:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794196736 00010000:00010000:1.0:1746147734.070539:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7edd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc712 expref: 23 pid: 22183 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.070571:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8704 00000100:00100000:3.0:1746147734.070579:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794196352:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.070747:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.070768:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095464a00/0xe64d3fbf12a7ed9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e1 expref: 23 pid: 7050 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.070783:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095464a00/0xe64d3fbf12a7ed9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e1 expref: 23 pid: 7050 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.070803:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095464a00/0xe64d3fbf12a7ed9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e1 expref: 23 pid: 7050 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.070832:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.070867:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967794196352:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 289us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.070873:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8704 00000100:00100000:3.0:1746147734.070901:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8705 00000100:00100000:3.0:1746147734.070906:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967794196736:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.070913:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.070921:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7edd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc712 expref: 21 pid: 22183 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.070928:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7edd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc712 expref: 21 pid: 22183 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.070938:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009527be00/0xe64d3fbf12a7edd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc712 expref: 21 pid: 22183 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.070953:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.070967:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1958:x1830967794196736:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 61us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.070974:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8705 00000100:00100000:0.0:1746147734.073045:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.073078:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.073106:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.073133:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.073155:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.073221:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794195456 00000100:00100000:3.0:1746147734.073227:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794195456 00010000:00010000:3.0:1746147734.073249:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800950f4800/0xe64d3fbf12a7ee7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc77b expref: 13 pid: 6715 timeout: 913 lvb_type: 1 00000100:00100000:3.0:1746147734.073268:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794195712 00000100:00100000:3.0:1746147734.073270:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794195712 00010000:00010000:3.0:1746147734.073279:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7ee74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc789 expref: 15 pid: 8184 timeout: 913 lvb_type: 1 00000100:00100000:3.0:1746147734.073287:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794195968 00000100:00100000:3.0:1746147734.073288:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794195968 00010000:00010000:3.0:1746147734.073295:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7edda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc719 expref: 17 pid: 22183 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.073303:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794196224 00000100:00100000:3.0:1746147734.073304:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794196224 00010000:00010000:3.0:1746147734.073311:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092c24000/0xe64d3fbf12a7eca6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc686 expref: 16 pid: 8468 timeout: 913 lvb_type: 1 00000100:00100000:3.0:1746147734.073318:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794196608 00000100:00100000:3.0:1746147734.073320:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794196608 00010000:00010000:3.0:1746147734.073326:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a913e600/0xe64d3fbf12a7ecad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc68d expref: 17 pid: 9615 timeout: 913 lvb_type: 1 00000100:00100000:3.0:1746147734.073334:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8706 00000100:00100000:3.0:1746147734.073340:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794195456:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.073351:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.073367:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800950f4800/0xe64d3fbf12a7ee7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc77b expref: 13 pid: 6715 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.073376:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800950f4800/0xe64d3fbf12a7ee7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc77b expref: 13 pid: 6715 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.073393:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800950f4800/0xe64d3fbf12a7ee7b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc77b expref: 13 pid: 6715 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.073407:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.073433:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794195456:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 94us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.073439:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8706 00000100:00100000:3.0:1746147734.073450:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8707 00000100:00100000:3.0:1746147734.073454:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+17:1960:x1830967794195712:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.073459:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.073469:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7ee74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc789 expref: 17 pid: 8184 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.073477:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7ee74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc789 expref: 17 pid: 8184 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.073488:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7ee74 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc789 expref: 17 pid: 8184 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.073501:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.073511:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+16:1960:x1830967794195712:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 57us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.073515:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8707 00000100:00100000:3.0:1746147734.073523:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8708 00000100:00100000:3.0:1746147734.073527:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794195968:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.073531:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.073536:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7edda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc719 expref: 17 pid: 22183 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.073544:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7edda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc719 expref: 17 pid: 22183 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.073554:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009527a800/0xe64d3fbf12a7edda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc719 expref: 17 pid: 22183 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.073560:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.073570:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794195968:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 43us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.073574:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8708 00000100:00100000:3.0:1746147734.073598:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8709 00000100:00100000:3.0:1746147734.073602:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2139c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+15:1960:x1830967794196224:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.073606:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.073613:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092c24000/0xe64d3fbf12a7eca6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc686 expref: 15 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.073621:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092c24000/0xe64d3fbf12a7eca6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc686 expref: 15 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.073630:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092c24000/0xe64d3fbf12a7eca6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc686 expref: 15 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.073648:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.073661:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2139c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794196224:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 59us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.073665:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8709 00000100:00100000:3.0:1746147734.073673:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8710 00000100:00100000:3.0:1746147734.073678:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794196608:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.073682:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.073689:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a913e600/0xe64d3fbf12a7ecad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc68d expref: 13 pid: 9615 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.073696:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a913e600/0xe64d3fbf12a7ecad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc68d expref: 13 pid: 9615 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.073710:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a913e600/0xe64d3fbf12a7ecad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc68d expref: 13 pid: 9615 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.073718:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147734.073985:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.073998:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794196992 00000100:00100000:2.0:1746147734.074001:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794196992 00010000:00010000:2.0:1746147734.074022:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7edcc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc70b expref: 15 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.074035:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8711 00000100:00100000:2.0:1746147734.074040:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794196992:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.074046:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.074053:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7edcc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc70b expref: 15 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.074061:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7edcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc70b expref: 15 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.074072:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7edcc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc70b expref: 15 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.074084:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.074086:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.074089:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7eedd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.074097:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7eedd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.074114:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147734.074127:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794196992:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 87us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.074131:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8711 00000100:00080000:0.0:1746147734.074132:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746147734.074143:0:8469:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7eedd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.074150:0:8469:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7eedd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.074164:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147734.074167:0:8469:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7eedd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.074174:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794195328 00010000:00010000:0.0:1746147734.074174:0:8469:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7eedd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.074177:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794195328 00010000:00010000:0.0:1746147734.074181:0:8469:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7eedd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.074186:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0xe64d3fbf12a7ede8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc727 expref: 30 pid: 22183 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746147734.074191:0:8469:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800943d8c00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147734.074194:0:8469:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7eedd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.074197:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8712 00000100:00100000:2.0:1746147734.074201:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794195328:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147734.074201:0:8469:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7eedd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.074206:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147734.074211:0:8469:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7eedd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.074213:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0xe64d3fbf12a7ede8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc727 expref: 30 pid: 22183 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746147734.074217:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943d8c00/0xe64d3fbf12a7eedd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.074220:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0xe64d3fbf12a7ede8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc727 expref: 30 pid: 22183 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.074229:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0xe64d3fbf12a7ede8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc727 expref: 30 pid: 22183 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.074239:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.074240:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.074243:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eec1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.074248:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eec1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147734.074256:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794194816:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 15388us (15445us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147734.074259:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147734.074262:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17028 00000100:00100000:1.0:1746147734.074339:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.074355:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.074366:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794195584 00000100:00100000:1.0:1746147734.074369:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794195584 00010000:00010000:1.0:1746147734.074380:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090038a00/0xe64d3fbf12a7eda2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e8 expref: 14 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.074390:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794195840 00000100:00100000:1.0:1746147734.074392:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794195840 00010000:00010000:1.0:1746147734.074399:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0da600/0xe64d3fbf12a7ee6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc782 expref: 12 pid: 22183 timeout: 913 lvb_type: 1 00000100:00100000:2.0:1746147734.074400:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794195328:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 198us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.074405:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8712 00000100:00100000:1.0:1746147734.074410:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8713 00000100:00100000:2.0:1746147734.074413:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8714 00000100:00100000:1.0:1746147734.074414:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794195584:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147734.074417:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794195840:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147734.074419:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.074423:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147734.074425:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090038a00/0xe64d3fbf12a7eda2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e8 expref: 14 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.074430:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c0da600/0xe64d3fbf12a7ee6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc782 expref: 12 pid: 22183 timeout: 913 lvb_type: 1 00010000:00010000:1.0:1746147734.074432:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090038a00/0xe64d3fbf12a7eda2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e8 expref: 14 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.074437:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c0da600/0xe64d3fbf12a7ee6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc782 expref: 12 pid: 22183 timeout: 913 lvb_type: 1 00010000:00010000:1.0:1746147734.074441:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090038a00/0xe64d3fbf12a7eda2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6e8 expref: 14 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.074445:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c0da600/0xe64d3fbf12a7ee6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc782 expref: 12 pid: 22183 timeout: 913 lvb_type: 1 00010000:00010000:2.0:1746147734.074451:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147734.074451:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.074452:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.074455:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7eec8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.074460:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7eec8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.074463:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794195840:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 46us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.074468:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8714 00010000:00010000:1.0:1746147734.074473:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147734.074482:0:7050:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eec1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.074484:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794195584:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 70us (145us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147734.074489:0:7050:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eec1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.074489:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8713 00010000:00010000:2.0:1746147734.074500:0:7050:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eec1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.074501:0:10613:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7eec8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.074506:0:7050:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eec1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.074506:0:10613:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7eec8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.074512:0:7050:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.074516:0:7050:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc1e600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147734.074516:0:10613:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7eec8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.074518:0:7050:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eec1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.074521:0:10613:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7eec8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.074524:0:7050:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eec1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.074526:0:10613:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7eec8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.074531:0:7050:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eec1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.074531:0:10613:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8eac00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147734.074533:0:10613:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7eec8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.074539:0:10613:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7eec8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.074541:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eec1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.074550:0:10613:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7eec8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.074554:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7eec8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.074562:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794194944:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 16101us (16195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.074567:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17024 00000100:00100000:1.0:1746147734.074578:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794194688:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 16102us (16250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.074582:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17025 00000100:00100000:2.0:1746147734.074803:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.074819:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794196096 00000100:00100000:2.0:1746147734.074822:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794196096 00002000:00100000:2.0:1746147734.074844:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (557056->700415) req@ffff88009fe96a00 x1830967794196096/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.074852:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96a00 with x1830967794196096 ext(557056->700415) 00010000:00010000:2.0:1746147734.074858:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 29 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.074861:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794196608:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 51us (573us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147734.074866:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 29 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.074871:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8710 00002000:00010000:2.0:1746147734.074871:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe96a00 00000100:00100000:2.0:1746147734.074893:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1558 00000100:00100000:2.0:1746147734.074899:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794196096:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147734.075081:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.075136:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.075155:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.075274:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794196480 00000100:00100000:1.0:1746147734.075277:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794196480 00010000:00010000:1.0:1746147734.075289:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb1be00/0xe64d3fbf12a7ee12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc751 expref: 20 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.075306:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794196864 00000100:00100000:1.0:1746147734.075308:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794196864 00010000:00010000:1.0:1746147734.075317:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013179fa00/0xe64d3fbf12a7ee0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc74a expref: 16 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.075326:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794197120 00000100:00100000:1.0:1746147734.075327:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794197120 00010000:00010000:1.0:1746147734.075333:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013179e400/0xe64d3fbf12a7ee04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc743 expref: 31 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.075342:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8715 00000100:00100000:1.0:1746147734.075346:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794196480:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147734.075355:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147734.075364:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb1be00/0xe64d3fbf12a7ee12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc751 expref: 20 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.075371:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb1be00/0xe64d3fbf12a7ee12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc751 expref: 20 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.075381:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb1be00/0xe64d3fbf12a7ee12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc751 expref: 20 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.075389:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.075391:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.075393:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7eecf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.075399:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7eecf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.075412:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147734.075421:0:4591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7eecf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.075428:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794196480:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 82us (348us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147734.075429:0:4591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7eecf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.075434:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8715 00010000:00010000:0.0:1746147734.075442:0:4591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7eecf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.075447:0:4591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7eecf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.075454:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8716 00010000:00010000:0.0:1746147734.075454:0:4591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7eecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.075458:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794196864:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147734.075459:0:4591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a029b200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147734.075462:0:4591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7eecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.075463:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147734.075467:0:4591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7eecf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.075470:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013179fa00/0xe64d3fbf12a7ee0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc74a expref: 16 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746147734.075476:0:4591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7eecf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.075481:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a029b200/0xe64d3fbf12a7eecf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.075482:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013179fa00/0xe64d3fbf12a7ee0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc74a expref: 16 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.075491:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013179fa00/0xe64d3fbf12a7ee0b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc74a expref: 16 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.075497:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147734.075507:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794196864:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 49us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147734.075508:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794195200:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 16819us (17114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.075512:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8716 00000100:00100000:0.0:1746147734.075514:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17026 00000100:00100000:1.0:1746147734.075519:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8717 00000100:00100000:1.0:1746147734.075523:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1958:x1830967794197120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147734.075528:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147734.075534:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013179e400/0xe64d3fbf12a7ee04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc743 expref: 31 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.075541:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013179e400/0xe64d3fbf12a7ee04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc743 expref: 31 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.075551:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013179e400/0xe64d3fbf12a7ee04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc743 expref: 31 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.075558:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.075560:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.075562:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308bc200/0xe64d3fbf12a7eee4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.075569:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bc200/0xe64d3fbf12a7eee4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.075722:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147734.075737:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967794197120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 213us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.075743:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8717 00010000:00010000:3.0:1746147734.075814:0:22183:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801308bc200/0xe64d3fbf12a7eee4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.075821:0:22183:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308bc200/0xe64d3fbf12a7eee4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.075834:0:22183:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801308bc200/0xe64d3fbf12a7eee4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.075840:0:22183:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bc200/0xe64d3fbf12a7eee4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.075845:0:22183:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801308bc200/0xe64d3fbf12a7eee4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.075850:0:22183:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801308bc200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147734.075852:0:22183:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801308bc200/0xe64d3fbf12a7eee4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.075858:0:22183:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801308bc200/0xe64d3fbf12a7eee4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.075866:0:22183:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801308bc200/0xe64d3fbf12a7eee4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.075872:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308bc200/0xe64d3fbf12a7eee4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147734.076007:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794195072:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 17089us (17171us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.076013:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17029 00000100:00100000:3.0:1746147734.079390:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794196096:12345-192.168.202.10@tcp:4:cat.0 Request processed in 4485us (4581us total) trans 17179874444 rc 0/0 00000100:00100000:3.0:1746147734.079399:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1558 00002000:00100000:3.0:1746147734.079408:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (557056->700415) req@ffff88009fe96a00 x1830967794196096/t17179874444(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/448 e 0 to 0 dl 1746147745 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.079416:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96a00 with x1830967794196096 ext(557056->700415) 00010000:00010000:3.0:1746147734.079423:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 30 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.079436:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 30 pid: 10613 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746147734.079442:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe96a00 00000100:00100000:2.0:1746147734.081750:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.081795:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794197248 00000100:00100000:1.0:1746147734.081802:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794197248 00010000:00010000:1.0:1746147734.081829:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 30 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.081859:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8718 00000100:00100000:1.0:1746147734.081864:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794197248:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147734.081876:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147734.081911:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 30 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.081920:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 30 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.082477:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ee66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 557056->700415) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc774 expref: 30 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.082488:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.082490:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.082493:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eed6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.082500:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eed6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.082528:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147734.082558:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794197248:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 694us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.082563:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8718 00010000:00010000:0.0:1746147734.082618:0:9615:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eed6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.082625:0:9615:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eed6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.082649:0:9615:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eed6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.082656:0:9615:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eed6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.082662:0:9615:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eed6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.082667:0:9615:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8ea600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147734.082670:0:9615:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eed6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.082676:0:9615:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eed6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.082683:0:9615:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eed6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.082687:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7eed6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147734.082720:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794194560:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 24023us (24057us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147734.082726:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17027 00000100:00100000:2.0:1746147734.090471:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.090504:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.090529:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794197504 00000100:00100000:2.0:1746147734.090536:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794197504 00000100:00100000:2.0:1746147734.090581:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794197760 00000100:00100000:2.0:1746147734.090584:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794197760 00000100:00100000:2.0:1746147734.090602:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12108 00000100:00100000:2.0:1746147734.090607:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+10:32525:x1830967794197504:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:2.0:1746147734.090659:0:17544:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.090680:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ee9e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc797 expref: 10 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.090707:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147734.090711:0:17544:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147734.090735:0:17544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147734.090746:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6ef expref: 327 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.090753:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6f6 expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.090759:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7edbe lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6fd expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.090766:0:17544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a600/0xe64d3fbf12a7ee58 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc76d expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.090771:0:17544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 7/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147734.090795:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a600/0xe64d3fbf12a7ee58 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc76d expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.090804:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a600/0xe64d3fbf12a7ee58 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc76d expref: 327 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.090815:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796546944:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.090878:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7edbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6fd expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.090898:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7edbe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6fd expref: 9 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.090905:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796547072:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.090933:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6f6 expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.090939:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6f6 expref: 327 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.090944:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796547200:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.090960:0:17544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6ef expref: 327 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.090965:0:17544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6ef expref: 327 pid: 17544 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.090974:0:17544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796547328:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.090984:0:17544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8af6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.091107:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12109 00000100:00100000:0.0:1746147734.091114:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32531:x1830967794197760:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147734.091126:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.091133:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1e400/0xe64d3fbf12a7eef2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc7ac expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.091198:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eef9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147734.091205:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eef9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147734.091212:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eef9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147734.091222:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ef00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147734.091226:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ef00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147734.091231:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ef00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147734.095011:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.095033:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.095057:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.095084:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.095090:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794197888 00000100:00100000:1.0:1746147734.095096:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794197888 00010000:00010000:1.0:1746147734.095124:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a600/0xe64d3fbf12a7ee58 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc76d expref: 328 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.095141:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794198144 00000100:00100000:1.0:1746147734.095141:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794198016 00000100:00100000:1.0:1746147734.095143:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794198016 00000100:00100000:3.0:1746147734.095145:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794198144 00010000:00010000:1.0:1746147734.095151:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7edbe lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6fd expref: 11 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.095157:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6ef expref: 329 pid: 17544 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.095163:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794198272 00000100:00100000:1.0:1746147734.095164:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794198272 00010000:00010000:1.0:1746147734.095171:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6f6 expref: 330 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.095172:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8719 00000100:00100000:3.0:1746147734.095178:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:1957:x1830967794197888:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147734.095181:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8720 00000100:00100000:1.0:1746147734.095185:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967794198016:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.095188:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147734.095191:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.095193:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a600/0xe64d3fbf12a7ee58 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc76d expref: 330 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.095195:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7edbe lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6fd expref: 11 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.095203:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a600/0xe64d3fbf12a7ee58 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc76d expref: 330 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746147734.095231:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8721 00000100:00100000:0.0:1746147734.095237:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2139180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:1957:x1830967794198144:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147734.095242:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147734.095245:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6ef expref: 330 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.095578:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7edbe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6fd expref: 11 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746147734.095587:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6ef expref: 330 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.095621:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.095625:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.095631:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147734.095651:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147734.095654:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:1.0:1746147734.095660:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.095674:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:1957:x1830967794197888:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 496us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.095677:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967794198016:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 491us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.095680:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8719 00000100:00100000:1.0:1746147734.095684:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8720 00000100:00100000:3.0:1746147734.095693:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8722 00000100:00100000:3.0:1746147734.095697:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:1960:x1830967794198272:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.095703:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.095707:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6f6 expref: 329 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746147734.095730:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147734.095733:0:7312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:0.0:1746147734.095738:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147734.095751:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2139180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:1957:x1830967794198144:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 515us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147734.095756:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8721 00010000:00010000:2.0:1746147734.095923:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a029a600/0xe64d3fbf12a7ee58 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc76d expref: 328 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.095939:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796546944:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.095947:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0266e00/0xe64d3fbf12a7edbe lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6fd expref: 10 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.095955:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796547072:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.095962:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796547200:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.095969:0:17544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248800/0xe64d3fbf12a7edb0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6ef expref: 327 pid: 17544 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.095976:0:17544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17544:1830967796547328:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.095995:0:17544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.096129:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6f6 expref: 326 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.096140:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7edb7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc6f6 expref: 326 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.096150:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.096154:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.096160:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.096166:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.096178:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.096192:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:1960:x1830967794198272:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 495us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.096198:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8722 00010000:00010000:2.0:1746147734.096709:0:17544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00010000:00010000:2.0:1746147734.096714:0:17544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000040:00080000:2.0:1746147734.097243:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3703, 88 off310232 00000004:00080000:2.0:1746147734.097250:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813271365026ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147734.097285:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3708, 88 off310320 00000004:00080000:2.0:1746147734.097289:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813271404544ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147734.097306:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3709, 88 off310408 00000004:00080000:2.0:1746147734.097309:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813271424819ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147734.097317:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3704, 88 off310320 00000004:00080000:2.0:1746147734.097319:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813271434517ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147734.097325:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3705, 88 off310408 00000004:00080000:2.0:1746147734.097327:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813271442139ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147734.097332:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3710, 88 off310496 00000004:00080000:2.0:1746147734.097334:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813271449936ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147734.097340:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3711, 88 off310584 00000004:00080000:2.0:1746147734.097342:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813271457755ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147734.097348:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3712, 88 off310672 00000004:00080000:2.0:1746147734.097350:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813271465762ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147734.097357:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3706, 88 off310496 00000004:00080000:2.0:1746147734.097359:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813271474512ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147734.097364:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3713, 88 off310760 00000004:00080000:2.0:1746147734.097367:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813271482345ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147734.097373:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3707, 88 off310584 00000004:00080000:2.0:1746147734.097375:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813271490309ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147734.097381:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3714, 88 off310848 00000004:00080000:2.0:1746147734.097383:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813271498787ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147734.097389:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3708, 88 off310672 00000004:00080000:2.0:1746147734.097391:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813271507074ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147734.097397:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3709, 88 off310760 00000004:00080000:2.0:1746147734.097399:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813271514865ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147734.097405:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3710, 88 off310848 00000004:00080000:2.0:1746147734.097407:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813271522952ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147734.097413:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3711, 88 off310936 00000004:00080000:2.0:1746147734.097415:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813271530609ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147734.097420:0:17544:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3715, 88 off310936 00000004:00080000:2.0:1746147734.097423:0:17544:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813271538964ns, next at 756024029964ns, rc = 0 00000004:00010000:3.0:1746147734.125658:0:17544:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009fe96680 reply state ffff8800908c2800 transno 8589946140 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17544 initiator: MDT0 00000100:00100000:3.0:1746147734.125673:0:17544:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746147734.125772:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+11:32525:x1830967794197504:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 35160us (35305us total) trans 8589946140 rc 0/0 00000100:00100000:3.0:1746147734.125780:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12108 00000001:00080000:0.0:1746147734.125843:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946136 is committed 00000001:00080000:0.0:1746147734.125859:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946140 is committed 00000004:00080000:0.0:1746147734.125863:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2783 committed 00000004:00080000:0.0:1746147734.125870:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2779 committed 00000004:00080000:0.0:1746147734.125875:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2778 committed 00000004:00080000:0.0:1746147734.125876:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2777 committed 00000004:00080000:0.0:1746147734.125878:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2776 committed 00000004:00080000:0.0:1746147734.125879:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2782 committed 00000004:00080000:0.0:1746147734.125880:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2775 committed 00000004:00080000:0.0:1746147734.125882:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2781 committed 00000004:00080000:0.0:1746147734.125897:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2774 committed 00000004:00080000:0.0:1746147734.125899:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2780 committed 00000004:00080000:0.0:1746147734.125900:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2779 committed 00000004:00080000:0.0:1746147734.125901:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2778 committed 00000004:00080000:0.0:1746147734.125903:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2773 committed 00000004:00080000:0.0:1746147734.125904:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2772 committed 00000004:00080000:0.0:1746147734.125905:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2777 committed 00000004:00080000:0.0:1746147734.125907:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2776 committed 00000004:00080000:0.0:1746147734.125909:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2771 committed 00000001:00080000:0.0:1746147734.125917:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946135 is committed 00000001:00080000:0.0:1746147734.125924:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946138 is committed 00010000:00010000:0.0:1746147734.125945:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147734.125957:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7eeb3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7a5 expref: 7 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.125964:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147734.125994:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7eeb3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7a5 expref: 7 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.126005:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7eeb3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7a5 expref: 7 pid: 17544 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746147734.126016:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2139500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796547456:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147734.126068:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.126191:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a213bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796547968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.126223:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126242:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796548480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.126254:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126265:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796548992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.126277:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126286:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796549504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.126297:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126310:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746147734.126315:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796547584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.126327:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126335:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a213b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796548096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.126346:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126354:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796548608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.126367:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126374:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a548bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796549120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.126385:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126398:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a213b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796547840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.126410:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126419:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796548352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.126429:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126438:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a213a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796548864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.126447:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126455:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796549376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.126464:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126473:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1746147734.126476:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2139880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796547712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.126486:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126493:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796548224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.126503:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126508:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a213ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796548736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.126517:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126523:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796549248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.126532:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.126547:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796547968 00000100:00100000:0.0:1746147734.126553:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796547968 00000100:00100000:0.0:1746147734.126573:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796548480 00000100:00100000:0.0:1746147734.126575:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796548480 00000100:00100000:0.0:1746147734.126581:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796548992 00000100:00100000:0.0:1746147734.126583:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796548992 00000100:00100000:0.0:1746147734.126590:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796549504 00000100:00100000:0.0:1746147734.126591:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796549504 00000100:00100000:0.0:1746147734.126596:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796547584 00000100:00100000:0.0:1746147734.126598:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796547584 00000100:00100000:0.0:1746147734.126604:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796548096 00000100:00100000:0.0:1746147734.126605:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796548096 00000100:00100000:0.0:1746147734.126610:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796548608 00000100:00100000:0.0:1746147734.126611:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796548608 00000100:00100000:0.0:1746147734.126615:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796549120 00000100:00100000:0.0:1746147734.126617:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796549120 00000100:00100000:0.0:1746147734.126621:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796547840 00000100:00100000:0.0:1746147734.126622:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796547840 00000100:00100000:0.0:1746147734.126627:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796548352 00000100:00100000:0.0:1746147734.126628:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796548352 00000100:00100000:0.0:1746147734.126664:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796548864 00000100:00100000:0.0:1746147734.126667:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796548864 00000100:00100000:0.0:1746147734.126673:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796549376 00000100:00100000:0.0:1746147734.126675:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796549376 00000100:00100000:0.0:1746147734.126679:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796547712 00000100:00100000:0.0:1746147734.126681:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796547712 00000100:00100000:0.0:1746147734.126686:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796548224 00000100:00100000:0.0:1746147734.126688:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796548224 00000100:00100000:0.0:1746147734.126693:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796548736 00000100:00100000:0.0:1746147734.126694:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796548736 00000100:00100000:0.0:1746147734.126698:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796549248 00000100:00100000:0.0:1746147734.126700:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796549248 00000100:00100000:0.0:1746147734.126707:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17030 00000100:00100000:0.0:1746147734.126712:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3301:x1830967796547968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.126873:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3301:x1830967796547968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (649us total) trans 21474841678 rc 0/0 00000100:00100000:0.0:1746147734.126878:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17030 00000100:00100000:0.0:1746147734.126907:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17031 00000100:00100000:0.0:1746147734.126911:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3301:x1830967796548480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.126980:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3301:x1830967796548480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (724us total) trans 21474841679 rc 0/0 00000100:00100000:0.0:1746147734.126985:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17031 00000100:00100000:0.0:1746147734.126993:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17032 00000100:00100000:0.0:1746147734.126997:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3301:x1830967796548992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.127083:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3301:x1830967796548992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (804us total) trans 17179874445 rc 0/0 00000100:00100000:0.0:1746147734.127087:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17032 00000100:00100000:0.0:1746147734.127096:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17033 00000100:00100000:0.0:1746147734.127099:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3301:x1830967796549504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.127163:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3301:x1830967796549504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (864us total) trans 17179874446 rc 0/0 00000100:00100000:0.0:1746147734.127168:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17033 00000100:00100000:0.0:1746147734.127176:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17034 00000100:00100000:0.0:1746147734.127180:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3301:x1830967796547584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.127250:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3301:x1830967796547584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (922us total) trans 21474841680 rc 0/0 00000100:00100000:0.0:1746147734.127254:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17034 00000100:00100000:0.0:1746147734.127263:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17035 00000100:00100000:0.0:1746147734.127267:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3301:x1830967796548096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147734.127330:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:0.0:1746147734.127333:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147734.127334:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147734.127336:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147734.127338:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:0.0:1746147734.127355:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3301:x1830967796548096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (1007us total) trans 21474841681 rc 0/0 00000100:00100000:0.0:1746147734.127360:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17035 00000100:00100000:0.0:1746147734.127369:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17036 00000100:00100000:0.0:1746147734.127372:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3301:x1830967796548608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.127447:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3301:x1830967796548608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1078us total) trans 17179874447 rc 0/0 00000100:00100000:0.0:1746147734.127451:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17036 00000100:00100000:0.0:1746147734.127459:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17037 00000100:00100000:0.0:1746147734.127463:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3301:x1830967796549120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.127525:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3301:x1830967796549120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (1139us total) trans 17179874448 rc 0/0 00000100:00100000:0.0:1746147734.127529:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17037 00000100:00100000:0.0:1746147734.127537:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17038 00000100:00100000:0.0:1746147734.127541:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3304:x1830967796547840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.127615:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3304:x1830967796547840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1203us total) trans 21474841682 rc 0/0 00000100:00100000:0.0:1746147734.127619:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17038 00000100:00100000:0.0:1746147734.127628:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17039 00000100:00100000:0.0:1746147734.127644:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3304:x1830967796548352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.127712:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3304:x1830967796548352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (1281us total) trans 21474841683 rc 0/0 00000100:00100000:0.0:1746147734.127716:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17039 00000100:00100000:0.0:1746147734.127725:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17040 00000100:00100000:0.0:1746147734.127729:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3304:x1830967796548864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.127802:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3304:x1830967796548864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1353us total) trans 17179874449 rc 0/0 00000100:00100000:0.0:1746147734.127807:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17040 00000100:00100000:0.0:1746147734.127815:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17041 00000100:00100000:0.0:1746147734.127819:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3304:x1830967796549376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.127913:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3304:x1830967796549376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (1447us total) trans 17179874450 rc 0/0 00000100:00100000:0.0:1746147734.127918:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17041 00000100:00100000:0.0:1746147734.127927:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17042 00000100:00100000:0.0:1746147734.127932:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3304:x1830967796547712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.128005:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3304:x1830967796547712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1516us total) trans 21474841684 rc 0/0 00000100:00100000:0.0:1746147734.128009:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17042 00000100:00100000:0.0:1746147734.128017:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17043 00000100:00100000:0.0:1746147734.128021:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3304:x1830967796548224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.128080:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3304:x1830967796548224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (1575us total) trans 21474841685 rc 0/0 00000100:00100000:0.0:1746147734.128087:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17043 00000100:00100000:0.0:1746147734.128095:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17044 00000100:00100000:0.0:1746147734.128099:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3304:x1830967796548736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.128169:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3304:x1830967796548736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (1650us total) trans 17179874451 rc 0/0 00000100:00100000:0.0:1746147734.128173:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17044 00000100:00100000:0.0:1746147734.128181:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17045 00000100:00100000:0.0:1746147734.128185:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3304:x1830967796549248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.128247:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3304:x1830967796549248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (1714us total) trans 17179874452 rc 0/0 00000100:00100000:0.0:1746147734.128251:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17045 00000004:00080000:0.0:1746147734.128301:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2139880/2, rc 0, transno 21474841684 00000100:00100000:0.0:1746147734.128305:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2139880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796547712:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147734.128311:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2139180/2, rc 0, transno 21474841685 00000100:00100000:0.0:1746147734.128313:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796548224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147734.128321:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a213ad80/2, rc 0, transno 17179874451 00000100:00100000:0.0:1746147734.128327:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a213ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796548736:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147734.128333:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d7f100/2, rc 0, transno 17179874452 00000100:00100000:0.0:1746147734.128335:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796549248:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147734.128340:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a213b100/2, rc 0, transno 21474841682 00000100:00100000:0.0:1746147734.128342:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a213b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796547840:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147734.128347:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2139c00/2, rc 0, transno 21474841683 00000100:00100000:0.0:1746147734.128349:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796548352:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147734.128355:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a213a300/2, rc 0, transno 17179874449 00000100:00100000:0.0:1746147734.128357:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a213a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796548864:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147734.128362:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d7d880/2, rc 0, transno 17179874450 00000100:00100000:0.0:1746147734.128365:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796549376:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147734.128407:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2139f80/2, rc 0, transno 21474841680 00000100:00100000:0.0:1746147734.128410:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796547584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147734.128416:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a213b800/2, rc 0, transno 21474841681 00000100:00100000:0.0:1746147734.128418:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a213b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796548096:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147734.128424:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2138000/2, rc 0, transno 17179874447 00000100:00100000:0.0:1746147734.128426:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796548608:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147734.128431:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a548bb80/2, rc 0, transno 17179874448 00000100:00100000:0.0:1746147734.128433:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a548bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796549120:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147734.128439:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a213bb80/2, rc 0, transno 21474841678 00000100:00100000:0.0:1746147734.128441:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a213bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796547968:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147734.128447:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2138700/2, rc 0, transno 21474841679 00000100:00100000:0.0:1746147734.128449:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796548480:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147734.128455:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2138a80/2, rc 0, transno 17179874445 00000100:00100000:0.0:1746147734.128457:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796548992:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147734.128463:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800943c7100/2, rc 0, transno 17179874446 00000100:00100000:0.0:1746147734.128465:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796549504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.128471:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147734.128476:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796549632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.128498:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.128517:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796549632 00000100:00100000:0.0:1746147734.128521:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796549632 00000100:00100000:0.0:1746147734.128536:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17046 00000100:00100000:0.0:1746147734.128539:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3301:x1830967796549632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.128610:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3301:x1830967796549632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (112us total) trans 17179874453 rc 0/0 00000100:00100000:0.0:1746147734.128615:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17046 00000004:00080000:0.0:1746147734.128631:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e37100/2, rc 0, transno 17179874453 00000100:00100000:0.0:1746147734.128648:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796549632:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147734.128905:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.128915:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.128922:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.128927:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c0da600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147734.128930:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.128936:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.128948:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.128951:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147734.128954:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00010000:00010000:3.0:1746147734.128958:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7eeeb lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17544 initiator: MDT0 00000100:00100000:1.0:1746147734.135903:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.136038:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794198400 00000100:00100000:3.0:1746147734.136045:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794198400 00000100:00100000:3.0:1746147734.136074:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12110 00000100:00100000:3.0:1746147734.136081:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+7:32525:x1830967794198400:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147734.136100:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.136115:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094812400/0xe64d3fbf12a7ef0e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc7b3 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.136161:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094812400/0xe64d3fbf12a7ef0e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7b3 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.136171:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094812400/0xe64d3fbf12a7ef0e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7b3 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.136183:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.136185:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147734.136188:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094812400, rc 0) 00000100:00100000:3.0:1746147734.136220:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41587371-240a-4781-aecb-638f17200fbd+8:32525:x1830967794198400:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 139us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.136225:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12110 00000100:00100000:0.0:1746147734.136369:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2139500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796547456:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147734.136385:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:3.0:1746147734.137721:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.137738:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794198528 00000100:00100000:3.0:1746147734.137741:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794198528 00010000:00010000:3.0:1746147734.137758:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7eeb3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7a5 expref: 8 pid: 17544 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.137773:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8723 00000100:00100000:3.0:1746147734.137777:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794198528:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.137785:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.137788:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7eeb3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7a5 expref: 8 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.137796:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7eeb3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7a5 expref: 8 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.137808:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bca00/0xe64d3fbf12a7eeb3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7a5 expref: 8 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.137818:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.137821:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.137828:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.137832:0:7096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.138496:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147734.138552:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138558:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:1.0:1746147734.138570:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147734.138696:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138701:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138706:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138711:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5545600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147734.138713:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138719:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138725:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147734.138727:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147734.138729:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138733:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5545600/0xe64d3fbf12a7ef07 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138744:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eef9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138748:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eef9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138752:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eef9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138755:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc1e600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147734.138757:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eef9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138760:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eef9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138765:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147734.138766:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147734.138768:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eef9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138772:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1e600/0xe64d3fbf12a7eef9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138779:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ef00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138783:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ef00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138786:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ef00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138789:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc1f800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147734.138791:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ef00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138794:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ef00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138798:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a0276a00) 00010000:00010000:1.0:1746147734.138799:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147734.138801:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ef00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138804:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1f800/0xe64d3fbf12a7ef00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.138834:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1e400/0xe64d3fbf12a7eef2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7ac expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.138840:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc1e400/0xe64d3fbf12a7eef2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7ac expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.138845:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc1e400, rc 0) 00000100:00100000:3.0:1746147734.138882:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794198528:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1103us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.138901:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8723 00000100:00100000:1.0:1746147734.138971:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32531:x1830967794197760:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 47858us (48467us total) trans 8589946141 rc 301/301 00000100:00100000:1.0:1746147734.138976:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12109 00000100:00100000:3.0:1746147734.161194:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.161229:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.161251:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.161272:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794198784 00000100:00100000:0.0:1746147734.161273:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794199040 00000100:00100000:3.0:1746147734.161278:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794198784 00000100:00100000:0.0:1746147734.161278:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794199040 00000100:00100000:0.0:1746147734.161307:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794199168 00000100:00100000:0.0:1746147734.161308:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794199168 00000100:00100000:3.0:1746147734.161309:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5055 00000100:00100000:3.0:1746147734.161315:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+7:32525:x1830967794198784:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1746147734.161320:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12111 00000100:00100000:0.0:1746147734.161323:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32534:x1830967794199040:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147734.161334:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.161348:0:15085:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc000/0xe64d3fbf12a7ef1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc7ba expref: -99 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.161420:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc200/0xe64d3fbf12a7ef23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161429:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc200/0xe64d3fbf12a7ef23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161438:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc200/0xe64d3fbf12a7ef23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161446:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161451:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161455:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00000100:00100000:3.0:1746147734.161466:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41587371-240a-4781-aecb-638f17200fbd+8:32525:x1830967794198784:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 151us (280us total) trans 8589946142 rc 0/0 00000100:00100000:3.0:1746147734.161472:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5055 00010000:00010000:0.0:1746147734.161533:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ef31 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00000100:00100000:3.0:1746147734.161538:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12112 00010000:00010000:0.0:1746147734.161540:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ef31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00000100:00100000:3.0:1746147734.161543:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32531:x1830967794199168:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147734.161545:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ef31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147734.161549:0:17544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:0.0:1746147734.161553:0:15085:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147734.161554:0:17544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094813a00/0xe64d3fbf12a7ef38 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc7c1 expref: -99 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.161575:0:17544:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094813a00/0xe64d3fbf12a7ef38 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7c1 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.161583:0:17544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094813a00/0xe64d3fbf12a7ef38 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7c1 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.161589:0:15085:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc200/0xe64d3fbf12a7ef23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147734.161594:0:17544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147734.161594:0:15085:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc200/0xe64d3fbf12a7ef23 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147734.161597:0:17544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147734.161599:0:15085:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc200/0xe64d3fbf12a7ef23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147734.161600:0:17544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094813a00, rc 0) 00010000:00010000:0.0:1746147734.161603:0:15085:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801308bc200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147734.161606:0:15085:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc200/0xe64d3fbf12a7ef23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161612:0:15085:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc200/0xe64d3fbf12a7ef23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 00000100:00100000:3.0:1746147734.161616:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32531:x1830967794199168:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 73us (365us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147734.161619:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147734.161620:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746147734.161621:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12112 00010000:00010000:0.0:1746147734.161623:0:15085:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc200/0xe64d3fbf12a7ef23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161627:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc200/0xe64d3fbf12a7ef23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161645:0:15085:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161650:0:15085:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161654:0:15085:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161658:0:15085:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801308bcc00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147734.161660:0:15085:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161664:0:15085:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161670:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fb19e00) 00010000:00010000:0.0:1746147734.161672:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147734.161674:0:15085:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161678:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:0.0:1746147734.161712:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bc000/0xe64d3fbf12a7ef1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7ba expref: 12 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.161720:0:15085:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ef31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7ba expref: 11 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.161725:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147734.161727:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147734.161728:0:15085:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bd000, rc 0) 00000100:00100000:0.0:1746147734.161756:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32534:x1830967794199040:12345-192.168.202.10@tcp:101:cat.0 Request processed in 431us (527us total) trans 8589946143 rc 0/0 00000100:00100000:0.0:1746147734.161760:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12111 00000100:00100000:0.0:1746147734.167841:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.169344:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794199424 00000100:00100000:3.0:1746147734.169357:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794199424 00000100:00100000:3.0:1746147734.169423:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5056 00000100:00100000:3.0:1746147734.169432:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+8:32525:x1830967794199424:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:3.0:1746147734.169665:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+9:32525:x1830967794199424:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 234us (1834us total) trans 8589946144 rc 0/0 00000100:00100000:3.0:1746147734.169672:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5056 00000100:00100000:1.0:1746147734.169685:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.170031:0:16639:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794199680 00000100:00100000:2.0:1746147734.170036:0:16639:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794199680 00000100:00100000:2.0:1746147734.170058:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5057 00000100:00100000:2.0:1746147734.170063:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32534:x1830967794199680:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:2.0:1746147734.170154:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32534:x1830967794199680:12345-192.168.202.10@tcp:35:cat.0 Request processed in 90us (470us total) trans 8589946145 rc 0/0 00000100:00100000:2.0:1746147734.170160:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5057 00000100:00100000:1.0:1746147734.170647:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.170986:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794199936 00000100:00100000:3.0:1746147734.170992:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794199936 00000100:00100000:3.0:1746147734.171045:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12113 00000100:00100000:3.0:1746147734.171055:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32531:x1830967794199936:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147734.171069:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.171073:0:5744:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147734.171104:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094813a00/0xe64d3fbf12a7ef38 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7c1 expref: 12 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.171119:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.171124:0:5744:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147734.171137:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094813e00/0xe64d3fbf12a7ef46 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc7c8 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.171184:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.171202:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094812400/0xe64d3fbf12a7ef0e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7b3 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.171211:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ef31 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7ba expref: 12 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.171218:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 5/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.171251:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ef31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7ba expref: 12 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.171264:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ef31 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7ba expref: 12 pid: 15085 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.171279:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce62300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796549760:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.174092:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.174234:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794200192 00000100:00100000:0.0:1746147734.174243:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794200192 00000100:00100000:0.0:1746147734.174293:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12114 00000100:00100000:0.0:1746147734.174301:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:32536:x1830967794200192:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147734.174324:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.174341:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ef54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc7cf expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.174441:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd600/0xe64d3fbf12a7ef5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174452:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd600/0xe64d3fbf12a7ef5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174463:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd600/0xe64d3fbf12a7ef5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174475:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bda00/0xe64d3fbf12a7ef62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174480:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bda00/0xe64d3fbf12a7ef62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174485:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bda00/0xe64d3fbf12a7ef62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174582:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7ef69 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174590:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7ef69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174595:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7ef69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:0.0:1746147734.174603:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147734.174688:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7ef69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174694:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7ef69 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174700:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7ef69 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174705:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801308bce00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147734.174708:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7ef69 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174713:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7ef69 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174723:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147734.174726:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746147734.174729:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7ef69 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174733:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bce00/0xe64d3fbf12a7ef69 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174748:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd600/0xe64d3fbf12a7ef5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174752:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd600/0xe64d3fbf12a7ef5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174756:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd600/0xe64d3fbf12a7ef5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174760:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801308bd600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147734.174762:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd600/0xe64d3fbf12a7ef5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174766:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd600/0xe64d3fbf12a7ef5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174771:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147734.174773:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147734.174775:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd600/0xe64d3fbf12a7ef5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174779:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd600/0xe64d3fbf12a7ef5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174785:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bda00/0xe64d3fbf12a7ef62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174791:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bda00/0xe64d3fbf12a7ef62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174795:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bda00/0xe64d3fbf12a7ef62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174798:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801308bda00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147734.174800:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bda00/0xe64d3fbf12a7ef62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174803:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bda00/0xe64d3fbf12a7ef62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174806:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c2aef00) 00010000:00010000:0.0:1746147734.174808:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147734.174809:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bda00/0xe64d3fbf12a7ef62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174813:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bda00/0xe64d3fbf12a7ef62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147734.174844:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ef54 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7cf expref: 324 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.174851:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bde00/0xe64d3fbf12a7ef54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7cf expref: 324 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.174858:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bde00, rc 0) 00000100:00100000:0.0:1746147734.174927:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:32536:x1830967794200192:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 626us (842us total) trans 8589946146 rc 301/301 00000100:00100000:0.0:1746147734.174936:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12114 00010000:00010000:3.0:1746147734.175337:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094812400/0xe64d3fbf12a7ef0e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7b3 expref: 8 pid: 17544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.175349:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094812400/0xe64d3fbf12a7ef0e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7b3 expref: 8 pid: 17544 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.175362:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796549888:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.177042:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.177685:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.177702:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.177755:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce62300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796549760:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147734.177825:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.177952:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.178138:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794200320 00000100:00100000:2.0:1746147734.178144:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794200320 00000100:00100000:2.0:1746147734.178182:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794200448 00000100:00100000:2.0:1746147734.178184:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794200448 00000100:00100000:2.0:1746147734.178195:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794200576 00000100:00100000:2.0:1746147734.178196:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794200576 00000100:00100000:2.0:1746147734.178208:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17047 00000100:00100000:2.0:1746147734.178214:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794200320:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147734.178233:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.178251:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2e00/0xe64d3fbf12a7ef77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc7d6 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147734.178277:0:6715:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x68141997, atime: 0x68141996, ctime: 0x68141997, blocks: 0x7fd 00010000:00010000:2.0:1746147734.178296:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.178298:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.178307:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2e00/0xe64d3fbf12a7ef77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7d6 expref: 16 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.178323:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2e00/0xe64d3fbf12a7ef77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7d6 expref: 16 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.178335:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d2e00, rc 0) 00000100:00100000:3.0:1746147734.178450:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17048 00000100:00100000:3.0:1746147734.178457:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794200448:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147734.178465:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.178477:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7ef7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc7dd expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147734.178492:0:22183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x68141996, atime: 0x68141996, ctime: 0x68141996, blocks: 0x81b 00010000:00010000:3.0:1746147734.178501:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.178502:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.178506:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7ef7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7dd expref: 15 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.178515:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7ef7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7dd expref: 15 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.178521:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5643600, rc 0) 00000100:00100000:2.0:1746147734.179106:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794200320:12345-192.168.202.10@tcp:101:cat.0 Request processed in 889us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.179114:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17047 00000100:00100000:2.0:1746147734.179133:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17049 00000100:00100000:2.0:1746147734.179139:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794200576:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147734.179147:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.179155:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7ef85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc7e4 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147734.179168:0:6715:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x68141996, atime: 0x68141996, ctime: 0x68141996, blocks: 0x821 00010000:00010000:2.0:1746147734.179176:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.179177:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.179181:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7ef85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7e4 expref: 16 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.179191:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7ef85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7e4 expref: 16 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.179198:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d2200, rc 0) 00000100:00100000:3.0:1746147734.179273:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794200448:12345-192.168.202.10@tcp:101:cat.0 Request processed in 816us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.179279:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17048 00000100:00100000:0.0:1746147734.179498:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.179516:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794200704 00000100:00100000:0.0:1746147734.179521:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794200704 00000100:00100000:0.0:1746147734.179544:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794200832 00000100:00100000:0.0:1746147734.179546:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794200832 00000100:00100000:0.0:1746147734.179557:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17050 00000100:00100000:0.0:1746147734.179562:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794200704:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147734.179570:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.179580:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308bc000/0xe64d3fbf12a7ef8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc7eb expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147734.179594:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x68141996, atime: 0x68141996, ctime: 0x68141996, blocks: 0x81f 00010000:00010000:0.0:1746147734.179602:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.179604:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.179608:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bc000/0xe64d3fbf12a7ef8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7eb expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.179617:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801308bc000/0xe64d3fbf12a7ef8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7eb expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.179624:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bc000, rc 0) 00000100:00100000:0.0:1746147734.179650:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794200704:12345-192.168.202.10@tcp:101:cat.0 Request processed in 87us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147734.179655:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17050 00000100:00100000:0.0:1746147734.179667:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17051 00000100:00100000:0.0:1746147734.179671:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794200832:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147734.179676:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.179685:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7ef93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc7f2 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147734.179695:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x458:0x0] initial LVB size: 5013696, mtime: 0x68141996, atime: 0x68141996, ctime: 0x68141996, blocks: 0x1691 00010000:00010000:0.0:1746147734.179702:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.179703:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.179706:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7ef93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f2 expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.179714:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7ef93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f2 expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.179721:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bc600, rc 0) 00000100:00100000:0.0:1746147734.179736:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794200832:12345-192.168.202.10@tcp:101:cat.0 Request processed in 65us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147734.179740:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17051 00000100:00100000:0.0:1746147734.179777:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.179790:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794200960 00000100:00100000:0.0:1746147734.179792:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794200960 00000100:00100000:0.0:1746147734.179806:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17052 00000100:00100000:0.0:1746147734.179810:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794200960:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147734.179818:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.179827:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc7f9 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147734.179837:0:21480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x456:0x0] initial LVB size: 4194304, mtime: 0x68141996, atime: 0x68141996, ctime: 0x68141996, blocks: 0x1029 00010000:00010000:0.0:1746147734.179844:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.179845:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.179849:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f9 expref: 17 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.179856:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f9 expref: 17 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.179862:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801308bcc00, rc 0) 00000100:00100000:0.0:1746147734.179874:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794200960:12345-192.168.202.10@tcp:101:cat.0 Request processed in 64us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147734.179878:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17052 00000100:00100000:0.0:1746147734.179922:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.180016:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.180337:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794201088 00000100:00100000:3.0:1746147734.180341:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794201088 00010000:00010000:3.0:1746147734.180361:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ef31 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7ba expref: 13 pid: 15085 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.180380:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794201216 00000100:00100000:3.0:1746147734.180382:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794201216 00010000:00010000:3.0:1746147734.180390:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094812400/0xe64d3fbf12a7ef0e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7b3 expref: 9 pid: 17544 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.180402:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8724 00000100:00100000:3.0:1746147734.180406:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794201088:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.180415:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.180419:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ef31 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7ba expref: 13 pid: 15085 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.180429:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ef31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7ba expref: 13 pid: 15085 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.180444:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801308bd000/0xe64d3fbf12a7ef31 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7ba expref: 13 pid: 15085 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.180455:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.180459:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.180466:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.180470:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.180490:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794201088:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 84us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.180494:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8724 00000100:00100000:3.0:1746147734.180503:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8725 00000100:00100000:3.0:1746147734.180506:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794201216:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.180511:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.180514:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094812400/0xe64d3fbf12a7ef0e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7b3 expref: 9 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.180524:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094812400/0xe64d3fbf12a7ef0e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7b3 expref: 9 pid: 17544 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.180532:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.180534:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.180539:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.180544:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.180557:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.180566:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794201216:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 59us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.180570:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8725 00010000:00010000:3.0:1746147734.180605:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094812400/0xe64d3fbf12a7ef0e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7b3 expref: 8 pid: 17544 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.180612:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796549888:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.180631:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.180647:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.180651:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147734.181232:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794200576:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2090us (3403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.181238:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17049 00000040:00080000:3.0:1746147734.181246:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3712, 88 off311024 00000004:00080000:3.0:1746147734.181252:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813355367064ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147734.181290:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3716, 88 off311024 00000004:00080000:3.0:1746147734.181293:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813355408302ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147734.181304:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3717, 88 off311112 00000004:00080000:3.0:1746147734.181306:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813355422039ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147734.181313:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3713, 88 off311112 00000004:00080000:3.0:1746147734.181316:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813355431180ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147734.181321:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3714, 88 off311200 00000004:00080000:3.0:1746147734.181323:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813355438787ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147734.181329:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3718, 88 off311200 00000004:00080000:3.0:1746147734.181332:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813355447277ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147734.181361:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3720, 88 off311384 00000004:00080000:3.0:1746147734.181364:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813355480020ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147734.181371:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3721, 88 off311472 00000004:00080000:3.0:1746147734.181495:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813355610090ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147734.181531:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3716, 88 off311384 00000004:00080000:3.0:1746147734.181534:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813355649984ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147734.181543:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3722, 88 off311560 00000004:00080000:3.0:1746147734.181545:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813355660782ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147734.181552:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3717, 88 off311472 00000004:00080000:3.0:1746147734.181555:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813355670084ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147734.181560:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3723, 88 off311648 00000004:00080000:3.0:1746147734.181562:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813355677584ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147734.181567:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3718, 88 off311560 00000004:00080000:3.0:1746147734.181569:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813355685071ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147734.181575:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3719, 88 off311648 00000004:00080000:3.0:1746147734.181577:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813355692790ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147734.181582:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3720, 88 off311736 00000004:00080000:3.0:1746147734.181584:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813355699997ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147734.181590:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3721, 88 off311824 00000004:00080000:3.0:1746147734.181592:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813355707670ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147734.181598:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3724, 88 off311736 00000004:00080000:3.0:1746147734.181600:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813355715969ns, next at 756024029964ns, rc = 0 00000100:00100000:1.0:1746147734.185111:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.185165:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794201344 00000100:00100000:2.0:1746147734.185174:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794201344 00000100:00100000:2.0:1746147734.185214:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12115 00000100:00100000:2.0:1746147734.185222:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32534:x1830967794201344:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147734.185245:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.185264:0:15085:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc800 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.185318:0:15085:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.185327:0:15085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc800 expref: 14 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.185346:0:15085:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.185358:0:15085:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc800 expref: 14 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.185372:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147734.185375:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147734.185378:0:15085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc800 expref: 14 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.185602:0:15085:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d3600, rc 0) 00000100:00100000:2.0:1746147734.185664:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32534:x1830967794201344:12345-192.168.202.10@tcp:101:cat.0 Request processed in 442us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.185671:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12115 00010000:00010000:3.0:1746147734.201243:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7c8 expref: 14 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.201257:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.201260:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147734.201263:0:5744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc800 expref: 14 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.201272:0:5744:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc800 expref: 14 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.201278:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc800 expref: 14 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.201312:0:5744:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc800 expref: 14 pid: 15085 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147734.201324:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796550016:192.168.202.10@tcp:105: 00000001:00080000:1.0:1746147734.201429:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946146 is committed 00000001:00080000:1.0:1746147734.201438:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946143 is committed 00000001:00080000:1.0:1746147734.201446:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946145 is committed 00000001:00080000:1.0:1746147734.201450:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946147 is committed 00000004:00080000:1.0:1746147734.201455:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2791 committed 00000004:00080000:1.0:1746147734.201461:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2788 committed 00000004:00080000:1.0:1746147734.201466:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2787 committed 00000004:00080000:1.0:1746147734.201467:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2786 committed 00000004:00080000:1.0:1746147734.201469:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2785 committed 00000004:00080000:1.0:1746147734.201471:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2790 committed 00000004:00080000:1.0:1746147734.201472:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2784 committed 00000004:00080000:1.0:1746147734.201473:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2789 committed 00000004:00080000:1.0:1746147734.201475:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2783 committed 00000004:00080000:1.0:1746147734.201476:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2788 committed 00000004:00080000:1.0:1746147734.201477:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2787 committed 00000004:00080000:1.0:1746147734.201478:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2786 committed 00000004:00080000:1.0:1746147734.201480:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2782 committed 00000004:00080000:1.0:1746147734.201482:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2781 committed 00000004:00080000:1.0:1746147734.201483:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2785 committed 00000004:00080000:1.0:1746147734.201485:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2784 committed 00000004:00080000:1.0:1746147734.201486:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2780 committed 00000001:00080000:1.0:1746147734.201490:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946144 is committed 00000100:00100000:2.0:1746147734.201557:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796550144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147734.201600:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147734.201630:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796550656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.201650:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796550400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.201673:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.201688:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796550912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.201699:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.201710:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147734.201714:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796550528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.201725:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.201736:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796551040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.201748:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147734.201769:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796550144 00000100:00100000:0.0:1746147734.201776:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796550144 00000100:00100000:0.0:1746147734.201808:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796550400 00000100:00100000:0.0:1746147734.201810:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796550400 00000100:00100000:0.0:1746147734.201821:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796550912 00000100:00100000:0.0:1746147734.201822:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796550912 00000100:00100000:0.0:1746147734.201831:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796550528 00000100:00100000:0.0:1746147734.201833:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796550528 00000100:00100000:0.0:1746147734.201841:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796551040 00000100:00100000:0.0:1746147734.201843:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796551040 00000100:00100000:0.0:1746147734.201855:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17053 00000100:00100000:0.0:1746147734.201861:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3303:x1830967796550144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147734.202056:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147734.202060:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:0.0:1746147734.202062:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147734.202064:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147735 -> 1746147735 00002000:00010000:0.0:1746147734.202065:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 2045 -> 2045 00000100:00100000:0.0:1746147734.202090:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3303:x1830967796550144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (490us total) trans 17179874454 rc 0/0 00000100:00100000:0.0:1746147734.202096:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17053 00000100:00100000:0.0:1746147734.202111:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17054 00000100:00100000:0.0:1746147734.202115:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3301:x1830967796550400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147734.202187:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:0.0:1746147734.202189:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147734.202191:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147734.202192:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147734.202195:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:0.0:1746147734.202215:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3301:x1830967796550400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (541us total) trans 17179874455 rc 0/0 00000100:00100000:0.0:1746147734.202220:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17054 00000100:00100000:0.0:1746147734.202229:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17055 00000100:00100000:0.0:1746147734.202233:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3301:x1830967796550912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.202307:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3301:x1830967796550912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (606us total) trans 17179874456 rc 0/0 00000100:00100000:0.0:1746147734.202312:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17055 00000100:00100000:0.0:1746147734.202320:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17056 00000100:00100000:0.0:1746147734.202324:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3301:x1830967796550528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.202394:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3301:x1830967796550528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (667us total) trans 17179874457 rc 0/0 00000100:00100000:0.0:1746147734.202399:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17056 00000100:00100000:0.0:1746147734.202409:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17057 00000100:00100000:0.0:1746147734.202413:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3301:x1830967796551040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.202482:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3301:x1830967796551040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (732us total) trans 17179874458 rc 0/0 00000100:00100000:0.0:1746147734.202487:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17057 00000100:00100000:2.0:1746147734.202489:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746147734.202521:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e34e00/2, rc 0, transno 17179874454 00000100:00100000:2.0:1746147734.202529:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796550144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147734.202535:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746147734.202540:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796550272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147734.202553:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147734.202554:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147734.202679:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796551552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147734.202911:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796551296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.204589:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796550656 00000100:00100000:0.0:1746147734.204599:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796550656 00000100:00100000:3.0:1746147734.205136:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796550272 00000100:00100000:3.0:1746147734.205140:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796550272 00000100:00100000:3.0:1746147734.205158:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17058 00000100:00100000:3.0:1746147734.205164:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3303:x1830967796550656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147734.205342:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17059 00000100:00100000:0.0:1746147734.205347:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3303:x1830967796550272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147734.205423:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147734.205426:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147734.205429:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147734.205431:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:0.0:1746147734.205433:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746147734.205949:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3303:x1830967796550656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 784us (3458us total) trans 17179874459 rc 0/0 00000100:00100000:3.0:1746147734.205955:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17058 00000100:00100000:3.0:1746147734.206068:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147734.206091:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796552064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147734.206115:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147734.206131:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746147734.206136:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796551424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147734.206149:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147734.206155:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796551936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147734.206166:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147734.206228:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796551552 00000100:00100000:3.0:1746147734.206232:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796551552 00000100:00100000:3.0:1746147734.206244:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796552064 00000100:00100000:3.0:1746147734.206246:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796552064 00000100:00100000:3.0:1746147734.206252:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796551424 00000100:00100000:3.0:1746147734.206253:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796551424 00000100:00100000:3.0:1746147734.206259:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796551936 00000100:00100000:3.0:1746147734.206260:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796551936 00000100:00100000:3.0:1746147734.206267:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17060 00000100:00100000:3.0:1746147734.206271:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3302:x1830967796551552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147734.206386:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3302:x1830967796551552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (318us total) trans 21474841686 rc 0/0 00000100:00100000:3.0:1746147734.206394:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17060 00000100:00100000:3.0:1746147734.206405:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17061 00000100:00100000:3.0:1746147734.206409:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3302:x1830967796552064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147734.206477:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3302:x1830967796552064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (360us total) trans 21474841687 rc 0/0 00000100:00100000:3.0:1746147734.206481:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17061 00000100:00100000:3.0:1746147734.206493:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17062 00000100:00100000:3.0:1746147734.206496:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3302:x1830967796551424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147734.206557:0:22183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147734.206559:0:22183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:3.0:1746147734.206561:0:22183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:3.0:1746147734.206563:0:22183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:3.0:1746147734.206564:0:22183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746147734.206581:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3302:x1830967796551424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (430us total) trans 21474841688 rc 0/0 00000100:00100000:0.0:1746147734.207061:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3303:x1830967796550272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1712us (4503us total) trans 17179874460 rc 0/0 00000100:00100000:0.0:1746147734.207066:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17059 00000100:00100000:0.0:1746147734.207078:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17063 00000100:00100000:0.0:1746147734.207084:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3302:x1830967796551936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147734.207166:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3302:x1830967796551936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (998us total) trans 21474841689 rc 0/0 00000100:00100000:0.0:1746147734.207171:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17063 00000004:00080000:0.0:1746147734.207230:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2139500/2, rc 0, transno 17179874457 00000100:00100000:0.0:1746147734.207236:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796550528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147734.207244:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8acc700/2, rc 0, transno 17179874458 00000100:00100000:0.0:1746147734.207247:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796551040:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147734.207254:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e35880/2, rc 0, transno 17179874455 00000100:00100000:0.0:1746147734.207257:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796550400:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147734.207264:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8acc380/2, rc 0, transno 17179874456 00000100:00100000:0.0:1746147734.207266:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796550912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147734.207838:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17062 00000004:00080000:3.0:1746147734.207868:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ce62300/2, rc 0, transno 21474841688 00000100:00100000:3.0:1746147734.207873:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796551424:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147734.207880:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135849500/2, rc 0, transno 21474841689 00000100:00100000:3.0:1746147734.207926:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796551936:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147734.207937:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013584b800/2, rc 0, transno 21474841686 00000100:00100000:3.0:1746147734.207939:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796551552:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147734.207946:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013584a680/2, rc 0, transno 21474841687 00000100:00100000:3.0:1746147734.207949:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796552064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147734.208079:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147734.208111:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796551808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147734.208134:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147734.208150:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1746147734.208155:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796551168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147734.208168:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147734.208175:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796551680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147734.208185:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147734.208192:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796552192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147734.208202:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147734.208217:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796551296 00000100:00100000:1.0:1746147734.208221:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796551296 00000100:00100000:1.0:1746147734.208239:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796551808 00000100:00100000:1.0:1746147734.208240:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796551808 00000100:00100000:1.0:1746147734.208247:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796551168 00000100:00100000:1.0:1746147734.208248:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796551168 00000100:00100000:1.0:1746147734.208254:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796551680 00000100:00100000:1.0:1746147734.208256:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796551680 00000100:00100000:1.0:1746147734.208261:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796552192 00000100:00100000:1.0:1746147734.208263:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796552192 00000100:00100000:1.0:1746147734.208272:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17064 00000100:00100000:1.0:1746147734.208277:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+44:3304:x1830967796551296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147734.208372:0:6715:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147734.208374:0:6715:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:1.0:1746147734.208377:0:6715:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:1.0:1746147734.208379:0:6715:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:1.0:1746147734.208380:0:6715:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147734.208402:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+45:3304:x1830967796551296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (323us total) trans 21474841690 rc 0/0 00000100:00100000:1.0:1746147734.208410:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17064 00000100:00100000:1.0:1746147734.208420:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17065 00000100:00100000:1.0:1746147734.208423:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+44:3304:x1830967796551808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147734.208495:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+45:3304:x1830967796551808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (359us total) trans 21474841691 rc 0/0 00000100:00100000:1.0:1746147734.208500:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17065 00000100:00100000:1.0:1746147734.208614:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17066 00000100:00100000:1.0:1746147734.208618:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+44:3304:x1830967796551168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147734.208709:0:6715:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147734.208711:0:6715:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147734 -> 1746147734 00002000:00010000:1.0:1746147734.208713:0:6715:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147734 -> 1746147734 00002000:00010000:1.0:1746147734.208715:0:6715:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147734 -> 1746147734 00002000:00010000:1.0:1746147734.208716:0:6715:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2075 -> 2075 00000100:00100000:1.0:1746147734.208734:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+45:3304:x1830967796551168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (565us total) trans 21474841692 rc 0/0 00000100:00100000:1.0:1746147734.208738:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17066 00000100:00100000:1.0:1746147734.208747:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17067 00000100:00100000:1.0:1746147734.208750:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+44:3304:x1830967796551680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147734.208813:0:6715:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:1.0:1746147734.208816:0:6715:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147734.208818:0:6715:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147734.208819:0:6715:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147734.208821:0:6715:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:1.0:1746147734.208838:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+45:3304:x1830967796551680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (652us total) trans 21474841693 rc 0/0 00000100:00100000:1.0:1746147734.208844:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17067 00000100:00100000:1.0:1746147734.208852:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17068 00000100:00100000:1.0:1746147734.208856:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+48:3304:x1830967796552192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147734.208985:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+49:3304:x1830967796552192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (780us total) trans 17179874461 rc 0/0 00000004:00080000:2.0:1746147734.209280:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e37480/2, rc 0, transno 17179874460 00000100:00100000:2.0:1746147734.209285:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796550272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147734.209291:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796550784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147734.209310:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746147734.209372:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8acce00/2, rc 0, transno 17179874459 00000100:00100000:2.0:1746147734.209376:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796550656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147734.209413:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796550784 00000100:00100000:3.0:1746147734.209416:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796550784 00000100:00100000:3.0:1746147734.209436:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17069 00000100:00100000:3.0:1746147734.209441:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3303:x1830967796550784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147734.209525:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3303:x1830967796550784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (214us total) trans 17179874462 rc 0/0 00000100:00100000:3.0:1746147734.209531:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17069 00000004:00080000:2.0:1746147734.209582:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8acca80/2, rc 0, transno 17179874462 00000100:00100000:2.0:1746147734.209585:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796550784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147734.209860:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17068 00000004:00080000:2.0:1746147734.210029:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0434380/2, rc 0, transno 21474841692 00000100:00100000:2.0:1746147734.210033:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796551168:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147734.210041:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013584aa00/2, rc 0, transno 21474841693 00000100:00100000:2.0:1746147734.210674:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796551680:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147734.210690:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8ace300/2, rc 0, transno 17179874461 00000100:00100000:2.0:1746147734.210694:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796552192:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147734.210703:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0435f80/2, rc 0, transno 21474841690 00000100:00100000:2.0:1746147734.210706:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796551296:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147734.210713:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135848a80/2, rc 0, transno 21474841691 00000100:00100000:2.0:1746147734.210715:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796551808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147734.210963:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796550016:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147734.210994:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094813e00/0xe64d3fbf12a7ef46 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7c8 expref: 10 pid: 5744 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746147734.211001:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147734.211020:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7c8 expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.211052:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094813600, rc 0) 00000100:00100000:2.0:1746147734.211091:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794201472 00000100:00100000:2.0:1746147734.211095:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794201472 00000100:00100000:3.0:1746147734.211105:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32531:x1830967794199936:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 40053us (40458us total) trans 8589946147 rc 0/0 00000100:00100000:3.0:1746147734.211111:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12113 00000100:00100000:2.0:1746147734.211119:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5058 00000100:00100000:2.0:1746147734.211124:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32534:x1830967794201472:12345-192.168.202.10@tcp:49:cat.0 00000100:00100000:2.0:1746147734.211188:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32534:x1830967794201472:12345-192.168.202.10@tcp:49:cat.0 Request processed in 60us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.211194:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5058 00000100:00100000:0.0:1746147734.214439:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.214543:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794201600 00000100:00100000:2.0:1746147734.214552:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794201600 00000100:00100000:2.0:1746147734.214594:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5059 00000100:00100000:2.0:1746147734.214601:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a9c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32531:x1830967794201600:12345-192.168.202.10@tcp:49:multiop.0 00000100:00100000:2.0:1746147734.215056:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a9c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32531:x1830967794201600:12345-192.168.202.10@tcp:49:multiop.0 Request processed in 455us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.215063:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5059 00000100:00100000:2.0:1746147734.222863:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.223151:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794201728 00000100:00100000:1.0:1746147734.223162:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794201728 00000100:00100000:1.0:1746147734.223205:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17070 00000100:00100000:1.0:1746147734.223213:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32531:x1830967794201728:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147734.223234:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.223253:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc807 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.223283:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7ef7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7dd expref: 17 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.223290:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.223292:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.223295:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1495040->1589247] (req 1495040->1589247) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 17 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.223327:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7ef7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7dd expref: 17 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.223338:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7ef7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7dd expref: 17 pid: 22183 timeout: 913 lvb_type: 1 00000100:00100000:1.0:1746147734.223351:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796552320:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147734.223471:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147734.225038:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796552320:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.225076:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1495040->1589247] (req 1495040->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 17 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.225098:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8eb800, rc 0) 00000100:00100000:1.0:1746147734.225156:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32531:x1830967794201728:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1942us (2301us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.225164:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17070 00000100:00100000:2.0:1746147734.225336:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.225398:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794201984 00000100:00100000:3.0:1746147734.225406:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794201984 00002000:00100000:3.0:1746147734.225448:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fe94000 x1830967794201984/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.225457:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe94000 with x1830967794201984 ext(0->1048575) 00002000:00010000:3.0:1746147734.225461:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe94000 00000100:00100000:3.0:1746147734.225488:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7698 00000100:00100000:3.0:1746147734.225494:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794201984:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147734.226952:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.226985:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.227034:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.227049:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794202240 00000100:00100000:2.0:1746147734.227056:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794202240 00002000:00100000:2.0:1746147734.227095:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a8acf480 x1830967794202240/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.227106:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf480 with x1830967794202240 ext(1048576->2097151) 00010000:00010000:2.0:1746147734.227115:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7ef7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7dd expref: 17 pid: 22183 timeout: 913 lvb_type: 1 00010000:00010000:2.0:1746147734.227131:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7ef7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7dd expref: 17 pid: 22183 timeout: 913 lvb_type: 1 00000100:00100000:1.0:1746147734.227133:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794202496 00000100:00100000:1.0:1746147734.227137:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794202496 00002000:00010000:2.0:1746147734.227138:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8acf480 00002000:00100000:1.0:1746147734.227154:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a8acfb80 x1830967794202496/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.227161:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acfb80 with x1830967794202496 ext(1048576->2097151) 00002000:00010000:1.0:1746147734.227164:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acfb80 00000100:00100000:2.0:1746147734.227181:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794202752 00000100:00100000:2.0:1746147734.227185:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794202752 00000100:00100000:0.0:1746147734.227195:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1559 00002000:00100000:2.0:1746147734.227204:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a8acf100 x1830967794202752/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147734.227204:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794202240:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:2.0:1746147734.227211:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf100 with x1830967794202752 ext(1048576->2097151) 00002000:00010000:2.0:1746147734.227215:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acf100 00000100:00100000:2.0:1746147734.227235:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7699 00000100:00100000:2.0:1746147734.227243:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967794202752:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147734.228908:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7700 00000100:00100000:1.0:1746147734.228920:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794202496:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147734.245157:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794202240:12345-192.168.202.10@tcp:3:cat.0 Request processed in 17946us (18202us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147734.245168:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1559 00002000:00100000:0.0:1746147734.245178:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800a8acf480 x1830967794202240/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147734.245186:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf480 with x1830967794202240 ext(1048576->2097151) 00010000:00010000:0.0:1746147734.245194:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7ef7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7dd expref: 19 pid: 22183 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746147734.245206:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7ef7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7dd expref: 19 pid: 22183 timeout: 913 lvb_type: 1 00002000:00010000:0.0:1746147734.245213:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8acf480 00000100:00100000:3.0:1746147734.245302:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967794202752:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18047us (18253us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147734.245312:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7699 00002000:00100000:3.0:1746147734.245322:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800a8acf100 x1830967794202752/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.245331:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf100 with x1830967794202752 ext(1048576->2097151) 00002000:00010000:3.0:1746147734.245336:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acf100 00000100:00100000:0.0:1746147734.259476:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.259730:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794203008 00000100:00100000:3.0:1746147734.259741:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794203008 00000100:00100000:3.0:1746147734.259817:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12116 00000100:00100000:3.0:1746147734.259827:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:32540:x1830967794203008:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147734.259851:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.259873:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7efaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc80e expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.260421:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794202496:12345-192.168.202.10@tcp:3:cat.0 Request processed in 31497us (33426us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147734.260423:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794201984:12345-192.168.202.10@tcp:3:cat.0 Request processed in 34927us (35088us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147734.260431:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7700 00000100:00100000:2.0:1746147734.260440:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7698 00002000:00100000:2.0:1746147734.260446:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fe94000 x1830967794201984/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.260446:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a8acfb80 x1830967794202496/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.260453:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe94000 with x1830967794201984 ext(0->1048575) 00002000:00010000:2.0:1746147734.260458:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe94000 00002000:00100000:1.0:1746147734.260459:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acfb80 with x1830967794202496 ext(1048576->2097151) 00002000:00010000:1.0:1746147734.260462:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acfb80 00010000:00010000:3.0:1746147734.260472:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7efb6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260486:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7efb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260496:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7efb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260509:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095093000/0xe64d3fbf12a7efbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260514:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095093000/0xe64d3fbf12a7efbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260520:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095093000/0xe64d3fbf12a7efbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260629:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7efc4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260647:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7efc4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260653:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7efc4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147734.260667:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147734.260803:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7efb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260810:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7efb6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260816:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7efb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260821:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095092800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147734.260825:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7efb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260831:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7efb6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260842:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147734.260844:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147734.260848:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7efb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260856:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7efb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260916:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095093000/0xe64d3fbf12a7efbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260922:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095093000/0xe64d3fbf12a7efbd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260926:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095093000/0xe64d3fbf12a7efbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260930:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095093000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147734.260932:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095093000/0xe64d3fbf12a7efbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260937:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095093000/0xe64d3fbf12a7efbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260942:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcc4000) 00010000:00010000:3.0:1746147734.260944:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147734.260947:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095093000/0xe64d3fbf12a7efbd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260951:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095093000/0xe64d3fbf12a7efbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.260993:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7efaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc80e expref: 325 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.261005:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7efc4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc80e expref: 324 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.261017:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.261019:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147734.261021:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095093400, rc 0) 00000100:00100000:3.0:1746147734.261069:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32540:x1830967794203008:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1244us (1603us total) trans 8589946148 rc 0/0 00000100:00100000:3.0:1746147734.261077:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12116 00000100:00100000:0.0:1746147734.265004:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.266249:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794203136 00000100:00100000:2.0:1746147734.266257:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794203136 00010000:00010000:2.0:1746147734.266288:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7ef7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7dd expref: 17 pid: 22183 timeout: 913 lvb_type: 1 00000100:00100000:2.0:1746147734.266321:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8726 00000100:00100000:2.0:1746147734.266328:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967794203136:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.266341:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.266360:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7ef7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7dd expref: 17 pid: 22183 timeout: 913 lvb_type: 1 00010000:00010000:2.0:1746147734.266371:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7ef7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7dd expref: 17 pid: 22183 timeout: 913 lvb_type: 1 00010000:00010000:2.0:1746147734.266390:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7ef7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7dd expref: 17 pid: 22183 timeout: 913 lvb_type: 1 00010000:00010000:2.0:1746147734.266417:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.266419:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.266424:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 16 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.266433:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 16 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.266461:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 16 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.266472:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796552448:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147734.266547:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2085000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.267168:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.267823:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794203392 00000100:00100000:2.0:1746147734.267826:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794203392 00000100:00100000:2.0:1746147734.267867:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5060 00000100:00100000:2.0:1746147734.267874:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32540:x1830967794203392:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:2.0:1746147734.268061:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32540:x1830967794203392:12345-192.168.202.10@tcp:35:cat.0 Request processed in 186us (893us total) trans 8589946149 rc 0/0 00000100:00100000:2.0:1746147734.268067:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5060 00000100:00100000:0.0:1746147734.269601:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.269808:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794203520 00000100:00100000:1.0:1746147734.269813:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794203520 00000100:00100000:1.0:1746147734.269846:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17071 00000100:00100000:1.0:1746147734.269852:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32534:x1830967794203520:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147734.269864:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.269878:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7efd2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc815 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.269916:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 18 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.269923:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147734.269924:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147734.269927:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7efd2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc815 expref: 18 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.269949:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 18 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.269958:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 18 pid: 8468 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.269967:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796552576:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147734.270018:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.270367:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.270456:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796552448:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147734.270470:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147734.270511:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794203136:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4182us (5513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.270520:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8726 00000100:00100000:3.0:1746147734.271047:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794203776 00000100:00100000:3.0:1746147734.271058:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794203776 00002000:00100000:3.0:1746147734.271101:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x454:0x0] (1495040->1499135) req@ffff8800a8ace680 x1830967794203776/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.271111:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ace680 with x1830967794203776 ext(1495040->1499135) 00010000:00010000:3.0:1746147734.271120:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 18 pid: 8468 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.271133:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 18 pid: 8468 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746147734.271140:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8ace680 00000100:00100000:3.0:1746147734.271171:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1560 00000100:00100000:3.0:1746147734.271178:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794203776:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147734.271376:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794203776:12345-192.168.202.10@tcp:3:cat.0 Request processed in 198us (1009us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147734.271383:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1560 00002000:00100000:3.0:1746147734.271389:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x454:0x0] (1495040->1499135) req@ffff8800a8ace680 x1830967794203776/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/4536 e 0 to 0 dl 1746147745 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.271396:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ace680 with x1830967794203776 ext(1495040->1499135) 00010000:00010000:3.0:1746147734.271400:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 18 pid: 8468 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.271409:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 18 pid: 8468 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746147734.271415:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8ace680 00000100:00100000:0.0:1746147734.273399:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.273470:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.273496:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796552576:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147734.273497:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.273512:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147734.273522:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7efd2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc815 expref: 17 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.273537:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a66aba00, rc 0) 00000100:00100000:1.0:1746147734.273586:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32534:x1830967794203520:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3734us (3988us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.273595:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17071 00000100:00100000:3.0:1746147734.273606:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794204032 00000100:00100000:3.0:1746147734.273613:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794204032 00000100:00100000:1.0:1746147734.273621:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794204288 00000100:00100000:1.0:1746147734.273626:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794204288 00000100:00100000:3.0:1746147734.273657:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794204544 00000100:00100000:3.0:1746147734.273660:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794204544 00000100:00100000:1.0:1746147734.273661:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794203904 00000100:00100000:1.0:1746147734.273663:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794203904 00000100:00100000:3.0:1746147734.273678:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17072 00000100:00100000:3.0:1746147734.273685:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794204032:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147734.273689:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17073 00000100:00100000:1.0:1746147734.273695:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794204288:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147734.273706:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.273708:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.273718:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095639600/0xe64d3fbf12a7efd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc831 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.273721:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095092400/0xe64d3fbf12a7efe0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc823 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.273734:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.273736:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.273742:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095639600/0xe64d3fbf12a7efd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc831 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.273753:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095639600/0xe64d3fbf12a7efd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc831 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.273760:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095639600, rc 0) 00000100:00100000:3.0:1746147734.273773:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796552704:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147734.273776:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794204288:12345-192.168.202.10@tcp:101:cat.0 Request processed in 82us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.273782:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17073 00000100:00100000:1.0:1746147734.273793:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17074 00000100:00100000:1.0:1746147734.273797:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794204544:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147734.273804:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.273812:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095639a00/0xe64d3fbf12a7efe7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc83f expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.273820:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.273821:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147734.273825:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147734.273825:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095639a00/0xe64d3fbf12a7efe7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc83f expref: 22 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.273832:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095639a00/0xe64d3fbf12a7efe7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc83f expref: 22 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.273838:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095639a00, rc 0) 00000100:00100000:1.0:1746147734.273851:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794204544:12345-192.168.202.10@tcp:101:cat.0 Request processed in 54us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.273856:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17074 00000100:00100000:1.0:1746147734.273867:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17075 00000100:00100000:1.0:1746147734.273870:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794203904:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147734.273874:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.273880:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095639000/0xe64d3fbf12a7efee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc81c expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.273909:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.273910:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.273914:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095639000/0xe64d3fbf12a7efee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc81c expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.273921:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095639000/0xe64d3fbf12a7efee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc81c expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.273928:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095639000, rc 0) 00000100:00100000:1.0:1746147734.273941:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794203904:12345-192.168.202.10@tcp:101:cat.0 Request processed in 70us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.273946:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17075 00000100:00100000:0.0:1746147734.274940:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.275088:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794204160 00000100:00100000:0.0:1746147734.275092:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794204160 00000100:00100000:0.0:1746147734.275118:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17076 00000100:00100000:0.0:1746147734.275123:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794204160:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147734.275133:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.275142:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2a00/0xe64d3fbf12a7eff5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc82a expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.275156:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.275158:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.275164:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2a00/0xe64d3fbf12a7eff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc82a expref: 23 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.275177:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2a00/0xe64d3fbf12a7eff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc82a expref: 23 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.275186:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad2c2a00, rc 0) 00000100:00100000:0.0:1746147734.275216:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794204160:12345-192.168.202.10@tcp:101:cat.0 Request processed in 93us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147734.275221:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17076 00000100:00100000:0.0:1746147734.275258:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.275498:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794204416 00000100:00100000:3.0:1746147734.275501:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794204416 00000100:00100000:3.0:1746147734.275522:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17077 00000100:00100000:3.0:1746147734.275526:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794204416:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147734.275534:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.275543:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801354ea600/0xe64d3fbf12a7effc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc838 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.275556:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.275558:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.275562:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801354ea600/0xe64d3fbf12a7effc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc838 expref: 32 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.275572:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801354ea600/0xe64d3fbf12a7effc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc838 expref: 32 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.275578:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801354ea600, rc 0) 00000100:00100000:3.0:1746147734.275594:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794204416:12345-192.168.202.10@tcp:101:cat.0 Request processed in 67us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.275599:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17077 00000100:00100000:0.0:1746147734.275826:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.276188:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794204800 00000100:00100000:3.0:1746147734.276192:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794204800 00002000:00100000:3.0:1746147734.276215:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x454:0x0] (1585152->1589247) req@ffff88009c2a9880 x1830967794204800/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.276224:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a9880 with x1830967794204800 ext(1585152->1589247) 00010000:00010000:3.0:1746147734.276230:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 17 pid: 8468 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.276673:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 17 pid: 8468 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746147734.276681:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c2a9880 00000100:00100000:3.0:1746147734.276700:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1561 00000100:00100000:3.0:1746147734.276707:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794204800:12345-192.168.202.10@tcp:3:cat.0 00002000:00010000:2.0:1746147734.276810:0:20619:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime: 1746147734 -> 1746147735 00002000:00010000:2.0:1746147734.276816:0:20619:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime: 1746147734 -> 1746147735 00002000:00010000:2.0:1746147734.276818:0:20619:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime: 1746147734 -> 1746147735 00000100:00100000:2.0:1746147734.276836:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796552704:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147734.276862:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095092400/0xe64d3fbf12a7efe0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc823 expref: 22 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.276874:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095092400/0xe64d3fbf12a7efe0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc823 expref: 22 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.276909:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095092400, rc 0) 00000100:00100000:2.0:1746147734.276963:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794204032:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3277us (3570us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147734.276971:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17072 00000100:00100000:3.0:1746147734.277131:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794204800:12345-192.168.202.10@tcp:3:cat.0 Request processed in 423us (1303us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147734.277137:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1561 00002000:00100000:3.0:1746147734.277143:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x454:0x0] (1585152->1589247) req@ffff88009c2a9880 x1830967794204800/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/4536 e 0 to 0 dl 1746147745 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.277151:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a9880 with x1830967794204800 ext(1585152->1589247) 00010000:00010000:3.0:1746147734.277156:0:31360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 17 pid: 8468 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.277166:0:31360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 17 pid: 8468 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746147734.277171:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c2a9880 00000100:00100000:0.0:1746147734.280824:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.280921:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794205184 00000100:00100000:0.0:1746147734.280921:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.280933:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794205184 00000100:00100000:3.0:1746147734.281036:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794205312 00000100:00100000:3.0:1746147734.281045:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794205312 00000100:00100000:2.0:1746147734.281073:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5061 00000100:00100000:2.0:1746147734.281082:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32531:x1830967794205184:12345-192.168.202.10@tcp:35:multiop.0 00002000:00100000:3.0:1746147734.281088:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1495040->1589247) req@ffff88009c2aa680 x1830967794205312/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.281098:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2aa680 with x1830967794205312 ext(1495040->1589247) 00010000:00010000:3.0:1746147734.281106:0:31359:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 17 pid: 8468 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.281121:0:31359:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 17 pid: 8468 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746147734.281128:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c2aa680 00000100:00100000:3.0:1746147734.281158:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1562 00000100:00100000:3.0:1746147734.281164:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794205312:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147734.281282:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32531:x1830967794205184:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 201us (469us total) trans 8589946150 rc 0/0 00000100:00100000:2.0:1746147734.281289:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5061 00000100:00100000:3.0:1746147734.285920:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794205312:12345-192.168.202.10@tcp:4:cat.0 Request processed in 4740us (4983us total) trans 21474841694 rc 0/0 00000100:00100000:3.0:1746147734.285934:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1562 00002000:00100000:3.0:1746147734.285947:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1495040->1589247) req@ffff88009c2aa680 x1830967794205312/t21474841694(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/448 e 0 to 0 dl 1746147745 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.285956:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2aa680 with x1830967794205312 ext(1495040->1589247) 00010000:00010000:3.0:1746147734.285967:0:31359:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 19 pid: 8468 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.285983:0:31359:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 19 pid: 8468 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746147734.285991:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c2aa680 00000100:00100000:2.0:1746147734.286215:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.286408:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794205568 00000100:00100000:3.0:1746147734.286415:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794205568 00002000:00100000:3.0:1746147734.286446:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fe95f80 x1830967794205568/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.286453:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe95f80 with x1830967794205568 ext(0->1048575) 00002000:00010000:3.0:1746147734.286457:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe95f80 00000100:00100000:3.0:1746147734.286473:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7701 00000100:00100000:3.0:1746147734.286479:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967794205568:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147734.292917:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.293019:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794205696 00000100:00100000:2.0:1746147734.293028:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794205696 00010000:00010000:2.0:1746147734.293069:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 19 pid: 8468 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.293109:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8727 00000100:00100000:2.0:1746147734.293116:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794205696:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.293130:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.293159:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 19 pid: 8468 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.293171:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 19 pid: 8468 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.293197:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7efa8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->1589247) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc807 expref: 19 pid: 8468 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.293229:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.293232:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.293239:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7efd2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc815 expref: 18 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.293247:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7efd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc815 expref: 18 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.293280:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7efd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc815 expref: 18 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.293293:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796552832:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147734.294071:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147734.297398:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967794205568:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10905us (11177us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147734.297415:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7701 00002000:00100000:3.0:1746147734.297429:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fe95f80 x1830967794205568/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.297439:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe95f80 with x1830967794205568 ext(0->1048575) 00002000:00010000:3.0:1746147734.297444:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe95f80 00000100:00100000:0.0:1746147734.299179:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.299274:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794205952 00000100:00100000:2.0:1746147734.299279:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796552832:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147734.299281:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794205952 00010000:00010000:2.0:1746147734.299297:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746147734.299317:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009c2ab480 x1830967794205952/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.299325:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2ab480 with x1830967794205952 ext(1048576->2097151) 00002000:00010000:3.0:1746147734.299330:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2ab480 00000100:00100000:2.0:1746147734.299330:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794205696:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6215us (6456us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.299337:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8727 00000100:00100000:3.0:1746147734.299671:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7702 00000100:00100000:3.0:1746147734.299678:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794205952:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147734.308238:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.308435:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794206080 00000100:00100000:2.0:1746147734.308445:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794206080 00000100:00100000:2.0:1746147734.308509:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17078 00000100:00100000:2.0:1746147734.308517:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32540:x1830967794206080:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147734.308537:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.308557:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f003 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc846 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.308589:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.308591:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.308600:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc846 expref: 22 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.308616:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc846 expref: 22 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.308628:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d2c00, rc 0) 00000100:00100000:2.0:1746147734.308702:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:32540:x1830967794206080:12345-192.168.202.10@tcp:101:cat.0 Request processed in 186us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.308708:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17078 00000100:00100000:3.0:1746147734.314223:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794205952:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14532us (15038us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147734.314238:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7702 00002000:00100000:3.0:1746147734.314251:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009c2ab480 x1830967794205952/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.314262:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2ab480 with x1830967794205952 ext(1048576->2097151) 00002000:00010000:3.0:1746147734.314268:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2ab480 00000100:00100000:0.0:1746147734.320102:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.321251:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794206208 00000100:00100000:2.0:1746147734.321262:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794206208 00000100:00100000:2.0:1746147734.321312:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17079 00000100:00100000:2.0:1746147734.321321:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:32536:x1830967794206208:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147734.321343:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.321361:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc84d expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.321396:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2e00/0xe64d3fbf12a7ef77 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7d6 expref: 17 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.321405:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095639000/0xe64d3fbf12a7efee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc81c expref: 33 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.321417:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.321419:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.321422:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [487424->1048575] (req 487424->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 33 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.321455:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095639000/0xe64d3fbf12a7efee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc81c expref: 33 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.321649:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095639000/0xe64d3fbf12a7efee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc81c expref: 33 pid: 8468 timeout: 913 lvb_type: 1 00000100:00100000:2.0:1746147734.321673:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796552960:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.322355:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2e00/0xe64d3fbf12a7ef77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7d6 expref: 17 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.322365:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2e00/0xe64d3fbf12a7ef77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7d6 expref: 17 pid: 6715 timeout: 913 lvb_type: 1 00000100:00100000:2.0:1746147734.322373:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796553088:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.322401:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a66a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147734.323294:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796552960:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.323667:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.323812:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794206464 00000100:00100000:3.0:1746147734.323817:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794206464 00002000:00100000:3.0:1746147734.323856:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009fe95500 x1830967794206464/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.323867:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe95500 with x1830967794206464 ext(1048576->2097151) 00002000:00010000:3.0:1746147734.323872:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe95500 00000100:00100000:0.0:1746147734.324205:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.324491:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.324543:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794206720 00000100:00100000:3.0:1746147734.324546:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794206720 00000100:00100000:3.0:1746147734.324566:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796553088:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.324588:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [487424->1048575] (req 487424->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 33 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.324604:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d2800, rc 0) 00000100:00100000:3.0:1746147734.324656:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:32536:x1830967794206208:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3336us (4565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.324664:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17079 00002000:00100000:3.0:1746147734.324698:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009c2a8700 x1830967794206720/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.324706:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a8700 with x1830967794206720 ext(1048576->2097151) 00002000:00010000:3.0:1746147734.324710:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a8700 00000100:00100000:3.0:1746147734.324729:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7703 00000100:00100000:3.0:1746147734.324735:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794206464:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147734.326002:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794206976 00000100:00100000:2.0:1746147734.326017:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794206976 00002000:00100000:2.0:1746147734.326092:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009c2a8a80 x1830967794206976/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.326107:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a8a80 with x1830967794206976 ext(1048576->2097151) 00002000:00010000:2.0:1746147734.326120:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c2a8a80 00000100:00100000:2.0:1746147734.326188:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7704 00000100:00100000:2.0:1746147734.326204:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794206720:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147734.326733:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7705 00000100:00100000:0.0:1746147734.326761:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794206976:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147734.327588:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.330427:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794207104 00000100:00100000:3.0:1746147734.330437:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794207104 00010000:00010000:3.0:1746147734.330469:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095639000/0xe64d3fbf12a7efee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc81c expref: 34 pid: 8468 timeout: 913 lvb_type: 1 00000100:00100000:3.0:1746147734.330500:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8728 00000100:00100000:3.0:1746147734.330507:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967794207104:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.330518:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.330537:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095639000/0xe64d3fbf12a7efee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc81c expref: 34 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.330549:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095639000/0xe64d3fbf12a7efee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc81c expref: 34 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.330569:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095639000/0xe64d3fbf12a7efee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc81c expref: 34 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.330589:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.330613:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794207104:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 106us (3028us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.330620:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8728 00000100:00100000:3.0:1746147734.331964:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.331982:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794207232 00000100:00100000:3.0:1746147734.331985:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794207232 00010000:00010000:3.0:1746147734.332001:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2e00/0xe64d3fbf12a7ef77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7d6 expref: 18 pid: 6715 timeout: 913 lvb_type: 1 00000100:00100000:3.0:1746147734.332019:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8729 00000100:00100000:3.0:1746147734.332024:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794207232:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.332032:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.332044:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2e00/0xe64d3fbf12a7ef77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7d6 expref: 18 pid: 6715 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.332053:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2e00/0xe64d3fbf12a7ef77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7d6 expref: 18 pid: 6715 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.332066:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2e00/0xe64d3fbf12a7ef77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7d6 expref: 18 pid: 6715 timeout: 913 lvb_type: 1 00010000:00010000:3.0:1746147734.332076:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.332078:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.332083:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 32 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.332091:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 32 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.332120:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 32 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147734.332131:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796553216:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147734.332187:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147734.341199:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.341327:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794208128 00000100:00100000:2.0:1746147734.341341:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794208128 00002000:00100000:2.0:1746147734.341395:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009aee8e00 x1830967794208128/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.341405:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee8e00 with x1830967794208128 ext(3145728->4194303) 00002000:00010000:2.0:1746147734.341412:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aee8e00 00000100:00100000:2.0:1746147734.341572:0:31360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7706 00000100:00100000:2.0:1746147734.341582:0:31360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794208128:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147734.349602:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.349656:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.349683:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.349848:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794207488 00000100:00100000:2.0:1746147734.349857:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794207488 00002000:00100000:2.0:1746147734.349918:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009aeebb80 x1830967794207488/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.349934:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeebb80 with x1830967794207488 ext(2097152->3145727) 00002000:00010000:2.0:1746147734.349939:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeebb80 00000100:00100000:2.0:1746147734.349957:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794207744 00000100:00100000:2.0:1746147734.349959:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794207744 00000100:00100000:1.0:1746147734.350025:0:31356:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794208000 00000100:00100000:1.0:1746147734.350028:0:31356:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794208000 00002000:00100000:1.0:1746147734.350046:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800951d6300 x1830967794208000/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.350053:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d6300 with x1830967794208000 ext(2097152->3145727) 00002000:00010000:1.0:1746147734.350056:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d6300 00000100:00100000:1.0:1746147734.350070:0:31356:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7707 00002000:00100000:2.0:1746147734.350099:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a213aa00 x1830967794207744/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.350115:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a213aa00 with x1830967794207744 ext(3145728->4194303) 00002000:00010000:2.0:1746147734.350118:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a213aa00 00000100:00100000:2.0:1746147734.350129:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7708 00000100:00100000:2.0:1746147734.350135:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794208000:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147734.350688:0:31356:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794207488:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147734.351066:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7709 00000100:00100000:0.0:1746147734.351087:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794207744:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147734.352336:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794206464:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 27593us (28662us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147734.352346:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7703 00002000:00100000:3.0:1746147734.352355:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009fe95500 x1830967794206464/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.352369:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe95500 with x1830967794206464 ext(1048576->2097151) 00002000:00010000:3.0:1746147734.352374:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe95500 00000100:00100000:3.0:1746147734.354040:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796553216:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147734.354060:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.354080:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794207232:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 22055us (22118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.354091:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8729 00000100:00100000:3.0:1746147734.355690:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.356645:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794208512 00000100:00100000:3.0:1746147734.356656:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794208512 00002000:00100000:3.0:1746147734.356745:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x455:0x0] (487424->491519) req@ffff88013584a300 x1830967794208512/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.356755:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584a300 with x1830967794208512 ext(487424->491519) 00002000:00010000:3.0:1746147734.356761:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584a300 00000100:00100000:3.0:1746147734.356785:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7710 00000100:00100000:3.0:1746147734.356794:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967794208512:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147734.357724:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794206720:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 31516us (33512us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147734.357734:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7704 00002000:00100000:2.0:1746147734.357742:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009c2a8700 x1830967794206720/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.357752:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a8700 with x1830967794206720 ext(1048576->2097151) 00002000:00010000:2.0:1746147734.357756:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c2a8700 00000100:00100000:0.0:1746147734.358445:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794206976:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 31685us (33949us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147734.358453:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7705 00002000:00100000:0.0:1746147734.358459:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009c2a8a80 x1830967794206976/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147734.358467:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c2a8a80 with x1830967794206976 ext(1048576->2097151) 00002000:00010000:0.0:1746147734.358471:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c2a8a80 00000100:00100000:3.0:1746147734.358742:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1957:x1830967794208512:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 1948us (3060us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147734.358749:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7710 00002000:00100000:3.0:1746147734.358754:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x455:0x0] (487424->491519) req@ffff88013584a300 x1830967794208512/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/4536 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.358760:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584a300 with x1830967794208512 ext(487424->491519) 00002000:00010000:3.0:1746147734.358763:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584a300 00000100:00100000:1.0:1746147734.366427:0:31360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794208128:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24834us (25223us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147734.366442:0:31360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7706 00002000:00100000:1.0:1746147734.366457:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009aee8e00 x1830967794208128/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.366467:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aee8e00 with x1830967794208128 ext(3145728->4194303) 00002000:00010000:1.0:1746147734.366473:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aee8e00 00000100:00100000:1.0:1746147734.371236:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794207744:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20145us (21565us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147734.371252:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7709 00002000:00100000:1.0:1746147734.371266:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a213aa00 x1830967794207744/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.371277:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a213aa00 with x1830967794207744 ext(3145728->4194303) 00002000:00010000:1.0:1746147734.371283:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a213aa00 00000100:00100000:1.0:1746147734.374346:0:31356:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794207488:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24255us (24742us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147734.374360:0:31356:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7707 00002000:00100000:1.0:1746147734.374373:0:31356:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009aeebb80 x1830967794207488/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.374383:0:31356:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeebb80 with x1830967794207488 ext(2097152->3145727) 00002000:00010000:1.0:1746147734.374389:0:31356:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeebb80 00000100:00100000:0.0:1746147734.374972:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.375292:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794208640 00000100:00100000:3.0:1746147734.375301:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794208640 00000100:00100000:2.0:1746147734.375327:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794208000:12345-192.168.202.10@tcp:3:cat.0 Request processed in 25191us (25641us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147734.375336:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7708 00000100:00100000:3.0:1746147734.375341:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17080 00002000:00100000:2.0:1746147734.375343:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800951d6300 x1830967794208000/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147734.375347:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:32536:x1830967794208640:12345-192.168.202.10@tcp:101:multiop.0 00002000:00100000:2.0:1746147734.375355:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d6300 with x1830967794208000 ext(2097152->3145727) 00002000:00010000:2.0:1746147734.375359:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d6300 00010000:00010000:3.0:1746147734.375362:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.375378:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc854 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.375406:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7efd2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc815 expref: 17 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.375415:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f003 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc846 expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.375421:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.375422:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.375426:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->1380351] (req 1048576->1380351) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.375454:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc846 expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.375465:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f003 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc846 expref: 23 pid: 20619 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.375477:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796553344:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.375544:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7efd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc815 expref: 17 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.375553:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7efd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc815 expref: 17 pid: 8468 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.375560:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796553472:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.375576:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.380725:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.381012:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796553344:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.381022:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796553472:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.381051:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->1380351] (req 1048576->1380351) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.381068:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248200, rc 0) 00000100:00100000:3.0:1746147734.381135:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32536:x1830967794208640:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5787us (6164us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.381144:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17080 00000100:00100000:2.0:1746147734.383380:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794208896 00000100:00100000:2.0:1746147734.383395:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794208896 00010000:00010000:2.0:1746147734.383438:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7efd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc815 expref: 18 pid: 8468 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746147734.383446:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.383648:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794208768 00000100:00100000:2.0:1746147734.383650:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794208768 00010000:00010000:2.0:1746147734.383663:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f003 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc846 expref: 23 pid: 20619 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.383682:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8730 00000100:00100000:2.0:1746147734.383689:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794208896:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.383703:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.383724:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7efd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc815 expref: 18 pid: 8468 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.383734:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7efd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc815 expref: 18 pid: 8468 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.383759:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7efd2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc815 expref: 18 pid: 8468 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.383763:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8731 00000100:00100000:3.0:1746147734.383783:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794208768:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.383788:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147734.383800:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.383824:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f003 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc846 expref: 23 pid: 20619 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.383825:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794208896:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 137us (3111us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.383832:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8730 00010000:00010000:3.0:1746147734.383838:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc846 expref: 23 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.383864:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f003 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc846 expref: 23 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.383927:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.383929:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.383935:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1380351) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 22 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.383942:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1380351) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 22 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.383972:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1380351) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 22 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147734.383982:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796553600:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147734.384714:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.389936:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.390645:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.390739:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.390782:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794209024 00000100:00100000:1.0:1746147734.390792:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794209024 00000100:00100000:1.0:1746147734.390833:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794209152 00000100:00100000:1.0:1746147734.390836:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794209152 00000100:00100000:1.0:1746147734.390852:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17081 00000100:00100000:1.0:1746147734.390859:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794209024:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147734.390879:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147734.390909:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17082 00010000:00010000:1.0:1746147734.390918:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095093000/0xe64d3fbf12a7f018 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc85b expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147734.390918:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794209152:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147734.390928:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.390938:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7f01f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc862 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.390952:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794209280 00000100:00100000:2.0:1746147734.390964:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794209280 00000100:00100000:1.0:1746147734.390972:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796553728:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147734.390972:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796553856:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147734.391018:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12117 00000100:00100000:2.0:1746147734.391025:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+6:32542:x1830967794209280:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147734.391046:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147734.391046:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147734.391062:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7f026 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc869 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.391113:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7f02d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391125:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7f02d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391133:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7f02d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391144:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7f034 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391148:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7f034 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391152:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7f034 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147734.391183:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cda780 going to sleep for 11 seconds 00010000:00010000:2.0:1746147734.391609:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7f03b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391617:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7f03b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391623:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7f03b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:2.0:1746147734.391658:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147734.391663:0:5744:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147734.391676:0:5744:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7f03b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391684:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7f03b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391689:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7f02d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391697:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7f02d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391703:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7f02d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391838:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d3e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147734.391843:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7f02d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391850:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7f02d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391859:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147734.391861:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147734.391864:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7f02d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391869:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3e00/0xe64d3fbf12a7f02d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391927:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7f034 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391933:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7f034 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391937:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7f034 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391941:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d2400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147734.391943:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7f034 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391951:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7f034 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391957:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06ee200) 00010000:00010000:2.0:1746147734.391959:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147734.391961:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7f034 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391966:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2400/0xe64d3fbf12a7f034 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.391994:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7f026 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc869 expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.392005:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7f03b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc869 expref: 7 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.392011:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147734.392012:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147734.392015:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d2a00, rc 0) 00000100:00100000:2.0:1746147734.392242:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+7:32542:x1830967794209280:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 1216us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.392249:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12117 00000100:00100000:0.0:1746147734.401955:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.401990:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.402008:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.402024:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.402039:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.402063:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794210432 00000100:00100000:0.0:1746147734.402071:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794210432 00000100:00100000:0.0:1746147734.402123:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17083 00000100:00100000:0.0:1746147734.402131:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794210432:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147734.402150:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.402167:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7f042 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc870 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.402347:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794209536 00000100:00100000:2.0:1746147734.402357:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794209536 00002000:00100000:2.0:1746147734.402399:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009fc11180 x1830967794209536/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.402408:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc11180 with x1830967794209536 ext(2097152->3145727) 00002000:00010000:2.0:1746147734.402413:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc11180 00000100:00100000:2.0:1746147734.402445:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794209792 00000100:00100000:2.0:1746147734.402448:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794209792 00002000:00100000:2.0:1746147734.402458:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fc11c00 x1830967794209792/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.402465:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc11c00 with x1830967794209792 ext(3145728->4194303) 00002000:00010000:2.0:1746147734.402467:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc11c00 00000100:00100000:2.0:1746147734.402478:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794210048 00000100:00100000:2.0:1746147734.402480:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794210048 00002000:00100000:2.0:1746147734.402492:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fc10e00 x1830967794210048/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.402497:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10e00 with x1830967794210048 ext(2097152->3145727) 00002000:00010000:2.0:1746147734.402500:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc10e00 00000100:00100000:2.0:1746147734.402507:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794210304 00000100:00100000:2.0:1746147734.402509:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794210304 00002000:00100000:2.0:1746147734.402518:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fc11f80 x1830967794210304/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.402523:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc11f80 with x1830967794210304 ext(3145728->4194303) 00002000:00010000:2.0:1746147734.402525:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc11f80 00000100:00100000:2.0:1746147734.402535:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7711 00000100:00100000:2.0:1746147734.402541:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1957:x1830967794209536:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147734.403113:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7712 00000100:00100000:3.0:1746147734.403124:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1957:x1830967794209792:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147734.403745:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7713 00000100:00100000:2.0:1746147734.403753:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794210048:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147734.403796:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7714 00000100:00100000:1.0:1746147734.403805:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794210304:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147734.404043:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796553984:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147734.404107:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cda9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147734.404495:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796553600:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147734.404510:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.404528:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794208768:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 20754us (21084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.404537:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8731 00000100:00100000:0.0:1746147734.405184:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.405233:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.405683:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.405709:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794210688 00000100:00100000:1.0:1746147734.406008:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794210688 00000100:00100000:1.0:1746147734.406037:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794210560 00000100:00100000:1.0:1746147734.406039:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794210560 00000100:00100000:1.0:1746147734.406052:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17084 00000100:00100000:1.0:1746147734.406057:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794210688:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147734.406070:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.406085:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7f049 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc87e expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.406103:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.406105:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.406113:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7f049 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc87e expref: 11 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.406126:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7f049 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc87e expref: 11 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.406135:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a66aba00, rc 0) 00000100:00100000:1.0:1746147734.406162:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794210688:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 105us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.406168:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17084 00000100:00100000:1.0:1746147734.406180:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794210816 00000100:00100000:1.0:1746147734.406183:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794210816 00000100:00100000:1.0:1746147734.406196:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17085 00000100:00100000:1.0:1746147734.406200:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794210560:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147734.406205:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.406212:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7f050 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc877 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.406241:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796554112:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147734.406286:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147734.406303:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17086 00000100:00100000:1.0:1746147734.406308:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794210816:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147734.406315:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.406324:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7f057 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc885 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147734.406330:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147734.406335:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.406336:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.406341:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7f057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc885 expref: 11 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.406350:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7f057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc885 expref: 11 pid: 8468 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147734.406352:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147734.406356:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55e8e00, rc 0) 00000100:00100000:0.0:1746147734.406371:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794210944 00000100:00100000:1.0:1746147734.406372:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794210816:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 64us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.406376:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17086 00000100:00100000:0.0:1746147734.406376:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794210944 00000100:00100000:0.0:1746147734.406413:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17087 00000100:00100000:0.0:1746147734.406420:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794210944:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147734.406433:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.406445:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7f05e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc88c expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.406462:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.406464:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.406471:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7f05e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc88c expref: 12 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.406484:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7f05e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc88c expref: 12 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.406493:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a213de00, rc 0) 00000100:00100000:0.0:1746147734.406518:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794210944:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 99us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147734.406524:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17087 00000100:00100000:0.0:1746147734.406551:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.406560:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794211328 00000100:00100000:0.0:1746147734.406563:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794211328 00000100:00100000:0.0:1746147734.406575:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17088 00000100:00100000:0.0:1746147734.406580:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794211328:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147734.406587:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.406596:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0267600/0xe64d3fbf12a7f065 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc893 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.406607:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.406608:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.406612:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0267600/0xe64d3fbf12a7f065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc893 expref: 13 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.406622:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0267600/0xe64d3fbf12a7f065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc893 expref: 13 pid: 10613 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746147734.406841:0:6715:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime: 1746147734 -> 1746147735 00000100:00100000:1.0:1746147734.406858:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796553728:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147734.406898:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095093000/0xe64d3fbf12a7f018 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc85b expref: 18 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.406907:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095093000/0xe64d3fbf12a7f018 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc85b expref: 18 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.406921:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095093000, rc 0) 00000100:00100000:1.0:1746147734.406939:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794209024:12345-192.168.202.10@tcp:101:cat.0 Request processed in 16081us (17014us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147734.406945:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17081 00000100:00100000:1.0:1746147734.408195:0:31360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794211200 00000100:00100000:1.0:1746147734.408200:0:31360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794211200 00002000:00100000:1.0:1746147734.408225:0:31360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x454:0x0] (1376256->1380351) req@ffff88009fc10000 x1830967794211200/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.408232:0:31360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10000 with x1830967794211200 ext(1376256->1380351) 00002000:00010000:1.0:1746147734.408236:0:31360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc10000 00000100:00100000:1.0:1746147734.408253:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7715 00000100:00100000:1.0:1746147734.408258:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967794211200:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147734.408387:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967794211200:12345-192.168.202.10@tcp:3:cat.0 Request processed in 128us (2057us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147734.408395:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7715 00002000:00100000:1.0:1746147734.408399:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x454:0x0] (1376256->1380351) req@ffff88009fc10000 x1830967794211200/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/4536 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.408405:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10000 with x1830967794211200 ext(1376256->1380351) 00002000:00010000:1.0:1746147734.408407:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc10000 00000100:00100000:1.0:1746147734.409130:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796553856:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147734.409152:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7f01f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc862 expref: 18 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.409162:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7f01f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc862 expref: 18 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.409171:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad2c2c00, rc 0) 00000100:00100000:1.0:1746147734.409194:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794209152:12345-192.168.202.10@tcp:101:cat.0 Request processed in 18278us (18550us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147734.409199:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17082 00000100:00100000:3.0:1746147734.415626:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967794209536:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13070us (13667us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147734.415652:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7711 00002000:00100000:3.0:1746147734.415666:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009fc11180 x1830967794209536/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.415676:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc11180 with x1830967794209536 ext(2097152->3145727) 00002000:00010000:3.0:1746147734.415683:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc11180 00010000:00010000:0.0:1746147734.415946:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0267600, rc 0) 00000100:00100000:1.0:1746147734.416333:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+13:1959:x1830967794211328:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 9749us (9778us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.416340:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17088 00000100:00100000:1.0:1746147734.416404:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.416448:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1957:x1830967794209792:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13326us (14456us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147734.416454:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7712 00002000:00100000:3.0:1746147734.416460:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fc11c00 x1830967794209792/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.416468:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc11c00 with x1830967794209792 ext(3145728->4194303) 00002000:00010000:3.0:1746147734.416471:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc11c00 00000100:00100000:1.0:1746147734.416511:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796554112:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147734.416542:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794211840 00010000:00010000:1.0:1746147734.416542:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7f050 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc877 expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147734.416548:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794211840 00010000:00010000:1.0:1746147734.416562:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55e9e00/0xe64d3fbf12a7f050 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc877 expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.416572:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55e9e00, rc 0) 00000100:00100000:3.0:1746147734.416579:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12118 00000100:00100000:3.0:1746147734.416585:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32544:x1830967794211840:12345-192.168.202.10@tcp:101:multiop.0 00000100:00100000:1.0:1746147734.416597:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794210560:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 10396us (11364us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147734.416603:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17085 00010000:00010000:3.0:1746147734.416604:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.416618:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248600/0xe64d3fbf12a7f06c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc89a expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.416727:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f073 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.416740:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f073 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.416754:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f073 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.416766:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7f07a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.416772:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7f07a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.416777:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7f07a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.416876:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f081 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.416906:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f081 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.416913:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f081 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147734.416922:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147734.416997:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f073 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.417003:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f073 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.417009:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f073 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.417014:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0249a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147734.417017:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f073 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.417025:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f073 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.417035:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147734.417037:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147734.417041:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f073 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.417046:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.417074:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7f07a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.417079:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7f07a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.417083:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7f07a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.417087:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0249000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147734.417089:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7f07a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.417094:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7f07a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.417100:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcc4000) 00010000:00010000:3.0:1746147734.417101:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147734.417103:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7f07a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.417108:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249000/0xe64d3fbf12a7f07a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.417138:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248600/0xe64d3fbf12a7f06c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc89a expref: 13 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.417148:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f081 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc89a expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.417154:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.417156:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147734.417158:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248400, rc 0) 00000100:00100000:3.0:1746147734.417184:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32544:x1830967794211840:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 599us (781us total) trans 8589946151 rc 0/0 00000100:00100000:3.0:1746147734.417191:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12118 00000100:00100000:0.0:1746147734.417231:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796553984:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147734.417249:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7f042 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc870 expref: 11 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.417259:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7f042 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc870 expref: 11 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.417281:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad2c2e00, rc 0) 00000100:00100000:0.0:1746147734.417304:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794210432:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 15174us (15263us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147734.417309:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17083 00000100:00100000:0.0:1746147734.419368:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.419490:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794211584 00000100:00100000:3.0:1746147734.419498:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794211584 00002000:00100000:3.0:1746147734.419536:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009fc10a80 x1830967794211584/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.419547:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10a80 with x1830967794211584 ext(4194304->5017599) 00002000:00010000:3.0:1746147734.419552:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc10a80 00000100:00100000:3.0:1746147734.419585:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7716 00000100:00100000:3.0:1746147734.419593:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794211584:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147734.419937:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794210048:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16176us (17918us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147734.419952:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7713 00002000:00100000:2.0:1746147734.419962:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fc10e00 x1830967794210048/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.419972:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10e00 with x1830967794210048 ext(2097152->3145727) 00002000:00010000:2.0:1746147734.419976:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc10e00 00000100:00100000:2.0:1746147734.422694:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794210304:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18877us (20655us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147734.422707:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7714 00002000:00100000:2.0:1746147734.422717:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fc11f80 x1830967794210304/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.422726:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc11f80 with x1830967794210304 ext(3145728->4194303) 00002000:00010000:2.0:1746147734.422731:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc11f80 00000100:00100000:0.0:1746147734.422800:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.422868:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794212096 00000100:00100000:2.0:1746147734.422875:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794212096 00000100:00100000:2.0:1746147734.422928:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5062 00000100:00100000:2.0:1746147734.422940:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32536:x1830967794212096:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:2.0:1746147734.423624:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32536:x1830967794212096:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 682us (823us total) trans 8589946152 rc 0/0 00000100:00100000:2.0:1746147734.423645:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5062 00000100:00100000:0.0:1746147734.423951:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.425001:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794212352 00000100:00100000:3.0:1746147734.425010:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794212352 00000100:00100000:3.0:1746147734.425053:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12119 00000100:00100000:3.0:1746147734.425060:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+7:32542:x1830967794212352:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147734.425080:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.425100:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f08f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc8a1 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.425191:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f096 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.425207:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7efc4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc80e expref: 325 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.425214:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7f03b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc869 expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.425221:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f081 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc89a expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.425227:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f096 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.425259:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f081 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc89a expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.425270:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f081 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc89a expref: 11 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.425284:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584b100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796554240:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.425369:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7f03b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc869 expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.425377:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7f03b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc869 expref: 8 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.425390:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796554368:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.425414:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7efc4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc80e expref: 325 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.425422:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7efc4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc80e expref: 325 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.425429:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796554496:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.425444:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147734.428269:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794211584:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8665us (8898us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746147734.428281:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7716 00002000:00100000:3.0:1746147734.428293:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009fc10a80 x1830967794211584/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.428303:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10a80 with x1830967794211584 ext(4194304->5017599) 00002000:00010000:3.0:1746147734.428308:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc10a80 00000100:00100000:0.0:1746147734.429750:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.429766:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584b100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796554240:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.429776:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796554368:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.429784:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796554496:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.429810:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f096 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147734.429912:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794212608 00000100:00100000:2.0:1746147734.429918:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794212608 00010000:00010000:2.0:1746147734.429949:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7f03b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc869 expref: 9 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746147734.430002:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.430722:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.430748:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794212480 00000100:00100000:2.0:1746147734.430752:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794212480 00010000:00010000:2.0:1746147734.430767:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f081 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc89a expref: 12 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.430785:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8732 00000100:00100000:2.0:1746147734.430792:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967794212608:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.430806:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.430812:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7f03b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc869 expref: 9 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.430822:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7f03b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc869 expref: 9 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.430843:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2a00/0xe64d3fbf12a7f03b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc869 expref: 9 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.430858:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147734.430863:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f096 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.430871:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f096 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.430876:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147734.430937:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794212608:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 144us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.430943:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8732 00000100:00100000:2.0:1746147734.430957:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8733 00000100:00100000:2.0:1746147734.430962:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1958:x1830967794212480:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.430967:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.430971:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f081 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc89a expref: 12 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.430979:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f081 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc89a expref: 12 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.430990:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f081 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc89a expref: 12 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.430998:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147734.431001:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f096 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.431006:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f096 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.431010:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147734.431027:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967794212480:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 65us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.431032:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8733 00000100:00100000:3.0:1746147734.431154:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794212736 00000100:00100000:3.0:1746147734.431158:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794212736 00010000:00010000:3.0:1746147734.431172:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7efc4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc80e expref: 326 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.431186:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8734 00000100:00100000:3.0:1746147734.431190:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:1958:x1830967794212736:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.431196:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147734.431200:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7efc4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc80e expref: 326 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.431208:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7efc4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc80e expref: 326 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.431220:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7efc4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc80e expref: 326 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.431234:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.431237:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f096 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.431243:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f096 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.431250:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f096 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.431265:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.431294:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:1958:x1830967794212736:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 103us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.431300:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8734 00010000:00010000:3.0:1746147734.431319:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f096 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.431326:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f096 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147734.431343:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:1.0:1746147734.431350:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147734.431481:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f08f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8a1 expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.431493:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f096 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8a1 expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.431499:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.431502:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147734.431504:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248a00, rc 0) 00000100:00100000:3.0:1746147734.431525:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+8:32542:x1830967794212352:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 6466us (7575us total) trans 8589946153 rc 0/0 00000100:00100000:3.0:1746147734.431531:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12119 00000100:00100000:3.0:1746147734.431542:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794212864 00000100:00100000:3.0:1746147734.431545:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794212864 00000100:00100000:3.0:1746147734.431559:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12120 00000100:00100000:3.0:1746147734.431564:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32540:x1830967794212864:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147734.431580:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.431590:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7f0a4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc8a8 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.431623:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7f0a4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8a8 expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.431649:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7f0a4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8a8 expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.431664:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.431666:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147734.431667:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d3200, rc 0) 00000100:00100000:3.0:1746147734.431682:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32540:x1830967794212864:12345-192.168.202.10@tcp:101:cat.0 Request processed in 119us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.431688:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12120 00000100:00100000:0.0:1746147734.432979:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.433048:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794213120 00000100:00100000:3.0:1746147734.433053:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794213120 00000100:00100000:3.0:1746147734.433094:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12121 00000100:00100000:3.0:1746147734.433100:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+8:32542:x1830967794213120:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147734.433116:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.433119:0:5744:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147734.433135:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f096 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8a1 expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.433148:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.433152:0:5744:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147734.433160:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3400/0xe64d3fbf12a7f0ab lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc8af expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.433228:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f0b2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.433237:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f0b2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.433245:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f0b2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.433255:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f0b2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.433261:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f0b2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.433268:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f0b2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.433273:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02d2c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147734.433277:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f0b2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.433283:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f0b2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.433289:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.433292:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147734.433294:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f0b2 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.433299:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d2c00/0xe64d3fbf12a7f0b2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.433318:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3400/0xe64d3fbf12a7f0ab lrc: 1/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8af expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.433324:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3400/0xe64d3fbf12a7f0ab lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8af expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.433336:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02d3400, rc 0) 00000100:00100000:3.0:1746147734.434261:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+7:32542:x1830967794213120:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 1156us (1283us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147734.434269:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12121 00000100:00100000:0.0:1746147734.434296:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.434406:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.434474:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794213248 00000100:00100000:0.0:1746147734.434480:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794213248 00000100:00100000:0.0:1746147734.434515:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794213376 00000100:00100000:0.0:1746147734.434517:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794213376 00000100:00100000:0.0:1746147734.434531:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17089 00000100:00100000:0.0:1746147734.434537:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794213248:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147734.434541:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17090 00000100:00100000:2.0:1746147734.434548:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794213376:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147734.434550:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.434557:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.434565:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090039a00/0xe64d3fbf12a7f0b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc8b6 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.434568:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5def400/0xe64d3fbf12a7f0c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc8bd expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.434611:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796554752:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147734.434611:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796554624:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147734.434695:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e2c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.436004:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cda9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147734.436236:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796554624:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147734.436265:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090039a00/0xe64d3fbf12a7f0b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8b6 expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.436278:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090039a00/0xe64d3fbf12a7f0b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8b6 expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.436301:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090039a00, rc 0) 00000100:00100000:0.0:1746147734.436358:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796554752:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147734.436373:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5def400/0xe64d3fbf12a7f0c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8bd expref: 18 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.436381:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5def400/0xe64d3fbf12a7f0c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8bd expref: 18 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147734.436401:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5def400, rc 0) 00000100:00100000:0.0:1746147734.436649:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794213376:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2100us (2241us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147734.436656:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17090 00000100:00100000:1.0:1746147734.436700:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794213248:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2163us (2405us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147734.436705:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17089 00000100:00100000:0.0:1746147734.437946:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.439683:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794213632 00000100:00100000:2.0:1746147734.439695:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794213632 00000100:00100000:2.0:1746147734.439750:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5063 00000100:00100000:2.0:1746147734.439758:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+7:32542:x1830967794213632:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147734.440011:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+8:32542:x1830967794213632:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 253us (2070us total) trans 8589946154 rc 0/0 00000100:00100000:2.0:1746147734.440018:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5063 00000100:00100000:3.0:1746147734.440388:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.440415:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.440438:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794213760 00000100:00100000:1.0:1746147734.440443:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794213760 00000100:00100000:1.0:1746147734.440465:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794213888 00000100:00100000:1.0:1746147734.440467:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794213888 00000100:00100000:3.0:1746147734.440468:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.440481:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17091 00000100:00100000:1.0:1746147734.440485:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794213760:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147734.440526:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794214144 00000100:00100000:2.0:1746147734.440530:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794214144 00002000:00100000:2.0:1746147734.440559:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88013584b100 x1830967794214144/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.440570:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584b100 with x1830967794214144 ext(4194304->5017599) 00002000:00010000:2.0:1746147734.440576:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584b100 00000100:00100000:2.0:1746147734.440588:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7717 00000100:00100000:2.0:1746147734.440593:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1957:x1830967794214144:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147734.440744:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17092 00000100:00100000:0.0:1746147734.440752:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794213888:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147734.440761:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.440780:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090038600/0xe64d3fbf12a7f0c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc8cb expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147734.440827:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796554880:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147734.440912:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cdaf00 going to sleep for 11 seconds 00010000:00010000:1.0:1746147734.441312:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.441335:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f0ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc8c4 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.441388:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796555008:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147734.441473:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147734.444993:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796554880:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147734.445030:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090038600/0xe64d3fbf12a7f0c7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8cb expref: 18 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.445045:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090038600/0xe64d3fbf12a7f0c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8cb expref: 18 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.445062:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090038600, rc 0) 00000100:00100000:1.0:1746147734.445077:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796555008:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147734.445108:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f0ce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8c4 expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.445120:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f0ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8c4 expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.445142:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0299e00, rc 0) 00000100:00100000:2.0:1746147734.445148:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794213888:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4394us (4729us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147734.445158:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17092 00000100:00100000:1.0:1746147734.445175:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794213760:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4688us (4786us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147734.445183:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17091 00000100:00100000:2.0:1746147734.449998:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1957:x1830967794214144:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9392us (9516us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147734.450011:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7717 00002000:00100000:2.0:1746147734.450023:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88013584b100 x1830967794214144/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.450032:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584b100 with x1830967794214144 ext(4194304->5017599) 00002000:00010000:2.0:1746147734.450037:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584b100 00000100:00100000:0.0:1746147734.457391:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.458674:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794214272 00000100:00100000:1.0:1746147734.458687:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794214272 00000100:00100000:1.0:1746147734.459407:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17093 00000100:00100000:1.0:1746147734.459417:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32544:x1830967794214272:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147734.459437:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.459455:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc8d2 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.459485:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308bc000/0xe64d3fbf12a7ef8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7eb expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.459496:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7f057 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc885 expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.459504:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095639600/0xe64d3fbf12a7efd9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc831 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.459510:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.459512:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.459516:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [1159168->1617919] (req 1159168->1617919) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 18 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.459547:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095639600/0xe64d3fbf12a7efd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc831 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.459560:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095639600/0xe64d3fbf12a7efd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc831 expref: 31 pid: 8468 timeout: 913 lvb_type: 1 00000100:00100000:1.0:1746147734.459573:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796555136:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.459687:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7f057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc885 expref: 9 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.459696:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7f057 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc885 expref: 9 pid: 8468 timeout: 913 lvb_type: 1 00000100:00100000:1.0:1746147734.459704:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796555264:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.459727:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801308bc000/0xe64d3fbf12a7ef8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7eb expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.459734:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801308bc000/0xe64d3fbf12a7ef8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7eb expref: 18 pid: 8470 timeout: 913 lvb_type: 1 00000100:00100000:1.0:1746147734.459742:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796555392:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147734.459757:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147734.461371:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796555136:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147734.461385:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796555264:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147734.461394:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796555392:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.461425:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [1159168->1617919] (req 1159168->1617919) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 18 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.461440:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248c00, rc 0) 00000100:00100000:1.0:1746147734.462088:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32544:x1830967794214272:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2670us (4702us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.462096:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17093 00000100:00100000:0.0:1746147734.468508:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.470208:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794214528 00000100:00100000:2.0:1746147734.470222:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794214528 00010000:00010000:2.0:1746147734.470354:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bc000/0xe64d3fbf12a7ef8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7eb expref: 18 pid: 8470 timeout: 913 lvb_type: 1 00000100:00100000:1.0:1746147734.470366:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.470413:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.471080:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794214656 00000100:00100000:2.0:1746147734.471085:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794214656 00010000:00010000:2.0:1746147734.471100:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095639600/0xe64d3fbf12a7efd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc831 expref: 32 pid: 8468 timeout: 913 lvb_type: 1 00000100:00100000:2.0:1746147734.471114:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794214400 00000100:00100000:2.0:1746147734.471116:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794214400 00010000:00010000:2.0:1746147734.471125:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7f057 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc885 expref: 10 pid: 8468 timeout: 913 lvb_type: 1 00000100:00100000:2.0:1746147734.471142:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8735 00000100:00100000:2.0:1746147734.471150:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794214528:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147734.471154:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8736 00000100:00100000:1.0:1746147734.471159:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6671850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967794214656:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.471163:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147734.471165:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.471186:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801308bc000/0xe64d3fbf12a7ef8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7eb expref: 18 pid: 8470 timeout: 913 lvb_type: 1 00010000:00010000:1.0:1746147734.471186:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095639600/0xe64d3fbf12a7efd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc831 expref: 32 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:2.0:1746147734.471196:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801308bc000/0xe64d3fbf12a7ef8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7eb expref: 18 pid: 8470 timeout: 913 lvb_type: 1 00010000:00010000:1.0:1746147734.471203:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095639600/0xe64d3fbf12a7efd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc831 expref: 32 pid: 8468 timeout: 913 lvb_type: 1 00000100:00100000:0.0:1746147734.471306:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8737 00000100:00100000:0.0:1746147734.471313:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967794214400:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147734.471321:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.471720:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308bc000/0xe64d3fbf12a7ef8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7eb expref: 18 pid: 8470 timeout: 913 lvb_type: 1 00010000:00010000:1.0:1746147734.471723:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095639600/0xe64d3fbf12a7efd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc831 expref: 32 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:1.0:1746147734.471795:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147734.471796:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147734.471844:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6671850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967794214656:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 684us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.471852:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8736 00000100:00100000:2.0:1746147734.471900:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794214528:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 733us (3386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.471906:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8735 00010000:00010000:0.0:1746147734.472383:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7f057 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc885 expref: 10 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746147734.472395:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7f057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc885 expref: 10 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746147734.472410:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55e8e00/0xe64d3fbf12a7f057 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc885 expref: 10 pid: 8468 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746147734.472439:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.472441:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.472448:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1617919) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 16 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.472457:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1617919) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 16 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.472498:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1617919) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 16 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147734.472512:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796555520:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147734.473263:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cdaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147734.475008:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796555520:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147734.475031:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147734.475083:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967794214400:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3769us (4666us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.475093:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8737 00000100:00100000:0.0:1746147734.475413:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.475457:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794214912 00000100:00100000:2.0:1746147734.475464:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794214912 00002000:00100000:2.0:1746147734.475502:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x457:0x0] (1159168->1163263) req@ffff88009d0df480 x1830967794214912/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.475518:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0df480 with x1830967794214912 ext(1159168->1163263) 00002000:00010000:2.0:1746147734.475522:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d0df480 00000100:00100000:2.0:1746147734.475617:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7718 00000100:00100000:2.0:1746147734.475626:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794214912:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147734.475800:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794214912:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 175us (387us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147734.475806:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7718 00002000:00100000:2.0:1746147734.475812:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x457:0x0] (1159168->1163263) req@ffff88009d0df480 x1830967794214912/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/4536 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.475819:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0df480 with x1830967794214912 ext(1159168->1163263) 00002000:00010000:2.0:1746147734.475822:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d0df480 00000100:00100000:1.0:1746147734.481783:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.482238:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794215168 00000100:00100000:3.0:1746147734.482250:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794215168 00002000:00100000:3.0:1746147734.482301:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x457:0x0] (1613824->1617919) req@ffff8800951d4700 x1830967794215168/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.482312:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d4700 with x1830967794215168 ext(1613824->1617919) 00002000:00010000:3.0:1746147734.482317:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800951d4700 00000100:00100000:3.0:1746147734.482447:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7719 00000100:00100000:3.0:1746147734.482456:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794215168:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147734.482923:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794215168:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 467us (1149us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147734.482931:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7719 00002000:00100000:3.0:1746147734.482937:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x457:0x0] (1613824->1617919) req@ffff8800951d4700 x1830967794215168/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/4536 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.482945:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d4700 with x1830967794215168 ext(1613824->1617919) 00002000:00010000:3.0:1746147734.482948:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800951d4700 00000100:00100000:0.0:1746147734.485381:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.485723:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794215424 00000100:00100000:2.0:1746147734.485734:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794215424 00000100:00100000:2.0:1746147734.485821:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5064 00000100:00100000:2.0:1746147734.485830:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32544:x1830967794215424:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:2.0:1746147734.486137:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32544:x1830967794215424:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 307us (767us total) trans 8589946155 rc 0/0 00000100:00100000:2.0:1746147734.486144:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5064 00000100:00100000:0.0:1746147734.545955:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.546167:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794215680 00000100:00100000:3.0:1746147734.546178:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794215680 00000100:00100000:3.0:1746147734.546254:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12122 00000100:00100000:3.0:1746147734.546262:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32551:x1830967794215680:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147734.546287:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.546308:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c8000/0xe64d3fbf12a7f0dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc8d9 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.546414:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7f0e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546426:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7f0e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546437:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7f0e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546449:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1400/0xe64d3fbf12a7f0ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546454:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1400/0xe64d3fbf12a7f0ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546458:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1400/0xe64d3fbf12a7f0ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546550:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f0f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546555:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546559:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147734.546570:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147734.546675:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7f0e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546681:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7f0e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546686:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7f0e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546691:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd9600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147734.546694:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7f0e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546700:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7f0e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546709:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147734.546711:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147734.546715:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7f0e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546718:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7f0e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546747:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1400/0xe64d3fbf12a7f0ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546752:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1400/0xe64d3fbf12a7f0ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546757:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1400/0xe64d3fbf12a7f0ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546764:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094ee1400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147734.546766:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1400/0xe64d3fbf12a7f0ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546770:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1400/0xe64d3fbf12a7f0ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546774:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcc4800) 00010000:00010000:3.0:1746147734.546776:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147734.546777:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1400/0xe64d3fbf12a7f0ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546780:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1400/0xe64d3fbf12a7f0ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.546808:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c8000/0xe64d3fbf12a7f0dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d9 expref: 329 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.546817:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d9 expref: 328 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.546822:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.546824:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147734.546826:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ee1e00, rc 0) 00000100:00100000:3.0:1746147734.546926:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32551:x1830967794215680:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 664us (982us total) trans 8589946156 rc 0/0 00000100:00100000:3.0:1746147734.546933:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12122 00000100:00100000:0.0:1746147734.678069:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.678210:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794215936 00000100:00100000:3.0:1746147734.678219:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794215936 00000100:00100000:3.0:1746147734.678270:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12123 00000100:00100000:3.0:1746147734.678278:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32554:x1830967794215936:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147734.678304:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.678323:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1000/0xe64d3fbf12a7f0ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc8e0 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.678431:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1800/0xe64d3fbf12a7f106 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678444:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1800/0xe64d3fbf12a7f106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678454:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1800/0xe64d3fbf12a7f106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678467:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1c00/0xe64d3fbf12a7f10d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678473:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1c00/0xe64d3fbf12a7f10d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678478:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1c00/0xe64d3fbf12a7f10d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678580:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0a00/0xe64d3fbf12a7f114 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678588:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0a00/0xe64d3fbf12a7f114 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678594:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0a00/0xe64d3fbf12a7f114 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147734.678602:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147734.678715:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1800/0xe64d3fbf12a7f106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678722:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1800/0xe64d3fbf12a7f106 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678728:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1800/0xe64d3fbf12a7f106 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678734:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094ee1800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147734.678738:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1800/0xe64d3fbf12a7f106 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678744:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1800/0xe64d3fbf12a7f106 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678754:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147734.678757:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147734.678761:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1800/0xe64d3fbf12a7f106 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678766:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1800/0xe64d3fbf12a7f106 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678799:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1c00/0xe64d3fbf12a7f10d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678804:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1c00/0xe64d3fbf12a7f10d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678809:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1c00/0xe64d3fbf12a7f10d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678812:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094ee1c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147734.678814:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1c00/0xe64d3fbf12a7f10d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678819:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1c00/0xe64d3fbf12a7f10d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678824:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcc4000) 00010000:00010000:3.0:1746147734.678826:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147734.678828:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1c00/0xe64d3fbf12a7f10d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678833:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1c00/0xe64d3fbf12a7f10d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.678866:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1000/0xe64d3fbf12a7f0ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8e0 expref: 15 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.678878:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0a00/0xe64d3fbf12a7f114 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8e0 expref: 14 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.678926:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.678928:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147734.678930:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ee0a00, rc 0) 00000100:00100000:3.0:1746147734.681126:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32554:x1830967794215936:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2836us (3060us total) trans 8589946157 rc 0/0 00000100:00100000:3.0:1746147734.681138:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12123 00000100:00100000:0.0:1746147734.683485:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.683690:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794216192 00000100:00100000:2.0:1746147734.683702:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794216192 00000100:00100000:2.0:1746147734.683780:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5065 00000100:00100000:2.0:1746147734.683792:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a9e6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32554:x1830967794216192:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:2.0:1746147734.684550:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a9e6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32554:x1830967794216192:12345-192.168.202.10@tcp:35:cat.0 Request processed in 757us (1072us total) trans 8589946158 rc 0/0 00000100:00100000:2.0:1746147734.684560:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5065 00000100:00100000:0.0:1746147734.688301:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.688362:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.688504:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794216320 00000100:00100000:1.0:1746147734.688514:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794216320 00000100:00100000:1.0:1746147734.688596:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794216448 00000100:00100000:1.0:1746147734.688599:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794216448 00000100:00100000:2.0:1746147734.688613:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17094 00000100:00100000:2.0:1746147734.688623:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794216320:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147734.688650:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.688668:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f122 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc8e7 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.688724:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796555648:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147734.688772:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17095 00000100:00100000:1.0:1746147734.688779:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794216448:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147734.688787:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.688797:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0249600/0xe64d3fbf12a7f129 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc8ee expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.688822:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796555776:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147734.689083:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2085000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147734.689127:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.689419:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.689651:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794216576 00000100:00100000:2.0:1746147734.689655:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794216576 00000100:00100000:2.0:1746147734.689694:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17096 00000100:00100000:2.0:1746147734.689703:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794216576:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147734.689713:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.689723:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7f130 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc8f5 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.689753:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796555904:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147734.689800:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147734.690540:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796555776:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147734.690568:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0249600/0xe64d3fbf12a7f129 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8ee expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.690581:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0249600/0xe64d3fbf12a7f129 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8ee expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.690604:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0249600, rc 0) 00000100:00100000:2.0:1746147734.690619:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796555648:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147734.690640:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794216448:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1861us (2278us total) trans 0 rc 301/301 00010000:00010000:2.0:1746147734.690644:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f122 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8e7 expref: 18 pid: 10613 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147734.690646:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17095 00010000:00010000:2.0:1746147734.690652:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f122 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8e7 expref: 18 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.690660:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dee400, rc 0) 00000100:00100000:2.0:1746147734.690675:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794216320:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2056us (2387us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147734.690681:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17094 00002000:00010000:2.0:1746147734.691316:0:4591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime: 1746147734 -> 1746147735 00002000:00010000:2.0:1746147734.691321:0:4591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime: 1746147734 -> 1746147735 00002000:00010000:2.0:1746147734.691322:0:4591:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime: 1746147734 -> 1746147735 00000100:00100000:2.0:1746147734.691334:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796555904:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147734.691350:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7f130 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8f5 expref: 32 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.691358:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd9600/0xe64d3fbf12a7f130 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8f5 expref: 32 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.691365:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd9600, rc 0) 00000100:00100000:2.0:1746147734.691397:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794216576:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1697us (1978us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147734.691402:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17096 00000100:00100000:0.0:1746147734.692504:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.692640:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794216704 00000100:00100000:2.0:1746147734.692647:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794216704 00000100:00100000:2.0:1746147734.692680:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17097 00000100:00100000:2.0:1746147734.692686:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32554:x1830967794216704:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147734.692703:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.692719:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc8fc expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.692745:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 30 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.692751:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147734.692753:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147734.692756:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 18 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.692784:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 30 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.692796:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 30 pid: 20619 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.692808:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796556032:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.692919:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.695619:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.695933:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794216960 00000100:00100000:3.0:1746147734.695942:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794216960 00002000:00100000:3.0:1746147734.695989:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x455:0x0] (487424->1048575) req@ffff88009d0de680 x1830967794216960/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.695998:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0de680 with x1830967794216960 ext(487424->1048575) 00010000:00010000:3.0:1746147734.696008:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 31 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.696021:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 31 pid: 20619 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746147734.696029:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d0de680 00000100:00100000:3.0:1746147734.696050:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1563 00000100:00100000:3.0:1746147734.696056:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1958:x1830967794216960:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147734.696700:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796556032:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.696728:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 18 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.696743:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2b0800, rc 0) 00000100:00100000:2.0:1746147734.699249:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32554:x1830967794216704:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6548us (6735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.699261:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17097 00000100:00100000:1.0:1746147734.699461:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.699518:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.699572:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794217088 00000100:00100000:1.0:1746147734.699580:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794217088 00002000:00100000:1.0:1746147734.699619:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (0->487423) req@ffff8800951d5f80 x1830967794217088/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.699639:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d5f80 with x1830967794217088 ext(0->487423) 00010000:00010000:1.0:1746147734.699647:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 33 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.699663:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 33 pid: 20619 timeout: 913 lvb_type: 0 00002000:00010000:1.0:1746147734.699669:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800951d5f80 00000100:00100000:1.0:1746147734.699683:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794217344 00000100:00100000:1.0:1746147734.699686:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794217344 00002000:00100000:1.0:1746147734.699700:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (1380352->2097151) req@ffff8800951d7480 x1830967794217344/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.699712:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d7480 with x1830967794217344 ext(1380352->2097151) 00002000:00010000:1.0:1746147734.699715:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d7480 00000100:00100000:1.0:1746147734.699728:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1564 00000100:00100000:1.0:1746147734.699734:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794217088:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147734.700525:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7720 00000100:00100000:1.0:1746147734.700533:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794217344:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147734.712653:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.713058:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794217088:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13320us (13594us total) trans 0 rc 487424/487424 00000100:00100000:1.0:1746147734.713070:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1564 00002000:00100000:1.0:1746147734.713083:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x455:0x0] (0->487423) req@ffff8800951d5f80 x1830967794217088/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:H/200/0 rc 487424/487424 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.713092:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d5f80 with x1830967794217088 ext(0->487423) 00010000:00010000:1.0:1746147734.713102:0:31357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 33 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.713117:0:31357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 33 pid: 20619 timeout: 913 lvb_type: 0 00002000:00010000:1.0:1746147734.713124:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800951d5f80 00000100:00100000:1.0:1746147734.713180:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.713270:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794217728 00000100:00100000:1.0:1746147734.713278:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794217728 00000100:00100000:1.0:1746147734.713307:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17098 00000100:00100000:1.0:1746147734.713313:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:32551:x1830967794217728:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147734.713328:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.713342:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc90a expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.713366:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147734.713370:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 17 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.713376:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147734.713380:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [974848->1048575] (req 974848->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 34 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.713414:0:4591:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 17 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.713428:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [974848->1048575] (req 974848->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 34 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.713438:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c42ee00, rc 0) 00000100:00100000:1.0:1746147734.713456:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32551:x1830967794217728:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 143us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.713461:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17098 00000100:00100000:3.0:1746147734.715616:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794217600 00000100:00100000:3.0:1746147734.715642:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794217600 00000100:00100000:3.0:1746147734.715696:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12124 00000100:00100000:3.0:1746147734.715704:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32559:x1830967794217600:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147734.715728:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.715747:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1200/0xe64d3fbf12a7f145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc903 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.715854:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.715868:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f0f1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d9 expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.715875:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0a00/0xe64d3fbf12a7f114 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8e0 expref: 16 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.715880:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 5/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.715925:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0a00/0xe64d3fbf12a7f114 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8e0 expref: 16 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.715935:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0a00/0xe64d3fbf12a7f114 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8e0 expref: 16 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.715946:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796556288:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.716026:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d9 expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.716034:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f0f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d9 expref: 327 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.716040:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796556416:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.716054:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147734.717525:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794217344:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16985us (17998us total) trans 0 rc 716800/716800 00000100:00100000:1.0:1746147734.717537:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7720 00002000:00100000:1.0:1746147734.717549:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1380352->2097151) req@ffff8800951d7480 x1830967794217344/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 716800/716800 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.717563:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d7480 with x1830967794217344 ext(1380352->2097151) 00002000:00010000:1.0:1746147734.717569:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d7480 00000100:00100000:1.0:1746147734.719538:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.719606:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796556288:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.719618:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796556416:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.719708:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147734.719786:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.719812:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794217856 00000100:00100000:1.0:1746147734.719817:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794217856 00010000:00010000:1.0:1746147734.719849:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0a00/0xe64d3fbf12a7f114 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8e0 expref: 17 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.719901:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794217984 00000100:00100000:1.0:1746147734.719904:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794217984 00000100:00100000:2.0:1746147734.719909:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8738 00010000:00010000:1.0:1746147734.719916:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f0f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d9 expref: 328 pid: 5744 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.719917:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794217856:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147734.719930:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8739 00010000:00010000:2.0:1746147734.719931:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147734.719934:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:1957:x1830967794217984:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.719937:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0a00/0xe64d3fbf12a7f114 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8e0 expref: 17 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.719939:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147734.719942:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f0f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d9 expref: 328 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.719946:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0a00/0xe64d3fbf12a7f114 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8e0 expref: 17 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.720002:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d9 expref: 328 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.720022:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0a00/0xe64d3fbf12a7f114 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8e0 expref: 17 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.720025:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f0f1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d9 expref: 328 pid: 5744 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.720039:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147734.720044:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.720052:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147734.720058:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.720063:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147734.720066:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147734.720104:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794217856:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 187us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.720110:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8738 00010000:00010000:1.0:1746147734.720112:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147734.720126:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:1957:x1830967794217984:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 191us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.720130:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8739 00010000:00010000:0.0:1746147734.720164:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147734.720170:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:0.0:1746147734.720189:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147734.720299:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee1200/0xe64d3fbf12a7f145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc903 expref: 17 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.720326:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc903 expref: 16 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.720333:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147734.720335:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147734.720337:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ee0800, rc 0) 00000100:00100000:0.0:1746147734.720360:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32559:x1830967794217600:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4658us (7717us total) trans 8589946159 rc 0/0 00000100:00100000:0.0:1746147734.720367:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12124 00000100:00100000:3.0:1746147734.721125:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967794216960:12345-192.168.202.10@tcp:4:cat.0 Request processed in 25064us (25511us total) trans 17179874463 rc 0/0 00000100:00100000:3.0:1746147734.721135:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1563 00002000:00100000:3.0:1746147734.721144:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x455:0x0] (487424->1048575) req@ffff88009d0de680 x1830967794216960/t17179874463(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/448 e 0 to 0 dl 1746147745 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.721153:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0de680 with x1830967794216960 ext(487424->1048575) 00010000:00010000:3.0:1746147734.721162:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 34 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.721177:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 34 pid: 20619 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746147734.721183:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d0de680 00000100:00100000:0.0:1746147734.726177:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.726593:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794218112 00000100:00100000:1.0:1746147734.726604:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794218112 00000100:00100000:1.0:1746147734.726675:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17099 00000100:00100000:1.0:1746147734.726684:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32557:x1830967794218112:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147734.726703:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.726723:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7f15a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc911 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.726755:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1617919) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 17 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.726763:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147734.726765:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147734.726768:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7f15a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc911 expref: 35 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.726800:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1617919) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 17 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.726812:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1617919) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 17 pid: 8470 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.726824:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796556544:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147734.726946:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.727297:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.728101:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794218240 00000100:00100000:1.0:1746147734.728109:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794218240 00010000:00010000:1.0:1746147734.728144:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 36 pid: 20619 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.728171:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8740 00000100:00100000:1.0:1746147734.728178:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967794218240:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147734.728191:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147734.728202:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796556544:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.728216:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 36 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.728225:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 36 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.728232:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7f15a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc911 expref: 36 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.728245:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c42f600, rc 0) 00010000:00010000:1.0:1746147734.728247:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02d2800/0xe64d3fbf12a7f00a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc84d expref: 36 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.728258:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.728259:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.728266:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 17 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.728272:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 17 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.728294:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:32557:x1830967794218112:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1608us (2126us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147734.728299:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 17 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.728301:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17099 00010000:00010000:1.0:1746147734.728309:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 17 pid: 4591 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.728319:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796556672:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147734.728368:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.728942:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.729010:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794218368 00000100:00100000:3.0:1746147734.729014:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794218368 00002000:00100000:3.0:1746147734.729044:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x457:0x0] (1159168->1617919) req@ffff88009d0dfb80 x1830967794218368/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.729052:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dfb80 with x1830967794218368 ext(1159168->1617919) 00010000:00010000:3.0:1746147734.729058:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 18 pid: 8470 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.729068:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 18 pid: 8470 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746147734.729074:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d0dfb80 00000100:00100000:3.0:1746147734.729087:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1565 00000100:00100000:3.0:1746147734.729093:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794218368:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147734.730050:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796556672:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147734.730070:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147734.730109:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967794218240:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1930us (2812us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.730117:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8740 00000100:00100000:0.0:1746147734.732049:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.734731:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794218624 00000100:00100000:1.0:1746147734.734746:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794218624 00002000:00100000:1.0:1746147734.734798:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009d0dea00 x1830967794218624/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.734808:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dea00 with x1830967794218624 ext(0->1048575) 00010000:00010000:1.0:1746147734.734817:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 20 pid: 4591 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.734831:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 20 pid: 4591 timeout: 913 lvb_type: 0 00002000:00010000:1.0:1746147734.734839:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d0dea00 00000100:00100000:1.0:1746147734.734869:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1566 00000100:00100000:1.0:1746147734.734877:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794218624:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147734.735255:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.735418:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794218752 00000100:00100000:3.0:1746147734.735425:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794218752 00000100:00100000:3.0:1746147734.735473:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17100 00000100:00100000:3.0:1746147734.735480:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32559:x1830967794218752:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147734.735490:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.735517:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc918 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.735550:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7ef93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f2 expref: 22 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.735560:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7f05e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc88c expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.735567:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801354ea600/0xe64d3fbf12a7effc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc838 expref: 33 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.735574:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.735577:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.735581:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3166208->3465215] (req 3166208->3465215) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 22 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.735617:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801354ea600/0xe64d3fbf12a7effc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc838 expref: 33 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.735651:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801354ea600/0xe64d3fbf12a7effc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc838 expref: 33 pid: 4592 timeout: 913 lvb_type: 1 00000100:00100000:3.0:1746147734.735666:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796556800:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.735761:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7f05e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc88c expref: 8 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.735771:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7f05e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc88c expref: 8 pid: 10613 timeout: 913 lvb_type: 1 00000100:00100000:3.0:1746147734.735781:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796556928:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.735816:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7ef93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f2 expref: 22 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.735825:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7ef93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f2 expref: 22 pid: 8470 timeout: 913 lvb_type: 1 00000100:00100000:3.0:1746147734.735833:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796557056:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.735856:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147734.738129:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967794218368:12345-192.168.202.10@tcp:4:cat.0 Request processed in 9028us (9180us total) trans 17179874464 rc 0/0 00000100:00100000:2.0:1746147734.738140:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1565 00002000:00100000:2.0:1746147734.738150:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x457:0x0] (1159168->1617919) req@ffff88009d0dfb80 x1830967794218368/t17179874464(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/448 e 0 to 0 dl 1746147745 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.738159:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dfb80 with x1830967794218368 ext(1159168->1617919) 00010000:00010000:2.0:1746147734.738167:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 24 pid: 8470 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.738180:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 24 pid: 8470 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746147734.738186:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d0dfb80 00000100:00100000:3.0:1746147734.742990:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796556800:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.743010:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796556928:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.743020:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796557056:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.743054:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3166208->3465215] (req 3166208->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.743074:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ee1e00, rc 0) 00000100:00100000:3.0:1746147734.743131:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:32559:x1830967794218752:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 7649us (7876us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.743140:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17100 00000100:00100000:0.0:1746147734.747672:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.747758:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.747773:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794219008 00000100:00100000:1.0:1746147734.747783:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794219008 00010000:00010000:1.0:1746147734.747827:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7ef93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f2 expref: 23 pid: 8470 timeout: 913 lvb_type: 1 00000100:00100000:0.0:1746147734.747849:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.747927:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794218880 00000100:00100000:1.0:1746147734.747931:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794218880 00010000:00010000:1.0:1746147734.747943:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7f05e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc88c expref: 9 pid: 10613 timeout: 913 lvb_type: 1 00000100:00100000:1.0:1746147734.747957:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794219136 00000100:00100000:1.0:1746147734.747959:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794219136 00010000:00010000:1.0:1746147734.747968:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801354ea600/0xe64d3fbf12a7effc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc838 expref: 34 pid: 4592 timeout: 913 lvb_type: 1 00000100:00100000:0.0:1746147734.747977:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8741 00000100:00100000:0.0:1746147734.748840:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967794219008:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147734.748858:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147734.748999:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7ef93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f2 expref: 23 pid: 8470 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746147734.749014:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7ef93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f2 expref: 23 pid: 8470 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746147734.749120:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801308bc600/0xe64d3fbf12a7ef93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f2 expref: 23 pid: 8470 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746147734.749147:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147734.749160:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8742 00000100:00100000:2.0:1746147734.749178:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794218880:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.749194:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147734.749197:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967794219008:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 367us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147734.749206:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8741 00010000:00010000:2.0:1746147734.749222:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7f05e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc88c expref: 9 pid: 10613 timeout: 913 lvb_type: 1 00000100:00100000:1.0:1746147734.749224:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8743 00000100:00100000:1.0:1746147734.749233:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6670050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967794219136:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.749234:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7f05e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc88c expref: 9 pid: 10613 timeout: 913 lvb_type: 1 00010000:00010000:1.0:1746147734.749241:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.749261:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a213de00/0xe64d3fbf12a7f05e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc88c expref: 9 pid: 10613 timeout: 913 lvb_type: 1 00000100:00100000:0.0:1746147734.749413:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147734.749499:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801354ea600/0xe64d3fbf12a7effc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc838 expref: 34 pid: 4592 timeout: 913 lvb_type: 1 00010000:00010000:1.0:1746147734.749509:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801354ea600/0xe64d3fbf12a7effc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc838 expref: 34 pid: 4592 timeout: 913 lvb_type: 1 00010000:00010000:1.0:1746147734.749523:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801354ea600/0xe64d3fbf12a7effc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc838 expref: 34 pid: 4592 timeout: 913 lvb_type: 1 00010000:00010000:1.0:1746147734.749537:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.749539:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.749547:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3465215) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.749555:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3465215) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.749585:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.749596:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796557184:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147734.749600:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147734.749655:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147734.749659:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794218880:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 488us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.749666:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8742 00000100:00100000:2.0:1746147734.749688:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794219264 00000100:00100000:2.0:1746147734.749693:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794219264 00010000:00010000:2.0:1746147734.749709:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 22 pid: 8470 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.750481:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8744 00000100:00100000:2.0:1746147734.750488:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967794219264:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.750495:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.750508:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 22 pid: 8470 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.750516:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1617919) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 22 pid: 8470 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.750528:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248c00/0xe64d3fbf12a7f0d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1617919) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8d2 expref: 22 pid: 8470 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.750537:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.750539:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.750545:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7f15a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc911 expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.750553:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7f15a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc911 expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.750579:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7f15a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc911 expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.750590:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796557312:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147734.750647:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147734.751614:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794218624:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16728us (19565us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147734.751638:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1566 00002000:00100000:1.0:1746147734.751653:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009d0dea00 x1830967794218624/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.751662:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dea00 with x1830967794218624 ext(0->1048575) 00010000:00010000:1.0:1746147734.751672:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 20 pid: 4591 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.751692:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 20 pid: 4591 timeout: 913 lvb_type: 0 00002000:00010000:1.0:1746147734.751698:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d0dea00 00000100:00100000:2.0:1746147734.753164:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796557312:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147734.753189:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147734.753233:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794219264:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2742us (3819us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.753244:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8744 00000100:00100000:1.0:1746147734.753341:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796557184:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147734.753360:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147734.753387:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6670050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794219136:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4154us (5538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.753394:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8743 00000100:00100000:0.0:1746147734.754961:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.755133:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794219520 00000100:00100000:1.0:1746147734.755143:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794219520 00002000:00100000:1.0:1746147734.755194:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3166208->3170303) req@ffff8800956b6680 x1830967794219520/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.755204:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b6680 with x1830967794219520 ext(3166208->3170303) 00002000:00010000:1.0:1746147734.755209:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b6680 00000100:00100000:1.0:1746147734.755256:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7721 00000100:00100000:1.0:1746147734.755267:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794219520:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147734.755477:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1959:x1830967794219520:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 212us (524us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147734.755483:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7721 00002000:00100000:1.0:1746147734.755489:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3166208->3170303) req@ffff8800956b6680 x1830967794219520/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/4536 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.755496:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b6680 with x1830967794219520 ext(3166208->3170303) 00002000:00010000:1.0:1746147734.755499:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b6680 00000100:00100000:0.0:1746147734.756426:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.759058:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794219776 00000100:00100000:2.0:1746147734.759072:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794219776 00002000:00100000:2.0:1746147734.759123:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800956b4700 x1830967794219776/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.759134:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b4700 with x1830967794219776 ext(1048576->2097151) 00002000:00010000:2.0:1746147734.759140:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b4700 00000100:00100000:2.0:1746147734.759174:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7722 00000100:00100000:2.0:1746147734.759182:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967794219776:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147734.760098:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.760148:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794220032 00000100:00100000:0.0:1746147734.760154:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794220032 00002000:00100000:0.0:1746147734.760178:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (3461120->3465215) req@ffff880135849c00 x1830967794220032/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147734.760186:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849c00 with x1830967794220032 ext(3461120->3465215) 00002000:00010000:0.0:1746147734.760190:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135849c00 00000100:00100000:0.0:1746147734.760204:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7723 00000100:00100000:0.0:1746147734.760209:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794220032:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147734.760351:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794220032:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 141us (257us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147734.760357:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7723 00002000:00100000:0.0:1746147734.760363:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (3461120->3465215) req@ffff880135849c00 x1830967794220032/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/4536 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147734.760369:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849c00 with x1830967794220032 ext(3461120->3465215) 00002000:00010000:0.0:1746147734.760372:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135849c00 00000100:00100000:3.0:1746147734.763606:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.764171:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794220160 00000100:00100000:2.0:1746147734.764183:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794220160 00000100:00100000:2.0:1746147734.764237:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17101 00000100:00100000:2.0:1746147734.764245:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32554:x1830967794220160:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147734.764266:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.764286:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc91f expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.764320:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1380351) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 21 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.764328:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147734.764330:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147734.764334:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 18 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147734.764451:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.764494:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794220288 00000100:00100000:0.0:1746147734.764500:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794220288 00010000:00010000:0.0:1746147734.764521:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 19 pid: 4591 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746147734.764542:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8745 00000100:00100000:0.0:1746147734.764547:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1958:x1830967794220288:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147734.764556:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147734.764578:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 19 pid: 4591 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746147734.764590:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 19 pid: 4591 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746147734.764608:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a2b0800/0xe64d3fbf12a7f137 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8fc expref: 19 pid: 4591 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746147734.764623:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.764625:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147734.764645:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 34 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.764652:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 34 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.764676:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 34 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147734.764688:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796557440:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147734.764754:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cda9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147734.765067:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1380351) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 21 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.765081:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1380351) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 21 pid: 20619 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.765091:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796557568:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.765158:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.770594:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.770674:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7097:1830967796557440:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147734.770695:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147734.770755:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794220288:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6205us (6303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.770765:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8745 00000100:00100000:1.0:1746147734.770806:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794220544 00000100:00100000:1.0:1746147734.770812:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794220544 00002000:00100000:1.0:1746147734.770846:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (974848->978943) req@ffff8800956b5c00 x1830967794220544/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.770867:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b5c00 with x1830967794220544 ext(974848->978943) 00002000:00010000:1.0:1746147734.770871:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b5c00 00000100:00100000:1.0:1746147734.770911:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7724 00000100:00100000:1.0:1746147734.770918:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967794220544:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147734.771095:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967794220544:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 176us (512us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147734.771100:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7724 00002000:00100000:1.0:1746147734.771105:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x455:0x0] (974848->978943) req@ffff8800956b5c00 x1830967794220544/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/4536 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.771111:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b5c00 with x1830967794220544 ext(974848->978943) 00002000:00010000:1.0:1746147734.771114:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b5c00 00000100:00100000:1.0:1746147734.771640:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.771675:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796557568:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147734.771684:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794220672 00000100:00100000:0.0:1746147734.771689:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794220672 00010000:00010000:3.0:1746147734.771705:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 18 pid: 10613 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746147734.771712:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1380351) req@ffff8800951d7800 x1830967794220672/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147734.771720:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d7800 with x1830967794220672 ext(1048576->1380351) 00010000:00010000:0.0:1746147734.771725:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 22 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.771728:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2b0200, rc 0) 00010000:00010000:0.0:1746147734.771737:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 22 pid: 20619 timeout: 913 lvb_type: 0 00002000:00010000:0.0:1746147734.771742:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800951d7800 00000100:00100000:0.0:1746147734.771754:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1567 00000100:00100000:0.0:1746147734.771759:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967794220672:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:3.0:1746147734.771765:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32554:x1830967794220160:12345-192.168.202.10@tcp:101:cat.0 Request processed in 7518us (8169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.771773:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17101 00000100:00100000:2.0:1746147734.771927:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967794219776:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 12744us (15503us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147734.771934:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7722 00002000:00100000:2.0:1746147734.771940:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800956b4700 x1830967794219776/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.771947:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b4700 with x1830967794219776 ext(1048576->2097151) 00002000:00010000:2.0:1746147734.771950:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b4700 00000100:00100000:3.0:1746147734.775265:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.775375:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794220800 00000100:00100000:0.0:1746147734.775385:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794220800 00000100:00100000:0.0:1746147734.775443:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17102 00000100:00100000:0.0:1746147734.775451:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32551:x1830967794220800:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147734.775471:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.775490:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc926 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.775518:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147734.775526:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.775532:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746147734.775535:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2011135] (req 1048576->2011135) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 25 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.775573:0:10613:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.775585:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2011135] (req 1048576->2011135) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 25 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.775595:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090038000, rc 0) 00000100:00100000:0.0:1746147734.775929:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:32551:x1830967794220800:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 477us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147734.775935:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17102 00000100:00100000:2.0:1746147734.777682:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794220672:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 5914us (6045us total) trans 21474841695 rc 0/0 00000100:00100000:2.0:1746147734.777693:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1567 00002000:00100000:2.0:1746147734.777703:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->1380351) req@ffff8800951d7800 x1830967794220672/t21474841695(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/448 e 0 to 0 dl 1746147745 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.777713:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d7800 with x1830967794220672 ext(1048576->1380351) 00010000:00010000:2.0:1746147734.777721:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 25 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.777736:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 25 pid: 20619 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746147734.777743:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800951d7800 00000100:00100000:3.0:1746147734.779745:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.781564:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794220928 00000100:00100000:0.0:1746147734.781578:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794220928 00000100:00100000:0.0:1746147734.781658:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17103 00000100:00100000:0.0:1746147734.781667:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:32557:x1830967794220928:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147734.781686:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147734.781704:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090038200/0xe64d3fbf12a7f176 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc92d expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.781736:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.781748:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147734.781750:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147734.781753:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090038200/0xe64d3fbf12a7f176 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc92d expref: 34 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.781784:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3465215) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.781795:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3465215) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 17 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746147734.781807:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796557824:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147734.781914:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cda9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.782860:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.782982:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794221056 00000100:00100000:1.0:1746147734.782988:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794221056 00010000:00010000:1.0:1746147734.783028:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 25 pid: 20619 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.783064:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8746 00000100:00100000:1.0:1746147734.783072:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794221056:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147734.783088:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147734.783110:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 25 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.783121:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1380351) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 25 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.783142:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f011 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1380351) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc854 expref: 25 pid: 20619 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.783159:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.783161:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.783168:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.783176:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.783205:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 17 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.783214:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 17 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.783229:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796557952:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147734.783297:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.783979:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796557824:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147734.784003:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090038200/0xe64d3fbf12a7f176 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc92d expref: 34 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.784016:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090038200, rc 0) 00000100:00100000:0.0:1746147734.784055:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32557:x1830967794220928:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2389us (4321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147734.784063:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17103 00000100:00100000:0.0:1746147734.786463:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.786521:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794221184 00000100:00100000:2.0:1746147734.786531:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794221184 00000100:00100000:1.0:1746147734.786557:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7097:1830967796557952:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147734.786576:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746147734.786580:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3166208->3465215) req@ffff8800956b5180 x1830967794221184/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.786590:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b5180 with x1830967794221184 ext(3166208->3465215) 00010000:00010000:2.0:1746147734.786599:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 18 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.786611:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 18 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746147734.786616:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794221056:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3545us (3757us total) trans 0 rc 0/0 00002000:00010000:2.0:1746147734.786618:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800956b5180 00000100:00100000:1.0:1746147734.786625:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8746 00000100:00100000:2.0:1746147734.786653:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1568 00000100:00100000:2.0:1746147734.786661:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794221184:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:0.0:1746147734.787801:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.787958:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794221440 00000100:00100000:1.0:1746147734.787964:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794221440 00002000:00100000:1.0:1746147734.787990:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800956b7800 x1830967794221440/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.787999:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b7800 with x1830967794221440 ext(1048576->2097151) 00010000:00010000:1.0:1746147734.788006:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 18 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.788018:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 18 pid: 10613 timeout: 913 lvb_type: 0 00002000:00010000:1.0:1746147734.788024:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800956b7800 00000100:00100000:1.0:1746147734.788048:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1569 00000100:00100000:1.0:1746147734.788055:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794221440:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147734.792280:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794221184:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 5606us (5813us total) trans 17179874465 rc 0/0 00000100:00100000:3.0:1746147734.792293:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1568 00002000:00100000:3.0:1746147734.792307:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3166208->3465215) req@ffff8800956b5180 x1830967794221184/t17179874465(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/448 e 0 to 0 dl 1746147745 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.792316:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b5180 with x1830967794221184 ext(3166208->3465215) 00010000:00010000:3.0:1746147734.792326:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 20 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.792340:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 20 pid: 10613 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746147734.792346:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800956b5180 00000100:00100000:0.0:1746147734.796279:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.796518:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794221440:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 8461us (8719us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147734.796533:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1569 00002000:00100000:1.0:1746147734.796545:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff8800956b7800 x1830967794221440/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.796554:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b7800 with x1830967794221440 ext(1048576->2097151) 00010000:00010000:1.0:1746147734.796564:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 18 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746147734.796579:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 18 pid: 10613 timeout: 913 lvb_type: 0 00002000:00010000:1.0:1746147734.796586:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800956b7800 00000100:00100000:2.0:1746147734.796785:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794221568 00000100:00100000:2.0:1746147734.796793:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794221568 00010000:00010000:2.0:1746147734.796821:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 20 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746147734.796980:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8747 00000100:00100000:3.0:1746147734.796989:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967794221568:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147734.797002:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147734.797019:0:20557:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147734 -> 1746147735 00002000:00010000:3.0:1746147734.797023:0:20557:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147734 -> 1746147735 00010000:00010000:3.0:1746147734.797027:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 20 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.797037:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3465215) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 20 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.797059:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ee1e00/0xe64d3fbf12a7f161 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3465215) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc918 expref: 20 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746147734.797087:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.797089:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.797096:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090038200/0xe64d3fbf12a7f176 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc92d expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.797104:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090038200/0xe64d3fbf12a7f176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc92d expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.797137:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090038200/0xe64d3fbf12a7f176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc92d expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147734.797149:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796558080:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147734.797249:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.804997:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.805288:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794221696 00000100:00100000:1.0:1746147734.805298:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794221696 00000100:00100000:1.0:1746147734.805358:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17104 00000100:00100000:1.0:1746147734.805367:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32554:x1830967794221696:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147734.805385:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.805407:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7f17d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc934 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.805434:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.805435:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.805443:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7f17d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc934 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.805458:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7f17d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc934 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.805475:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e93c000, rc 0) 00000100:00100000:1.0:1746147734.805520:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32554:x1830967794221696:12345-192.168.202.10@tcp:101:cat.0 Request processed in 154us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147734.805526:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17104 00000100:00100000:3.0:1746147734.805687:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796558080:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147734.805706:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.805725:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967794221568:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 8739us (9458us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.805737:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8747 00010000:00010000:1.0:1746147734.805806:0:7099:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147734.806382:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.806592:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794221824 00000100:00100000:2.0:1746147734.806598:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794221824 00010000:00010000:2.0:1746147734.806621:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 18 pid: 10613 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746147734.806660:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8748 00000100:00100000:2.0:1746147734.806666:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794221824:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.806677:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.806703:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 18 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.806715:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 18 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.806734:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a2b0200/0xe64d3fbf12a7f168 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc91f expref: 18 pid: 10613 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746147734.806761:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.806763:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.806767:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2011135) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.806774:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2011135) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.806804:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2011135) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.806820:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796558208:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147734.807298:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.808150:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.808195:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.808254:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794222080 00000100:00100000:1.0:1746147734.808262:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794222080 00002000:00100000:1.0:1746147734.808309:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800956b4380 x1830967794222080/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147734.808319:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b4380 with x1830967794222080 ext(2097152->3145727) 00002000:00010000:1.0:1746147734.808324:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b4380 00000100:00100000:3.0:1746147734.808342:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794222336 00000100:00100000:3.0:1746147734.808353:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794222336 00000100:00100000:1.0:1746147734.808359:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7725 00000100:00100000:1.0:1746147734.808366:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967794222080:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:3.0:1746147734.808394:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800956b6300 x1830967794222336/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.808402:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b6300 with x1830967794222336 ext(3145728->4194303) 00002000:00010000:3.0:1746147734.808407:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b6300 00000100:00100000:3.0:1746147734.808442:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7726 00000100:00100000:3.0:1746147734.808449:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967794222336:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147734.810929:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.811034:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794222592 00000100:00100000:3.0:1746147734.811041:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794222592 00000100:00100000:2.0:1746147734.811066:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796558208:192.168.202.10@tcp:105: 00002000:00100000:3.0:1746147734.811070:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800956b4e00 x1830967794222592/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.811080:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b4e00 with x1830967794222592 ext(1048576->2097151) 00002000:00010000:3.0:1746147734.811085:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b4e00 00010000:00010000:2.0:1746147734.811091:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147734.811102:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7727 00000100:00100000:3.0:1746147734.811109:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794222592:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147734.811131:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967794221824:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4463us (4748us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.811141:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8748 00000100:00100000:0.0:1746147734.825283:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.825558:0:31357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794222848 00000100:00100000:2.0:1746147734.825568:0:31357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794222848 00002000:00100000:2.0:1746147734.825616:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (2007040->2011135) req@ffff8800956b4a80 x1830967794222848/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.825636:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b4a80 with x1830967794222848 ext(2007040->2011135) 00002000:00010000:2.0:1746147734.825644:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800956b4a80 00000100:00100000:2.0:1746147734.825668:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7728 00000100:00100000:2.0:1746147734.825677:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794222848:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147734.826375:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967794222336:12345-192.168.202.10@tcp:3:cat.0 Request processed in 17917us (18169us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147734.826387:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7726 00002000:00100000:3.0:1746147734.826399:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800956b6300 x1830967794222336/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147734.826399:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794222848:12345-192.168.202.10@tcp:3:cat.0 Request processed in 721us (1125us total) trans 0 rc 4096/4096 00002000:00100000:3.0:1746147734.826408:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b6300 with x1830967794222336 ext(3145728->4194303) 00000100:00100000:2.0:1746147734.826408:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7728 00002000:00010000:3.0:1746147734.826414:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b6300 00002000:00100000:2.0:1746147734.826415:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x454:0x0] (2007040->2011135) req@ffff8800956b4a80 x1830967794222848/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/4536 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.826423:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b4a80 with x1830967794222848 ext(2007040->2011135) 00002000:00010000:2.0:1746147734.826427:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800956b4a80 00000100:00100000:2.0:1746147734.827594:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794222080:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19224us (19445us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147734.827603:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7725 00002000:00100000:2.0:1746147734.827610:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800956b4380 x1830967794222080/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.827617:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b4380 with x1830967794222080 ext(2097152->3145727) 00002000:00010000:2.0:1746147734.827621:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b4380 00000100:00100000:3.0:1746147734.828119:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794222592:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 17007us (17194us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147734.828127:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7727 00002000:00100000:3.0:1746147734.828134:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800956b4e00 x1830967794222592/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.828141:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b4e00 with x1830967794222592 ext(1048576->2097151) 00002000:00010000:3.0:1746147734.828144:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b4e00 00000100:00100000:0.0:1746147734.837064:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.837145:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794223104 00000100:00100000:2.0:1746147734.837152:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794223104 00000100:00100000:2.0:1746147734.837187:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5066 00000100:00100000:2.0:1746147734.837193:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32551:x1830967794223104:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:2.0:1746147734.837388:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32551:x1830967794223104:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 194us (329us total) trans 8589946160 rc 0/0 00000100:00100000:2.0:1746147734.837395:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5066 00000100:00100000:0.0:1746147734.839124:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.840337:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.840522:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794223488 00000100:00100000:3.0:1746147734.840529:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794223488 00002000:00100000:3.0:1746147734.840562:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800956b6d80 x1830967794223488/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.840574:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b6d80 with x1830967794223488 ext(4194304->5017599) 00002000:00010000:3.0:1746147734.840579:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b6d80 00000100:00100000:3.0:1746147734.840596:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7729 00000100:00100000:3.0:1746147734.840603:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794223488:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147734.840616:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794223232 00000100:00100000:2.0:1746147734.840621:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794223232 00000100:00100000:2.0:1746147734.840666:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17105 00000100:00100000:2.0:1746147734.840672:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32554:x1830967794223232:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147734.840681:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.840701:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a925f200/0xe64d3fbf12a7f184 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc93b expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.840718:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.840720:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.840726:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925f200/0xe64d3fbf12a7f184 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc93b expref: 21 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.840740:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a925f200/0xe64d3fbf12a7f184 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc93b expref: 21 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.840749:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925f200, rc 0) 00000100:00100000:2.0:1746147734.840792:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32554:x1830967794223232:12345-192.168.202.10@tcp:101:cat.0 Request processed in 120us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.840798:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17105 00000100:00100000:0.0:1746147734.847477:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.847515:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.847539:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794223744 00000100:00100000:0.0:1746147734.847548:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794223744 00002000:00100000:0.0:1746147734.847590:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a08aad80 x1830967794223744/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147734.847599:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08aad80 with x1830967794223744 ext(2097152->3145727) 00002000:00010000:0.0:1746147734.847605:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08aad80 00000100:00100000:0.0:1746147734.847641:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794224000 00000100:00100000:0.0:1746147734.847643:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794224000 00002000:00100000:0.0:1746147734.847656:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a08a9500 x1830967794224000/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147734.847662:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a9500 with x1830967794224000 ext(3145728->4194303) 00002000:00010000:0.0:1746147734.847665:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08a9500 00000100:00100000:0.0:1746147734.847685:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7730 00000100:00100000:0.0:1746147734.847693:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967794223744:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147734.847707:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7731 00000100:00100000:3.0:1746147734.847722:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967794224000:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147734.850067:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794223488:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9456us (9722us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147734.850080:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7729 00002000:00100000:2.0:1746147734.850090:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800956b6d80 x1830967794223488/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.850241:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800956b6d80 with x1830967794223488 ext(4194304->5017599) 00002000:00010000:2.0:1746147734.850247:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800956b6d80 00000100:00100000:2.0:1746147734.858543:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1957:x1830967794223744:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10835us (11062us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147734.858557:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7730 00002000:00100000:2.0:1746147734.858571:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a08aad80 x1830967794223744/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147734.858580:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08aad80 with x1830967794223744 ext(2097152->3145727) 00002000:00010000:2.0:1746147734.858585:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08aad80 00000100:00100000:3.0:1746147734.859162:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967794224000:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11439us (11639us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147734.859170:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7731 00002000:00100000:3.0:1746147734.859261:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a08a9500 x1830967794224000/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.859271:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a9500 with x1830967794224000 ext(3145728->4194303) 00002000:00010000:3.0:1746147734.859275:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08a9500 00000100:00100000:0.0:1746147734.869813:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.869928:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794224128 00000100:00100000:2.0:1746147734.869939:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794224128 00000100:00100000:2.0:1746147734.869997:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17106 00000100:00100000:2.0:1746147734.870005:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794224128:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147734.870167:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.870189:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a925f400/0xe64d3fbf12a7f18b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc942 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.870246:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796558336:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147734.870364:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.870380:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794224256 00000100:00100000:1.0:1746147734.870384:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794224256 00000100:00100000:1.0:1746147734.870412:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17107 00000100:00100000:1.0:1746147734.870418:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794224256:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147734.870426:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.870438:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8dbf200/0xe64d3fbf12a7f192 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc949 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.870504:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796558464:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147734.870594:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147734.871254:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147734.871586:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796558336:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147734.871617:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a925f400/0xe64d3fbf12a7f18b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc942 expref: 22 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.871639:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a925f400/0xe64d3fbf12a7f18b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc942 expref: 22 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.871663:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925f400, rc 0) 00000100:00100000:2.0:1746147734.871753:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794224128:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1748us (1951us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147734.872154:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17106 00000100:00100000:2.0:1746147734.872331:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796558464:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147734.872359:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8dbf200/0xe64d3fbf12a7f192 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc949 expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.872370:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8dbf200/0xe64d3fbf12a7f192 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc949 expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.872379:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8dbf200, rc 0) 00000100:00100000:2.0:1746147734.872429:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794224256:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2011us (2065us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147734.872434:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17107 00000100:00100000:0.0:1746147734.877459:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.877562:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794224512 00000100:00100000:3.0:1746147734.877573:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794224512 00002000:00100000:3.0:1746147734.877656:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a08a9f80 x1830967794224512/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/0 e 0 to 0 dl 1746147745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.877785:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a9f80 with x1830967794224512 ext(4194304->5017599) 00002000:00010000:3.0:1746147734.877790:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08a9f80 00000100:00100000:3.0:1746147734.877823:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7732 00000100:00100000:3.0:1746147734.877834:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967794224512:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147734.887987:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967794224512:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10144us (10528us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746147734.888000:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7732 00002000:00100000:3.0:1746147734.888012:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a08a9f80 x1830967794224512/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:355/0 lens 488/440 e 0 to 0 dl 1746147745 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147734.888022:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a9f80 with x1830967794224512 ext(4194304->5017599) 00002000:00010000:3.0:1746147734.888028:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08a9f80 00000100:00100000:0.0:1746147734.892483:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.892539:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.892657:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794224640 00000100:00100000:3.0:1746147734.892668:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794224640 00000100:00100000:3.0:1746147734.892719:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794224768 00000100:00100000:3.0:1746147734.892721:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794224768 00000100:00100000:3.0:1746147734.893141:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17108 00000100:00100000:3.0:1746147734.893149:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794224640:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147734.893168:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.893187:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f199 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc950 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147734.893239:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796558592:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147734.893383:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17109 00000100:00100000:2.0:1746147734.893392:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794224768:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147734.893402:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.893415:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a925ee00/0xe64d3fbf12a7f1a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc957 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.893443:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796558720:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147734.893643:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147734.893803:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147734.897359:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796558592:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147734.897359:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796558720:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147734.897388:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f199 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc950 expref: 22 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.897388:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a925ee00/0xe64d3fbf12a7f1a0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc957 expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.897402:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f199 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc950 expref: 22 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.897403:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a925ee00/0xe64d3fbf12a7f1a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc957 expref: 18 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.897417:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a1e00, rc 0) 00010000:00010000:2.0:1746147734.897431:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925ee00, rc 0) 00000100:00100000:3.0:1746147734.897463:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794224640:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4314us (4990us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147734.897472:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17108 00000100:00100000:2.0:1746147734.897490:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794224768:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4099us (4950us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147734.897496:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17109 00000100:00100000:0.0:1746147734.903508:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.903561:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.903639:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794224896 00000100:00100000:2.0:1746147734.903649:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794224896 00000100:00100000:2.0:1746147734.903699:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794225024 00000100:00100000:2.0:1746147734.903701:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794225024 00000100:00100000:2.0:1746147734.903727:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17110 00000100:00100000:2.0:1746147734.903735:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967794224896:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147734.903754:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.903771:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7f1a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc95e expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.903824:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796558848:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147734.903911:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17111 00000100:00100000:2.0:1746147734.903917:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147734.903927:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794225024:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147734.903943:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.903959:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb200/0xe64d3fbf12a7f1ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc965 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.904004:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796558976:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147734.904060:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147734.909245:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796558848:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147734.909286:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7f1a7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc95e expref: 22 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.909301:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a925f600/0xe64d3fbf12a7f1a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc95e expref: 22 pid: 8470 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147734.909425:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796558976:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147734.909444:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb200/0xe64d3fbf12a7f1ae lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc965 expref: 18 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.909454:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb200/0xe64d3fbf12a7f1ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc965 expref: 18 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.909477:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8eb200, rc 0) 00000100:00100000:1.0:1746147734.909529:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794225024:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5606us (5966us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147734.909538:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17111 00010000:00010000:2.0:1746147734.909759:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925f600, rc 0) 00000100:00100000:2.0:1746147734.909781:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967794224896:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6046us (6285us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147734.909786:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17110 00000100:00100000:0.0:1746147734.957596:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.957699:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794225152 00000100:00100000:2.0:1746147734.957709:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794225152 00000100:00100000:2.0:1746147734.957802:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12125 00000100:00100000:2.0:1746147734.957811:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+8:32565:x1830967794225152:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147734.957840:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.957861:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925e600/0xe64d3fbf12a7f1b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc96c expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.957953:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7f1bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.957966:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7f1bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.957978:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7f1bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.957988:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f1c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.957991:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.957995:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.958108:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.958118:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc903 expref: 15 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.958124:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.958156:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc903 expref: 15 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.958168:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc903 expref: 15 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147734.958179:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796559104:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.958767:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147734.959952:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796559104:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.959977:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147734.962326:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.962391:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794225408 00000100:00100000:2.0:1746147734.962400:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794225408 00000100:00100000:2.0:1746147734.962456:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5067 00000100:00100000:2.0:1746147734.962464:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:7669:x1830967794225408:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147734.962723:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:7669:x1830967794225408:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 258us (405us total) trans 8589946161 rc 0/0 00000100:00100000:2.0:1746147734.962733:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5067 00000100:00100000:0.0:1746147734.965977:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.966060:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794225536 00000100:00100000:2.0:1746147734.966070:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794225536 00010000:00010000:2.0:1746147734.966103:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc903 expref: 17 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147734.966129:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8749 00000100:00100000:2.0:1746147734.966135:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794225536:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.966148:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.966153:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc903 expref: 17 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147734.966165:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc903 expref: 17 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147734.966187:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ee0800/0xe64d3fbf12a7f14c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc903 expref: 17 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147734.966214:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147734.966219:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.966227:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.966233:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.966923:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147734.966925:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.966933:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147734.966974:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:3.0:1746147734.966979:0:5744:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1746147734.966979:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794225536:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 844us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.966986:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8749 00000004:00010000:3.0:1746147734.966994:0:5744:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967003:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967015:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7f1bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967021:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7f1bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967027:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7f1bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967032:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a925ec00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147734.967036:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7f1bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967046:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7f1bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967055:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147734.967057:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147734.967060:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7f1bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967063:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925ec00/0xe64d3fbf12a7f1bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967075:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967080:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f1c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967083:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967086:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a925fe00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147734.967088:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967092:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f1c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967097:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06ee500) 00010000:00010000:3.0:1746147734.967099:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147734.967101:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f1c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967105:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f1c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.967140:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925e600/0xe64d3fbf12a7f1b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc96c expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.967153:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc96c expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.967159:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.967161:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147734.967163:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925fc00, rc 0) 00000100:00100000:3.0:1746147734.967200:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+9:32565:x1830967794225152:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 9391us (9619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.967207:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12125 00000100:00100000:0.0:1746147734.969310:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.969344:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.969363:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.969394:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.969487:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794225664 00000100:00100000:2.0:1746147734.969495:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794225664 00000100:00100000:1.0:1746147734.969518:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794225920 00000100:00100000:2.0:1746147734.969528:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794225792 00000100:00100000:2.0:1746147734.969529:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794225792 00000100:00100000:1.0:1746147734.969534:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794225920 00000100:00100000:2.0:1746147734.969540:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794226048 00000100:00100000:2.0:1746147734.969542:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794226048 00000100:00100000:2.0:1746147734.969552:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17112 00000100:00100000:2.0:1746147734.969559:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967794225664:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147734.969576:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147734.969582:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17113 00010000:00010000:2.0:1746147734.969590:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a925ee00/0xe64d3fbf12a7f1d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc973 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.969590:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967794225792:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:2.0:1746147734.969649:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796559232:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147734.969706:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65de540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147734.969724:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17114 00000100:00100000:2.0:1746147734.969729:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967794226048:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147734.969735:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.969742:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbf200/0xe64d3fbf12a7f1d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc988 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.969751:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.969753:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.969761:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbf200/0xe64d3fbf12a7f1d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc988 expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.969779:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbf200/0xe64d3fbf12a7f1d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc988 expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.969788:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8dbf200, rc 0) 00000100:00100000:2.0:1746147734.969804:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+12:1958:x1830967794226048:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 75us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.969809:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17114 00000100:00100000:2.0:1746147734.969822:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17115 00010000:00010000:1.0:1746147734.969828:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147734.969831:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967794225920:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147734.969836:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.969842:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbea00/0xe64d3fbf12a7f1e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc981 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.969844:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7f1df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc97a expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.969850:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.969852:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.969855:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbea00/0xe64d3fbf12a7f1e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc981 expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.969866:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbea00/0xe64d3fbf12a7f1e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc981 expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.969872:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8dbea00, rc 0) 00000100:00100000:2.0:1746147734.969881:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+12:1958:x1830967794225920:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 51us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.969913:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17115 00000100:00100000:1.0:1746147734.969918:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796559360:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147734.969985:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147734.972691:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796559360:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147734.972719:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7f1df lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc97a expref: 12 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.972730:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7f1df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc97a expref: 12 pid: 10613 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147734.972735:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796559232:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147734.972749:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8eac00, rc 0) 00010000:00010000:2.0:1746147734.972760:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a925ee00/0xe64d3fbf12a7f1d1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc973 expref: 11 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.972771:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a925ee00/0xe64d3fbf12a7f1d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc973 expref: 11 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.972783:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925ee00, rc 0) 00000100:00100000:1.0:1746147734.972792:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967794225792:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 3202us (3426us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147734.972800:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17113 00000100:00100000:2.0:1746147734.972810:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967794225664:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 3252us (3509us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147734.972817:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17112 00000100:00100000:0.0:1746147734.975095:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.975196:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794226304 00000100:00100000:3.0:1746147734.975204:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794226304 00000100:00100000:3.0:1746147734.975252:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12126 00000100:00100000:3.0:1746147734.975260:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+9:32565:x1830967794226304:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147734.975282:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.975299:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1000/0xe64d3fbf12a7f1ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc98f expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.975388:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.975401:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc96c expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.975409:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.975438:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc96c expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.975448:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc96c expref: 10 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147734.975461:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796559488:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.975873:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147734.977624:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796559488:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.977658:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147734.977812:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.978000:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794226432 00000100:00100000:2.0:1746147734.978008:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794226432 00010000:00010000:2.0:1746147734.978038:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc96c expref: 11 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147734.978105:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8750 00000100:00100000:2.0:1746147734.978112:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6673050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794226432:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147734.978126:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.978131:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc96c expref: 11 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147734.978146:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc96c expref: 11 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147734.978166:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a925fc00/0xe64d3fbf12a7f1ca lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc96c expref: 11 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147734.978185:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147734.978189:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.978199:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.978205:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.978257:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.978263:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147734.978283:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147734.978295:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147734.978344:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6673050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794226432:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 231us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.978350:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8750 00010000:00010000:3.0:1746147734.978420:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1000/0xe64d3fbf12a7f1ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc98f expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.978433:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc98f expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.978441:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.978443:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147734.978445:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a1c00, rc 0) 00000100:00100000:3.0:1746147734.978481:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32565:x1830967794226304:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 3221us (3393us total) trans 8589946162 rc 0/0 00000100:00100000:3.0:1746147734.978487:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12126 00000100:00100000:0.0:1746147734.980749:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.980921:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794226560 00000100:00100000:3.0:1746147734.980930:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794226560 00000100:00100000:3.0:1746147734.980969:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12127 00000100:00100000:3.0:1746147734.980976:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32565:x1830967794226560:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147734.981000:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.981017:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f202 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc996 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.981093:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f209 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.981106:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc98f expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.981113:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f209 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.981143:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc98f expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.981155:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc98f expref: 11 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147734.981167:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796559616:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.981252:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.982797:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147734.982913:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794226688 00000100:00100000:2.0:1746147734.982920:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794226688 00010000:00010000:2.0:1746147734.982949:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc98f expref: 12 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147734.982973:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8751 00000100:00100000:2.0:1746147734.982980:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794226688:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147734.982990:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796559616:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.982991:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147734.982997:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc98f expref: 12 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147734.983007:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc98f expref: 12 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147734.983129:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f209 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.983139:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f1f4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc98f expref: 12 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147734.983156:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147734.983160:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f209 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.983169:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f209 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.983175:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f209 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147734.983204:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147734.983246:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794226688:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 266us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147734.983253:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8751 00010000:00010000:3.0:1746147734.983314:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f209 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.983321:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f209 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147734.983361:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:3.0:1746147734.983366:0:5744:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147734.983383:0:5744:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f209 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.983409:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f202 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc996 expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.983421:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f209 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc996 expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.983432:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.983434:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147734.983436:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0800, rc 0) 00000100:00100000:3.0:1746147734.983475:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32565:x1830967794226560:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 2499us (2735us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147734.983482:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12127 00000100:00100000:0.0:1746147734.986195:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.987009:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.987095:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794226944 00000100:00100000:1.0:1746147734.987104:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794226944 00000100:00100000:1.0:1746147734.987142:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794226816 00000100:00100000:1.0:1746147734.987144:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794226816 00000100:00100000:1.0:1746147734.987172:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17116 00000100:00100000:1.0:1746147734.987179:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967794226944:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147734.987197:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147734.987215:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f210 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc9a4 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.987268:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17117 00000100:00100000:2.0:1746147734.987277:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967794226816:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147734.987285:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147734.987300:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a925e600/0xe64d3fbf12a7f217 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc99d expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147734.987433:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796559744:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147734.987433:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796559872:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147734.987513:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147734.987564:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147734.989080:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796559744:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147734.989112:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a925e600/0xe64d3fbf12a7f217 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc99d expref: 11 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.989126:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a925e600/0xe64d3fbf12a7f217 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc99d expref: 11 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.989137:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a925e600, rc 0) 00000100:00100000:2.0:1746147734.989175:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967794226816:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1899us (2167us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147734.989183:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17117 00000100:00100000:1.0:1746147734.989201:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796559872:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147734.989218:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f210 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9a4 expref: 12 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.989228:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f210 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9a4 expref: 12 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.989255:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8eba00, rc 0) 00000100:00100000:1.0:1746147734.989274:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967794226944:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 2096us (3089us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147734.989280:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17116 00000100:00100000:0.0:1746147734.991131:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147734.991194:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794227200 00000100:00100000:3.0:1746147734.991203:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794227200 00000100:00100000:3.0:1746147734.991256:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12128 00000100:00100000:3.0:1746147734.991263:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32565:x1830967794227200:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147734.991280:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147734.991297:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f21e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc9ab expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.991384:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0400/0xe64d3fbf12a7f225 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.991397:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0400/0xe64d3fbf12a7f225 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147734.991408:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0400/0xe64d3fbf12a7f225 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147734.991419:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147734.991534:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f21e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ab expref: 13 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.991549:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0400/0xe64d3fbf12a7f225 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ab expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.992074:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147734.992077:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147734.992080:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0400, rc 0) 00000100:00100000:3.0:1746147734.992121:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+12:32565:x1830967794227200:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 858us (997us total) trans 8589946163 rc 0/0 00000100:00100000:3.0:1746147734.992127:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12128 00000100:00100000:0.0:1746147734.993809:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.994927:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.994963:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.994985:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794227456 00000100:00100000:1.0:1746147734.994990:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794227328 00000100:00100000:0.0:1746147734.994994:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794227456 00000100:00100000:1.0:1746147734.995000:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794227328 00000100:00100000:1.0:1746147734.995041:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794227712 00000100:00100000:1.0:1746147734.995043:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794227712 00000100:00100000:1.0:1746147734.995061:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17118 00000100:00100000:1.0:1746147734.995067:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794227328:12345-192.168.202.10@tcp:1:lfs.0 00000100:00100000:2.0:1746147734.995081:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17119 00000100:00100000:2.0:1746147734.995092:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794227712:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:1.0:1746147734.995103:0:10613:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f233 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.995118:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 33 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.995124:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147734.995125:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147734.995126:0:4591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f23a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.995128:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f233 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.995142:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7f15a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc911 expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.995150:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbea00/0xe64d3fbf12a7f1e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc981 expref: 11 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.995154:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 33 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.995158:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7f17d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc934 expref: 20 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.995164:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147734.995166:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.995166:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 33 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147734.995168:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f23a lrc: 6/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147734.995177:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796560000:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.995197:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7f17d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc934 expref: 20 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.995206:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7f17d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc934 expref: 20 pid: 10613 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147734.995217:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796560128:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147734.995253:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746147734.995269:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbea00/0xe64d3fbf12a7f1e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc981 expref: 11 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147734.995276:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbea00/0xe64d3fbf12a7f1e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc981 expref: 11 pid: 8470 timeout: 914 lvb_type: 1 00000100:00100000:2.0:1746147734.995284:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796560256:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147734.995305:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7f15a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc911 expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147734.995313:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7f15a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc911 expref: 33 pid: 10613 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147734.995321:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796560384:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147734.995335:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9e2c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.996044:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17120 00000100:00100000:0.0:1746147734.996051:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794227456:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:0.0:1746147734.996074:0:9615:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5714000/0xe64d3fbf12a7f241 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.996088:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2011135) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.996094:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147734.996096:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147734.996097:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5714000/0xe64d3fbf12a7f241 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.996115:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2011135) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 23 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147734.996124:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2011135) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 23 pid: 10613 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147734.996145:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796560512:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147734.996183:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cda9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147734.996215:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.996374:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147734.996418:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147734.996536:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794227968 00000100:00100000:1.0:1746147734.996540:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794227968 00000100:00100000:1.0:1746147734.996559:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794227584 00000100:00100000:1.0:1746147734.996561:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794227584 00000100:00100000:1.0:1746147734.996571:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794227840 00000100:00100000:1.0:1746147734.996573:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794227840 00000100:00100000:1.0:1746147734.996584:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17121 00000100:00100000:1.0:1746147734.996589:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794227968:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:1.0:1746147734.996607:0:7050:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f248 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.996617:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f9 expref: 16 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.996623:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0267600/0xe64d3fbf12a7f065 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc893 expref: 13 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.996641:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095639a00/0xe64d3fbf12a7efe7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc83f expref: 23 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.996646:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.996648:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.996650:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f248 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.996666:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095639a00/0xe64d3fbf12a7efe7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc83f expref: 23 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.996673:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095639a00/0xe64d3fbf12a7efe7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc83f expref: 23 pid: 8468 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147734.996681:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796560640:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147734.996688:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17122 00000100:00100000:3.0:1746147734.996700:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794227584:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:1.0:1746147734.996712:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0267600/0xe64d3fbf12a7f065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc893 expref: 13 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.996720:0:8469:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f24f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.996722:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0267600/0xe64d3fbf12a7f065 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc893 expref: 13 pid: 10613 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147734.996729:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796560768:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.996731:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7ef85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7e4 expref: 16 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.996739:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7f049 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc87e expref: 13 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.996745:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2a00/0xe64d3fbf12a7eff5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc82a expref: 23 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.996751:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.996751:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f9 expref: 16 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147734.996752:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147734.996755:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f24f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.996758:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f9 expref: 16 pid: 21480 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746147734.996769:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2a00/0xe64d3fbf12a7eff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc82a expref: 23 pid: 4591 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147734.996770:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796560896:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147734.996778:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2a00/0xe64d3fbf12a7eff5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc82a expref: 23 pid: 4591 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147734.996786:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796561024:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147734.996805:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941c6c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746147734.996817:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7f049 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc87e expref: 13 pid: 8470 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147734.996821:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17123 00010000:00010000:3.0:1746147734.996824:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7f049 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc87e expref: 13 pid: 8470 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147734.996827:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794227840:12345-192.168.202.10@tcp:1:lfs.0 00000100:00100000:3.0:1746147734.996830:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796561152:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.996845:0:8184:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7f256 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.996848:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7ef85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7e4 expref: 16 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.996854:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090038200/0xe64d3fbf12a7f176 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc92d expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147734.996855:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7ef85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7e4 expref: 16 pid: 6715 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147734.996861:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0224e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796561280:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.996861:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbf200/0xe64d3fbf12a7f1d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc988 expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.996867:0:8184:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a925f200/0xe64d3fbf12a7f184 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc93b expref: 20 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147734.996872:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e840 going to sleep for 11 seconds 00010000:00010000:1.0:1746147734.996873:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.996874:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147734.996876:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7f256 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.996914:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a925f200/0xe64d3fbf12a7f184 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc93b expref: 20 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.996922:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a925f200/0xe64d3fbf12a7f184 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc93b expref: 20 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147734.996931:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796561408:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.996976:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbf200/0xe64d3fbf12a7f1d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc988 expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147734.996984:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbf200/0xe64d3fbf12a7f1d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc988 expref: 12 pid: 8470 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147734.996990:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796561536:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147734.997012:0:8184:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090038200/0xe64d3fbf12a7f176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc92d expref: 33 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147734.997020:0:8184:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090038200/0xe64d3fbf12a7f176 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc92d expref: 33 pid: 10613 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147734.997027:0:8184:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796561664:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147734.997040:0:8184:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.001326:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796560128:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.001347:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796560384:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.001356:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796560256:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.001386:0:4591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f23a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.001417:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796561024:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.001425:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796561152:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.001431:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0224e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796561280:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.001448:0:8469:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f24f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.001499:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796560512:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147735.001516:0:9615:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5714000/0xe64d3fbf12a7f241 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.001564:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796560000:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147735.001579:0:10613:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f233 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.001600:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796561408:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.001606:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796561536:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.001616:0:8184:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8184:1830967796561664:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147735.001640:0:8184:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7f256 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.001665:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796560640:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.001677:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796560768:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.001684:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796560896:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147735.001697:0:7050:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f248 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.002596:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.002646:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.002658:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794228480 00000100:00100000:2.0:1746147735.002666:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794228480 00010000:00010000:2.0:1746147735.002701:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbea00/0xe64d3fbf12a7f1e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc981 expref: 13 pid: 8470 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.002803:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8752 00000100:00100000:1.0:1746147735.002812:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+13:1957:x1830967794228480:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.002828:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.003049:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbea00/0xe64d3fbf12a7f1e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc981 expref: 13 pid: 8470 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.003061:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbea00/0xe64d3fbf12a7f1e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc981 expref: 13 pid: 8470 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.003082:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbea00/0xe64d3fbf12a7f1e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc981 expref: 13 pid: 8470 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147735.003088:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794228352 00000100:00100000:3.0:1746147735.003092:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794228352 00010000:00010000:1.0:1746147735.003102:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746147735.003128:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (974848->1048575) req@ffff880130d27b80 x1830967794228352/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.003137:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d27b80 with x1830967794228352 ext(974848->1048575) 00010000:00010000:3.0:1746147735.003144:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 34 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.003146:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967794228480:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 334us (553us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147735.003153:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 34 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.003153:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8752 00002000:00010000:3.0:1746147735.003159:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130d27b80 00000100:00100000:3.0:1746147735.003170:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1570 00000100:00100000:3.0:1746147735.003175:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967794228352:12345-192.168.202.10@tcp:4:cat.0 00000100:00080000:0.0:1746147735.003760:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147735.011922:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.011960:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.012463:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.012585:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.012600:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794228096 00000100:00100000:2.0:1746147735.012609:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794228096 00010000:00010000:2.0:1746147735.012656:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7f15a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc911 expref: 36 pid: 10613 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.012682:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794228736 00000100:00100000:2.0:1746147735.012684:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794228736 00010000:00010000:2.0:1746147735.012696:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0267600/0xe64d3fbf12a7f065 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc893 expref: 14 pid: 10613 timeout: 914 lvb_type: 1 00000100:00100000:2.0:1746147735.012714:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794228864 00000100:00100000:2.0:1746147735.012716:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794228864 00010000:00010000:2.0:1746147735.012727:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7f049 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc87e expref: 15 pid: 8470 timeout: 914 lvb_type: 1 00000100:00100000:2.0:1746147735.012742:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8753 00000100:00100000:2.0:1746147735.012749:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967794228096:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147735.012763:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.012786:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7f15a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc911 expref: 36 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.012797:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7f15a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc911 expref: 36 pid: 10613 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.012817:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8754 00010000:00010000:2.0:1746147735.012820:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c42f600/0xe64d3fbf12a7f15a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc911 expref: 36 pid: 10613 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.012828:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+15:1959:x1830967794228736:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147735.012837:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.012848:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147735.012852:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0267600/0xe64d3fbf12a7f065 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc893 expref: 15 pid: 10613 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746147735.012862:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0267600/0xe64d3fbf12a7f065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc893 expref: 15 pid: 10613 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746147735.012878:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0267600/0xe64d3fbf12a7f065 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc893 expref: 15 pid: 10613 timeout: 914 lvb_type: 1 00000100:00100000:2.0:1746147735.012900:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967794228096:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 135us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.012907:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8753 00010000:00010000:0.0:1746147735.012908:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.012920:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8755 00000100:00100000:2.0:1746147735.012924:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794228864:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147735.012925:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794228736:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 101us (965us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147735.012931:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147735.012932:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8754 00010000:00010000:2.0:1746147735.012941:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7f049 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc87e expref: 13 pid: 8470 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746147735.012949:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7f049 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc87e expref: 13 pid: 8470 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746147735.012959:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a66aba00/0xe64d3fbf12a7f049 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc87e expref: 13 pid: 8470 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746147735.012968:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.012982:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794228864:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 57us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.012987:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8755 00000100:00100000:1.0:1746147735.013545:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.013577:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.013592:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.013604:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794229376 00000100:00100000:1.0:1746147735.013607:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794229376 00010000:00010000:1.0:1746147735.013641:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2a00/0xe64d3fbf12a7eff5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc82a expref: 24 pid: 4591 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.013654:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794228608 00000100:00100000:1.0:1746147735.013656:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794228608 00010000:00010000:1.0:1746147735.013666:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7f17d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc934 expref: 21 pid: 10613 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.013675:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794228992 00000100:00100000:1.0:1746147735.013676:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794228992 00010000:00010000:1.0:1746147735.013684:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7ef85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7e4 expref: 17 pid: 6715 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.013695:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8756 00000100:00100000:1.0:1746147735.013700:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794229376:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.013706:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.013715:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2a00/0xe64d3fbf12a7eff5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc82a expref: 24 pid: 4591 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.013737:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2a00/0xe64d3fbf12a7eff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc82a expref: 24 pid: 4591 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.013748:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2a00/0xe64d3fbf12a7eff5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc82a expref: 24 pid: 4591 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.013759:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147735.013778:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794229376:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 79us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.013784:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8756 00000100:00100000:1.0:1746147735.013797:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8757 00000100:00100000:1.0:1746147735.013808:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6671450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967794228608:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.013814:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.013822:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7f17d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc934 expref: 21 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.013830:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7f17d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc934 expref: 21 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.013841:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e93c000/0xe64d3fbf12a7f17d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc934 expref: 21 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.013850:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.013852:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.013856:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f23a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.013864:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8758 00010000:00010000:1.0:1746147735.013865:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f23a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.013881:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794228992:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.013903:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147735.013919:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6671450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1959:x1830967794228608:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 110us (375us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147735.013923:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147735.013925:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8757 00010000:00010000:2.0:1746147735.013947:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7ef85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7e4 expref: 17 pid: 6715 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746147735.013959:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7ef85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7e4 expref: 17 pid: 6715 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.013976:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147735.013980:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02d2200/0xe64d3fbf12a7ef85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7e4 expref: 17 pid: 6715 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.013988:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794229248 00000100:00100000:1.0:1746147735.013990:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794229248 00010000:00010000:2.0:1746147735.013993:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.013995:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.013998:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f24f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.014001:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095639a00/0xe64d3fbf12a7efe7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc83f expref: 23 pid: 8468 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746147735.014005:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f24f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.014013:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8759 00000100:00100000:1.0:1746147735.014017:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794229248:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.014023:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.014030:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147735.014031:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095639a00/0xe64d3fbf12a7efe7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc83f expref: 23 pid: 8468 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.014038:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095639a00/0xe64d3fbf12a7efe7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc83f expref: 23 pid: 8468 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.014049:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095639a00/0xe64d3fbf12a7efe7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc83f expref: 23 pid: 8468 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.014058:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.014068:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794228992:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 194us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.014075:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8758 00000100:00100000:1.0:1746147735.014075:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794229248:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 57us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.014080:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8759 00000100:00100000:2.0:1746147735.014114:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794228224 00000100:00100000:2.0:1746147735.014121:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794228224 00000100:00100000:1.0:1746147735.014133:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00100000:2.0:1746147735.014146:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2011135) req@ffff8800951d5500 x1830967794228224/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.014154:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d5500 with x1830967794228224 ext(1048576->2011135) 00010000:00010000:2.0:1746147735.014161:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 22 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.014173:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 22 pid: 10613 timeout: 914 lvb_type: 0 00002000:00010000:2.0:1746147735.014179:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800951d5500 00000100:00100000:2.0:1746147735.014195:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1571 00000100:00100000:2.0:1746147735.014200:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794228224:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147735.014257:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794229120 00000100:00100000:3.0:1746147735.014261:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794229120 00010000:00010000:3.0:1746147735.014276:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbf200/0xe64d3fbf12a7f1d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc988 expref: 12 pid: 8470 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147735.014302:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8760 00000100:00100000:3.0:1746147735.014306:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967794229120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.014312:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.014323:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbf200/0xe64d3fbf12a7f1d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc988 expref: 12 pid: 8470 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746147735.014331:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbf200/0xe64d3fbf12a7f1d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc988 expref: 12 pid: 8470 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746147735.014342:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8dbf200/0xe64d3fbf12a7f1d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc988 expref: 12 pid: 8470 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746147735.014355:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147735.014374:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967794229120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 68us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.014379:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8760 00010000:00010000:3.0:1746147735.014408:0:8469:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f24f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014415:0:8469:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f24f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014431:0:8469:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f24f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014438:0:8469:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f24f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014444:0:8469:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f24f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014450:0:8469:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02a1600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147735.014454:0:8469:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f24f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014460:0:8469:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f24f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014468:0:8469:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f24f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014473:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f24f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.014507:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794227584:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 17812us (18133us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.014513:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17122 00010000:00010000:3.0:1746147735.014532:0:4591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f23a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014537:0:4591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f23a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014548:0:4591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f23a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014552:0:4591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f23a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014556:0:4591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f23a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014560:0:4591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a925fe00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147735.014562:0:4591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f23a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014567:0:4591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f23a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014573:0:4591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f23a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.014577:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a925fe00/0xe64d3fbf12a7f23a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.014605:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794227712:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 19517us (19642us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.014609:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17119 00000100:00100000:3.0:1746147735.014809:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967794228352:12345-192.168.202.10@tcp:4:cat.0 Request processed in 11633us (12162us total) trans 17179874466 rc 0/0 00000100:00100000:3.0:1746147735.014816:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1570 00002000:00100000:3.0:1746147735.014822:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (974848->1048575) req@ffff880130d27b80 x1830967794228352/t17179874466(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/448 e 0 to 0 dl 1746147746 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.014831:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d27b80 with x1830967794228352 ext(974848->1048575) 00010000:00010000:3.0:1746147735.014836:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 35 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.014843:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 35 pid: 4591 timeout: 914 lvb_type: 0 00002000:00010000:3.0:1746147735.014849:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130d27b80 00000100:00080000:0.0:1746147735.015163:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147735.017321:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.017371:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.017406:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794229504 00000100:00100000:2.0:1746147735.017414:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794229504 00010000:00010000:2.0:1746147735.017441:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090038200/0xe64d3fbf12a7f176 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc92d expref: 35 pid: 10613 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.017470:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794229632 00000100:00100000:2.0:1746147735.017472:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794229632 00010000:00010000:2.0:1746147735.017481:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a925f200/0xe64d3fbf12a7f184 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc93b expref: 20 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.017509:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8761 00000100:00100000:2.0:1746147735.017515:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967794229504:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147735.017526:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147735.017530:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8762 00000100:00100000:3.0:1746147735.017542:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794229632:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.017557:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.017580:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a925f200/0xe64d3fbf12a7f184 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc93b expref: 20 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.017592:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a925f200/0xe64d3fbf12a7f184 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc93b expref: 20 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.017613:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a925f200/0xe64d3fbf12a7f184 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc93b expref: 20 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.017638:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147735.017682:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794229632:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 143us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.017688:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8762 00010000:00010000:2.0:1746147735.017795:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090038200/0xe64d3fbf12a7f176 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc92d expref: 35 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.017804:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090038200/0xe64d3fbf12a7f176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc92d expref: 35 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.017846:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090038200/0xe64d3fbf12a7f176 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc92d expref: 35 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.017857:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.017858:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.017861:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7f256 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.017868:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7f256 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.017967:0:8184:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7f256 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.017978:0:8184:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7f256 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.017998:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147735.017999:0:8184:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7f256 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.018006:0:8184:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7f256 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.018011:0:8184:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7f256 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.018017:0:8184:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a002cc00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147735.018021:0:8184:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7f256 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.018028:0:8184:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7f256 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.018038:0:8184:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7f256 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.018048:0:8184:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a002cc00/0xe64d3fbf12a7f256 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.018111:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1957:x1830967794229504:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 595us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.018117:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8761 00000100:00100000:1.0:1746147735.018644:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794227840:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 21814us (22222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.018654:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17123 00000100:00100000:2.0:1746147735.020404:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.020473:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794229760 00000100:00100000:3.0:1746147735.020483:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794229760 00010000:00010000:3.0:1746147735.020518:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f9 expref: 16 pid: 21480 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147735.020554:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8763 00000100:00100000:3.0:1746147735.020560:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794229760:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.020573:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.020594:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f9 expref: 16 pid: 21480 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746147735.020604:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f9 expref: 16 pid: 21480 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746147735.020634:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801308bcc00/0xe64d3fbf12a7ef9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7f9 expref: 16 pid: 21480 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746147735.020649:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.020651:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.020655:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.020663:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f248 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.020956:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.021149:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794229888 00000100:00100000:0.0:1746147735.021155:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794229888 00010000:00010000:0.0:1746147735.021176:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 34 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.021236:0:7050:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f248 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.021246:0:7050:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f248 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.021266:0:7050:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f248 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.021274:0:7050:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.021281:0:7050:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f248 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.021287:0:7050:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8ea800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147735.021291:0:7050:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f248 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.021299:0:7050:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f248 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.021311:0:7050:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f248 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.021377:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794227968:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 24787us (25160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.021386:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17121 00000100:00100000:1.0:1746147735.021414:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8764 00000100:00100000:1.0:1746147735.021421:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6672c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1958:x1830967794229888:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.021430:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.021481:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f248 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.021519:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147735.021554:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794229760:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 989us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.021560:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8763 00010000:00010000:1.0:1746147735.021851:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 34 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.021860:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 34 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.021875:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c42ee00/0xe64d3fbf12a7f13e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc90a expref: 34 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.021915:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.021917:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.021921:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f233 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.021928:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f233 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.021963:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147735.021994:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6672c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1958:x1830967794229888:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 573us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.022000:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8764 00010000:00010000:2.0:1746147735.022150:0:10613:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f233 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.022159:0:10613:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f233 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.022177:0:10613:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f233 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.022183:0:10613:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.022190:0:10613:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.022195:0:10613:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8eb800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147735.022198:0:10613:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.022205:0:10613:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.022214:0:10613:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f233 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.022218:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f233 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.022257:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794227328:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 27190us (27334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.022264:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17118 00000100:00100000:2.0:1746147735.032335:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794228224:12345-192.168.202.10@tcp:4:cat.0 Request processed in 18122us (18745us total) trans 21474841696 rc 0/0 00000100:00100000:2.0:1746147735.032347:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1571 00002000:00100000:2.0:1746147735.032358:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2011135) req@ffff8800951d5500 x1830967794228224/t21474841696(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/448 e 0 to 0 dl 1746147746 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.032368:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d5500 with x1830967794228224 ext(1048576->2011135) 00010000:00010000:2.0:1746147735.032379:0:8475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 24 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.032396:0:8475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 24 pid: 10613 timeout: 914 lvb_type: 0 00002000:00010000:2.0:1746147735.032402:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800951d5500 00000100:00100000:0.0:1746147735.034690:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.035360:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794230016 00000100:00100000:1.0:1746147735.035370:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794230016 00010000:00010000:1.0:1746147735.035408:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 24 pid: 10613 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.035468:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8765 00000100:00100000:1.0:1746147735.035476:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794230016:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.035490:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.035511:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 24 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.035522:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2011135) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 24 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.035546:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090038000/0xe64d3fbf12a7f16f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2011135) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc926 expref: 24 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.035561:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.035563:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.035568:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5714000/0xe64d3fbf12a7f241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.035686:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5714000/0xe64d3fbf12a7f241 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.035759:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147735.035810:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794230016:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 334us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.035817:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8765 00010000:00010000:0.0:1746147735.035881:0:9615:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5714000/0xe64d3fbf12a7f241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.035918:0:9615:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5714000/0xe64d3fbf12a7f241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.035939:0:9615:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5714000/0xe64d3fbf12a7f241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.035946:0:9615:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5714000/0xe64d3fbf12a7f241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.035954:0:9615:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5714000/0xe64d3fbf12a7f241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.035960:0:9615:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5714000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147735.035964:0:9615:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5714000/0xe64d3fbf12a7f241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.035972:0:9615:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5714000/0xe64d3fbf12a7f241 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.035982:0:9615:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5714000/0xe64d3fbf12a7f241 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.035989:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5714000/0xe64d3fbf12a7f241 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.036050:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794227456:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 39999us (42245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147735.036059:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17120 00000100:00100000:3.0:1746147735.038034:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.038076:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794230272 00000100:00100000:0.0:1746147735.038085:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794230272 00000100:00100000:0.0:1746147735.038135:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12129 00000100:00100000:0.0:1746147735.038143:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+12:32565:x1830967794230272:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:0.0:1746147735.038238:0:5744:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147735.038260:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f209 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc996 expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.038275:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147735.038279:0:5744:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147735.038305:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147735.038318:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7c8 expref: 15 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.038324:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc800 expref: 15 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.038331:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7f0a4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8a8 expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.038338:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 6/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147735.038366:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7f0a4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8a8 expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.038382:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7f0a4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8a8 expref: 327 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.038393:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796561792:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147735.038484:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc800 expref: 15 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.038491:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc800 expref: 15 pid: 15085 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.038498:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796561920:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147735.038521:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7c8 expref: 15 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.038527:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7c8 expref: 15 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.038534:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d26680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796562048:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147735.038547:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cda9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.040513:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.040557:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.040621:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794230528 00000100:00100000:0.0:1746147735.040639:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794230400 00000100:00100000:2.0:1746147735.040641:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794230528 00000100:00100000:0.0:1746147735.040644:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794230400 00010000:00010000:2.0:1746147735.040676:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc800 expref: 16 pid: 15085 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.040676:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7f0a4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8a8 expref: 328 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.040717:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8766 00000100:00100000:2.0:1746147735.040722:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8767 00000100:00100000:0.0:1746147735.040725:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:1960:x1830967794230400:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147735.040728:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794230528:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147735.040739:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.040740:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.040745:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc800 expref: 16 pid: 15085 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.040745:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7f0a4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8a8 expref: 328 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.040756:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7f0a4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8a8 expref: 328 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.040764:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc800 expref: 16 pid: 15085 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.041120:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3200/0xe64d3fbf12a7f0a4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc8a8 expref: 328 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.041139:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796561792:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147735.041168:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147735.041173:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147735.041182:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147735.041183:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.041187:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.041193:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.041227:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794230528:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 499us (724us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147735.041230:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02d3600/0xe64d3fbf12a7efa1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc800 expref: 16 pid: 15085 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.041234:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8767 00000100:00100000:3.0:1746147735.041241:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796561920:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.041366:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:1960:x1830967794230400:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 641us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.041372:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8766 00000100:00100000:0.0:1746147735.041998:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.042072:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794230656 00000100:00100000:1.0:1746147735.042076:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794230656 00010000:00010000:1.0:1746147735.042095:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7c8 expref: 15 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.042127:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8768 00000100:00100000:1.0:1746147735.042133:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1958:x1830967794230656:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.042143:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.042147:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7c8 expref: 15 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.042156:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7c8 expref: 15 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.042173:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147735.042176:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147735.042184:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147735.042190:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147735.042209:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147735.042358:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094813600/0xe64d3fbf12a7ef4d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc7c8 expref: 15 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.042369:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d26680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796562048:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.042397:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147735.042404:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147735.042408:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147735.043250:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794230656:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1113us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.043259:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8768 00000040:00080000:3.0:1746147735.043715:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3722, 88 off311912 00000004:00080000:3.0:1746147735.043724:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814217839050ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.043958:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3725, 88 off311824 00000004:00080000:3.0:1746147735.043964:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814218079224ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147735.043990:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3726, 88 off311912 00000004:00080000:3.0:1746147735.043993:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814218108958ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147735.044001:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3723, 88 off312000 00000004:00080000:3.0:1746147735.044004:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814218119188ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.044010:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3724, 88 off312088 00000004:00080000:3.0:1746147735.044012:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814218128001ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.044019:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3727, 88 off312000 00000004:00080000:3.0:1746147735.044021:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814218136961ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147735.044028:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3728, 88 off312088 00000004:00080000:3.0:1746147735.044031:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814218146141ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147735.044037:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3729, 88 off312176 00000004:00080000:3.0:1746147735.044038:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814218154114ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147735.044045:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3725, 88 off312176 00000004:00080000:3.0:1746147735.044047:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814218162621ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.044054:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3730, 88 off312264 00000004:00080000:3.0:1746147735.044056:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814218171984ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147735.044062:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3726, 88 off312264 00000004:00080000:3.0:1746147735.044065:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814218180656ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.044072:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3731, 88 off312352 00000004:00080000:3.0:1746147735.044074:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814218189684ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147735.044080:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3727, 88 off312352 00000004:00080000:3.0:1746147735.044082:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814218197723ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.044088:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3728, 88 off312440 00000004:00080000:3.0:1746147735.044091:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814218206281ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.044097:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3729, 88 off312528 00000004:00080000:3.0:1746147735.044099:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814218214964ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.044105:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3730, 88 off312616 00000004:00080000:3.0:1746147735.044107:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814218222344ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.044113:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3732, 88 off312440 00000004:00080000:3.0:1746147735.044115:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814218230154ns, next at 756024029964ns, rc = 0 00000004:00010000:3.0:1746147735.065332:0:5744:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a0224e00 reply state ffff88009c181c00 transno 8589946164 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:3.0:1746147735.065348:0:5744:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746147735.065356:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946159 is committed 00000001:00080000:0.0:1746147735.065367:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946161 is committed 00000001:00080000:0.0:1746147735.065371:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946160 is committed 00000001:00080000:0.0:1746147735.065379:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946154 is committed 00000001:00080000:0.0:1746147735.065390:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946164 is committed 00000004:00080000:0.0:1746147735.065393:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2799 committed 00000004:00080000:0.0:1746147735.065409:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2797 committed 00000004:00080000:0.0:1746147735.065415:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2796 committed 00000004:00080000:0.0:1746147735.065417:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2795 committed 00000004:00080000:0.0:1746147735.065419:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2794 committed 00000004:00080000:0.0:1746147735.065420:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2798 committed 00000004:00080000:0.0:1746147735.065421:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2793 committed 00000004:00080000:0.0:1746147735.065422:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2797 committed 00000004:00080000:0.0:1746147735.065424:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2792 committed 00000004:00080000:0.0:1746147735.065425:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2796 committed 00000004:00080000:0.0:1746147735.065426:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2795 committed 00000004:00080000:0.0:1746147735.065428:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2794 committed 00000004:00080000:0.0:1746147735.065430:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2791 committed 00000004:00080000:0.0:1746147735.065431:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2790 committed 00000004:00080000:0.0:1746147735.065433:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2793 committed 00000004:00080000:0.0:1746147735.065435:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2792 committed 00000004:00080000:0.0:1746147735.065436:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2789 committed 00010000:00080000:3.0:1746147735.065453:0:5744:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147735.065468:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+8:32565:x1830967794230272:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 27322us (27437us total) trans 8589946164 rc 0/0 00000100:00100000:3.0:1746147735.065476:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12129 00000100:00100000:1.0:1746147735.065514:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796562176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147735.065523:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796562304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147735.065860:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147735.065868:0:3288:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147735.065876:0:3288:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147735.065899:0:3288:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147735.065905:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147735.065906:0:3288:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a59f8200 already unused, calling callback (ffffffffa1369690) 00000100:00100000:0.0:1746147735.065909:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796562688:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147735.065910:0:3288:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147735.065917:0:3288:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147735.065923:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796562816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147735.065927:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147735.065932:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147735.065935:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746147735.065939:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796563328:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147735.065940:0:3288:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147735.065941:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147735.065945:0:3288:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59f8200/0xe64d3fbf12a7f25d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147735.065952:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796563200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147735.065953:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147735.065961:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796562432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.065966:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.065966:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796563840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.065977:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796563712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.065978:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147735.065993:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796562944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.065993:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.065994:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796562304 00000100:00100000:0.0:1746147735.066001:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796562304 00000100:00100000:3.0:1746147735.066005:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.066007:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746147735.066011:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796562560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.066013:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796563456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.066023:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147735.066028:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796562176 00000100:00100000:3.0:1746147735.066031:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796562176 00000100:00100000:1.0:1746147735.066031:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796563072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.066046:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.066437:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796563584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.066453:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.066682:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796562688 00000100:00100000:0.0:1746147735.066686:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796562688 00000100:00100000:3.0:1746147735.066705:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796562816 00000100:00100000:0.0:1746147735.066708:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796563328 00000100:00100000:3.0:1746147735.066709:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796562816 00000100:00100000:0.0:1746147735.066710:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796563328 00000100:00100000:0.0:1746147735.066717:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796563200 00000100:00100000:0.0:1746147735.066719:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796563200 00000100:00100000:3.0:1746147735.066722:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796562432 00000100:00100000:3.0:1746147735.066723:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796562432 00000100:00100000:0.0:1746147735.066727:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796563712 00000100:00100000:0.0:1746147735.066728:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796563712 00000100:00100000:3.0:1746147735.066730:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796562944 00000100:00100000:3.0:1746147735.066731:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796562944 00000100:00100000:0.0:1746147735.066736:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796562560 00000100:00100000:3.0:1746147735.066737:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796563072 00000100:00100000:3.0:1746147735.066738:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796563072 00000100:00100000:0.0:1746147735.066738:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796562560 00000100:00100000:0.0:1746147735.066747:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17124 00000100:00100000:0.0:1746147735.066752:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3301:x1830967796562304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.066769:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796564096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.066784:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.066806:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796563584 00000100:00100000:1.0:1746147735.066809:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796563584 00000100:00100000:2.0:1746147735.066831:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796564096 00000100:00100000:2.0:1746147735.066834:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796564096 00000100:00100000:3.0:1746147735.066956:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17125 00000100:00100000:0.0:1746147735.066957:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3301:x1830967796562304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (1097us total) trans 21474841697 rc 0/0 00000100:00100000:3.0:1746147735.066963:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3304:x1830967796562176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147735.066964:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17124 00000100:00100000:1.0:1746147735.066975:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17126 00000100:00100000:0.0:1746147735.066978:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17127 00000100:00100000:1.0:1746147735.066980:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:3301:x1830967796562688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.066982:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+55:3301:x1830967796563328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.067010:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17128 00000100:00100000:1.0:1746147735.067014:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3304:x1830967796562816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.067067:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3304:x1830967796562176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (1162us total) trans 21474841698 rc 0/0 00000100:00100000:3.0:1746147735.067073:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17125 00000100:00100000:3.0:1746147735.067084:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17129 00000100:00100000:3.0:1746147735.067087:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3304:x1830967796563200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.067092:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3304:x1830967796562816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (1151us total) trans 21474841699 rc 0/0 00000100:00100000:1.0:1746147735.067097:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17128 00000100:00100000:1.0:1746147735.067106:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17130 00000100:00100000:1.0:1746147735.067110:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3302:x1830967796562432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147735.067155:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3304:x1830967796563200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1187us total) trans 21474841700 rc 0/0 00000100:00100000:3.0:1746147735.067160:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17129 00000100:00100000:3.0:1746147735.067169:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17131 00000100:00100000:3.0:1746147735.067172:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+51:3304:x1830967796563712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.067201:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3302:x1830967796562432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (1222us total) trans 17179874467 rc 0/0 00000100:00100000:1.0:1746147735.067206:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17130 00000100:00100000:1.0:1746147735.067214:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17132 00000100:00100000:1.0:1746147735.067218:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3302:x1830967796562944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.067239:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3304:x1830967796563712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1245us total) trans 21474841701 rc 0/0 00000100:00100000:3.0:1746147735.067244:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17131 00002000:00010000:1.0:1746147735.067283:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:1.0:1746147735.067287:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147735.067289:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147735.067292:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147735.067294:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:1.0:1746147735.067311:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3302:x1830967796562944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (1305us total) trans 21474841702 rc 0/0 00000100:00100000:1.0:1746147735.067316:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17132 00000100:00100000:1.0:1746147735.067325:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17133 00000100:00100000:1.0:1746147735.067328:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3304:x1830967796562560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147735.067344:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+56:3301:x1830967796563328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 361us (1389us total) trans 17179874468 rc 0/0 00000100:00100000:0.0:1746147735.067351:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17127 00000100:00100000:0.0:1746147735.067360:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17134 00000100:00100000:0.0:1746147735.067365:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+55:3304:x1830967796563072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.067398:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3304:x1830967796562560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1373us total) trans 21474841703 rc 0/0 00000100:00100000:1.0:1746147735.067403:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17133 00000100:00100000:1.0:1746147735.067411:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17135 00000100:00100000:1.0:1746147735.067416:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3304:x1830967796563584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147735.067854:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17136 00000100:00100000:3.0:1746147735.067861:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3304:x1830967796564096:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746147735.067942:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147735.067945:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147735.068000:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147735.068017:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796563456 00000100:00100000:2.0:1746147735.068023:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796563456 00000100:00100000:3.0:1746147735.068033:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796563968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147735.068040:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17137 00000100:00100000:2.0:1746147735.068045:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3302:x1830967796563456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147735.068048:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.068052:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.068074:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147735.068086:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d26d80/2, rc 0, transno 17179874467 00000100:00100000:3.0:1746147735.068096:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796562432:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147735.068102:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800951d5880/2, rc 0, transno 21474841697 00000004:00080000:3.0:1746147735.068104:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a08ab100/2, rc 0, transno 21474841702 00000100:00100000:0.0:1746147735.068106:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796562304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.068107:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796562944:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147735.068115:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d25c00/2, rc 0, transno 17179874468 00000100:00100000:3.0:1746147735.068119:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796563968 00000100:00100000:0.0:1746147735.068119:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796563328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147735.068122:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796563968 00000100:00100000:0.0:1746147735.068134:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796563840 00000100:00100000:3.0:1746147735.068136:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17138 00000100:00100000:0.0:1746147735.068137:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796563840 00000100:00100000:2.0:1746147735.068138:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3302:x1830967796563456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (138us total) trans 21474841704 rc 0/0 00000100:00100000:3.0:1746147735.068140:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3302:x1830967796563968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147735.068144:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17137 00000100:00100000:0.0:1746147735.068152:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17139 00000100:00100000:0.0:1746147735.068156:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3301:x1830967796563840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147735.068234:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+59:3302:x1830967796563968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (180us total) trans 17179874470 rc 0/0 00000100:00100000:3.0:1746147735.068240:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17138 00000004:00080000:3.0:1746147735.068260:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d0dd880/2, rc 0, transno 21474841704 00000100:00100000:3.0:1746147735.068264:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796563456:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147735.068270:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800941b0e00/2, rc 0, transno 17179874470 00000100:00100000:3.0:1746147735.068273:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796563968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147735.068284:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794230784 00000100:00100000:3.0:1746147735.068286:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794230784 00000100:00100000:3.0:1746147735.068306:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12130 00000100:00100000:3.0:1746147735.068310:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+7:32565:x1830967794230784:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147735.068324:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.068340:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f264 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc9b2 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.068341:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3304:x1830967796563584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 925us (1887us total) trans 17179874471 rc 0/0 00000100:00100000:1.0:1746147735.068347:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17135 00000004:00080000:1.0:1746147735.068381:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800951d5180/2, rc 0, transno 21474841703 00000100:00100000:1.0:1746147735.068384:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796562560:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147735.068392:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800943c6300/2, rc 0, transno 17179874471 00010000:00010000:3.0:1746147735.068393:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f264 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9b2 expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.068395:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796563584:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147735.068401:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800951d5c00/2, rc 0, transno 21474841698 00010000:00010000:3.0:1746147735.068404:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f264 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9b2 expref: 8 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.068404:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796562176:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147735.068409:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800951d4380/2, rc 0, transno 21474841699 00000100:00100000:1.0:1746147735.068412:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796562816:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746147735.068416:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00000004:00080000:1.0:1746147735.068417:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d0ddc00/2, rc 0, transno 21474841700 00010000:00010000:3.0:1746147735.068418:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746147735.068420:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796563200:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746147735.068421:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0000, rc 0) 00000004:00080000:1.0:1746147735.068425:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d0df800/2, rc 0, transno 21474841701 00000100:00100000:1.0:1746147735.068427:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796563712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.068448:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+8:32565:x1830967794230784:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 137us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.068453:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12130 00000100:00100000:1.0:1746147735.068470:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3304:x1830967796563072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1105us (2423us total) trans 17179874469 rc 0/0 00000100:00100000:1.0:1746147735.068475:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17134 00000004:00080000:1.0:1746147735.068490:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d24e00/2, rc 0, transno 17179874469 00000100:00100000:1.0:1746147735.068493:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796563072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.068607:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3301:x1830967796563840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 449us (531us total) trans 17179874472 rc 0/0 00000100:00100000:0.0:1746147735.068612:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17139 00000004:00080000:2.0:1746147735.068614:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800943c7800/2, rc 0, transno 17179874472 00000100:00100000:2.0:1746147735.068617:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796563840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147735.068675:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796564224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147735.068692:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.068710:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796564224 00000100:00100000:0.0:1746147735.068713:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796564224 00000100:00100000:0.0:1746147735.068727:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17140 00000100:00100000:0.0:1746147735.068732:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3304:x1830967796564224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.068811:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3304:x1830967796564224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (117us total) trans 17179874473 rc 0/0 00000100:00100000:0.0:1746147735.068817:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17140 00000100:00100000:1.0:1746147735.069040:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:3301:x1830967796562688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2060us (3111us total) trans 17179874474 rc 0/0 00000100:00100000:1.0:1746147735.069045:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17126 00000004:00080000:2.0:1746147735.069152:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d26680/2, rc 0, transno 17179874474 00000100:00100000:2.0:1746147735.069156:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796562688:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147735.069168:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135811f80/2, rc 0, transno 17179874473 00000100:00100000:2.0:1746147735.069171:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796564224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147735.069176:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3304:x1830967796564096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1316us (2390us total) trans 17179874475 rc 0/0 00000004:00080000:2.0:1746147735.069177:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800941b1500/2, rc 0, transno 17179874475 00000100:00100000:2.0:1746147735.069180:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796564096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147735.069181:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17136 00000100:00100000:3.0:1746147735.071701:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.071756:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794230912 00000100:00100000:2.0:1746147735.071765:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794230912 00000100:00100000:2.0:1746147735.071818:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12131 00000100:00100000:2.0:1746147735.071826:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41587371-240a-4781-aecb-638f17200fbd+8:32565:x1830967794230912:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147735.071845:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.071864:0:15085:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f26b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc9b9 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.071969:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7f272 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.071981:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7f272 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.071989:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7f272 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00000004:00200000:2.0:1746147735.072008:0:15085:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147735.072011:0:15085:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147735.072023:0:15085:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7f272 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.072041:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f26b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9b9 expref: 10 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.072053:0:15085:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7f272 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9b9 expref: 9 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.072060:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.072063:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147735.072065:0:15085:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736a000, rc 0) 00000100:00100000:2.0:1746147735.072118:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41587371-240a-4781-aecb-638f17200fbd+9:32565:x1830967794230912:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 292us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.072125:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12131 00000100:00100000:0.0:1746147735.075245:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.075288:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.075314:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.075332:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.075347:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.075386:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.075413:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794231040 00000100:00100000:0.0:1746147735.075422:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794231040 00000100:00100000:0.0:1746147735.075462:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794231168 00000100:00100000:0.0:1746147735.075464:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794231168 00000100:00100000:0.0:1746147735.075494:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794231296 00000100:00100000:0.0:1746147735.075497:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794231296 00000100:00100000:0.0:1746147735.075508:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794231552 00000100:00100000:0.0:1746147735.075510:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794231552 00000100:00100000:0.0:1746147735.075519:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794231424 00000100:00100000:0.0:1746147735.075521:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794231424 00000100:00100000:0.0:1746147735.075531:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794231680 00000100:00100000:0.0:1746147735.075533:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794231680 00000100:00100000:0.0:1746147735.075547:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17141 00000100:00100000:0.0:1746147735.075555:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794231040:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147735.075575:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147735.075585:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17142 00000100:00100000:2.0:1746147735.075594:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794231168:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147735.075602:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.075635:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7f279 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc9c7 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147735.075662:0:8469:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x68141997, atime: 0x68141997, ctime: 0x68141997, blocks: 0x81b 00010000:00010000:2.0:1746147735.075685:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.075687:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.075698:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7f279 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c7 expref: 12 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.075713:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7f279 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c7 expref: 12 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.075723:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736bc00, rc 0) 00000100:00100000:2.0:1746147735.075770:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794231168:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 178us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.075776:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17142 00000100:00100000:2.0:1746147735.075800:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17143 00000100:00100000:2.0:1746147735.075805:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794231296:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147735.075811:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.075818:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a736b800/0xe64d3fbf12a7f280 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc9ce expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147735.075829:0:8469:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x68141996, atime: 0x68141996, ctime: 0x68141996, blocks: 0x821 00010000:00010000:2.0:1746147735.075835:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.075837:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.075841:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736b800/0xe64d3fbf12a7f280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ce expref: 12 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.075853:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a736b800/0xe64d3fbf12a7f280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ce expref: 12 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.075861:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736b800, rc 0) 00000100:00100000:2.0:1746147735.075875:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794231296:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 71us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.075880:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17143 00000100:00100000:2.0:1746147735.075917:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17144 00000100:00100000:2.0:1746147735.075922:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794231552:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147735.075928:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147735.076206:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17145 00000100:00100000:3.0:1746147735.076213:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794231424:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147735.076215:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f287 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc9c0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.076220:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.076227:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f28e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc9d5 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147735.076233:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x68141997, atime: 0x68141997, ctime: 0x68141997, blocks: 0x7fd 00002000:00010000:3.0:1746147735.076239:0:20619:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x68141997, atime: 0x68141996, ctime: 0x68141997, blocks: 0x81f 00010000:00010000:0.0:1746147735.076242:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.076245:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.076245:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.076246:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.076250:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f287 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c0 expref: 12 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.076256:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f28e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9d5 expref: 12 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.076260:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f287 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c0 expref: 12 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.076264:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f28e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9d5 expref: 12 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.076266:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8ea800, rc 0) 00010000:00010000:3.0:1746147735.076270:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0c00, rc 0) 00000100:00100000:3.0:1746147735.076283:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794231424:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 72us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147735.076283:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794231040:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 730us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.076288:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17145 00000100:00100000:0.0:1746147735.076299:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17141 00000100:00100000:3.0:1746147735.076301:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17146 00000100:00100000:3.0:1746147735.076306:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794231680:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147735.076312:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.076320:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f295 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc9e3 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147735.076330:0:20619:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x456:0x0] initial LVB size: 4194304, mtime: 0x68141996, atime: 0x68141996, ctime: 0x68141996, blocks: 0x1029 00010000:00010000:3.0:1746147735.076339:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.076341:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.076344:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9e3 expref: 12 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.076358:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9e3 expref: 12 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.076364:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a1e00, rc 0) 00000100:00100000:3.0:1746147735.076380:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794231680:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 73us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.076384:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17146 00010000:00010000:2.0:1746147735.076390:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a736a400/0xe64d3fbf12a7f29c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc9dc expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147735.076404:0:8469:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x458:0x0] initial LVB size: 5013696, mtime: 0x68141997, atime: 0x68141996, ctime: 0x68141997, blocks: 0x1691 00010000:00010000:2.0:1746147735.076413:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.076414:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.076418:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a736a400/0xe64d3fbf12a7f29c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9dc expref: 11 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.076428:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a736a400/0xe64d3fbf12a7f29c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9dc expref: 11 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.076435:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736a400, rc 0) 00000100:00100000:2.0:1746147735.076452:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794231552:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 530us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.076460:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17144 00000100:00100000:0.0:1746147735.087046:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.087101:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.087168:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794231936 00000100:00100000:3.0:1746147735.087179:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794231936 00000100:00100000:2.0:1746147735.087182:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794232192 00000100:00100000:2.0:1746147735.087187:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794232192 00000100:00100000:3.0:1746147735.087254:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7733 00000100:00100000:2.0:1746147735.087260:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7734 00000100:00100000:3.0:1746147735.087263:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41587371-240a-4781-aecb-638f17200fbd+11:1958:x1830967794231936:12345-192.168.202.10@tcp:3:lfs.0 00000100:00100000:2.0:1746147735.087267:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41587371-240a-4781-aecb-638f17200fbd+12:1958:x1830967794232192:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:2.0:1746147735.087304:0:8475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a54a4000/0xe64d3fbf12a7f2a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.087319:0:8475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.087321:0:8475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.087327:0:8475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a4000/0xe64d3fbf12a7f2a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.087341:0:8475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a54a4000/0xe64d3fbf12a7f2a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.087495:0:21458:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7f2aa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.087513:0:21458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.087515:0:21458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.087520:0:21458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7f2aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.087534:0:21458:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7f2aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.095543:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.095583:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.095608:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.095622:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.095696:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794232704 00000100:00100000:1.0:1746147735.095707:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794232704 00000100:00100000:1.0:1746147735.095764:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794232576 00000100:00100000:1.0:1746147735.095767:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794232576 00000100:00100000:1.0:1746147735.095782:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794232832 00000100:00100000:1.0:1746147735.095784:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794232832 00000100:00100000:1.0:1746147735.095794:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794233216 00000100:00100000:1.0:1746147735.095796:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794233216 00000100:00100000:2.0:1746147735.095802:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7735 00000100:00100000:2.0:1746147735.095813:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41587371-240a-4781-aecb-638f17200fbd+15:1957:x1830967794232704:12345-192.168.202.10@tcp:3:lfs.0 00000100:00100000:1.0:1746147735.095828:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7736 00000100:00100000:1.0:1746147735.095835:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41587371-240a-4781-aecb-638f17200fbd+15:1957:x1830967794232576:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:2.0:1746147735.095849:0:31357:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a54a4600/0xe64d3fbf12a7f2b1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.095851:0:31355:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092c24400/0xe64d3fbf12a7f2b8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.095863:0:31357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.095863:0:31355:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.095864:0:31355:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.095865:0:31357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.095869:0:31357:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54a4600/0xe64d3fbf12a7f2b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.095869:0:31355:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092c24400/0xe64d3fbf12a7f2b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.095904:0:31357:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54a4600/0xe64d3fbf12a7f2b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.095906:0:31355:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092c24400/0xe64d3fbf12a7f2b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.096537:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.096569:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.096591:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794233088 00000100:00100000:0.0:1746147735.096595:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794233088 00000100:00100000:0.0:1746147735.096621:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794233344 00000100:00100000:0.0:1746147735.096641:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794233344 00000100:00100000:0.0:1746147735.096660:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7737 00000100:00100000:0.0:1746147735.096666:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41587371-240a-4781-aecb-638f17200fbd+15:1957:x1830967794232832:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:0.0:1746147735.096684:0:31354:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7f2bf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.096693:0:31354:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.096695:0:31354:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.096698:0:31354:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7f2bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.096707:0:31354:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7f2bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.097077:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7738 00000100:00100000:3.0:1746147735.097094:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41587371-240a-4781-aecb-638f17200fbd+16:1957:x1830967794233216:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:3.0:1746147735.097134:0:2402:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f2c6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.097146:0:2402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.097147:0:2402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.097151:0:2402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f2c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.097161:0:2402:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f2c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.097473:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7739 00000100:00100000:3.0:1746147735.097479:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41587371-240a-4781-aecb-638f17200fbd+16:1957:x1830967794233088:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:3.0:1746147735.097493:0:31359:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2cd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.097500:0:31359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.097501:0:31359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.097503:0:31359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.097511:0:31359:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.097860:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7740 00000100:00100000:3.0:1746147735.097867:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41587371-240a-4781-aecb-638f17200fbd+16:1957:x1830967794233344:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:3.0:1746147735.097913:0:21459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2d4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.097921:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.097922:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.097925:0:21459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.097933:0:21459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.103512:0:8475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a54a4000/0xe64d3fbf12a7f2a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.103535:0:8475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54a4000/0xe64d3fbf12a7f2a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.103544:0:8475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a54a4000/0xe64d3fbf12a7f2a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.103551:0:8475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54a4000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147735.103556:0:8475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a54a4000/0xe64d3fbf12a7f2a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.103566:0:8475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a54a4000/0xe64d3fbf12a7f2a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.103588:0:8475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a54a4000/0xe64d3fbf12a7f2a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.103594:0:8475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54a4000/0xe64d3fbf12a7f2a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.103696:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41587371-240a-4781-aecb-638f17200fbd+18:1958:x1830967794232192:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 16421us (16586us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.103707:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7734 00010000:00010000:2.0:1746147735.103718:0:21458:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7f2aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.103727:0:21458:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7f2aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.103733:0:21458:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7f2aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.103738:0:21458:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02a0200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147735.103740:0:21458:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7f2aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.103747:0:21458:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7f2aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.103757:0:21458:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7f2aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.103761:0:21458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0200/0xe64d3fbf12a7f2aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.103804:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41587371-240a-4781-aecb-638f17200fbd+17:1958:x1830967794231936:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 16542us (16769us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147735.103811:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7733 00010000:00010000:2.0:1746147735.107863:0:31357:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a54a4600/0xe64d3fbf12a7f2b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.107921:0:31357:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54a4600/0xe64d3fbf12a7f2b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.107929:0:31357:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a54a4600/0xe64d3fbf12a7f2b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.107935:0:31357:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54a4600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147735.107939:0:31357:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a54a4600/0xe64d3fbf12a7f2b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.107945:0:31357:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a54a4600/0xe64d3fbf12a7f2b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.107963:0:31357:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a54a4600/0xe64d3fbf12a7f2b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.107969:0:31357:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54a4600/0xe64d3fbf12a7f2b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.108053:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41587371-240a-4781-aecb-638f17200fbd+15:1957:x1830967794232704:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 12238us (12515us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147735.108063:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7735 00010000:00010000:0.0:1746147735.115183:0:31354:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7f2bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.115201:0:31354:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7f2bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.115210:0:31354:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7f2bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.115216:0:31354:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8eac00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147735.115220:0:31354:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7f2bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.115228:0:31354:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7f2bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.115248:0:31354:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7f2bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.115254:0:31354:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8eac00/0xe64d3fbf12a7f2bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31354 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.115333:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41587371-240a-4781-aecb-638f17200fbd+13:1957:x1830967794232832:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 18660us (19717us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147735.115344:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7737 00010000:00010000:2.0:1746147735.116096:0:31355:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092c24400/0xe64d3fbf12a7f2b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.116111:0:31355:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092c24400/0xe64d3fbf12a7f2b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.116125:0:31355:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092c24400/0xe64d3fbf12a7f2b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.116131:0:31355:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092c24400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147735.116134:0:31355:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092c24400/0xe64d3fbf12a7f2b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.116141:0:31355:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092c24400/0xe64d3fbf12a7f2b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.116158:0:31355:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092c24400/0xe64d3fbf12a7f2b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.116163:0:31355:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092c24400/0xe64d3fbf12a7f2b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.116244:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967794232576:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 20406us (20657us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147735.116252:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7736 00010000:00010000:3.0:1746147735.124757:0:21459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.124777:0:21459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.124784:0:21459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.124790:0:21459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02a1600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147735.124794:0:21459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.124802:0:21459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.124822:0:21459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.124827:0:21459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.124953:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41587371-240a-4781-aecb-638f17200fbd+16:1957:x1830967794233344:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 27082us (28378us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.124963:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7740 00010000:00010000:3.0:1746147735.130425:0:31359:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.130446:0:31359:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.130454:0:31359:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.130638:0:31359:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02a1a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147735.130642:0:31359:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.130649:0:31359:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.130669:0:31359:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.130674:0:31359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.130758:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:41587371-240a-4781-aecb-638f17200fbd+14:1957:x1830967794233088:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 33273us (34218us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.130767:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7739 00010000:00010000:3.0:1746147735.135826:0:2402:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f2c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.135848:0:2402:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f2c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.135856:0:2402:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f2c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.135863:0:2402:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02a1c00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147735.135868:0:2402:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f2c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.135876:0:2402:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f2c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.135950:0:2402:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f2c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.135958:0:2402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f2c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.136768:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967794233216:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 39286us (40749us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.136783:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7738 00000100:00100000:0.0:1746147735.139967:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.140116:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794233728 00000100:00100000:2.0:1746147735.140127:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794233728 00000100:00100000:2.0:1746147735.140191:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12132 00000100:00100000:2.0:1746147735.140199:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41587371-240a-4781-aecb-638f17200fbd+9:32565:x1830967794233728:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:2.0:1746147735.140254:0:15085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.140283:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a736a000/0xe64d3fbf12a7f272 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9b9 expref: 9 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.140309:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.140313:0:15085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147735.140350:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298e00/0xe64d3fbf12a7f2db lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.140361:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298e00/0xe64d3fbf12a7f2db lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.140369:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298e00/0xe64d3fbf12a7f2db lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00000004:00010000:2.0:1746147735.140561:0:15085:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a5e34000 reply state ffff880094035000 transno 8589946165 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298e00/0xe64d3fbf12a7f2db lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00000100:00100000:2.0:1746147735.140567:0:15085:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147735.141069:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41587371-240a-4781-aecb-638f17200fbd+10:32565:x1830967794233728:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 867us (1111us total) trans 8589946165 rc 0/0 00000100:00100000:2.0:1746147735.141076:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12132 00010000:00010000:3.0:1746147735.142687:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298e00/0xe64d3fbf12a7f2db lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.142703:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298e00/0xe64d3fbf12a7f2db lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 00000100:00100000:0.0:1746147735.142713:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147735.142715:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298e00/0xe64d3fbf12a7f2db lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.142721:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0298e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147735.142727:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298e00/0xe64d3fbf12a7f2db lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.142734:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298e00/0xe64d3fbf12a7f2db lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.142752:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147735.142755:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147735.142760:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298e00/0xe64d3fbf12a7f2db lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.142765:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298e00/0xe64d3fbf12a7f2db lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00000100:00100000:2.0:1746147735.142926:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794233856 00000100:00100000:2.0:1746147735.142935:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794233856 00000100:00100000:2.0:1746147735.142992:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17147 00000100:00100000:2.0:1746147735.143000:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+11:32565:x1830967794233856:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147735.143018:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.143032:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f2e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc9ea expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.143058:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f287 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c0 expref: 12 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.143070:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.143072:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.143075:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f2e2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ea expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.143239:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f287 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c0 expref: 12 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.143252:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f287 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c0 expref: 12 pid: 8468 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147735.143265:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796564352:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.143385:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2b2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.144790:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796564352:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.144822:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f2e2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ea expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.144841:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a650fa00, rc 0) 00000100:00100000:3.0:1746147735.144926:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+12:32565:x1830967794233856:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1925us (2216us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.144937:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17147 00000100:00100000:0.0:1746147735.145379:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.145445:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794233984 00000100:00100000:1.0:1746147735.145453:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794233984 00010000:00010000:1.0:1746147735.145480:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f287 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c0 expref: 12 pid: 8468 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.145557:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8769 00000100:00100000:1.0:1746147735.145564:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794233984:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.145577:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.145603:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f287 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c0 expref: 12 pid: 8468 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.145614:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f287 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c0 expref: 12 pid: 8468 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.145645:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f287 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c0 expref: 12 pid: 8468 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.145721:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.145723:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.145731:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f2e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ea expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.145739:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f2e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ea expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.145767:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f2e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ea expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.145779:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796564480:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147735.145840:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.146864:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796564480:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147735.146880:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147735.146945:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794233984:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1380us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.146957:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8769 00000100:00100000:0.0:1746147735.147158:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.147289:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794234112 00000100:00100000:3.0:1746147735.147294:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794234112 00000100:00100000:3.0:1746147735.147328:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17148 00000100:00100000:3.0:1746147735.147332:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+12:32565:x1830967794234112:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147735.147346:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.147360:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc9f1 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.147388:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7f279 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c7 expref: 13 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.147396:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.147397:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.147400:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2e9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f1 expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.147423:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7f279 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c7 expref: 13 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.147433:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7f279 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c7 expref: 13 pid: 8469 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147735.147449:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0227100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796564608:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.147503:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.148538:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0227100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796564608:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147735.148547:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147735.148561:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2e9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f1 expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.148576:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a1a00, rc 0) 00000100:00100000:3.0:1746147735.148619:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+13:32565:x1830967794234112:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1285us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.148637:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17148 00000100:00100000:1.0:1746147735.148655:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794234240 00000100:00100000:1.0:1746147735.148661:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794234240 00010000:00010000:1.0:1746147735.148679:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7f279 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c7 expref: 13 pid: 8469 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.148714:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8770 00000100:00100000:1.0:1746147735.148721:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794234240:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.148730:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.148749:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7f279 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c7 expref: 13 pid: 8469 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.148759:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7f279 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c7 expref: 13 pid: 8469 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.148783:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a736bc00/0xe64d3fbf12a7f279 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9c7 expref: 13 pid: 8469 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.148794:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.148795:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.148800:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f1 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.148807:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f1 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.148832:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f1 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.148841:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796564736:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147735.148913:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.150030:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796564736:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147735.150043:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147735.150055:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.150072:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794234240:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1351us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.150079:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8770 00000100:00100000:3.0:1746147735.150103:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794234368 00000100:00100000:3.0:1746147735.150108:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794234368 00000100:00100000:3.0:1746147735.150138:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17149 00000100:00100000:3.0:1746147735.150144:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+12:32565:x1830967794234368:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147735.150160:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.150174:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc9f8 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.150195:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a736b800/0xe64d3fbf12a7f280 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ce expref: 13 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.150202:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.150204:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.150207:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2f0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f8 expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.150231:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a736b800/0xe64d3fbf12a7f280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ce expref: 13 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.150242:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a736b800/0xe64d3fbf12a7f280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ce expref: 13 pid: 8469 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147735.150251:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0227100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796564864:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.150304:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.151013:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0227100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796564864:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.151031:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f8 expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.151043:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a1600, rc 0) 00000100:00100000:3.0:1746147735.151066:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+13:32565:x1830967794234368:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 921us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.151071:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17149 00000100:00100000:0.0:1746147735.151583:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.151831:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794234496 00000100:00100000:1.0:1746147735.151837:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794234496 00010000:00010000:1.0:1746147735.151860:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736b800/0xe64d3fbf12a7f280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ce expref: 13 pid: 8469 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.151920:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8771 00000100:00100000:1.0:1746147735.151926:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6673450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794234496:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.151937:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.151957:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a736b800/0xe64d3fbf12a7f280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ce expref: 13 pid: 8469 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.151967:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a736b800/0xe64d3fbf12a7f280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ce expref: 13 pid: 8469 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.151987:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a736b800/0xe64d3fbf12a7f280 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ce expref: 13 pid: 8469 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.152000:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.152001:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.152007:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f8 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.152014:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f8 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.152039:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f8 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.152055:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796564992:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147735.152539:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.153694:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796564992:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147735.153710:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147735.153730:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.153751:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6673450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794234496:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1825us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.153762:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8771 00000100:00100000:3.0:1746147735.153783:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794234624 00000100:00100000:3.0:1746147735.153788:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794234624 00000100:00100000:3.0:1746147735.153832:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17150 00000100:00100000:3.0:1746147735.153839:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+11:32565:x1830967794234624:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147735.153855:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.153870:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f2f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafc9ff expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.153916:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f28e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9d5 expref: 12 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.153923:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.153925:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.153928:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f2f7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ff expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.153951:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f28e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9d5 expref: 12 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.153963:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f28e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9d5 expref: 12 pid: 20619 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147735.153973:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0227100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796565120:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.154028:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.155355:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.155360:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0227100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796565120:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.155384:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f2f7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ff expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.155398:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0600, rc 0) 00000100:00100000:3.0:1746147735.155445:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+12:32565:x1830967794234624:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1605us (1715us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.155452:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17150 00000100:00100000:1.0:1746147735.155653:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794234752 00000100:00100000:1.0:1746147735.155660:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794234752 00010000:00010000:1.0:1746147735.155682:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f28e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9d5 expref: 12 pid: 20619 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.155703:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8772 00000100:00100000:1.0:1746147735.155709:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794234752:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.155719:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.155739:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f28e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9d5 expref: 12 pid: 20619 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.155749:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f28e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9d5 expref: 12 pid: 20619 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.155767:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f28e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9d5 expref: 12 pid: 20619 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.155778:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.155780:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.155786:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f2f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ff expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.155798:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f2f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ff expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.155821:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f2f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ff expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.155832:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796565248:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147735.155919:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.157024:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796565248:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147735.157040:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147735.157108:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794234752:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1397us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.157116:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8772 00000100:00100000:2.0:1746147735.157204:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.157265:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794234880 00000100:00100000:3.0:1746147735.157272:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794234880 00000100:00100000:3.0:1746147735.157355:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17151 00000100:00100000:3.0:1746147735.157362:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+11:32565:x1830967794234880:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147735.157376:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.157391:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f2fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca06 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.157412:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a736a400/0xe64d3fbf12a7f29c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9dc expref: 12 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.157418:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.157420:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.157423:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f2fe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca06 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.157449:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a736a400/0xe64d3fbf12a7f29c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9dc expref: 12 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.157459:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a736a400/0xe64d3fbf12a7f29c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9dc expref: 12 pid: 8469 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147735.157469:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0224700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796565376:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.157578:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.159398:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0224700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796565376:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.159423:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f2fe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca06 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.159439:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0e00, rc 0) 00000100:00100000:3.0:1746147735.159481:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+12:32565:x1830967794234880:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 2120us (2278us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.159487:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17151 00000100:00100000:2.0:1746147735.161418:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.161482:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794235008 00000100:00100000:1.0:1746147735.161491:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794235008 00010000:00010000:1.0:1746147735.161523:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a736a400/0xe64d3fbf12a7f29c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9dc expref: 12 pid: 8469 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.161562:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8773 00000100:00100000:1.0:1746147735.161570:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794235008:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.161585:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.161607:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a736a400/0xe64d3fbf12a7f29c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9dc expref: 12 pid: 8469 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.161636:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a736a400/0xe64d3fbf12a7f29c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9dc expref: 12 pid: 8469 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.161661:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a736a400/0xe64d3fbf12a7f29c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9dc expref: 12 pid: 8469 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.161688:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.161691:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.161698:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f2fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca06 expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.161706:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f2fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca06 expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.161739:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f2fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca06 expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.161751:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796565504:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147735.162984:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.166527:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.166670:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796565504:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147735.166691:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.166745:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794235008:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5170us (5329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.166756:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8773 00000100:00100000:3.0:1746147735.167066:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794235136 00000100:00100000:3.0:1746147735.167074:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794235136 00000100:00100000:3.0:1746147735.167113:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17152 00000100:00100000:3.0:1746147735.167119:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+12:32565:x1830967794235136:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147735.167137:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.167253:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f305 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca0d expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.167284:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f295 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9e3 expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.167291:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.167292:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.167296:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f305 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca0d expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.167324:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9e3 expref: 13 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.167335:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9e3 expref: 13 pid: 20619 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147735.167352:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0224700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796565632:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.167557:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.168690:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.168778:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0224700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796565632:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.168805:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f305 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca0d expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.168813:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794235264 00000100:00100000:2.0:1746147735.168819:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794235264 00010000:00010000:3.0:1746147735.168820:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736ac00, rc 0) 00010000:00010000:2.0:1746147735.168844:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9e3 expref: 14 pid: 20619 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147735.168862:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+14:32565:x1830967794235136:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1743us (2344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.168868:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17152 00000100:00100000:2.0:1746147735.168870:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8774 00000100:00100000:2.0:1746147735.168875:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794235264:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147735.168912:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.168976:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9e3 expref: 13 pid: 20619 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746147735.168988:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9e3 expref: 13 pid: 20619 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746147735.169013:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f295 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9e3 expref: 13 pid: 20619 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746147735.169031:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.169033:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.169040:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f305 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca0d expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.169046:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca0d expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.169071:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca0d expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.169081:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796565760:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147735.169166:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2b2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.171778:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.171810:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.171841:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.171858:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.171871:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.171939:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.172003:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794235392 00000100:00100000:2.0:1746147735.172013:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794235392 00000100:00100000:2.0:1746147735.172058:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794235520 00000100:00100000:2.0:1746147735.172061:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794235520 00000100:00100000:1.0:1746147735.172064:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794235776 00000100:00100000:1.0:1746147735.172069:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794235776 00000100:00100000:2.0:1746147735.172074:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794236032 00000100:00100000:2.0:1746147735.172076:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794236032 00000100:00100000:1.0:1746147735.172086:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794235648 00000100:00100000:1.0:1746147735.172088:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794235648 00000100:00100000:2.0:1746147735.172089:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794235904 00000100:00100000:2.0:1746147735.172090:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794235904 00000100:00100000:1.0:1746147735.172100:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17153 00000100:00100000:2.0:1746147735.172175:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17154 00000100:00100000:1.0:1746147735.172175:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+13:1959:x1830967794235392:12345-192.168.202.10@tcp:2:lfs.0 00000100:00100000:2.0:1746147735.172180:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+15:1959:x1830967794235520:12345-192.168.202.10@tcp:2:lfs.0 00002000:00010000:2.0:1746147735.172341:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147735.172341:0:6715:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147735.172343:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:1.0:1746147735.172344:0:6715:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:2.0:1746147735.172345:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:2.0:1746147735.172346:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147735 -> 1746147736 00002000:00010000:1.0:1746147735.172346:0:6715:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:2.0:1746147735.172347:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2075 -> 2075 00002000:00010000:1.0:1746147735.172348:0:6715:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147735 -> 1746147736 00002000:00010000:1.0:1746147735.172350:0:6715:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 2045 -> 2045 00000100:00100000:2.0:1746147735.172384:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+16:1959:x1830967794235520:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 204us (574us total) trans 21474841705 rc 0/0 00000100:00100000:3.0:1746147735.172412:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17155 00000100:00100000:2.0:1746147735.172416:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17154 00000100:00100000:3.0:1746147735.172420:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794235776:12345-192.168.202.10@tcp:2:lfs.0 00000100:00100000:2.0:1746147735.172428:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17156 00000100:00100000:2.0:1746147735.172431:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+15:1959:x1830967794236032:12345-192.168.202.10@tcp:2:lfs.0 00002000:00010000:2.0:1746147735.172471:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147735.172473:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147734 -> 1746147735 00002000:00010000:2.0:1746147735.172474:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147734 -> 1746147735 00002000:00010000:2.0:1746147735.172475:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147734 -> 1746147736 00002000:00010000:2.0:1746147735.172476:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00002000:00010000:3.0:1746147735.172494:0:22183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147735.172496:0:22183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:3.0:1746147735.172498:0:22183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147734 -> 1746147735 00002000:00010000:3.0:1746147735.172500:0:22183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147735 -> 1746147736 00002000:00010000:3.0:1746147735.172502:0:22183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147735.172532:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17157 00000100:00100000:0.0:1746147735.172540:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+16:1959:x1830967794235648:12345-192.168.202.10@tcp:2:lfs.0 00002000:00010000:0.0:1746147735.172836:0:8468:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147735.172839:0:8468:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147734 -> 1746147735 00002000:00010000:0.0:1746147735.172841:0:8468:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147734 -> 1746147735 00002000:00010000:0.0:1746147735.172843:0:8468:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147734 -> 1746147736 00002000:00010000:0.0:1746147735.172844:0:8468:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147735.172947:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+15:1959:x1830967794235392:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 839us (1180us total) trans 17179874476 rc 0/0 00000100:00100000:2.0:1746147735.172951:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+17:1959:x1830967794236032:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 518us (1091us total) trans 21474841706 rc 0/0 00000100:00100000:1.0:1746147735.172954:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17153 00000100:00100000:2.0:1746147735.172958:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17156 00000100:00100000:1.0:1746147735.172966:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17158 00000100:00100000:1.0:1746147735.172972:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794235904:12345-192.168.202.10@tcp:2:lfs.0 00000100:00100000:2.0:1746147735.173008:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796565760:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147735.173025:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1746147735.173035:0:6715:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:1.0:1746147735.173038:0:6715:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:1.0:1746147735.173039:0:6715:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147734 -> 1746147735 00002000:00010000:1.0:1746147735.173041:0:6715:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147735 -> 1746147736 00002000:00010000:1.0:1746147735.173043:0:6715:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:2.0:1746147735.173044:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+16:1960:x1830967794235264:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4169us (4359us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.173051:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8774 00000100:00100000:1.0:1746147735.173059:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+15:1959:x1830967794235904:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 88us (1120us total) trans 17179874478 rc 0/0 00000100:00100000:1.0:1746147735.173063:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17158 00000100:00100000:3.0:1746147735.173537:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794235776:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 1117us (1693us total) trans 17179874477 rc 0/0 00000100:00100000:3.0:1746147735.173543:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17155 00000100:00100000:0.0:1746147735.173620:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+15:1959:x1830967794235648:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 1082us (1747us total) trans 21474841707 rc 0/0 00000100:00100000:0.0:1746147735.173636:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17157 00000100:00100000:3.0:1746147735.176710:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.176776:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794236288 00000100:00100000:2.0:1746147735.176786:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794236288 00000100:00100000:2.0:1746147735.176829:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5068 00000100:00100000:2.0:1746147735.176837:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+9:32565:x1830967794236288:12345-192.168.202.10@tcp:35:lfs.0 00000004:00010000:2.0:1746147735.176932:0:14549:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x3bf:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0400/0xe64d3fbf12a7f225 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ab expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.176977:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746147735.176989:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f264 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9b2 expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.176996:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746147735.177028:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f264 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9b2 expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.177040:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f264 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9b2 expref: 9 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.177054:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14549:1830967796565888:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147735.177144:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2b2540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.178274:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14549:1830967796565888:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147735.178295:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746147735.178757:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.178931:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794236416 00000100:00100000:2.0:1746147735.178937:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794236416 00010000:00010000:2.0:1746147735.178965:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f264 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9b2 expref: 10 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.179008:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8775 00000100:00100000:2.0:1746147735.179015:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794236416:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147735.179028:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.179034:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f264 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9b2 expref: 10 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.179044:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f264 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9b2 expref: 10 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.179063:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f264 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9b2 expref: 10 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.179093:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.179098:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746147735.179106:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746147735.179112:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746147735.179142:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.179176:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794236416:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 161us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.179183:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8775 00010000:00010000:3.0:1746147735.179335:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147735.179347:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000040:00080000:3.0:1746147735.180521:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3731, 88 off312704 00000004:00080000:3.0:1746147735.180530:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814354644600ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.180585:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3733, 88 off312528 00000004:00080000:3.0:1746147735.180588:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814354703756ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147735.180607:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3734, 88 off312616 00000004:00080000:3.0:1746147735.180610:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814354725848ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147735.180617:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3732, 88 off312792 00000004:00080000:3.0:1746147735.180619:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814354734375ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.180632:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3733, 88 off312880 00000004:00080000:3.0:1746147735.180634:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814354749988ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.180640:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3735, 88 off312704 00000004:00080000:3.0:1746147735.180642:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814354757870ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147735.180648:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3736, 88 off312792 00000004:00080000:3.0:1746147735.180651:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814354766188ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147735.180656:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3737, 88 off312880 00000004:00080000:3.0:1746147735.180658:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814354773678ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147735.180663:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3734, 88 off312968 00000004:00080000:3.0:1746147735.180665:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814354780270ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.180670:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3738, 88 off312968 00000004:00080000:3.0:1746147735.180672:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814354787713ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147735.180677:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3735, 88 off313056 00000004:00080000:3.0:1746147735.180679:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814354794691ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.180684:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3739, 88 off313056 00000004:00080000:3.0:1746147735.180687:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814354802653ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147735.180692:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3736, 88 off313144 00000004:00080000:3.0:1746147735.180694:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814354809840ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.180699:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3737, 88 off313232 00000004:00080000:3.0:1746147735.180701:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814354816746ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.180706:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3738, 88 off313320 00000004:00080000:3.0:1746147735.180708:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814354823400ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.180712:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3739, 88 off313408 00000004:00080000:3.0:1746147735.180714:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814354829836ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147735.180719:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3740, 88 off313144 00000004:00080000:3.0:1746147735.180721:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814354836490ns, next at 756024029964ns, rc = 0 00000004:00010000:3.0:1746147735.214212:0:14549:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a0224700 reply state ffff88009fdcfc00 transno 8589946166 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746147735.214229:0:14549:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746147735.214240:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147735.214243:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147735.214252:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0400/0xe64d3fbf12a7f225 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ab expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.214368:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+9:32565:x1830967794236288:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 37529us (37668us total) trans 8589946166 rc 0/0 00000100:00100000:3.0:1746147735.214378:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5068 00000001:00080000:0.0:1746147735.215177:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946165 is committed 00000001:00080000:0.0:1746147735.215211:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946166 is committed 00000004:00080000:0.0:1746147735.215296:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2807 committed 00000004:00080000:0.0:1746147735.215309:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2806 committed 00000004:00080000:0.0:1746147735.215315:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2805 committed 00000004:00080000:0.0:1746147735.215317:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2804 committed 00000004:00080000:0.0:1746147735.215319:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2803 committed 00000004:00080000:0.0:1746147735.215320:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2806 committed 00000004:00080000:0.0:1746147735.215322:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2802 committed 00000004:00080000:0.0:1746147735.215323:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2805 committed 00000004:00080000:0.0:1746147735.215325:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2801 committed 00000004:00080000:0.0:1746147735.215326:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2804 committed 00000004:00080000:0.0:1746147735.215328:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2803 committed 00000004:00080000:0.0:1746147735.215329:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2802 committed 00000004:00080000:0.0:1746147735.215332:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2800 committed 00000004:00080000:0.0:1746147735.215334:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2799 committed 00000004:00080000:0.0:1746147735.215335:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2801 committed 00000004:00080000:0.0:1746147735.215336:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2800 committed 00000004:00080000:0.0:1746147735.215339:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2798 committed 00000100:00100000:0.0:1746147735.215561:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796566016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.215612:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.215673:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796566528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.215688:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.215704:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147735.215708:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796566144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.215719:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.215729:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796566656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.215739:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.215790:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796566400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.215805:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.215814:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796566912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.215826:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.215835:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746147735.215838:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796566272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.215850:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.215859:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796566784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.215870:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.215906:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796566016 00000100:00100000:0.0:1746147735.215913:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796566016 00000100:00100000:0.0:1746147735.215943:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796566528 00000100:00100000:0.0:1746147735.215945:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796566528 00000100:00100000:0.0:1746147735.215953:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796566144 00000100:00100000:0.0:1746147735.215954:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796566144 00000100:00100000:0.0:1746147735.215961:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796566656 00000100:00100000:0.0:1746147735.215963:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796566656 00000100:00100000:0.0:1746147735.215970:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796566400 00000100:00100000:0.0:1746147735.215972:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796566400 00000100:00100000:0.0:1746147735.215979:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796566912 00000100:00100000:0.0:1746147735.215981:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796566912 00000100:00100000:0.0:1746147735.215987:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796566272 00000100:00100000:0.0:1746147735.215989:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796566272 00000100:00100000:0.0:1746147735.215994:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796566784 00000100:00100000:0.0:1746147735.215995:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796566784 00000100:00100000:0.0:1746147735.216003:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17159 00000100:00100000:0.0:1746147735.216009:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3301:x1830967796566016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147735.216204:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147735.216207:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:0.0:1746147735.216209:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:0.0:1746147735.216211:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:0.0:1746147735.216213:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 2045 -> 2045 00000100:00100000:0.0:1746147735.216238:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3301:x1830967796566016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (626us total) trans 17179874479 rc 0/0 00000100:00100000:0.0:1746147735.216243:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17159 00000100:00100000:0.0:1746147735.216255:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17160 00000100:00100000:0.0:1746147735.216259:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3301:x1830967796566528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.216328:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3301:x1830967796566528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (638us total) trans 17179874480 rc 0/0 00000100:00100000:0.0:1746147735.216333:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17160 00000100:00100000:0.0:1746147735.216341:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17161 00000100:00100000:0.0:1746147735.216345:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3301:x1830967796566144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147735.216403:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147735.216405:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:0.0:1746147735.216407:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:0.0:1746147735.216409:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:0.0:1746147735.216411:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746147735.216425:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3301:x1830967796566144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (705us total) trans 17179874481 rc 0/0 00000100:00100000:0.0:1746147735.216429:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17161 00000100:00100000:0.0:1746147735.216437:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17162 00000100:00100000:0.0:1746147735.216440:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3301:x1830967796566656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.216502:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3301:x1830967796566656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (762us total) trans 17179874482 rc 0/0 00000100:00100000:0.0:1746147735.216508:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17162 00000100:00100000:0.0:1746147735.216515:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17163 00000100:00100000:0.0:1746147735.216519:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3304:x1830967796566400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.216579:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3304:x1830967796566400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (773us total) trans 17179874483 rc 0/0 00000100:00100000:0.0:1746147735.216584:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17163 00000100:00100000:0.0:1746147735.216592:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17164 00000100:00100000:0.0:1746147735.216595:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3304:x1830967796566912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.216669:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3304:x1830967796566912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (841us total) trans 17179874484 rc 0/0 00000100:00100000:0.0:1746147735.216674:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17164 00000100:00100000:0.0:1746147735.216683:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17165 00000100:00100000:0.0:1746147735.216686:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3304:x1830967796566272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147735.216743:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:0.0:1746147735.216745:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:0.0:1746147735.216747:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:0.0:1746147735.216749:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:0.0:1746147735.216751:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:0.0:1746147735.216766:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3304:x1830967796566272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (915us total) trans 17179874485 rc 0/0 00000100:00100000:0.0:1746147735.216771:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17165 00000100:00100000:0.0:1746147735.216778:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17166 00000100:00100000:0.0:1746147735.216782:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3304:x1830967796566784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.216850:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3304:x1830967796566784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (978us total) trans 17179874486 rc 0/0 00000100:00100000:0.0:1746147735.216855:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17166 00000004:00080000:0.0:1746147735.217000:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f514380/2, rc 0, transno 17179874485 00000100:00100000:0.0:1746147735.217008:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796566272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147735.217015:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f515180/2, rc 0, transno 17179874486 00000100:00100000:0.0:1746147735.217017:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796566784:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147735.217023:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f515c00/2, rc 0, transno 17179874483 00000100:00100000:0.0:1746147735.217026:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796566400:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147735.217031:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f516300/2, rc 0, transno 17179874484 00000100:00100000:0.0:1746147735.217034:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796566912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.217123:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.217143:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794236544 00000100:00100000:0.0:1746147735.217147:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794236544 00010000:00010000:3.0:1746147735.217227:0:3288:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147735.217237:0:3288:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147735.217243:0:3288:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147735.217251:0:3288:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c4cdc00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147735.217256:0:3288:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147735.217263:0:3288:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746147735.217280:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147735.217283:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147735.217287:0:3288:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746147735.217291:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796567296:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746147735.217292:0:3288:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4cdc00/0xe64d3fbf12a7f30c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746147735.217310:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796567168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.217318:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147735.217331:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147735.217348:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796567296 00000100:00100000:1.0:1746147735.217350:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796567808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.217351:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796567296 00000100:00100000:1.0:1746147735.217363:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147735.217367:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796567168 00000100:00100000:3.0:1746147735.217369:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796567168 00000100:00100000:1.0:1746147735.217374:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746147735.217377:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796567808 00000100:00100000:1.0:1746147735.217378:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796567424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.217379:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796567808 00000100:00100000:3.0:1746147735.217388:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17167 00000100:00100000:3.0:1746147735.217392:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+55:3303:x1830967796567296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.217392:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.217400:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796567936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.217412:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.217425:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796567424 00000100:00100000:1.0:1746147735.217428:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796567424 00000100:00100000:1.0:1746147735.217444:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796567936 00000100:00100000:1.0:1746147735.217446:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796567936 00000100:00100000:1.0:1746147735.217453:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17168 00000100:00100000:1.0:1746147735.217457:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3302:x1830967796567168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.217503:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17169 00000100:00100000:3.0:1746147735.217508:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3303:x1830967796567808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147735.217551:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147735.217554:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:1.0:1746147735.217556:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:1.0:1746147735.217558:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:1.0:1746147735.217560:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147735.217578:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3302:x1830967796567168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (246us total) trans 21474841709 rc 0/0 00000100:00100000:3.0:1746147735.217582:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3303:x1830967796567808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (218us total) trans 21474841710 rc 0/0 00000100:00100000:1.0:1746147735.217583:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17168 00000100:00100000:3.0:1746147735.217590:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17169 00000100:00100000:1.0:1746147735.217593:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17170 00000100:00100000:1.0:1746147735.217596:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3303:x1830967796567424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.217597:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17171 00000100:00100000:3.0:1746147735.217601:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3303:x1830967796567936:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147735.217657:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2a9c00/2, rc 0, transno 21474841709 00000100:00100000:3.0:1746147735.217661:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796567168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.217666:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796567680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.217682:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.217690:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3303:x1830967796567424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (297us total) trans 21474841711 rc 0/0 00000100:00100000:3.0:1746147735.217694:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746147735.217695:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17170 00000100:00100000:3.0:1746147735.217697:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796567040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.217702:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796567680 00000100:00100000:1.0:1746147735.217704:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796567680 00000100:00100000:3.0:1746147735.217711:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.217714:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796567040 00000100:00100000:1.0:1746147735.217715:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796567040 00000100:00100000:3.0:1746147735.217719:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796567552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.217724:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17172 00000100:00100000:1.0:1746147735.217728:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3302:x1830967796567680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.217730:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147735.217742:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796567552 00000100:00100000:3.0:1746147735.217744:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796567552 00000100:00100000:3.0:1746147735.217754:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17173 00000100:00100000:3.0:1746147735.217758:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3302:x1830967796567040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.217801:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:3302:x1830967796567680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (118us total) trans 21474841712 rc 0/0 00000100:00100000:1.0:1746147735.217806:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17172 00000100:00100000:1.0:1746147735.217814:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17174 00000100:00100000:1.0:1746147735.217817:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:3302:x1830967796567552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147735.217828:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147735.217830:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:3.0:1746147735.217832:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:3.0:1746147735.217834:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:3.0:1746147735.217836:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2075 -> 2075 00000100:00100000:3.0:1746147735.217852:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3302:x1830967796567040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (140us total) trans 21474841713 rc 0/0 00000100:00100000:3.0:1746147735.217856:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17173 00002000:00010000:1.0:1746147735.217880:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:1.0:1746147735.217898:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147735.217900:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147735.217901:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:1.0:1746147735.217903:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:1.0:1746147735.217919:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3302:x1830967796567552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (188us total) trans 21474841714 rc 0/0 00000100:00100000:1.0:1746147735.217924:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17174 00000100:00100000:3.0:1746147735.217936:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+62:3303:x1830967796567936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 335us (523us total) trans 21474841715 rc 0/0 00000100:00100000:3.0:1746147735.217941:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17171 00000004:00080000:3.0:1746147735.217954:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2aaa00/2, rc 0, transno 21474841713 00000004:00080000:1.0:1746147735.217954:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2a8000/2, rc 0, transno 21474841711 00000100:00100000:3.0:1746147735.217957:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796567040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.217957:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796567424:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147735.217962:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2ab800/2, rc 0, transno 21474841714 00000004:00080000:1.0:1746147735.217963:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2a9500/2, rc 0, transno 21474841715 00000100:00100000:3.0:1746147735.217965:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796567552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.217965:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796567936:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147735.217970:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2abb80/2, rc 0, transno 21474841712 00000004:00080000:1.0:1746147735.217971:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2a8e00/2, rc 0, transno 21474841710 00000100:00100000:3.0:1746147735.217973:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796567680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.217973:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796567808:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147735.217989:0:4591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147735.217991:0:4591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:3.0:1746147735.217992:0:4591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:3.0:1746147735.217994:0:4591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:3.0:1746147735.217995:0:4591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746147735.218013:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3303:x1830967796567296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 620us (694us total) trans 21474841708 rc 0/0 00000100:00100000:3.0:1746147735.218018:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17167 00000004:00080000:1.0:1746147735.218023:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2a9f80/2, rc 0, transno 21474841708 00000100:00100000:1.0:1746147735.218026:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796567296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147735.218246:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12133 00000100:00100000:0.0:1746147735.218254:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+6:32565:x1830967794236544:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147735.218270:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147735.218283:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090038e00/0xe64d3fbf12a7f313 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca14 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.218326:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090038e00/0xe64d3fbf12a7f313 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca14 expref: 7 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.218338:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090038e00/0xe64d3fbf12a7f313 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca14 expref: 7 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.218354:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147735.218357:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147735.218359:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090038e00, rc 0) 00000100:00100000:0.0:1746147735.218402:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+7:32565:x1830967794236544:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 150us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147735.218408:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12133 00000004:00080000:0.0:1746147735.218441:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f516a00/2, rc 0, transno 17179874481 00000100:00100000:0.0:1746147735.218444:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796566144:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147735.218451:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f517480/2, rc 0, transno 17179874482 00000100:00100000:0.0:1746147735.218453:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796566656:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147735.218462:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f515f80/2, rc 0, transno 17179874479 00000100:00100000:0.0:1746147735.218464:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796566016:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147735.218471:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f517800/2, rc 0, transno 17179874480 00000100:00100000:0.0:1746147735.218681:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796566528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147735.219217:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746147735.219226:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796568064:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147735.219256:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.219273:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796568064 00000100:00100000:0.0:1746147735.219277:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796568064 00000100:00100000:0.0:1746147735.219303:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17175 00000100:00100000:0.0:1746147735.219308:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+67:3302:x1830967796568064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.219776:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+68:3302:x1830967796568064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 467us (518us total) trans 17179874487 rc 0/0 00000004:00080000:3.0:1746147735.219778:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c9aad80/2, rc 0, transno 17179874487 00000100:00100000:3.0:1746147735.219782:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796568064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.219783:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17175 00000100:00100000:0.0:1746147735.221134:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.221208:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794236800 00000100:00100000:3.0:1746147735.221213:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794236800 00000100:00100000:3.0:1746147735.221244:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5069 00000100:00100000:3.0:1746147735.221249:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+7:32565:x1830967794236800:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:3.0:1746147735.221784:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+8:32565:x1830967794236800:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 531us (654us total) trans 8589946167 rc 0/0 00000100:00100000:3.0:1746147735.221791:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5069 00000100:00100000:0.0:1746147735.247549:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.247616:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.247741:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794237184 00000100:00100000:3.0:1746147735.247751:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794237184 00000100:00100000:3.0:1746147735.248918:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794237312 00000100:00100000:3.0:1746147735.248925:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794237312 00000100:00100000:2.0:1746147735.248975:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12134 00000100:00100000:2.0:1746147735.248990:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:32572:x1830967794237184:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147735.249019:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.249040:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f31a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca1b expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.249113:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12135 00000100:00100000:3.0:1746147735.249120:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:32574:x1830967794237312:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147735.249130:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.249138:0:15085:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f321 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca22 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.249317:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f328 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249329:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249339:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249351:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f32f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249356:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f32f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249360:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f32f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249464:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f336 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249470:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f336 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249475:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f336 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:2.0:1746147735.249482:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147735.249585:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f344 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249592:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f344 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249598:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f344 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249606:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f34b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249611:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f34b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249615:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f34b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249672:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7f352 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249678:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7f352 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249683:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7f352 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00000004:00200000:3.0:1746147735.249688:0:15085:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147735.249729:0:15085:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f344 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249735:0:15085:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f344 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249741:0:15085:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f344 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249746:0:15085:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800950e5800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147735.249750:0:15085:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f344 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249756:0:15085:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f344 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249765:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147735.249768:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147735.249771:0:15085:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f344 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249776:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f344 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249796:0:15085:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f34b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.249801:0:15085:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f34b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.249864:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249873:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f328 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249877:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f328 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249881:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a650e600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147735.249900:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f328 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249905:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f328 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249911:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147735.249913:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147735.249914:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249919:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147735.249954:0:15085:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f34b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.249969:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f32f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249973:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f32f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249977:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f32f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249981:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a650fc00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147735.249983:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f32f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249991:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f32f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.249996:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06ee200) 00010000:00010000:2.0:1746147735.249998:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147735.250000:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f32f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.250005:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f32f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147735.250032:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f31a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca1b expref: 325 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.250042:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f336 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca1b expref: 324 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.250048:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.250049:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147735.250051:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a650f800, rc 0) 00010000:00010000:3.0:1746147735.250140:0:15085:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5896800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147735.250143:0:15085:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f34b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.250148:0:15085:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f34b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.250155:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a06ee200) 00010000:00010000:3.0:1746147735.250157:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147735.250159:0:15085:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f34b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.250163:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f34b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.250192:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f321 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca22 expref: 10 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.250201:0:15085:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7f352 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca22 expref: 9 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.250207:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147735.250209:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147735.250211:0:15085:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5896600, rc 0) 00000100:00100000:2.0:1746147735.250304:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32572:x1830967794237184:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1321us (2774us total) trans 8589946168 rc 0/0 00000100:00100000:2.0:1746147735.250311:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12134 00000100:00100000:3.0:1746147735.250355:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32574:x1830967794237312:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1235us (2739us total) trans 8589946169 rc 0/0 00000100:00100000:3.0:1746147735.250360:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12135 00000100:00100000:0.0:1746147735.255642:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.255694:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.255869:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794237568 00000100:00100000:3.0:1746147735.255879:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794237568 00000100:00100000:2.0:1746147735.255911:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794237440 00000100:00100000:2.0:1746147735.255915:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794237440 00000100:00100000:3.0:1746147735.255951:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17176 00000100:00100000:3.0:1746147735.255959:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:32577:x1830967794237568:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147735.255966:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17177 00000100:00100000:2.0:1746147735.255972:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:32576:x1830967794237440:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147735.255979:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.255979:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.255996:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f367 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca30 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.255996:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f360 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca29 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.256023:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f2e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ea expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.256031:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147735.256033:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147735.256036:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f360 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca29 expref: 34 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.256092:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147735.256097:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f367 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca30 expref: 20 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.256110:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f367 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca30 expref: 20 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.256120:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5896800, rc 0) 00000100:00100000:3.0:1746147735.256330:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32577:x1830967794237568:12345-192.168.202.10@tcp:101:cat.0 Request processed in 203us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.256337:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17176 00010000:00010000:2.0:1746147735.256965:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f2e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ea expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.256978:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f2e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ea expref: 13 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.256990:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796568192:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147735.257674:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cda780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.262451:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796568192:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147735.262452:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.262518:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794237696 00000100:00100000:1.0:1746147735.262524:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794237696 00010000:00010000:1.0:1746147735.262559:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f2e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ea expref: 14 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.262597:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8776 00000100:00100000:1.0:1746147735.262603:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+14:1957:x1830967794237696:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.262616:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.266411:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f2e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ea expref: 14 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.266430:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f2e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ea expref: 14 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.266457:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f2e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ea expref: 14 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.266490:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.266492:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.266500:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f360 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca29 expref: 34 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.266508:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f360 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca29 expref: 34 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.266515:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.266516:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.266520:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f367 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca30 expref: 19 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.266531:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f367 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca30 expref: 19 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.266571:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f367 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca30 expref: 19 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.266587:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d27480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796568320:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147735.266700:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f360 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca29 expref: 34 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.266708:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d25880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796568448:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147735.266725:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662ff00 going to sleep for 11 seconds 00010000:00010000:2.0:1746147735.267282:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f360 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca29 expref: 34 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.267293:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a650e000, rc 0) 00000100:00100000:3.0:1746147735.267387:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32576:x1830967794237440:12345-192.168.202.10@tcp:101:cat.0 Request processed in 11410us (11688us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.267397:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17177 00000100:00100000:1.0:1746147735.268691:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d27480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796568320:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147735.270675:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.270848:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794237952 00000100:00100000:3.0:1746147735.270856:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794237952 00000100:00100000:1.0:1746147735.270898:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d25880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796568448:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147735.270922:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147735.270930:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12136 00000100:00100000:3.0:1746147735.270937:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32572:x1830967794237952:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147735.270963:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147735.270963:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+13:1957:x1830967794237696:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 8359us (8547us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147735.270965:0:15085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:1.0:1746147735.270971:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8776 00010000:00010000:3.0:1746147735.270990:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f336 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca1b expref: 324 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.271007:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147735.271011:0:15085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147735.271024:0:15085:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f36e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca37 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.271077:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.271090:0:15085:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090038e00/0xe64d3fbf12a7f313 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca14 expref: 7 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.271097:0:15085:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7f352 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca22 expref: 8 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.271102:0:15085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.271128:0:15085:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7f352 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca22 expref: 8 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.271139:0:15085:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7f352 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca22 expref: 8 pid: 15085 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.271150:0:15085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15085:1830967796568576:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.271220:0:15085:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090038e00/0xe64d3fbf12a7f313 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca14 expref: 7 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.271228:0:15085:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090038e00/0xe64d3fbf12a7f313 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca14 expref: 7 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.271235:0:15085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15085:1830967796568704:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.271253:0:15085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a652ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.273127:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.273200:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794238080 00000100:00100000:2.0:1746147735.273209:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794238080 00000100:00100000:2.0:1746147735.273262:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12137 00000100:00100000:2.0:1746147735.273269:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32576:x1830967794238080:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.273289:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.273305:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca3e expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.273357:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.273365:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 4/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca3e expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.273382:0:5744:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.273392:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca3e expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.273403:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.273406:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147735.273409:0:5744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.273415:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a650fc00, rc 0) 00000100:00100000:2.0:1746147735.273705:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32576:x1830967794238080:12345-192.168.202.10@tcp:101:cat.0 Request processed in 435us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.273711:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12137 00000100:00100000:0.0:1746147735.274683:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.274755:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.274980:0:15085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15085:1830967796568576:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.274991:0:15085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15085:1830967796568704:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.275015:0:15085:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15085 initiator: MDT0 00000100:00100000:2.0:1746147735.275115:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794238208 00000100:00100000:2.0:1746147735.275121:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794238208 00010000:00010000:2.0:1746147735.275146:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7f352 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca22 expref: 9 pid: 15085 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.275176:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794238336 00000100:00100000:2.0:1746147735.275178:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794238336 00010000:00010000:2.0:1746147735.275186:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090038e00/0xe64d3fbf12a7f313 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca14 expref: 8 pid: 5744 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.275199:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8777 00000100:00100000:2.0:1746147735.275205:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794238208:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147735.275206:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8778 00000100:00100000:3.0:1746147735.275212:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6672450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794238336:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147735.275215:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.275220:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7f352 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca22 expref: 9 pid: 15085 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.275222:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.275226:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090038e00/0xe64d3fbf12a7f313 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca14 expref: 8 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.275229:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7f352 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca22 expref: 9 pid: 15085 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.275250:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5896600/0xe64d3fbf12a7f352 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca22 expref: 9 pid: 15085 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.275264:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.275268:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.275274:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.275278:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.275306:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1959:x1830967794238208:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 101us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.275311:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8777 00010000:00010000:3.0:1746147735.275428:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090038e00/0xe64d3fbf12a7f313 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca14 expref: 8 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.275440:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090038e00/0xe64d3fbf12a7f313 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca14 expref: 8 pid: 5744 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.275672:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147735.275676:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.275683:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.275689:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.275697:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca3e expref: 325 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.275721:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147735.275742:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6672450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794238336:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 530us (986us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147735.275742:0:15085:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15085 initiator: MDT0 00000100:00100000:3.0:1746147735.275748:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8778 00010000:00010000:2.0:1746147735.275749:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15085 initiator: MDT0 00000100:00100000:0.0:1746147735.276265:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.276524:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794238592 00000100:00100000:3.0:1746147735.276529:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794238592 00002000:00100000:3.0:1746147735.276560:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c9a9c00 x1830967794238592/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.276569:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a9c00 with x1830967794238592 ext(0->1048575) 00002000:00010000:3.0:1746147735.276572:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9a9c00 00000100:00100000:3.0:1746147735.276586:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7741 00000100:00100000:3.0:1746147735.276590:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1958:x1830967794238592:12345-192.168.202.10@tcp:3:cat.0 00000040:00080000:2.0:1746147735.277179:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3740, 88 off313496 00000004:00080000:2.0:1746147735.277185:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814451300056ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147735.277238:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3741, 88 off313232 00000004:00080000:2.0:1746147735.277242:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814451357879ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147735.277252:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3742, 88 off313320 00000004:00080000:2.0:1746147735.277255:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814451370409ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147735.277261:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3741, 88 off313584 00000004:00080000:2.0:1746147735.277263:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814451378949ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147735.277268:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3742, 88 off313672 00000004:00080000:2.0:1746147735.277271:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814451386158ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147735.277276:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3743, 88 off313408 00000004:00080000:2.0:1746147735.277278:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814451393168ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147735.277282:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3744, 88 off313496 00000004:00080000:2.0:1746147735.277284:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814451399909ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147735.277289:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3745, 88 off313584 00000004:00080000:2.0:1746147735.277291:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814451406525ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147735.277296:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3743, 88 off313760 00000004:00080000:2.0:1746147735.277297:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814451413109ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147735.277302:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3746, 88 off313672 00000004:00080000:2.0:1746147735.277304:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814451419530ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147735.277309:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3744, 88 off313848 00000004:00080000:2.0:1746147735.277310:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814451426015ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147735.277315:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3747, 88 off313760 00000004:00080000:2.0:1746147735.277317:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814451433078ns, next at 756024029964ns, rc = 0 00000040:00080000:2.0:1746147735.277323:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3745, 88 off313936 00000004:00080000:2.0:1746147735.277324:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814451440006ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147735.277329:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3746, 88 off314024 00000004:00080000:2.0:1746147735.277331:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814451446938ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147735.277336:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3747, 88 off314112 00000004:00080000:2.0:1746147735.277338:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814451453560ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147735.277343:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3748, 88 off314200 00000004:00080000:2.0:1746147735.277344:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814451460025ns, next at 756039729591ns, rc = 0 00000040:00080000:2.0:1746147735.277349:0:15085:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3748, 88 off313848 00000004:00080000:2.0:1746147735.277353:0:15085:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 814451468629ns, next at 756024029964ns, rc = 0 00000100:00100000:3.0:1746147735.291995:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1958:x1830967794238592:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15394us (15721us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.292010:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7741 00002000:00100000:3.0:1746147735.292022:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c9a9c00 x1830967794238592/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.292031:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a9c00 with x1830967794238592 ext(0->1048575) 00002000:00010000:3.0:1746147735.292037:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9a9c00 00000100:00100000:3.0:1746147735.304692:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.304725:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794238720 00000100:00100000:3.0:1746147735.304733:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794238720 00000100:00100000:3.0:1746147735.304786:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17178 00000100:00100000:3.0:1746147735.304794:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32577:x1830967794238720:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147735.304813:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.304830:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a2b1200/0xe64d3fbf12a7f383 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca45 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.304860:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f1 expref: 14 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.304868:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147735.304870:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147735.304873:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2b1200/0xe64d3fbf12a7f383 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca45 expref: 16 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.304927:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f1 expref: 14 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.304938:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f1 expref: 14 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.304952:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796568832:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.305023:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90cb40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147735.307654:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca37 expref: 327 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.307671:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147735.307674:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147735.307678:0:15085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca3e expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.307688:0:15085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca3e expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.307694:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca3e expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.307728:0:15085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca3e expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.307740:0:15085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15085:1830967796568960:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147735.307822:0:15085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90ce40 going to sleep for 11 seconds 00000001:00080000:1.0:1746147735.308002:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946170 is committed 00000004:00080000:1.0:1746147735.308009:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2815 committed 00000004:00080000:1.0:1746147735.308016:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2815 committed 00000004:00080000:1.0:1746147735.308023:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2814 committed 00000004:00080000:1.0:1746147735.308025:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2813 committed 00000004:00080000:1.0:1746147735.308026:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2812 committed 00000004:00080000:1.0:1746147735.308029:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2814 committed 00000004:00080000:1.0:1746147735.308030:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2811 committed 00000004:00080000:1.0:1746147735.308032:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2813 committed 00000004:00080000:1.0:1746147735.308034:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2810 committed 00000004:00080000:1.0:1746147735.308035:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2812 committed 00000004:00080000:1.0:1746147735.308037:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2811 committed 00000004:00080000:1.0:1746147735.308038:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2810 committed 00000004:00080000:1.0:1746147735.308040:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2809 committed 00000004:00080000:1.0:1746147735.308042:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2808 committed 00000004:00080000:1.0:1746147735.308043:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2809 committed 00000004:00080000:1.0:1746147735.308045:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2808 committed 00000004:00080000:1.0:1746147735.308046:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2807 committed 00000001:00080000:1.0:1746147735.308057:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946169 is committed 00000001:00080000:1.0:1746147735.308066:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946167 is committed 00000100:00100000:1.0:1746147735.308245:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796569472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.308283:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.308300:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796569984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.308314:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.308331:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746147735.308336:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796569088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.308349:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.308359:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796569600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.308371:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.308373:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796569344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.308385:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796570496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147735.308393:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147735.308395:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796569472 00000100:00100000:2.0:1746147735.308402:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796569472 00000100:00100000:1.0:1746147735.308404:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796569216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.308409:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796569856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.308418:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.308429:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796569728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147735.308435:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796569984 00000100:00100000:2.0:1746147735.308437:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796569984 00000100:00100000:1.0:1746147735.308443:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147735.308899:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796570112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.308923:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.310161:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796570240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.310163:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796570624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.310186:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.310198:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796570752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.310203:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796569600 00000100:00100000:3.0:1746147735.310210:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796569600 00000100:00100000:1.0:1746147735.310210:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147735.310235:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796569344 00000100:00100000:3.0:1746147735.310237:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796569344 00000100:00100000:1.0:1746147735.310238:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796569216 00000100:00100000:1.0:1746147735.310240:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796569216 00000100:00100000:3.0:1746147735.310244:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796569728 00000100:00100000:3.0:1746147735.310246:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796569728 00000100:00100000:3.0:1746147735.310252:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796570112 00000100:00100000:1.0:1746147735.310253:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796570240 00000100:00100000:3.0:1746147735.310254:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796570112 00000100:00100000:1.0:1746147735.310254:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796570240 00000100:00100000:3.0:1746147735.310261:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796570752 00000100:00100000:3.0:1746147735.310263:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796570752 00000100:00100000:1.0:1746147735.310265:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17179 00000100:00100000:3.0:1746147735.310271:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17180 00000100:00100000:1.0:1746147735.310272:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:3301:x1830967796569472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147735.310275:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+73:3301:x1830967796569984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.310302:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796569088 00000100:00100000:0.0:1746147735.310306:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796569088 00000100:00100000:3.0:1746147735.310402:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17181 00000100:00100000:3.0:1746147735.310409:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+74:3301:x1830967796569600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147735.310414:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17182 00000100:00100000:2.0:1746147735.310428:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+74:3304:x1830967796569344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.310524:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17183 00000100:00100000:0.0:1746147735.310531:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+74:3303:x1830967796569216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.310963:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17184 00000100:00100000:2.0:1746147735.310970:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17185 00000100:00100000:1.0:1746147735.310970:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+74:3303:x1830967796569728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147735.310975:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3302:x1830967796570112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.311018:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17186 00000100:00100000:3.0:1746147735.311023:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+63:3303:x1830967796570240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.311103:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17187 00000100:00100000:3.0:1746147735.311107:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3303:x1830967796570752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.311123:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+75:3303:x1830967796569728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 153us (2678us total) trans 17179874488 rc 0/0 00002000:00010000:2.0:1746147735.311126:0:21480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746147735.311129:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17184 00002000:00010000:2.0:1746147735.311130:0:21480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:2.0:1746147735.311132:0:21480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:2.0:1746147735.311134:0:21480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:2.0:1746147735.311136:0:21480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2075 -> 2075 00000100:00100000:1.0:1746147735.311144:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17188 00000100:00100000:1.0:1746147735.311148:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+74:3301:x1830967796569088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147735.311185:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+66:3302:x1830967796570112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 210us (2261us total) trans 21474841716 rc 0/0 00000100:00100000:2.0:1746147735.311191:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17185 00000100:00100000:3.0:1746147735.311201:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3303:x1830967796570752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (988us total) trans 21474841718 rc 0/0 00000100:00100000:3.0:1746147735.311207:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17187 00002000:00010000:1.0:1746147735.311220:0:7050:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147735.311222:0:7050:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:1.0:1746147735.311224:0:7050:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:1.0:1746147735.311226:0:7050:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:1.0:1746147735.311228:0:7050:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 2045 -> 2045 00002000:00010000:2.0:1746147735.311235:0:8468:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147735.311238:0:8468:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:2.0:1746147735.311239:0:8468:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:2.0:1746147735.311241:0:8468:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:2.0:1746147735.311243:0:8468:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147735.311248:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+75:3301:x1830967796569088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (2898us total) trans 17179874489 rc 0/0 00000100:00100000:1.0:1746147735.311257:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17188 00000100:00100000:2.0:1746147735.311260:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+64:3303:x1830967796570240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 236us (1073us total) trans 21474841717 rc 0/0 00000100:00100000:2.0:1746147735.311265:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17186 00000100:00100000:1.0:1746147735.311279:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.311301:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796571008:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147735.311306:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.311309:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796570496 00000100:00100000:2.0:1746147735.311313:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796570496 00000100:00100000:1.0:1746147735.311318:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147735.311331:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796571008 00000100:00100000:2.0:1746147735.311333:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796571008 00000100:00100000:2.0:1746147735.311342:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17189 00000004:00080000:1.0:1746147735.311345:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d25880/2, rc 0, transno 17179874489 00000100:00100000:2.0:1746147735.311346:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:3301:x1830967796570496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.311354:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796569088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147735.311373:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17190 00000100:00100000:1.0:1746147735.311378:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3301:x1830967796571008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147735.311428:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:3301:x1830967796570496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (149us total) trans 21474841719 rc 0/0 00000100:00100000:2.0:1746147735.311433:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17189 00000004:00080000:2.0:1746147735.311468:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe97480/2, rc 0, transno 21474841719 00000100:00100000:1.0:1746147735.311468:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3301:x1830967796571008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (148us total) trans 21474841720 rc 0/0 00000100:00100000:2.0:1746147735.311473:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796570496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.311474:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17190 00000004:00080000:2.0:1746147735.311483:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135849180/2, rc 0, transno 21474841720 00000100:00100000:2.0:1746147735.311486:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796571008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147735.311533:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746147735.311544:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796571136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147735.311569:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147735.311594:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796571136 00000100:00100000:2.0:1746147735.311596:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796571136 00000100:00100000:1.0:1746147735.311604:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3301:x1830967796569472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1332us (3320us total) trans 17179874490 rc 0/0 00000100:00100000:0.0:1746147735.311607:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.311611:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17179 00000100:00100000:2.0:1746147735.311613:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796569856 00000100:00100000:2.0:1746147735.311615:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796569856 00000100:00100000:1.0:1746147735.311633:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17191 00000100:00100000:0.0:1746147735.311636:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796570368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147735.311639:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3301:x1830967796571136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147735.311642:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17192 00000100:00100000:2.0:1746147735.311647:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aa2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3304:x1830967796569856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.311655:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.311668:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796570880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147735.311680:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147735.311702:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796570368 00000100:00100000:0.0:1746147735.311706:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796570368 00000100:00100000:1.0:1746147735.311714:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3301:x1830967796571136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (144us total) trans 17179874491 rc 0/0 00000100:00100000:1.0:1746147735.311718:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17191 00000100:00100000:0.0:1746147735.311720:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796570880 00000100:00100000:0.0:1746147735.311722:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796570880 00000100:00100000:1.0:1746147735.311727:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17193 00000100:00100000:0.0:1746147735.311730:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17194 00000100:00100000:1.0:1746147735.311731:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3304:x1830967796570368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147735.311734:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3304:x1830967796570880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147735.311751:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aa2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3304:x1830967796569856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (144us total) trans 17179874492 rc 0/0 00000100:00100000:2.0:1746147735.311757:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17192 00000004:00080000:2.0:1746147735.311780:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d5880/2, rc 0, transno 17179874491 00000100:00100000:2.0:1746147735.311783:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796571136:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147735.311792:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d25500/2, rc 0, transno 17179874490 00002000:00010000:1.0:1746147735.311792:0:8469:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:2.0:1746147735.311795:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796569472:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147735.311795:0:8469:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:1.0:1746147735.311797:0:8469:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:1.0:1746147735.311800:0:8469:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:1.0:1746147735.311801:0:8469:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746147735.311802:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3304:x1830967796570880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (121us total) trans 21474841721 rc 0/0 00000100:00100000:0.0:1746147735.311809:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17194 00000100:00100000:1.0:1746147735.311815:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3304:x1830967796570368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (159us total) trans 21474841722 rc 0/0 00000100:00100000:1.0:1746147735.311819:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17193 00000004:00080000:0.0:1746147735.311835:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d24a80/2, rc 0, transno 17179874492 00000100:00100000:0.0:1746147735.311838:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796569856:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147735.311845:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe94a80/2, rc 0, transno 21474841722 00000100:00100000:0.0:1746147735.311848:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796570368:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147735.311854:0:20619:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00000004:00080000:0.0:1746147735.311854:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aee9180/2, rc 0, transno 21474841721 00000100:00100000:0.0:1746147735.311856:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796570880:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147735.311857:0:20619:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:2.0:1746147735.311859:0:20619:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:2.0:1746147735.311861:0:20619:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:2.0:1746147735.311863:0:20619:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000004:00080000:1.0:1746147735.311863:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d25f80/2, rc 0, transno 17179874488 00000100:00100000:1.0:1746147735.311866:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796569728:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147735.311876:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe95c00/2, rc 0, transno 21474841717 00000100:00100000:1.0:1746147735.311878:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796570240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147735.311901:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+77:3304:x1830967796569344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1460us (3489us total) trans 17179874493 rc 0/0 00000004:00080000:1.0:1746147735.311902:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aeea680/2, rc 0, transno 21474841718 00000100:00100000:1.0:1746147735.311905:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796570752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147735.311907:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17182 00000004:00080000:2.0:1746147735.311927:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d25180/2, rc 0, transno 17179874493 00000100:00100000:2.0:1746147735.311930:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796569344:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147735.311988:0:4591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147735.311991:0:4591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147735 -> 1746147735 00002000:00010000:2.0:1746147735.311993:0:4591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:2.0:1746147735.311994:0:4591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:2.0:1746147735.311996:0:4591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746147735.312017:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+77:3303:x1830967796569216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1487us (3598us total) trans 17179874494 rc 0/0 00000100:00100000:2.0:1746147735.312021:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17183 00000100:00100000:3.0:1746147735.312127:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794238848 00000100:00100000:3.0:1746147735.312130:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794238848 00000100:00100000:2.0:1746147735.312131:0:15085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15085:1830967796568960:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147735.312150:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2e9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f1 expref: 15 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.312159:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f36e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca37 expref: 325 pid: 15085 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1746147735.312170:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8779 00010000:00010000:2.0:1746147735.312175:0:15085:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca37 expref: 324 pid: 15085 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.312176:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+15:1960:x1830967794238848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.312186:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.312195:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2e9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f1 expref: 15 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.312196:0:15085:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950e5800, rc 0) 00010000:00010000:3.0:1746147735.312205:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f1 expref: 15 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.312227:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147735.312228:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32572:x1830967794237952:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 41292us (41563us total) trans 8589946170 rc 0/0 00010000:00010000:3.0:1746147735.312229:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147735.312235:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12136 00010000:00010000:3.0:1746147735.312237:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a2b1200/0xe64d3fbf12a7f383 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca45 expref: 16 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.312245:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2b1200/0xe64d3fbf12a7f383 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca45 expref: 16 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.312269:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012a2b1200/0xe64d3fbf12a7f383 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca45 expref: 16 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.312277:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796571264:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147735.312332:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01540 going to sleep for 11 seconds 00010000:00010000:3.0:1746147735.312354:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1a00/0xe64d3fbf12a7f2e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f1 expref: 15 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.312364:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796568832:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.312378:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a2b1200/0xe64d3fbf12a7f383 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca45 expref: 16 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.312390:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a2b1200, rc 0) 00000100:00100000:3.0:1746147735.312411:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32577:x1830967794238720:12345-192.168.202.10@tcp:101:cat.0 Request processed in 7618us (7727us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.312417:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17178 00000100:00100000:2.0:1746147735.312503:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+78:3301:x1830967796569984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2227us (4188us total) trans 17179874496 rc 0/0 00000100:00100000:2.0:1746147735.312509:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17180 00000004:00080000:2.0:1746147735.312527:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d6d80/2, rc 0, transno 17179874496 00000100:00100000:2.0:1746147735.312530:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796569984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147735.312907:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.313068:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794238976 00000100:00100000:2.0:1746147735.313072:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794238976 00000100:00100000:2.0:1746147735.313095:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5070 00000100:00100000:2.0:1746147735.313100:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a9e7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32576:x1830967794238976:12345-192.168.202.10@tcp:49:cat.0 00000100:00100000:2.0:1746147735.313155:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a9e7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32576:x1830967794238976:12345-192.168.202.10@tcp:49:cat.0 Request processed in 55us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.313160:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5070 00000100:00100000:3.0:1746147735.313225:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3301:x1830967796569600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2815us (4850us total) trans 17179874495 rc 0/0 00000100:00100000:3.0:1746147735.313230:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17181 00000004:00080000:2.0:1746147735.313236:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d24380/2, rc 0, transno 17179874495 00000100:00100000:2.0:1746147735.313240:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796569600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147735.313348:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147735.313381:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe94380/2, rc 0, transno 21474841716 00000100:00100000:3.0:1746147735.313384:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796570112:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147735.313543:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796570624 00000004:00080000:1.0:1746147735.313544:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d27480/2, rc 0, transno 17179874494 00000100:00100000:2.0:1746147735.313548:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796570624 00000100:00100000:1.0:1746147735.313549:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796569216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147735.313569:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17195 00000100:00100000:2.0:1746147735.313574:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3302:x1830967796570624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147735.313698:0:22183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:2.0:1746147735.313701:0:22183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:2.0:1746147735.313703:0:22183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147735.313705:0:22183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:2.0:1746147735.313706:0:22183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:2.0:1746147735.313731:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+69:3302:x1830967796570624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 157us (382us total) trans 21474841723 rc 0/0 00000100:00100000:2.0:1746147735.313736:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17195 00000004:00080000:3.0:1746147735.313877:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aeeb100/2, rc 0, transno 21474841723 00000100:00100000:3.0:1746147735.313882:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796570624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147735.314145:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.314253:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794239104 00000100:00100000:1.0:1746147735.314257:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794239104 00000100:00100000:1.0:1746147735.314289:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5071 00000100:00100000:1.0:1746147735.314294:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32572:x1830967794239104:12345-192.168.202.10@tcp:49:multiop.0 00000100:00100000:1.0:1746147735.314361:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32572:x1830967794239104:12345-192.168.202.10@tcp:49:multiop.0 Request processed in 66us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.314366:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5071 00000100:00100000:3.0:1746147735.316012:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796571264:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147735.316031:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147735.316063:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794238848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3887us (4758us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.316072:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8779 00000100:00100000:0.0:1746147735.316128:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.316206:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794239232 00000100:00100000:2.0:1746147735.316212:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794239232 00000100:00100000:2.0:1746147735.316244:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12138 00000100:00100000:2.0:1746147735.316250:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:32577:x1830967794239232:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.316267:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.316284:0:15085:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f38a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca4c expref: -99 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.316341:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f38a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca4c expref: 8 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.316353:0:15085:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f38a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca4c expref: 8 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.316375:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.316377:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147735.316380:0:15085:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0299e00, rc 0) 00000100:00100000:2.0:1746147735.316402:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32577:x1830967794239232:12345-192.168.202.10@tcp:101:cat.0 Request processed in 152us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.316406:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12138 00000100:00100000:0.0:1746147735.318147:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.318973:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.319093:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794239616 00000100:00100000:2.0:1746147735.319104:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794239616 00000100:00100000:2.0:1746147735.319165:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17196 00000100:00100000:2.0:1746147735.319234:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:32572:x1830967794239616:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147735.319249:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.319264:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca53 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.319291:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f2fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca06 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.319298:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147735.319299:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147735.319302:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2207744->2523135] (req 2207744->2523135) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 35 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.319324:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794239488 00010000:00010000:2.0:1746147735.319328:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f2fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca06 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.319331:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794239488 00010000:00010000:2.0:1746147735.319338:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f2fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca06 expref: 12 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.319349:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796571392:192.168.202.10@tcp:104: 00002000:00100000:3.0:1746147735.319367:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c9aa680 x1830967794239488/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.319376:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9aa680 with x1830967794239488 ext(0->1048575) 00002000:00010000:3.0:1746147735.319381:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9aa680 00000100:00100000:3.0:1746147735.319404:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7742 00000100:00100000:3.0:1746147735.319416:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967794239488:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147735.319431:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2294900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.321323:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.321709:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794239872 00000100:00100000:2.0:1746147735.321716:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794239872 00002000:00100000:2.0:1746147735.321753:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009c9a9880 x1830967794239872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.321762:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a9880 with x1830967794239872 ext(1048576->2097151) 00002000:00010000:2.0:1746147735.321768:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9a9880 00000100:00100000:2.0:1746147735.321805:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7743 00000100:00100000:2.0:1746147735.321812:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794239872:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147735.331582:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.331615:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796571392:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.331653:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2207744->2523135] (req 2207744->2523135) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 37 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.331668:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0298800, rc 0) 00000100:00100000:3.0:1746147735.331718:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:32572:x1830967794239616:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 12546us (12747us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.331725:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17196 00000100:00100000:3.0:1746147735.331757:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794240000 00000100:00100000:3.0:1746147735.331762:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794240000 00010000:00010000:3.0:1746147735.331782:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f2fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca06 expref: 13 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.331808:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8780 00000100:00100000:3.0:1746147735.331814:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+13:1959:x1830967794240000:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.331825:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.331845:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f2fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca06 expref: 13 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.331854:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f2fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca06 expref: 13 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.331874:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f2fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca06 expref: 13 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.331918:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.331920:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.331925:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 36 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.331933:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 36 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.331958:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 36 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.331969:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796571520:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147735.332022:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.334374:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1959:x1830967794239488:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 14947us (16224us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.334385:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7742 00002000:00100000:3.0:1746147735.334396:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c9aa680 x1830967794239488/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.334406:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9aa680 with x1830967794239488 ext(0->1048575) 00002000:00010000:3.0:1746147735.334411:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9aa680 00000100:00100000:3.0:1746147735.336658:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796571520:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147735.336681:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147735.336733:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794240000:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4918us (5170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.336747:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8780 00000100:00100000:0.0:1746147735.336803:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.337135:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794239872:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15322us (15816us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147735.337143:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7743 00002000:00100000:2.0:1746147735.337153:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009c9a9880 x1830967794239872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.337162:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a9880 with x1830967794239872 ext(1048576->2097151) 00002000:00010000:2.0:1746147735.337168:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9a9880 00000100:00100000:2.0:1746147735.337183:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794240256 00000100:00100000:2.0:1746147735.337190:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794240256 00002000:00100000:2.0:1746147735.337221:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (2207744->2211839) req@ffff88009c9ab480 x1830967794240256/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.337227:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9ab480 with x1830967794240256 ext(2207744->2211839) 00002000:00010000:2.0:1746147735.337230:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9ab480 00000100:00100000:2.0:1746147735.337246:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7744 00000100:00100000:2.0:1746147735.337252:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967794240256:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147735.337399:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1958:x1830967794240256:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 147us (841us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147735.337405:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7744 00002000:00100000:2.0:1746147735.337410:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (2207744->2211839) req@ffff88009c9ab480 x1830967794240256/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/4536 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.337416:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9ab480 with x1830967794240256 ext(2207744->2211839) 00002000:00010000:2.0:1746147735.337418:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9ab480 00000100:00100000:0.0:1746147735.347342:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.347400:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.347457:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794240640 00000100:00100000:2.0:1746147735.347467:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794240640 00002000:00100000:2.0:1746147735.347517:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2519040->2523135) req@ffff88009c9aa300 x1830967794240640/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.347527:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9aa300 with x1830967794240640 ext(2519040->2523135) 00002000:00010000:2.0:1746147735.347532:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9aa300 00000100:00100000:2.0:1746147735.347554:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7745 00000100:00100000:2.0:1746147735.347561:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967794240640:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147735.347770:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1957:x1830967794240640:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 208us (368us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147735.347778:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7745 00002000:00100000:2.0:1746147735.347783:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2519040->2523135) req@ffff88009c9aa300 x1830967794240640/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/4536 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.347790:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9aa300 with x1830967794240640 ext(2519040->2523135) 00002000:00010000:2.0:1746147735.347793:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9aa300 00000100:00100000:3.0:1746147735.347833:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794240512 00000100:00100000:3.0:1746147735.347837:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794240512 00000100:00100000:3.0:1746147735.347865:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17197 00000100:00100000:3.0:1746147735.347870:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32576:x1830967794240512:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147735.347880:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.347928:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5def400/0xe64d3fbf12a7f398 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca5a expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.347950:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.347952:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.347959:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5def400/0xe64d3fbf12a7f398 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca5a expref: 24 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.347973:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5def400/0xe64d3fbf12a7f398 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca5a expref: 24 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.347984:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5def400, rc 0) 00000100:00100000:3.0:1746147735.348007:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32576:x1830967794240512:12345-192.168.202.10@tcp:101:cat.0 Request processed in 137us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.348012:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17197 00000100:00100000:0.0:1746147735.350969:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.351241:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794240896 00000100:00100000:2.0:1746147735.351250:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794240896 00002000:00100000:2.0:1746147735.351294:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880091119880 x1830967794240896/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.351304:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091119880 with x1830967794240896 ext(1048576->2097151) 00002000:00010000:2.0:1746147735.351310:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091119880 00000100:00100000:2.0:1746147735.351335:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7746 00000100:00100000:2.0:1746147735.351342:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794240896:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147735.352772:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.353700:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794241152 00000100:00100000:2.0:1746147735.353710:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794241152 00000100:00100000:2.0:1746147735.353762:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5072 00000100:00100000:2.0:1746147735.353770:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32572:x1830967794241152:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:2.0:1746147735.354086:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32572:x1830967794241152:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 315us (1318us total) trans 8589946171 rc 0/0 00000100:00100000:2.0:1746147735.354094:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5072 00000100:00100000:2.0:1746147735.357846:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.358770:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794241280 00000100:00100000:0.0:1746147735.358780:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794241280 00000100:00100000:0.0:1746147735.358838:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17198 00000100:00100000:0.0:1746147735.358847:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32577:x1830967794241280:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147735.358867:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147735.358911:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7f39f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca61 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.358946:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f8 expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.358954:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147735.358956:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147735.358959:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7f39f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca61 expref: 17 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.358990:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f8 expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.359001:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f8 expref: 13 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.359013:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091119c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796571648:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147735.359939:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c07fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.360606:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794240896:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 9260us (9644us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147735.360618:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7746 00002000:00100000:2.0:1746147735.360638:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880091119880 x1830967794240896/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.360648:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091119880 with x1830967794240896 ext(1048576->2097151) 00002000:00010000:2.0:1746147735.360653:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091119880 00000100:00100000:2.0:1746147735.361984:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091119c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796571648:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147735.362017:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7f39f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca61 expref: 17 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.362034:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc30c00, rc 0) 00000100:00100000:2.0:1746147735.362066:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32577:x1830967794241280:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3220us (4230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.362074:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17198 00000100:00100000:1.0:1746147735.362150:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.362501:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794241408 00000100:00100000:3.0:1746147735.362508:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794241408 00010000:00010000:3.0:1746147735.362534:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f8 expref: 14 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.362563:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8781 00000100:00100000:3.0:1746147735.362571:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794241408:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.362583:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.362604:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f8 expref: 14 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.362615:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f8 expref: 14 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.362645:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f2f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9f8 expref: 14 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.362662:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.362664:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.362671:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7f39f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca61 expref: 16 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.362678:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7f39f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca61 expref: 16 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.362706:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7f39f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca61 expref: 16 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.362717:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796571776:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147735.362770:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.365929:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.365992:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794241536 00000100:00100000:2.0:1746147735.366001:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794241536 00000100:00100000:3.0:1746147735.366276:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796571776:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147735.366295:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147735.366334:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+13:1959:x1830967794241408:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3763us (4185us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.366342:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8781 00000100:00100000:2.0:1746147735.366364:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17199 00000100:00100000:2.0:1746147735.366374:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32576:x1830967794241536:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.366391:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.366407:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7f3a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca68 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.366430:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.366432:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.366439:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7f3a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca68 expref: 25 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.366453:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7f3a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca68 expref: 25 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.366462:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc31200, rc 0) 00000100:00100000:2.0:1746147735.366481:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:32576:x1830967794241536:12345-192.168.202.10@tcp:101:cat.0 Request processed in 110us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.367334:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17199 00000100:00100000:0.0:1746147735.367436:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.367481:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794241792 00000100:00100000:2.0:1746147735.367485:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794241792 00002000:00100000:2.0:1746147735.367513:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880091118a80 x1830967794241792/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.367522:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091118a80 with x1830967794241792 ext(1048576->2097151) 00002000:00010000:2.0:1746147735.367527:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091118a80 00000100:00100000:2.0:1746147735.367553:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7747 00000100:00100000:2.0:1746147735.367558:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967794241792:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147735.369419:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.370004:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794242048 00000100:00100000:1.0:1746147735.370012:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794242048 00002000:00100000:1.0:1746147735.370049:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009111b100 x1830967794242048/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.371817:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111b100 with x1830967794242048 ext(1048576->2097151) 00002000:00010000:1.0:1746147735.371824:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009111b100 00000100:00100000:1.0:1746147735.371870:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7748 00000100:00100000:1.0:1746147735.371892:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794242048:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147735.374505:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.374756:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794242176 00000100:00100000:3.0:1746147735.374765:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794242176 00000100:00100000:3.0:1746147735.374820:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17200 00000100:00100000:3.0:1746147735.374827:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:32574:x1830967794242176:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147735.374846:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.374865:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca6f expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.374918:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a2b1200/0xe64d3fbf12a7f383 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca45 expref: 20 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.374927:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5def400/0xe64d3fbf12a7f398 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca5a expref: 26 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.374933:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.374935:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.374938:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 5/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1458176->2097151] (req 1458176->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 20 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.374969:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5def400/0xe64d3fbf12a7f398 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca5a expref: 26 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.374980:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5def400/0xe64d3fbf12a7f398 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca5a expref: 26 pid: 4592 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.374997:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796571904:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.375068:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012a2b1200/0xe64d3fbf12a7f383 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca45 expref: 20 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.375075:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012a2b1200/0xe64d3fbf12a7f383 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca45 expref: 20 pid: 6715 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.375082:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796572032:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.375098:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.383093:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1957:x1830967794241792:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15521us (15644us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147735.383107:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7747 00002000:00100000:2.0:1746147735.383119:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880091118a80 x1830967794241792/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.383128:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091118a80 with x1830967794241792 ext(1048576->2097151) 00002000:00010000:2.0:1746147735.383134:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091118a80 00000100:00100000:3.0:1746147735.383539:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796571904:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.383711:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796572032:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.383740:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1458176->2097151] (req 1458176->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 18 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.383757:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dee400, rc 0) 00000100:00100000:3.0:1746147735.383793:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32574:x1830967794242176:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 8966us (9299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.383799:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17200 00000100:00100000:0.0:1746147735.384773:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.384860:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794242304 00000100:00100000:3.0:1746147735.384868:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794242304 00010000:00010000:3.0:1746147735.384907:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5def400/0xe64d3fbf12a7f398 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca5a expref: 27 pid: 4592 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.385364:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8782 00000100:00100000:3.0:1746147735.385373:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794242304:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.385392:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.385540:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5def400/0xe64d3fbf12a7f398 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca5a expref: 27 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.385553:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5def400/0xe64d3fbf12a7f398 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca5a expref: 27 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.385576:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5def400/0xe64d3fbf12a7f398 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca5a expref: 27 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.385592:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147735.385641:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.385684:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794242048:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 13807us (16273us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147735.385692:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7748 00002000:00100000:1.0:1746147735.385700:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009111b100 x1830967794242048/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.385708:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111b100 with x1830967794242048 ext(1048576->2097151) 00002000:00010000:1.0:1746147735.385711:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009111b100 00000100:00100000:2.0:1746147735.385762:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794242432 00000100:00100000:2.0:1746147735.385766:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794242432 00010000:00010000:2.0:1746147735.385780:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012a2b1200/0xe64d3fbf12a7f383 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca45 expref: 18 pid: 6715 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.385806:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8783 00000100:00100000:2.0:1746147735.385811:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794242432:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147735.385819:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.385827:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a2b1200/0xe64d3fbf12a7f383 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca45 expref: 18 pid: 6715 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.385836:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a2b1200/0xe64d3fbf12a7f383 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca45 expref: 18 pid: 6715 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.386126:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a2b1200/0xe64d3fbf12a7f383 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca45 expref: 18 pid: 6715 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.386815:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794242304:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 248us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.386864:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8782 00010000:00010000:2.0:1746147735.386982:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.386987:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.386995:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 17 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.387004:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 17 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.387038:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 17 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.387051:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0226300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796572160:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147735.387525:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.387814:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.387854:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794242560 00000100:00100000:3.0:1746147735.387860:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794242560 00000100:00100000:3.0:1746147735.387915:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17201 00000100:00100000:3.0:1746147735.387922:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32577:x1830967794242560:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147735.387937:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.387952:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f3b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca76 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.388024:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f2f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ff expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.388030:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147735.388195:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147735.388199:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f3b4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca76 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.388220:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f2f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ff expref: 11 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.388231:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f2f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ff expref: 11 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.388240:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796572288:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.388294:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.391377:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.391438:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794242816 00000100:00100000:1.0:1746147735.391448:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794242816 00000100:00100000:2.0:1746147735.391583:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0226300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796572160:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147735.391609:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746147735.391696:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1458176->1462271) req@ffff88009111aa00 x1830967794242816/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.391706:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111aa00 with x1830967794242816 ext(1458176->1462271) 00002000:00010000:1.0:1746147735.391712:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009111aa00 00000100:00100000:2.0:1746147735.391855:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794242432:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6042us (6212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.391863:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7749 00000100:00100000:2.0:1746147735.391865:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8783 00000100:00100000:1.0:1746147735.391872:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794242816:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147735.392065:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794242816:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 194us (698us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147735.392072:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7749 00002000:00100000:1.0:1746147735.392078:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1458176->1462271) req@ffff88009111aa00 x1830967794242816/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/4536 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.392085:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111aa00 with x1830967794242816 ext(1458176->1462271) 00002000:00010000:1.0:1746147735.392087:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009111aa00 00000100:00100000:0.0:1746147735.392108:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.392131:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794242944 00000100:00100000:2.0:1746147735.392137:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794242944 00010000:00010000:2.0:1746147735.392158:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f2f7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ff expref: 12 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.392178:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8784 00000100:00100000:2.0:1746147735.392184:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967794242944:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147735.392193:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.392210:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f2f7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ff expref: 12 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.392221:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f2f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ff expref: 12 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.392241:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.392243:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.392250:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f3b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca76 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.392256:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f2f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafc9ff expref: 12 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.392258:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f3b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca76 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.392282:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f3b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca76 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.392285:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796572288:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147735.392297:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0226300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796572416:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147735.392341:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.392540:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147735.392615:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f3b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca76 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.392636:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950e5400, rc 0) 00000100:00100000:1.0:1746147735.392655:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794243072 00000100:00100000:1.0:1746147735.392659:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794243072 00000100:00100000:3.0:1746147735.392660:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32577:x1830967794242560:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4739us (4847us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.392666:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17201 00000100:00100000:3.0:1746147735.392681:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17202 00000100:00100000:3.0:1746147735.392685:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:32576:x1830967794243072:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147735.392694:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.392706:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f3bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca7d expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.393027:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.393029:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.393035:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f3bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca7d expref: 36 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.393057:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f3bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca7d expref: 36 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.393065:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5defc00, rc 0) 00000100:00100000:3.0:1746147735.393097:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:32576:x1830967794243072:12345-192.168.202.10@tcp:101:cat.0 Request processed in 411us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.393103:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17202 00000100:00100000:2.0:1746147735.394063:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0226300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796572416:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147735.394079:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.395952:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+11:1957:x1830967794242944:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3760us (3836us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.395965:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8784 00000100:00100000:1.0:1746147735.399433:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.399568:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794243328 00000100:00100000:3.0:1746147735.399578:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794243328 00002000:00100000:3.0:1746147735.399636:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800949d7800 x1830967794243328/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.399647:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d7800 with x1830967794243328 ext(1048576->2097151) 00002000:00010000:3.0:1746147735.399652:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d7800 00000100:00100000:3.0:1746147735.399671:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7750 00000100:00100000:3.0:1746147735.399678:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967794243328:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147735.401058:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.401109:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794243584 00000100:00100000:2.0:1746147735.401115:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794243584 00002000:00100000:2.0:1746147735.401144:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880091118000 x1830967794243584/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.401152:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091118000 with x1830967794243584 ext(1048576->2097151) 00002000:00010000:2.0:1746147735.401158:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091118000 00000100:00100000:2.0:1746147735.401183:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7751 00000100:00100000:2.0:1746147735.401189:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794243584:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147735.405676:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.406823:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794243712 00000100:00100000:3.0:1746147735.406834:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794243712 00000100:00100000:3.0:1746147735.406919:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17203 00000100:00100000:3.0:1746147735.406929:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32574:x1830967794243712:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147735.406951:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.406971:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca84 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.406999:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7f39f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca61 expref: 18 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.407007:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7f3a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca68 expref: 23 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.407012:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.407014:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.407018:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->1159167] (req 1048576->1159167) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 18 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.407051:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7f3a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca68 expref: 23 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.407063:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7f3a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca68 expref: 23 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.407074:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796572544:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.407172:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7f39f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca61 expref: 18 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.407180:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7f39f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca61 expref: 18 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.407192:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796572672:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.407210:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.415124:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796572544:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147735.415906:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.415939:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.415999:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796572672:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.416035:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->1159167] (req 1048576->1159167) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 18 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.416054:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950e4e00, rc 0) 00000100:00100000:3.0:1746147735.416101:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32574:x1830967794243712:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 9174us (10438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.416110:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17203 00000100:00100000:2.0:1746147735.416276:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794243584:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 15085us (15221us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147735.416286:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7751 00002000:00100000:2.0:1746147735.416295:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880091118000 x1830967794243584/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.416303:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091118000 with x1830967794243584 ext(1048576->2097151) 00002000:00010000:2.0:1746147735.416308:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091118000 00000100:00100000:0.0:1746147735.417090:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794243840 00000100:00100000:0.0:1746147735.417097:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794243840 00010000:00010000:0.0:1746147735.417122:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7f39f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca61 expref: 18 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.417155:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794243968 00000100:00100000:0.0:1746147735.417158:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794243968 00010000:00010000:0.0:1746147735.417168:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7f3a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca68 expref: 24 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.417774:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8785 00000100:00100000:0.0:1746147735.417782:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6673c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794243840:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147735.417796:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147735.417818:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7f39f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca61 expref: 18 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.417828:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7f39f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca61 expref: 18 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.417850:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc30c00/0xe64d3fbf12a7f39f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca61 expref: 18 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.418134:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147735.418175:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6673c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794243840:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 394us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147735.418181:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8785 00000100:00100000:0.0:1746147735.418221:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8786 00000100:00100000:0.0:1746147735.418228:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794243968:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147735.418236:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147735.418243:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7f3a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca68 expref: 24 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.418252:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7f3a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca68 expref: 24 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.418262:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc31200/0xe64d3fbf12a7f3a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca68 expref: 24 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.418269:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.418271:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.418278:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 16 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.418285:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 16 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.418311:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 16 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.418321:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009111b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796572800:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147735.418362:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c07f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.418779:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967794243328:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 19099us (19355us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.418787:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7750 00002000:00100000:3.0:1746147735.418794:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800949d7800 x1830967794243328/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.418803:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d7800 with x1830967794243328 ext(1048576->2097151) 00002000:00010000:3.0:1746147735.418808:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d7800 00000100:00100000:2.0:1746147735.423157:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009111b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796572800:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147735.423178:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.423237:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794243968:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5007us (7295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.423248:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8786 00000100:00100000:0.0:1746147735.427549:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.427596:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.427645:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.427666:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794244224 00000100:00100000:2.0:1746147735.427676:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794244224 00002000:00100000:2.0:1746147735.427727:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x455:0x0] (1155072->1159167) req@ffff88009111ad80 x1830967794244224/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.427737:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111ad80 with x1830967794244224 ext(1155072->1159167) 00002000:00010000:2.0:1746147735.427743:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009111ad80 00000100:00100000:2.0:1746147735.427771:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7752 00000100:00100000:2.0:1746147735.427779:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794244224:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147735.427833:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794244352 00000100:00100000:1.0:1746147735.427837:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794244352 00000100:00100000:1.0:1746147735.427861:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794244480 00000100:00100000:1.0:1746147735.427863:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794244480 00000100:00100000:1.0:1746147735.427877:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17204 00000100:00100000:1.0:1746147735.427907:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794244352:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.427920:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.427938:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb200/0xe64d3fbf12a7f3c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca8b expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.427980:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794244224:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 201us (383us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147735.427987:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7752 00000100:00100000:1.0:1746147735.427990:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796572928:192.168.202.10@tcp:106: 00002000:00100000:2.0:1746147735.427992:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1155072->1159167) req@ffff88009111ad80 x1830967794244224/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/4536 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.427999:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111ad80 with x1830967794244224 ext(1155072->1159167) 00002000:00010000:2.0:1746147735.428002:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009111ad80 00000100:00100000:1.0:1746147735.428052:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.428072:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17205 00000100:00100000:1.0:1746147735.428077:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967794244480:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.428084:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.428095:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f3d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca92 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.428120:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796573056:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147735.428721:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.431098:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.431266:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794244736 00000100:00100000:2.0:1746147735.431275:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794244736 00002000:00100000:2.0:1746147735.431315:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009111a680 x1830967794244736/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 504/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.431325:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111a680 with x1830967794244736 ext(2097152->3145727) 00002000:00010000:2.0:1746147735.431332:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009111a680 00000100:00100000:2.0:1746147735.431365:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7753 00000100:00100000:2.0:1746147735.431373:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967794244736:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:1.0:1746147735.431391:0:4591:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca0d expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.431420:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796573056:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147735.431451:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f3d0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca92 expref: 18 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.431463:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f3d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca92 expref: 18 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.431478:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8eba00, rc 0) 00000100:00100000:1.0:1746147735.431524:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967794244480:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3445us (3877us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147735.431531:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17205 00002000:00010000:1.0:1746147735.431567:0:4592:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime: 1746147735 -> 1746147736 00002000:00010000:1.0:1746147735.431571:0:4592:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147735 -> 1746147736 00000100:00100000:1.0:1746147735.431578:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796572928:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147735.431593:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb200/0xe64d3fbf12a7f3c9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca8b expref: 22 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.431601:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb200/0xe64d3fbf12a7f3c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca8b expref: 22 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.431609:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8eb200, rc 0) 00000100:00100000:1.0:1746147735.431640:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794244352:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3758us (4102us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147735.431645:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17204 00000100:00100000:2.0:1746147735.432469:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.432559:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794244992 00000100:00100000:3.0:1746147735.432564:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794244992 00000100:00100000:3.0:1746147735.432597:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5073 00000100:00100000:3.0:1746147735.432602:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32574:x1830967794244992:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147735.432804:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32574:x1830967794244992:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 200us (336us total) trans 8589946172 rc 0/0 00000100:00100000:3.0:1746147735.432811:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5073 00000100:00100000:0.0:1746147735.437082:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.437267:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794245120 00000100:00100000:1.0:1746147735.437277:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794245120 00000100:00100000:1.0:1746147735.437337:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17206 00000100:00100000:1.0:1746147735.437346:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32577:x1830967794245120:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.437365:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.437384:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafca99 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.437414:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 37 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.437422:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147735.437424:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147735.437427:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca99 expref: 22 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.437457:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 37 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.437468:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 37 pid: 4592 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.437479:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796573184:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.437567:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.441327:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967794244736:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9942us (10226us total) trans 0 rc 733184/733184 00000100:00100000:2.0:1746147735.441340:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7753 00002000:00100000:2.0:1746147735.441353:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009111a680 x1830967794244736/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 504/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.441363:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111a680 with x1830967794244736 ext(2097152->3145727) 00010000:00010000:2.0:1746147735.441373:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 36 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.441390:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 36 pid: 4592 timeout: 914 lvb_type: 0 00002000:00010000:2.0:1746147735.441397:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009111a680 00000100:00100000:0.0:1746147735.441719:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.441821:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796573184:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147735.441847:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca99 expref: 22 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.441864:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8ebc00, rc 0) 00000100:00100000:1.0:1746147735.441905:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32577:x1830967794245120:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4560us (4835us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.441911:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17206 00000100:00100000:2.0:1746147735.442931:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794245248 00000100:00100000:2.0:1746147735.442939:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794245248 00002000:00100000:2.0:1746147735.442977:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (2207744->2523135) req@ffff880091119c00 x1830967794245248/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.442986:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091119c00 with x1830967794245248 ext(2207744->2523135) 00010000:00010000:2.0:1746147735.442992:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 36 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.443009:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 36 pid: 4592 timeout: 914 lvb_type: 0 00002000:00010000:2.0:1746147735.443014:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091119c00 00000100:00100000:2.0:1746147735.443043:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1572 00000100:00100000:2.0:1746147735.443050:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967794245248:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147735.454984:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.455234:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794245376 00000100:00100000:1.0:1746147735.455252:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794245376 00000100:00100000:1.0:1746147735.455306:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17207 00000100:00100000:1.0:1746147735.455313:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32576:x1830967794245376:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.455328:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.455348:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f3de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcaa0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.455386:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f305 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca0d expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.455393:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147735.455394:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147735.455397:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f3de lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa0 expref: 24 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.455428:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca0d expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.455442:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca0d expref: 12 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.455451:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796573312:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.455513:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.458499:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796573312:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147735.458533:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f3de lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa0 expref: 24 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.458552:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8eb600, rc 0) 00000100:00100000:1.0:1746147735.458609:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32576:x1830967794245376:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3295us (3632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.458618:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17207 00000100:00100000:0.0:1746147735.459756:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.459873:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794245504 00000100:00100000:2.0:1746147735.459881:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794245504 00010000:00010000:2.0:1746147735.459939:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca0d expref: 13 pid: 4591 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.459964:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8787 00000100:00100000:2.0:1746147735.459971:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+13:1959:x1830967794245504:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147735.459984:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.460005:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca0d expref: 13 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.460015:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca0d expref: 13 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.460040:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7f305 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca0d expref: 13 pid: 4591 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.460062:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.460064:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.460071:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f3de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa0 expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.460078:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f3de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa0 expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.460109:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f3de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa0 expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.460121:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0226680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796573440:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147735.460188:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967794245248:12345-192.168.202.10@tcp:4:cat.0 Request processed in 17131us (18462us total) trans 17179874497 rc 0/0 00000100:00100000:3.0:1746147735.460200:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1572 00002000:00100000:3.0:1746147735.460209:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (2207744->2523135) req@ffff880091119c00 x1830967794245248/t17179874497(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/448 e 0 to 0 dl 1746147746 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.460219:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091119c00 with x1830967794245248 ext(2207744->2523135) 00010000:00010000:3.0:1746147735.460226:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 38 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.460239:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 38 pid: 4592 timeout: 914 lvb_type: 0 00002000:00010000:3.0:1746147735.460251:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091119c00 00000100:00100000:2.0:1746147735.460274:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.461655:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.461704:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794245632 00000100:00100000:3.0:1746147735.461710:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794245632 00000100:00100000:3.0:1746147735.461747:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12139 00000100:00100000:3.0:1746147735.461752:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+6:32581:x1830967794245632:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147735.461768:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.461783:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f3e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcaa7 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.461828:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f3ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.461838:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f3ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.461853:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f3ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.461864:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f3f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.461868:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.461872:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462014:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f3fa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462021:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f3fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462027:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f3fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:3.0:1746147735.462052:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:3.0:1746147735.462055:0:14545:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147735.462067:0:14545:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f3fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462074:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f3fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462079:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f3ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462088:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f3ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462093:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f3ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462097:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a650fa00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147735.462100:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f3ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462105:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f3ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462112:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147735.462114:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147735.462116:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f3ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462120:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f3ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462136:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462140:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f3f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462144:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f3f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462147:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a650f800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147735.462149:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f3f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462157:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f3f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462161:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcc4500) 00010000:00010000:3.0:1746147735.462163:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147735.462164:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f3f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462168:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f3f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.462187:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f3e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa7 expref: 8 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.462195:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f3fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa7 expref: 7 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.462199:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147735.462201:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147735.462203:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a650ea00, rc 0) 00000100:00100000:3.0:1746147735.462874:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+7:32581:x1830967794245632:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1120us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.462881:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12139 00000100:00100000:2.0:1746147735.463676:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.463731:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794245760 00000100:00100000:0.0:1746147735.463737:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794245760 00010000:00010000:0.0:1746147735.463763:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 38 pid: 4592 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.463798:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8788 00000100:00100000:0.0:1746147735.463805:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967794245760:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147735.463817:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147735.463837:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 38 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.463848:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 38 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.463869:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f391 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2207744->2523135) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca53 expref: 38 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.463916:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.463918:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.463926:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca99 expref: 21 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.463933:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca99 expref: 21 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.463965:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca99 expref: 21 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.463970:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0226680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796573440:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147735.463977:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796573568:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147735.463988:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147735.464035:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c07f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.464181:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794245504:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4209us (4428us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.464189:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8787 00000100:00100000:0.0:1746147735.465087:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.465170:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794246016 00000100:00100000:3.0:1746147735.465176:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794246016 00002000:00100000:3.0:1746147735.465209:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880094efb480 x1830967794246016/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.465218:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efb480 with x1830967794246016 ext(2097152->3145727) 00002000:00010000:3.0:1746147735.465222:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efb480 00000100:00100000:3.0:1746147735.465237:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7754 00000100:00100000:3.0:1746147735.465242:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794246016:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147735.466299:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.466318:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794246144 00000100:00100000:1.0:1746147735.466323:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794246144 00000100:00100000:0.0:1746147735.466324:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796573568:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147735.466340:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147735.466356:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17208 00000100:00100000:1.0:1746147735.466361:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794246144:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147735.466374:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.466386:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea200/0xe64d3fbf12a7f401 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcaae expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.466389:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1957:x1830967794245760:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2583us (2717us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147735.466397:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8788 00010000:00010000:1.0:1746147735.466403:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.466405:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.466412:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea200/0xe64d3fbf12a7f401 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaae expref: 12 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.466424:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea200/0xe64d3fbf12a7f401 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaae expref: 12 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.466432:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8ea200, rc 0) 00000100:00100000:1.0:1746147735.466451:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794246144:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 91us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.466457:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17208 00000100:00100000:1.0:1746147735.471190:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.471217:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.471315:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794246272 00000100:00100000:1.0:1746147735.471323:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.471325:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794246272 00000100:00100000:0.0:1746147735.471343:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794246400 00000100:00100000:0.0:1746147735.471345:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794246400 00000100:00100000:0.0:1746147735.471389:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794246528 00000100:00100000:0.0:1746147735.471391:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794246528 00000100:00100000:2.0:1746147735.471398:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17209 00000100:00100000:2.0:1746147735.471413:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+13:1959:x1830967794246400:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:0.0:1746147735.471419:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17210 00000100:00100000:0.0:1746147735.471425:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794246528:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147735.471429:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147735.471439:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.471452:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7f408 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcabc expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.471452:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6542600/0xe64d3fbf12a7f40f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcac3 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.471470:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.471472:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.471481:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6542600/0xe64d3fbf12a7f40f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcac3 expref: 13 pid: 6715 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147735.471492:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0224700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796573696:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147735.471497:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6542600/0xe64d3fbf12a7f40f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcac3 expref: 13 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.471509:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6542600, rc 0) 00000100:00100000:0.0:1746147735.471565:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794246528:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 139us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147735.471571:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17210 00000100:00100000:0.0:1746147735.471602:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17211 00000100:00100000:0.0:1746147735.471607:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794246272:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147735.471614:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147735.471633:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7f416 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcab5 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.471666:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796573824:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147735.471710:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.472433:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c07f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.472604:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.472645:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.472675:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.472866:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794246784 00000100:00100000:0.0:1746147735.472873:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794246784 00000100:00100000:1.0:1746147735.473073:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794247040 00000100:00100000:1.0:1746147735.473080:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794247040 00002000:00100000:1.0:1746147735.473107:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a08aaa00 x1830967794247040/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147735.473109:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794246656 00000100:00100000:0.0:1746147735.473113:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794246656 00002000:00100000:1.0:1746147735.473115:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08aaa00 with x1830967794247040 ext(2097152->3145727) 00002000:00010000:1.0:1746147735.473119:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08aaa00 00000100:00100000:0.0:1746147735.473133:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17212 00000100:00100000:1.0:1746147735.473135:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7755 00000100:00100000:0.0:1746147735.473139:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+16:1960:x1830967794246784:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:1.0:1746147735.473141:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794247040:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:0.0:1746147735.473150:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147735.473163:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095639400/0xe64d3fbf12a7f41d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcad1 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.473181:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.473183:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.473190:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095639400/0xe64d3fbf12a7f41d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad1 expref: 17 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.473202:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095639400/0xe64d3fbf12a7f41d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad1 expref: 17 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.473211:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095639400, rc 0) 00000100:00100000:0.0:1746147735.473238:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+17:1960:x1830967794246784:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 99us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147735.473244:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17212 00000100:00100000:0.0:1746147735.473258:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17213 00000100:00100000:0.0:1746147735.473263:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794246656:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147735.473269:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147735.473277:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095639a00/0xe64d3fbf12a7f424 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcaca expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.473288:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.473289:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.473293:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095639a00/0xe64d3fbf12a7f424 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaca expref: 14 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.473302:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095639a00/0xe64d3fbf12a7f424 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaca expref: 14 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.473309:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095639a00, rc 0) 00000100:00100000:0.0:1746147735.473326:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794246656:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 63us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147735.473333:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17213 00002000:00010000:2.0:1746147735.474077:0:4591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime: 1746147735 -> 1746147736 00002000:00010000:2.0:1746147735.474081:0:4591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime: 1746147735 -> 1746147736 00000100:00100000:2.0:1746147735.474093:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0224700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796573696:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147735.474117:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7f408 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcabc expref: 16 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.474131:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7f408 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcabc expref: 16 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.474152:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095093a00, rc 0) 00000100:00100000:2.0:1746147735.474183:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+15:1959:x1830967794246400:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 2777us (2964us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147735.474189:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17209 00002000:00010000:1.0:1746147735.476871:0:6715:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime: 1746147735 -> 1746147736 00002000:00010000:1.0:1746147735.476877:0:6715:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime: 1746147735 -> 1746147736 00000100:00100000:1.0:1746147735.476910:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796573824:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147735.476939:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7f416 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcab5 expref: 14 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.476950:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6543c00/0xe64d3fbf12a7f416 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcab5 expref: 14 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.476963:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6543c00, rc 0) 00000100:00100000:1.0:1746147735.477005:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+13:1959:x1830967794246272:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 5397us (5822us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147735.477012:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17211 00000100:00100000:3.0:1746147735.477272:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794246016:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12022us (12178us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.477282:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7754 00002000:00100000:3.0:1746147735.477293:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880094efb480 x1830967794246016/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.477302:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efb480 with x1830967794246016 ext(2097152->3145727) 00002000:00010000:3.0:1746147735.477307:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efb480 00000100:00100000:0.0:1746147735.488793:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.488918:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794247296 00000100:00100000:3.0:1746147735.488929:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794247296 00000100:00100000:1.0:1746147735.489224:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794247040:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16078us (16544us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147735.489233:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7755 00002000:00100000:1.0:1746147735.489242:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a08aaa00 x1830967794247040/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.489250:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08aaa00 with x1830967794247040 ext(2097152->3145727) 00002000:00010000:1.0:1746147735.489255:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08aaa00 00000100:00100000:3.0:1746147735.489774:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12140 00000100:00100000:3.0:1746147735.489781:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+7:32581:x1830967794247296:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147735.489863:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.489879:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f42b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcad8 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.489930:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147735.490002:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.490014:0:14545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f3fa lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa7 expref: 8 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.490021:0:14545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00000100:00100000:1.0:1746147735.490402:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794247424 00010000:00010000:3.0:1746147735.490403:0:14545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f3fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa7 expref: 8 pid: 14545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.490409:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794247424 00010000:00010000:3.0:1746147735.490414:0:14545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f3fa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa7 expref: 8 pid: 14545 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.490424:0:14545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14545:1830967796573952:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.490449:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17214 00000100:00100000:1.0:1746147735.490456:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:32576:x1830967794247424:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.490470:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.490483:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f439 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcadf expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.490503:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.490506:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.490513:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f439 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcadf expref: 38 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.490526:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f439 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcadf expref: 38 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.490536:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8eba00, rc 0) 00000100:00100000:1.0:1746147735.490571:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:32576:x1830967794247424:12345-192.168.202.10@tcp:101:cat.0 Request processed in 115us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.490577:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17214 00000100:00100000:3.0:1746147735.491362:0:14545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.493252:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.493306:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794247552 00000100:00100000:1.0:1746147735.493313:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794247552 00000100:00100000:0.0:1746147735.493330:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.493350:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794247680 00000100:00100000:0.0:1746147735.493353:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794247680 00000100:00100000:1.0:1746147735.493357:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17215 00000100:00100000:1.0:1746147735.493364:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32577:x1830967794247552:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147735.493374:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f3fa lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa7 expref: 9 pid: 14545 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.493380:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.493395:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f440 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcae6 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.493395:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8789 00000100:00100000:0.0:1746147735.493400:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794247680:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147735.493410:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.493415:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.493415:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f3fa lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa7 expref: 9 pid: 14545 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.493417:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.493423:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f440 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcae6 expref: 18 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.493437:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f440 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcae6 expref: 18 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.493451:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8ea600, rc 0) 00000100:00100000:3.0:1746147735.493485:0:14545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14545:1830967796573952:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.493492:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32577:x1830967794247552:12345-192.168.202.10@tcp:101:cat.0 Request processed in 128us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.493499:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17215 00010000:00010000:3.0:1746147735.493502:0:14545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147735.493681:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f3fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa7 expref: 9 pid: 14545 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.493728:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f3fa lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa7 expref: 9 pid: 14545 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.493781:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147735.493785:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147735.493794:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147735.493803:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147735.493825:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147735.493852:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794247680:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 452us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147735.493858:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8789 00010000:00010000:2.0:1746147735.493859:0:14545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.493870:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:2.0:1746147735.493909:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147735.494032:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f42b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad8 expref: 9 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.494148:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad8 expref: 8 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.494156:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.494158:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147735.494161:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a650fa00, rc 0) 00000100:00100000:2.0:1746147735.494206:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+8:32581:x1830967794247296:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 4426us (5423us total) trans 8589946173 rc 0/0 00000100:00100000:2.0:1746147735.494213:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12140 00000100:00100000:0.0:1746147735.496996:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.497033:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794248064 00000100:00100000:1.0:1746147735.497042:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794248064 00002000:00100000:1.0:1746147735.497085:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880094efb100 x1830967794248064/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.497096:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efb100 with x1830967794248064 ext(3145728->4194303) 00002000:00010000:1.0:1746147735.497101:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efb100 00000100:00100000:1.0:1746147735.497127:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7756 00000100:00100000:1.0:1746147735.497134:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794248064:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147735.499944:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.499995:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.500018:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794248320 00000100:00100000:2.0:1746147735.500032:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794248320 00000100:00100000:2.0:1746147735.500072:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12141 00000100:00100000:2.0:1746147735.500079:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+8:32581:x1830967794248320:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:3.0:1746147735.500091:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794248192 00000100:00100000:3.0:1746147735.500095:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794248192 00010000:00010000:2.0:1746147735.500099:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.500115:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7f44e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcaed expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147735.500119:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a0224700 x1830967794248192/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.500128:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0224700 with x1830967794248192 ext(3145728->4194303) 00002000:00010000:3.0:1746147735.500132:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0224700 00000100:00100000:3.0:1746147735.500150:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7757 00000100:00100000:3.0:1746147735.500156:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967794248192:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:2.0:1746147735.500183:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7f455 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.500196:0:14545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad8 expref: 9 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.500202:0:14545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7f455 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.500229:0:14545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad8 expref: 9 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.500240:0:14545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad8 expref: 9 pid: 14545 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.500250:0:14545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8aced80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14545:1830967796574080:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147735.500349:0:14545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.500490:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.500514:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794248704 00000100:00100000:1.0:1746147735.500519:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794248704 00002000:00100000:1.0:1746147735.500548:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fe40000 x1830967794248704/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.500556:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe40000 with x1830967794248704 ext(3145728->4194303) 00000100:00100000:2.0:1746147735.500559:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:1.0:1746147735.500561:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe40000 00000100:00100000:1.0:1746147735.500581:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794248832 00000100:00100000:1.0:1746147735.500584:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794248832 00000100:00100000:2.0:1746147735.500588:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7758 00000100:00100000:2.0:1746147735.500595:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967794248704:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:1.0:1746147735.500596:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a8acdc00 x1830967794248832/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.500602:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acdc00 with x1830967794248832 ext(2097152->3145727) 00002000:00010000:1.0:1746147735.500605:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acdc00 00000100:00100000:1.0:1746147735.500617:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7759 00000100:00100000:1.0:1746147735.500632:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794248832:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147735.501750:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.501834:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794248960 00000100:00100000:3.0:1746147735.501839:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794248960 00002000:00100000:3.0:1746147735.501861:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a8acd500 x1830967794248960/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.501870:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acd500 with x1830967794248960 ext(3145728->4194303) 00002000:00010000:3.0:1746147735.501874:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acd500 00000100:00100000:3.0:1746147735.502531:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7760 00000100:00100000:3.0:1746147735.502540:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1957:x1830967794248960:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147735.510512:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.510538:0:14545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8aced80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14545:1830967796574080:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147735.510561:0:14545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7f455 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000100:00100000:1.0:1746147735.510912:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794249216 00000100:00100000:1.0:1746147735.510919:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794249216 00010000:00010000:1.0:1746147735.510949:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad8 expref: 10 pid: 14545 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.510990:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8790 00000100:00100000:1.0:1746147735.510998:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794249216:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.511010:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.511015:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad8 expref: 10 pid: 14545 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.511026:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad8 expref: 10 pid: 14545 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.511046:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fa00/0xe64d3fbf12a7f432 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad8 expref: 10 pid: 14545 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.511063:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147735.511067:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7f455 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147735.511076:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7f455 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147735.511083:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7f455 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147735.511112:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147735.511139:0:14545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7f455 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.511146:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7f455 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000100:00100000:1.0:1746147735.511154:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794249216:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 157us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.511163:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8790 00000004:00200000:2.0:1746147735.511189:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147735.511193:0:14545:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147735.511207:0:14545:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7f455 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.511235:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095093400/0xe64d3fbf12a7f44e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaed expref: 9 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.511251:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7f455 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaed expref: 8 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.511257:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.511260:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147735.511262:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095092800, rc 0) 00000100:00100000:2.0:1746147735.511283:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+8:32581:x1830967794248320:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 11205us (11288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.511289:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12141 00000100:00100000:3.0:1746147735.516872:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967794248192:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16705us (16925us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.516900:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7757 00002000:00100000:3.0:1746147735.516912:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a0224700 x1830967794248192/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.516921:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0224700 with x1830967794248192 ext(3145728->4194303) 00002000:00010000:3.0:1746147735.516927:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0224700 00000100:00100000:2.0:1746147735.516950:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794248064:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19815us (19963us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147735.516958:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7756 00002000:00100000:2.0:1746147735.516964:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880094efb100 x1830967794248064/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.516971:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efb100 with x1830967794248064 ext(3145728->4194303) 00002000:00010000:2.0:1746147735.516974:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efb100 00000100:00100000:2.0:1746147735.523981:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967794248704:12345-192.168.202.10@tcp:3:cat.0 Request processed in 23373us (23484us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147735.523994:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7758 00002000:00100000:2.0:1746147735.524007:0:31357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fe40000 x1830967794248704/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.524017:0:31357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe40000 with x1830967794248704 ext(3145728->4194303) 00002000:00010000:2.0:1746147735.524023:0:31357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe40000 00000100:00100000:3.0:1746147735.524026:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.524065:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794249344 00000100:00100000:0.0:1746147735.524072:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794249344 00000100:00100000:0.0:1746147735.524113:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17216 00000100:00100000:0.0:1746147735.524121:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794249344:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147735.524137:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147735.524156:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095639000/0xe64d3fbf12a7f45c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcaf4 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.524182:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.524212:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796574208:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147735.524241:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794249472 00000100:00100000:2.0:1746147735.524245:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794249472 00000100:00100000:0.0:1746147735.524262:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c07fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.524264:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17217 00000100:00100000:2.0:1746147735.524268:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794249472:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.524274:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.524281:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7f463 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcafb expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.524305:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8aced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796574336:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147735.524325:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.527717:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1957:x1830967794248960:12345-192.168.202.10@tcp:3:cat.0 Request processed in 25167us (25957us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.527730:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7760 00002000:00100000:3.0:1746147735.527741:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800a8acd500 x1830967794248960/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.527751:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acd500 with x1830967794248960 ext(3145728->4194303) 00002000:00010000:3.0:1746147735.527758:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acd500 00000100:00100000:2.0:1746147735.527806:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8aced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796574336:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147735.527844:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7f463 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcafb expref: 27 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.527857:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095093a00/0xe64d3fbf12a7f463 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcafb expref: 27 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.527878:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095093a00, rc 0) 00000100:00100000:0.0:1746147735.527958:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.527974:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794249600 00000100:00100000:2.0:1746147735.527974:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794249472:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3704us (3791us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147735.527979:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794249600 00000100:00100000:2.0:1746147735.527980:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17217 00000100:00100000:3.0:1746147735.528005:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17218 00000100:00100000:3.0:1746147735.528009:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+13:1959:x1830967794249600:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147735.528021:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.528032:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f46a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb02 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.528032:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.528042:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794249728 00000100:00100000:2.0:1746147735.528045:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794249728 00000100:00100000:1.0:1746147735.528073:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794248832:12345-192.168.202.10@tcp:3:cat.0 Request processed in 27449us (27513us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.528076:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796574464:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147735.528077:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17219 00000100:00100000:1.0:1746147735.528079:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7759 00000100:00100000:2.0:1746147735.528082:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+15:1959:x1830967794249728:12345-192.168.202.10@tcp:101:lfs.0 00002000:00100000:1.0:1746147735.528084:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a8acdc00 x1830967794248832/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147735.528089:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1746147735.528091:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acdc00 with x1830967794248832 ext(2097152->3145727) 00002000:00010000:1.0:1746147735.528094:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acdc00 00010000:00010000:2.0:1746147735.528095:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095092400/0xe64d3fbf12a7f471 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb09 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.528115:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8acdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796574592:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147735.528121:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.528137:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.528137:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796574208:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147735.528154:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095639000/0xe64d3fbf12a7f45c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaf4 expref: 25 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.528162:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095639000/0xe64d3fbf12a7f45c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaf4 expref: 25 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.528175:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095639000, rc 0) 00000100:00100000:1.0:1746147735.528193:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794249344:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4074us (4168us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147735.528198:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17216 00000100:00100000:3.0:1746147735.529663:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796574464:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147735.529675:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8acdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796574592:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147735.529688:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f46a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb02 expref: 16 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.529693:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095092400/0xe64d3fbf12a7f471 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb09 expref: 16 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.529700:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f46a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb02 expref: 16 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.529703:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095092400/0xe64d3fbf12a7f471 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb09 expref: 16 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.529715:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095092400, rc 0) 00010000:00010000:3.0:1746147735.529726:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a650f800, rc 0) 00000100:00100000:3.0:1746147735.529747:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794249600:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1736us (1789us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147735.529747:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794249728:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1664us (1714us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147735.529753:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17219 00000100:00100000:3.0:1746147735.530060:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17218 00000100:00100000:2.0:1746147735.532463:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.532463:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.532522:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794250240 00000100:00100000:0.0:1746147735.532536:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794250240 00000100:00100000:3.0:1746147735.532565:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794249984 00000100:00100000:3.0:1746147735.532569:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794249984 00002000:00100000:0.0:1746147735.532582:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009fe41c00 x1830967794250240/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147735.532591:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41c00 with x1830967794250240 ext(4194304->5017599) 00002000:00010000:0.0:1746147735.532597:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe41c00 00000100:00100000:3.0:1746147735.532605:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12142 00000100:00100000:0.0:1746147735.532610:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7761 00000100:00100000:3.0:1746147735.532612:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+8:32581:x1830967794249984:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:0.0:1746147735.532615:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1960:x1830967794250240:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:3.0:1746147735.532641:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.532659:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7f478 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb10 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.532738:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f47f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.532750:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f47f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147735.532760:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f47f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:3.0:1746147735.532771:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147735.532942:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7f478 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb10 expref: 11 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.532955:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f47f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb10 expref: 10 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.532962:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147735.532964:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147735.532967:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a650ea00, rc 0) 00000100:00100000:3.0:1746147735.533013:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+10:32581:x1830967794249984:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 401us (559us total) trans 8589946174 rc 0/0 00000100:00100000:3.0:1746147735.533018:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12142 00000100:00100000:0.0:1746147735.538573:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.539985:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794250368 00000100:00100000:3.0:1746147735.539996:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794250368 00000100:00100000:1.0:1746147735.540177:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.540494:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1960:x1830967794250240:12345-192.168.202.10@tcp:3:cat.0 Request processed in 7876us (8037us total) trans 0 rc 823296/823296 00000100:00100000:0.0:1746147735.540504:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7761 00002000:00100000:0.0:1746147735.540516:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009fe41c00 x1830967794250240/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147735.540525:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41c00 with x1830967794250240 ext(4194304->5017599) 00002000:00010000:0.0:1746147735.540530:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe41c00 00000100:00100000:3.0:1746147735.540769:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794250496 00000100:00100000:3.0:1746147735.540779:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794250496 00000100:00100000:3.0:1746147735.540817:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17220 00000100:00100000:3.0:1746147735.540824:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794250368:12345-192.168.202.10@tcp:1:lfs.0 00000100:00100000:1.0:1746147735.540830:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.540857:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794250752 00000100:00100000:3.0:1746147735.540858:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794250752 00000100:00100000:1.0:1746147735.540858:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.540880:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794251008 00000100:00100000:3.0:1746147735.540882:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794251008 00000100:00100000:3.0:1746147735.540920:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17221 00000100:00100000:3.0:1746147735.540924:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794250496:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:3.0:1746147735.540947:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f48d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.540961:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 17 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.540967:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147735.540968:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746147735.540969:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17222 00010000:00010000:3.0:1746147735.540971:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f48d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.540977:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+15:1960:x1830967794250752:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:3.0:1746147735.540996:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 17 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.541006:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 17 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.541009:0:8470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f8bbc00/0xe64d3fbf12a7f494 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.541018:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796574720:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147735.541025:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f3b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca76 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.541033:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6542600/0xe64d3fbf12a7f40f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcac3 expref: 15 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.541040:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f3bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca7d expref: 37 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.541045:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.541047:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.541050:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8bbc00/0xe64d3fbf12a7f494 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.541073:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f3bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca7d expref: 37 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.541083:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f3bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca7d expref: 37 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.541094:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796574848:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.541159:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8b01540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.541166:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17223 00000100:00100000:1.0:1746147735.541173:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794251008:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:1.0:1746147735.541192:0:8469:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092c24400/0xe64d3fbf12a7f49b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.541201:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f3de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa0 expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.541208:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f440 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcae6 expref: 17 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.541214:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095639400/0xe64d3fbf12a7f41d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad1 expref: 14 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.541218:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.541219:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.541221:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092c24400/0xe64d3fbf12a7f49b lrc: 6/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.541234:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095639400/0xe64d3fbf12a7f41d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad1 expref: 14 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.541240:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095639400/0xe64d3fbf12a7f41d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad1 expref: 14 pid: 22183 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.541247:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe41180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796574976:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.541441:0:4591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f4a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.541452:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f360 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca29 expref: 37 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.541459:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea200/0xe64d3fbf12a7f401 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaae expref: 15 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.541466:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f367 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca30 expref: 21 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.541471:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.541472:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.541474:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f4a2 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.541491:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f367 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca30 expref: 21 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.541500:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f367 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca30 expref: 21 pid: 4592 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.541508:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796575104:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147735.541563:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6542600/0xe64d3fbf12a7f40f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcac3 expref: 15 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.541571:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6542600/0xe64d3fbf12a7f40f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcac3 expref: 15 pid: 6715 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746147735.541579:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796575232:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147735.541605:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f3b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca76 expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.541612:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f3b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca76 expref: 21 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.541629:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796575360:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147735.541645:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c07fc00 going to sleep for 11 seconds 00010000:00010000:1.0:1746147735.541771:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f440 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcae6 expref: 17 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.541780:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f440 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcae6 expref: 17 pid: 6715 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.541788:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796575488:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147735.541813:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f3de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa0 expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.541822:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f3de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa0 expref: 23 pid: 4592 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.541830:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796575616:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.541844:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.541936:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.541976:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.542014:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.542037:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794251264 00000100:00100000:2.0:1746147735.542042:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794251264 00002000:00100000:2.0:1746147735.542066:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a8acf800 x1830967794251264/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.542075:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf800 with x1830967794251264 ext(4194304->5017599) 00002000:00010000:2.0:1746147735.542079:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acf800 00000100:00100000:2.0:1746147735.542095:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7762 00000100:00100000:2.0:1746147735.542101:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794251264:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147735.543246:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794250624 00000100:00100000:0.0:1746147735.543253:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794250624 00000100:00100000:0.0:1746147735.543282:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794250880 00000100:00100000:0.0:1746147735.543284:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794250880 00000100:00100000:0.0:1746147735.543297:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17224 00000100:00100000:0.0:1746147735.543302:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+15:1960:x1830967794250624:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:0.0:1746147735.543326:0:6715:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ba800/0xe64d3fbf12a7f4a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.543338:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 17 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.543343:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147735.543344:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147735.543346:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ba800/0xe64d3fbf12a7f4a9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.543363:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 17 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.543372:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 17 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.543381:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796575744:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147735.543407:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c07fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.543419:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17225 00000100:00100000:0.0:1746147735.543423:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+16:1960:x1830967794250880:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:0.0:1746147735.543438:0:22183:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.543446:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca99 expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.543453:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f439 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcadf expref: 37 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.543459:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095639a00/0xe64d3fbf12a7f424 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaca expref: 16 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.543463:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.543464:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.543466:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.543478:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095639a00/0xe64d3fbf12a7f424 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaca expref: 16 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.543484:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095639a00/0xe64d3fbf12a7f424 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaca expref: 16 pid: 22183 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746147735.543491:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796575872:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147735.543510:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f439 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcadf expref: 37 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.543518:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f439 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcadf expref: 37 pid: 6715 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.543531:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796576000:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147735.543550:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca99 expref: 23 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.543557:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca99 expref: 23 pid: 4592 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.543563:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796576128:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147735.543574:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c07f480 going to sleep for 11 seconds 00010000:00010000:3.0:1746147735.543703:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea200/0xe64d3fbf12a7f401 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaae expref: 16 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.543715:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea200/0xe64d3fbf12a7f401 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaae expref: 16 pid: 4592 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147735.543725:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796576256:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.543769:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f360 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca29 expref: 37 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.543780:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f360 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca29 expref: 37 pid: 6715 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.543788:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796576384:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.543799:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.550224:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.552505:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.552811:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794251392 00000100:00100000:3.0:1746147735.552819:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794251392 00000100:00100000:3.0:1746147735.552860:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794251520 00000100:00100000:3.0:1746147735.552862:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794251520 00000100:00100000:3.0:1746147735.552879:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17226 00000100:00100000:3.0:1746147735.552903:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794251392:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147735.552925:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.552946:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f4b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb17 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.552999:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796576512:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147735.553072:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.553134:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796574720:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.553152:0:20619:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f48d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.553322:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796574848:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.553364:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796575232:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.553389:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796575360:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.553407:0:8470:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f8bbc00/0xe64d3fbf12a7f494 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.553651:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe41180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796574976:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.553665:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796575488:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147735.553743:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17227 00000100:00100000:2.0:1746147735.553751:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967794251520:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.553758:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.553768:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f4be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb1e expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.553791:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796576640:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147735.553836:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.554806:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794251264:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12702us (12787us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746147735.554814:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7762 00002000:00100000:3.0:1746147735.554824:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a8acf800 x1830967794251264/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.554832:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acf800 with x1830967794251264 ext(4194304->5017599) 00010000:00010000:3.0:1746147735.554839:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca99 expref: 22 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.554849:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca99 expref: 22 pid: 4592 timeout: 914 lvb_type: 0 00002000:00010000:3.0:1746147735.554854:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a8acf800 00000100:00100000:1.0:1746147735.557159:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796575616:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147735.557159:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796575744:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147735.557182:0:6715:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f8ba800/0xe64d3fbf12a7f4a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.557183:0:8469:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092c24400/0xe64d3fbf12a7f49b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.557226:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796575872:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.557234:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796576000:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.557241:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796576128:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147735.557249:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147735.557262:0:22183:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.557286:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.557306:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.557334:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796575104:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147735.557335:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.557341:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796576256:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.557347:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796576384:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.557373:0:4591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f4a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.557393:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794252288 00000100:00100000:2.0:1746147735.557396:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794252032 00000100:00100000:3.0:1746147735.557398:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794252288 00000100:00100000:2.0:1746147735.557399:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794252032 00010000:00010000:2.0:1746147735.557425:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f440 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcae6 expref: 19 pid: 6715 timeout: 914 lvb_type: 0 00002000:00100000:3.0:1746147735.557433:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1159167) req@ffff8800954c1500 x1830967794252288/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.557441:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1500 with x1830967794252288 ext(1048576->1159167) 00010000:00010000:3.0:1746147735.557448:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 19 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.557451:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794251904 00000100:00100000:2.0:1746147735.557453:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794251904 00010000:00010000:3.0:1746147735.557457:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 19 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.557462:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095639400/0xe64d3fbf12a7f41d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad1 expref: 16 pid: 22183 timeout: 914 lvb_type: 1 00002000:00010000:3.0:1746147735.557463:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800954c1500 00000100:00100000:2.0:1746147735.557473:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794252160 00000100:00100000:2.0:1746147735.557474:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794252160 00000100:00100000:3.0:1746147735.557481:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8791 00010000:00010000:2.0:1746147735.557482:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f367 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca30 expref: 22 pid: 4592 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.557487:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1957:x1830967794252032:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147735.557494:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8792 00000100:00100000:2.0:1746147735.557497:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6672050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+16:1957:x1830967794251904:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.557498:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.557502:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.557517:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f440 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcae6 expref: 19 pid: 6715 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.557517:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095639400/0xe64d3fbf12a7f41d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad1 expref: 16 pid: 22183 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746147735.557526:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f440 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcae6 expref: 19 pid: 6715 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.557775:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8793 00000100:00100000:0.0:1746147735.557782:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967794252160:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147735.557791:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147735.557805:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f367 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca30 expref: 22 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.557813:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f367 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca30 expref: 22 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.557834:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5896800/0xe64d3fbf12a7f367 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca30 expref: 22 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.557854:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147735.557909:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967794252160:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 128us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147735.557916:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8793 00010000:00010000:2.0:1746147735.558038:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095639400/0xe64d3fbf12a7f41d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad1 expref: 16 pid: 22183 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746147735.558055:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f440 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcae6 expref: 19 pid: 6715 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.558059:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095639400/0xe64d3fbf12a7f41d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcad1 expref: 16 pid: 22183 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746147735.558076:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.558095:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6672050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+15:1957:x1830967794251904:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 597us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.558101:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8792 00000100:00100000:2.0:1746147735.558136:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1573 00000100:00100000:2.0:1746147735.558141:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794252288:12345-192.168.202.10@tcp:4:cat.0 00010000:00010000:3.0:1746147735.558179:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147735.558196:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794252032:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 709us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.558202:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8791 00000100:00100000:0.0:1746147735.558314:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.558339:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.558384:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.558397:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.558407:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.558418:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.558421:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794251776 00000100:00100000:1.0:1746147735.558425:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794251776 00000100:00100000:0.0:1746147735.558431:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147735.558439:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6542600/0xe64d3fbf12a7f40f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcac3 expref: 17 pid: 6715 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746147735.558442:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.558449:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794252544 00000100:00100000:1.0:1746147735.558451:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794252544 00010000:00010000:1.0:1746147735.558458:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095639a00/0xe64d3fbf12a7f424 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaca expref: 18 pid: 22183 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.558465:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794252800 00000100:00100000:1.0:1746147735.558467:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794252800 00010000:00010000:1.0:1746147735.558473:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea200/0xe64d3fbf12a7f401 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaae expref: 19 pid: 4592 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.558481:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794252416 00000100:00100000:1.0:1746147735.558482:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794252416 00010000:00010000:1.0:1746147735.558490:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f3bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca7d expref: 38 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.558498:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794252672 00000100:00100000:1.0:1746147735.558500:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794252672 00010000:00010000:1.0:1746147735.558506:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f439 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcadf expref: 39 pid: 6715 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.558513:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794253056 00000100:00100000:1.0:1746147735.558515:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794253056 00010000:00010000:1.0:1746147735.558525:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f3de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa0 expref: 28 pid: 4592 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.558533:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794252928 00000100:00100000:1.0:1746147735.558534:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794252928 00010000:00010000:1.0:1746147735.558542:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f3b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca76 expref: 21 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.558551:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8794 00000100:00100000:1.0:1746147735.558555:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+19:1960:x1830967794251776:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.558561:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.558571:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6542600/0xe64d3fbf12a7f40f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcac3 expref: 19 pid: 6715 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.558578:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6542600/0xe64d3fbf12a7f40f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcac3 expref: 19 pid: 6715 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.558589:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6542600/0xe64d3fbf12a7f40f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcac3 expref: 19 pid: 6715 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.558600:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147735.558616:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+18:1960:x1830967794251776:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 61us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.558631:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8794 00000100:00100000:1.0:1746147735.558640:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8795 00000100:00100000:1.0:1746147735.558644:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+17:1960:x1830967794252544:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.558652:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.558660:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095639a00/0xe64d3fbf12a7f424 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaca expref: 17 pid: 22183 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.558667:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095639a00/0xe64d3fbf12a7f424 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaca expref: 17 pid: 22183 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.558676:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095639a00/0xe64d3fbf12a7f424 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaca expref: 17 pid: 22183 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.558683:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147735.558693:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+16:1960:x1830967794252544:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 48us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.558698:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8796 00000100:00100000:1.0:1746147735.558701:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8795 00000100:00100000:2.0:1746147735.558703:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+16:1960:x1830967794252800:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147735.558708:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8797 00010000:00010000:2.0:1746147735.558709:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147735.558711:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1960:x1830967794252416:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.558715:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.558717:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea200/0xe64d3fbf12a7f401 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaae expref: 15 pid: 4592 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.558720:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f3bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca7d expref: 39 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.558724:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea200/0xe64d3fbf12a7f401 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaae expref: 15 pid: 4592 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.558727:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f3bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca7d expref: 39 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.558734:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea200/0xe64d3fbf12a7f401 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaae expref: 15 pid: 4592 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.558735:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f3bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca7d expref: 39 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.558741:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147735.558746:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.558752:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794252800:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 49us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.558755:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1960:x1830967794252416:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 43us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.558757:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8796 00000100:00100000:1.0:1746147735.558759:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8797 00000100:00100000:2.0:1746147735.558765:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8798 00000100:00100000:1.0:1746147735.558768:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8799 00000100:00100000:2.0:1746147735.558769:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1960:x1830967794252672:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147735.558771:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6670850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794253056:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147735.558775:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.558776:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.558780:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f439 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcadf expref: 37 pid: 6715 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.558783:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f3de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa0 expref: 28 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.558787:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f439 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcadf expref: 37 pid: 6715 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.558790:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f3de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa0 expref: 28 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.558795:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f439 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcadf expref: 37 pid: 6715 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.558800:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f3de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaa0 expref: 28 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.558802:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147735.558807:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.558809:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147735.558812:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967794252672:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 43us (394us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147735.558813:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092c24400/0xe64d3fbf12a7f49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.558817:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8798 00010000:00010000:1.0:1746147735.558821:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092c24400/0xe64d3fbf12a7f49b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.558824:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8800 00000100:00100000:2.0:1746147735.558828:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967794252928:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147735.558833:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.558838:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f3b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca76 expref: 21 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.558840:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147735.558845:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f3b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca76 expref: 21 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.558850:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6670850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794253056:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 79us (419us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147735.558854:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f3b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca76 expref: 21 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.558855:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8799 00010000:00010000:2.0:1746147735.558866:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.558867:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.558870:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8bbc00/0xe64d3fbf12a7f494 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.558875:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8bbc00/0xe64d3fbf12a7f494 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.558881:0:8469:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092c24400/0xe64d3fbf12a7f49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.558903:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147735.558908:0:8469:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092c24400/0xe64d3fbf12a7f49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.558916:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1957:x1830967794252928:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 87us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.558921:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8800 00000100:00100000:2.0:1746147735.558956:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796576640:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147735.558973:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f4be lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb1e expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.558983:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f4be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb1e expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.558991:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8eb800, rc 0) 00000100:00100000:2.0:1746147735.559005:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794251520:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5257us (6509us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147735.559011:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17227 00010000:00010000:2.0:1746147735.559042:0:8470:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f8bbc00/0xe64d3fbf12a7f494 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.559053:0:8470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8bbc00/0xe64d3fbf12a7f494 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.559068:0:8470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f8bbc00/0xe64d3fbf12a7f494 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.559075:0:8470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8bbc00/0xe64d3fbf12a7f494 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.559082:0:8470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f8bbc00/0xe64d3fbf12a7f494 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.559089:0:8470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8bbc00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147735.559092:0:8470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8bbc00/0xe64d3fbf12a7f494 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.559099:0:8470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8bbc00/0xe64d3fbf12a7f494 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.559107:0:8470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f8bbc00/0xe64d3fbf12a7f494 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.559112:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8bbc00/0xe64d3fbf12a7f494 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.559141:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794250752:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 18165us (18312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.559148:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17222 00000100:00100000:3.0:1746147735.559160:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794251648 00000100:00100000:3.0:1746147735.559163:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794251648 00000100:00100000:2.0:1746147735.559178:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796576512:192.168.202.10@tcp:106: 00002000:00100000:3.0:1746147735.559182:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1458176->2097151) req@ffff8800954c2680 x1830967794251648/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.559189:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c2680 with x1830967794251648 ext(1458176->2097151) 00010000:00010000:2.0:1746147735.559191:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f4b7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb17 expref: 24 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.559194:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1458176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 19 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.559199:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f4b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb17 expref: 24 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.559203:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1458176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 19 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.559207:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e60800, rc 0) 00002000:00010000:3.0:1746147735.559208:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800954c2680 00000100:00100000:2.0:1746147735.559220:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794251392:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6334us (9005us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147735.559225:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17226 00000100:00100000:3.0:1746147735.559226:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1574 00000100:00100000:3.0:1746147735.559231:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:1960:x1830967794251648:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147735.559711:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.559902:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794253184 00000100:00100000:2.0:1746147735.559906:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794253184 00010000:00010000:2.0:1746147735.559920:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f360 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca29 expref: 36 pid: 6715 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.559936:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8801 00000100:00100000:2.0:1746147735.559940:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967794253184:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147735.559947:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.559955:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f360 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca29 expref: 36 pid: 6715 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.559963:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f360 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca29 expref: 36 pid: 6715 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.559978:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f360 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca29 expref: 36 pid: 6715 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.559986:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.559988:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.559991:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f4a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.559997:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f4a2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.560012:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.560029:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967794253184:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 88us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.560034:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8801 00010000:00010000:1.0:1746147735.560119:0:8469:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092c24400/0xe64d3fbf12a7f49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.560126:0:8469:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092c24400/0xe64d3fbf12a7f49b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.560133:0:8469:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092c24400/0xe64d3fbf12a7f49b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.560138:0:8469:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092c24400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147735.560141:0:8469:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092c24400/0xe64d3fbf12a7f49b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.560147:0:8469:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092c24400/0xe64d3fbf12a7f49b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.560157:0:8469:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092c24400/0xe64d3fbf12a7f49b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.560164:0:4591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f4a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.560166:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092c24400/0xe64d3fbf12a7f49b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.560171:0:4591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f4a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.560184:0:4591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f4a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.560189:0:4591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f4a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.560199:0:4591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f4a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.560199:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794251008:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 19027us (19341us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147735.560204:0:4591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e127e00 already unused, calling callback (ffffffffa087ad70) 00000100:00100000:1.0:1746147735.560205:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17223 00010000:00010000:2.0:1746147735.560206:0:4591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f4a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.560212:0:4591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.560220:0:4591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f4a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.560225:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f4a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.560710:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794250368:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 19885us (22148us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.560717:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17220 00000100:00100000:2.0:1746147735.561737:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.562538:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.562560:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.562576:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.562589:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.562606:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794253312 00000100:00100000:1.0:1746147735.562612:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794253312 00000100:00100000:2.0:1746147735.562648:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967794252288:12345-192.168.202.10@tcp:4:cat.0 Request processed in 4506us (5360us total) trans 21474841724 rc 0/0 00000100:00100000:1.0:1746147735.562651:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794253440 00000100:00100000:1.0:1746147735.562653:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794253440 00000100:00100000:2.0:1746147735.562657:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1573 00000100:00100000:1.0:1746147735.562662:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794253568 00000100:00100000:1.0:1746147735.562663:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794253568 00002000:00100000:2.0:1746147735.562667:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1159167) req@ffff8800954c1500 x1830967794252288/t21474841724(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/448 e 0 to 0 dl 1746147746 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147735.562679:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794253696 00000100:00100000:1.0:1746147735.562680:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794253696 00002000:00100000:2.0:1746147735.562685:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1500 with x1830967794252288 ext(1048576->1159167) 00000100:00100000:1.0:1746147735.562690:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794253952 00000100:00100000:1.0:1746147735.562691:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794253952 00010000:00010000:2.0:1746147735.562694:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 23 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.562702:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17228 00010000:00010000:2.0:1746147735.562706:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 24 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.562707:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967794253312:12345-192.168.202.10@tcp:101:cat.0 00002000:00010000:2.0:1746147735.562712:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800954c1500 00010000:00010000:1.0:1746147735.562720:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147735.562731:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17229 00000100:00100000:2.0:1746147735.562736:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967794253440:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.562736:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7f4c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb25 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.562741:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.562749:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095093400/0xe64d3fbf12a7f4cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb2c expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147735.562754:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x68141997, atime: 0x68141997, ctime: 0x68141998, blocks: 0x7fd 00010000:00010000:1.0:1746147735.562764:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.562765:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.562773:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7f4c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb25 expref: 22 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.562785:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7f4c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb25 expref: 22 pid: 8468 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147735.562787:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796576768:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147735.562795:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5642a00, rc 0) 00000100:00100000:1.0:1746147735.562809:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967794253312:12345-192.168.202.10@tcp:101:cat.0 Request processed in 102us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.562814:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17228 00000100:00100000:1.0:1746147735.562823:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17230 00000100:00100000:1.0:1746147735.562827:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a9c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967794253568:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.562832:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147735.562834:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90ce40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147735.562837:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7f4d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb33 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.562850:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17231 00000100:00100000:2.0:1746147735.562854:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794253696:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147735.562855:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796576896:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147735.562860:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.562867:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f4da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb3a expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.562873:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f000 going to sleep for 11 seconds 00002000:00010000:2.0:1746147735.562878:0:8184:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x68141997, atime: 0x68141997, ctime: 0x68141998, blocks: 0x81f 00010000:00010000:2.0:1746147735.562904:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147735.562905:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17232 00010000:00010000:2.0:1746147735.562906:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.562910:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f4da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb3a expref: 22 pid: 8184 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147735.562910:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967794253952:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.562915:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.562918:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f4da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb3a expref: 22 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.562922:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013179e400/0xe64d3fbf12a7f4e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb48 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.562925:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0600, rc 0) 00000100:00100000:2.0:1746147735.562938:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794253696:12345-192.168.202.10@tcp:101:cat.0 Request processed in 83us (361us total) trans 0 rc 0/0 00002000:00010000:1.0:1746147735.562939:0:10613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x456:0x0] initial LVB size: 4194304, mtime: 0x68141997, atime: 0x68141997, ctime: 0x68141998, blocks: 0x1029 00000100:00100000:2.0:1746147735.562942:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17231 00010000:00010000:1.0:1746147735.562945:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.562946:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.562950:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013179e400/0xe64d3fbf12a7f4e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb48 expref: 26 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.562959:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013179e400/0xe64d3fbf12a7f4e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb48 expref: 26 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.562965:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179e400, rc 0) 00000100:00100000:2.0:1746147735.562978:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.562978:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967794253952:12345-192.168.202.10@tcp:101:cat.0 Request processed in 68us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.562982:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17232 00000100:00100000:1.0:1746147735.562989:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794253824 00000100:00100000:1.0:1746147735.562991:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794253824 00000100:00100000:1.0:1746147735.563009:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17233 00000100:00100000:1.0:1746147735.563013:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794253824:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.563018:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.563024:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f4e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb41 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.563032:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.563039:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f4e8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb41 expref: 23 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.563046:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a650f800/0xe64d3fbf12a7f4e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb41 expref: 23 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.563056:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a650f800, rc 0) 00000100:00100000:1.0:1746147735.563070:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794253824:12345-192.168.202.10@tcp:101:cat.0 Request processed in 56us (91us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147735.564673:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17233 00000100:00100000:0.0:1746147735.565587:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.565825:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794254080 00000100:00100000:1.0:1746147735.565832:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794254080 00000100:00100000:1.0:1746147735.565865:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17234 00000100:00100000:1.0:1746147735.565871:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:32576:x1830967794254080:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:0.0:1746147735.566107:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147735.566282:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.566299:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f4ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb4f expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.566367:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.566371:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.566378:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147735.566383:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f4ef lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [5013504->5242879] (req 5013504->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb4f expref: 36 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.566400:0:10613:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.566413:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f4ef lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [5013504->5242879] (req 5013504->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb4f expref: 36 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.566427:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a650fe00, rc 0) 00000100:00100000:1.0:1746147735.566547:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:32576:x1830967794254080:12345-192.168.202.10@tcp:101:cat.0 Request processed in 675us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.566553:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17234 00000100:00100000:3.0:1746147735.566758:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794254208 00000100:00100000:3.0:1746147735.566762:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794254208 00000100:00100000:0.0:1746147735.566782:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147735.566784:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca99 expref: 22 pid: 4592 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.567108:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794254336 00000100:00100000:3.0:1746147735.567112:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794254336 00000100:00100000:2.0:1746147735.567113:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8802 00000100:00100000:2.0:1746147735.567120:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967794254208:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.567125:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 26 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.567128:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.567153:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca99 expref: 22 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.567164:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca99 expref: 22 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.567184:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f3d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca99 expref: 22 pid: 4592 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.567195:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.567196:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.567199:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.567207:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.567230:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.567251:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967794254208:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 131us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.567257:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8802 00000100:00100000:2.0:1746147735.567269:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8803 00000100:00100000:2.0:1746147735.567273:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794254336:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147735.567281:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.567293:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 26 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.567301:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 26 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.567313:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.567314:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.567317:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ba800/0xe64d3fbf12a7f4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.567322:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ba800/0xe64d3fbf12a7f4a9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.567334:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.567349:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794254336:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 75us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.567355:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8803 00010000:00010000:0.0:1746147735.567412:0:22183:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.567420:0:22183:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.567441:0:22183:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.567448:0:22183:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.567455:0:22183:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.567460:0:22183:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8ba200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147735.567463:0:22183:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.567508:0:22183:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.567538:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.567540:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.567545:0:22183:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f4ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb4f expref: 35 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.567552:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f4ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb4f expref: 35 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.567578:0:22183:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f4ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb4f expref: 35 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.567595:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796577024:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147735.568198:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c07fe40 going to sleep for 11 seconds 00010000:00010000:0.0:1746147735.568215:0:6715:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f8ba800/0xe64d3fbf12a7f4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.568223:0:6715:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8ba800/0xe64d3fbf12a7f4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.568240:0:6715:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ba800/0xe64d3fbf12a7f4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.568246:0:6715:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ba800/0xe64d3fbf12a7f4a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.568252:0:6715:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f8ba800/0xe64d3fbf12a7f4a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.568257:0:6715:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8ba800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147735.568260:0:6715:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f8ba800/0xe64d3fbf12a7f4a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.568266:0:6715:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f8ba800/0xe64d3fbf12a7f4a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.568276:0:6715:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f8ba800/0xe64d3fbf12a7f4a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.568282:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ba800/0xe64d3fbf12a7f4a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.568321:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794250624:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 25017us (26384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147735.568328:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17224 00010000:00010000:1.0:1746147735.570807:0:8468:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.10@tcp) returned -22 from glimpse AST (req@ffff88009fe43b80 x1830967796576896) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 25 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.570817:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796576768:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147735.570832:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f3c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca84 expref: 25 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.570843:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796576896:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147735.570844:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095093400/0xe64d3fbf12a7f4cc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb2c expref: 24 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.570856:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095093400/0xe64d3fbf12a7f4cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb2c expref: 24 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.570860:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7f4d3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb33 expref: 24 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.570864:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095093400, rc 0) 00010000:00010000:1.0:1746147735.570867:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7f4d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb33 expref: 23 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.570881:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136404800, rc 0) 00000100:00100000:2.0:1746147735.570922:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794253440:12345-192.168.202.10@tcp:101:cat.0 Request processed in 8180us (8381us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147735.570923:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a9c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967794253568:12345-192.168.202.10@tcp:101:cat.0 Request processed in 8095us (8362us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147735.570930:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17230 00000100:00100000:2.0:1746147735.570954:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17229 00000100:00100000:3.0:1746147735.573676:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794251648:12345-192.168.202.10@tcp:4:cat.0 Request processed in 14434us (15267us total) trans 21474841725 rc 0/0 00000100:00100000:3.0:1746147735.573687:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1574 00002000:00100000:3.0:1746147735.573698:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1458176->2097151) req@ffff8800954c2680 x1830967794251648/t21474841725(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/448 e 0 to 0 dl 1746147746 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.573707:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c2680 with x1830967794251648 ext(1458176->2097151) 00010000:00010000:3.0:1746147735.573717:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 21 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746147735.573731:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 21 pid: 22183 timeout: 914 lvb_type: 0 00002000:00010000:3.0:1746147735.573737:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800954c2680 00000100:00100000:0.0:1746147735.574385:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.574403:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.574461:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796577024:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147735.574482:0:22183:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.574490:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba200/0xe64d3fbf12a7f4b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.574529:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794250880:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 31105us (32552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.574536:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17225 00000100:00100000:2.0:1746147735.574800:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.574824:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794254464 00000100:00100000:1.0:1746147735.574830:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794254592 00000100:00100000:3.0:1746147735.574831:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794254464 00000100:00100000:1.0:1746147735.574834:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794254592 00000100:00100000:2.0:1746147735.574840:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.574853:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.574868:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794254720 00000100:00100000:1.0:1746147735.574868:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794254848 00000100:00100000:3.0:1746147735.574870:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794254720 00000100:00100000:1.0:1746147735.574870:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794254848 00000100:00100000:2.0:1746147735.574875:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794254976 00000100:00100000:2.0:1746147735.574877:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794254976 00000100:00100000:3.0:1746147735.574904:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17235 00000100:00100000:3.0:1746147735.574910:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1957:x1830967794254464:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147735.574926:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.574940:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8bb800/0xe64d3fbf12a7f4f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb56 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.574959:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.574961:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.574970:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8bb800/0xe64d3fbf12a7f4f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb56 expref: 38 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.574984:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8bb800/0xe64d3fbf12a7f4f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb56 expref: 38 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.574995:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8bb800, rc 0) 00000100:00100000:3.0:1746147735.575015:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967794254464:12345-192.168.202.10@tcp:101:cat.0 Request processed in 106us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.575155:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17236 00000100:00100000:2.0:1746147735.575159:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17237 00000100:00100000:1.0:1746147735.575161:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32577:x1830967794254592:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147735.575164:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794254720:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.575169:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.575170:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.575176:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f4fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb5d expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.575179:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0400/0xe64d3fbf12a7f504 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb64 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.575188:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.575190:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.575193:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f4fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb5d expref: 22 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.575201:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f4fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb5d expref: 22 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.575208:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a650e000, rc 0) 00000100:00100000:2.0:1746147735.575211:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796577152:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147735.575221:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32577:x1830967794254592:12345-192.168.202.10@tcp:101:cat.0 Request processed in 62us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.575227:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17236 00000100:00100000:1.0:1746147735.575238:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17238 00000100:00100000:1.0:1746147735.575242:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794254848:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.575247:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147735.575251:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90ce40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147735.575254:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7f50b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb6b expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147735.575273:0:22183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x68141998, atime: 0x68141997, ctime: 0x68141998, blocks: 0x821 00010000:00010000:1.0:1746147735.575280:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.575281:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147735.575285:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147735.575285:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7f50b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb6b expref: 26 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.575294:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7f50b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb6b expref: 26 pid: 22183 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147735.575299:0:8184:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794255104 00010000:00010000:1.0:1746147735.575300:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a650f600, rc 0) 00000100:00100000:2.0:1746147735.575302:0:8184:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794255104 00000100:00100000:1.0:1746147735.575312:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967794254848:12345-192.168.202.10@tcp:101:cat.0 Request processed in 70us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.575315:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17239 00000100:00100000:1.0:1746147735.575317:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17238 00000100:00100000:2.0:1746147735.575318:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1957:x1830967794254976:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.575324:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147735.575325:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17240 00000100:00100000:1.0:1746147735.575329:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967794255104:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.575331:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f512 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb72 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.575333:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.575338:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f519 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb79 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.575340:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.575341:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.575345:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb72 expref: 39 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.575350:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.575351:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.575354:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb72 expref: 39 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.575354:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f519 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb79 expref: 27 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.575361:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950e5400, rc 0) 00010000:00010000:1.0:1746147735.575362:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f519 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb79 expref: 27 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.575368:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a650e600, rc 0) 00000100:00100000:2.0:1746147735.575372:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1957:x1830967794254976:12345-192.168.202.10@tcp:101:cat.0 Request processed in 54us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.575377:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17239 00000100:00100000:1.0:1746147735.575377:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967794255104:12345-192.168.202.10@tcp:101:cat.0 Request processed in 48us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.575381:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17240 00000100:00100000:3.0:1746147735.576432:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17235 00000100:00100000:0.0:1746147735.578320:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.578363:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.578513:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794255616 00000100:00100000:2.0:1746147735.578519:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796577152:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147735.578520:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794255616 00010000:00010000:1.0:1746147735.578549:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1458176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 21 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746147735.578550:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0400/0xe64d3fbf12a7f504 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb64 expref: 26 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.578561:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0400/0xe64d3fbf12a7f504 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb64 expref: 26 pid: 8470 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147735.578574:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8804 00010000:00010000:2.0:1746147735.578576:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0400, rc 0) 00000100:00100000:1.0:1746147735.578579:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794255616:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.578591:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.578599:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1458176->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 21 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746147735.578609:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1458176->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 21 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.578613:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794254720:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3448us (3813us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147735.578629:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17237 00000100:00100000:2.0:1746147735.578645:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794255488 00000100:00100000:2.0:1746147735.578647:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794255488 00000100:00100000:2.0:1746147735.578667:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17241 00000100:00100000:2.0:1746147735.578671:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794255488:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.578722:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.578731:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f520 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb87 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.578744:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.578750:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f520 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb87 expref: 23 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.578758:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e127e00/0xe64d3fbf12a7f520 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb87 expref: 23 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.578764:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e127e00, rc 0) 00010000:00010000:1.0:1746147735.578771:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5dee400/0xe64d3fbf12a7f3ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1458176->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca6f expref: 21 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.578778:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794255488:12345-192.168.202.10@tcp:101:cat.0 Request processed in 107us (415us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147735.578783:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17241 00010000:00010000:1.0:1746147735.578783:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.578785:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.578789:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.578796:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f48d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.578982:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147735.579002:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1960:x1830967794255616:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 422us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.579196:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8804 00000100:00100000:0.0:1746147735.579372:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.579404:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.579451:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794255744 00000100:00100000:2.0:1746147735.579454:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794255744 00000100:00100000:2.0:1746147735.579472:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17242 00000100:00100000:2.0:1746147735.579476:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:1957:x1830967794255744:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.579484:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.579491:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f527 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb8e expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.579501:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.579503:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.579508:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb8e expref: 21 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.579512:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.579518:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb8e expref: 21 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.579520:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.579525:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8ea800, rc 0) 00010000:00010000:3.0:1746147735.579541:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.579542:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967794255744:12345-192.168.202.10@tcp:101:cat.0 Request processed in 66us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.579547:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17242 00010000:00010000:3.0:1746147735.579548:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f48d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.579555:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f48d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.579561:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0298800 already unused, calling callback (ffffffffa087ad70) 00000100:00100000:2.0:1746147735.579562:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794255360 00000100:00100000:2.0:1746147735.579565:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794255360 00010000:00010000:3.0:1746147735.579566:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f48d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.579574:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f48d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.579583:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12143 00010000:00010000:3.0:1746147735.579584:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f48d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.579587:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32583:x1830967794255360:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147735.579589:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f48d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.579599:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.579609:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f52e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb80 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.579653:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794250496:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 38727us (39479us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.579658:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17221 00010000:00010000:2.0:1746147735.579707:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f535 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.579718:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f535 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.579725:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f535 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.579734:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f53c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.579739:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f53c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.579743:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f53c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.579835:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.579845:0:14545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f47f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb10 expref: 9 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.579851:0:14545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.579873:0:14545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f47f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb10 expref: 9 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.579901:0:14545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f47f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb10 expref: 9 pid: 14545 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746147735.579914:0:14545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14545:1830967796577280:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147735.579966:0:14545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.581501:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.581586:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.581746:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794256000 00000100:00100000:3.0:1746147735.581755:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794256000 00002000:00100000:3.0:1746147735.581799:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (5013504->5017599) req@ffff8800954c0e00 x1830967794256000/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.581809:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c0e00 with x1830967794256000 ext(5013504->5017599) 00002000:00010000:3.0:1746147735.581816:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c0e00 00000100:00100000:3.0:1746147735.581841:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7763 00000100:00100000:3.0:1746147735.581849:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1958:x1830967794256000:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147735.582093:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1958:x1830967794256000:12345-192.168.202.10@tcp:3:cat.0 Request processed in 243us (595us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147735.582101:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7763 00002000:00100000:3.0:1746147735.582107:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (5013504->5017599) req@ffff8800954c0e00 x1830967794256000/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/4536 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.582115:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c0e00 with x1830967794256000 ext(5013504->5017599) 00002000:00010000:3.0:1746147735.582118:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c0e00 00000100:00100000:2.0:1746147735.582125:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794256256 00000100:00100000:2.0:1746147735.582130:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794256256 00000100:00100000:2.0:1746147735.582156:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12144 00000100:00100000:2.0:1746147735.582161:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41587371-240a-4781-aecb-638f17200fbd+10:32581:x1830967794256256:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:2.0:1746147735.582194:0:15085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.582213:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095092800/0xe64d3fbf12a7f455 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcaed expref: 10 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.582229:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.582233:0:15085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.582239:0:15085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.582265:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41587371-240a-4781-aecb-638f17200fbd+9:32581:x1830967794256256:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 104us (679us total) trans 0 rc -16/-16 00000100:00100000:2.0:1746147735.582270:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12144 00000100:00100000:1.0:1746147735.583084:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.583107:0:14545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14545:1830967796577280:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147735.583123:0:14545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000100:00100000:0.0:1746147735.583132:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794256384 00000100:00100000:0.0:1746147735.583136:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794256384 00010000:00010000:0.0:1746147735.583153:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f47f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb10 expref: 9 pid: 14545 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746147735.583156:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.583196:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8805 00000100:00100000:0.0:1746147735.583202:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967794256384:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147735.583211:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147735.583215:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f47f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb10 expref: 9 pid: 14545 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.583225:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f47f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb10 expref: 9 pid: 14545 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.583238:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650ea00/0xe64d3fbf12a7f47f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb10 expref: 9 pid: 14545 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.583251:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147735.583255:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147735.583261:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147735.583268:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147735.583283:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147735.583290:0:14545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583296:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000100:00100000:0.0:1746147735.583303:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794256384:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 101us (221us total) trans 0 rc 0/0 00000004:00200000:2.0:1746147735.583309:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:0.0:1746147735.583309:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8805 00000100:00100000:0.0:1746147735.583327:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794256640 00000100:00100000:0.0:1746147735.583329:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794256640 00002000:00100000:0.0:1746147735.583344:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (5013504->5017599) req@ffff88009fe42300 x1830967794256640/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147735.583351:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe42300 with x1830967794256640 ext(5013504->5017599) 00002000:00010000:0.0:1746147735.583355:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe42300 00000100:00100000:0.0:1746147735.583366:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7764 00000100:00100000:0.0:1746147735.583371:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794256640:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:2.0:1746147735.583400:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583406:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583413:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583418:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8eba00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147735.583421:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583427:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583435:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.583437:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147735.583439:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583443:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f543 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583454:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f535 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00000100:00100000:0.0:1746147735.583455:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794256640:12345-192.168.202.10@tcp:3:cat.0 Request processed in 83us (298us total) trans 0 rc 4096/4096 00010000:00010000:2.0:1746147735.583458:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f535 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583462:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f535 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00000100:00100000:0.0:1746147735.583464:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7764 00010000:00010000:2.0:1746147735.583466:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8eb600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147735.583468:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f535 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00002000:00100000:0.0:1746147735.583468:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (5013504->5017599) req@ffff88009fe42300 x1830967794256640/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/4536 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147735.583472:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f535 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00002000:00100000:0.0:1746147735.583474:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe42300 with x1830967794256640 ext(5013504->5017599) 00002000:00010000:0.0:1746147735.583476:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe42300 00010000:00010000:2.0:1746147735.583481:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147735.583483:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147735.583486:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583490:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583497:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f53c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583501:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f53c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583506:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f53c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583510:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8eb800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147735.583512:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f53c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583516:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f53c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583522:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a00f3c00) 00010000:00010000:2.0:1746147735.583524:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147735.583526:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f53c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583530:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f53c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.583564:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f52e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb80 expref: 11 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.583572:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f52e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb80 expref: 11 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.583579:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8ea600, rc 0) 00000100:00100000:2.0:1746147735.583595:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32583:x1830967794255360:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4007us (4223us total) trans 8589946175 rc 301/301 00000100:00100000:2.0:1746147735.583600:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12143 00000100:00100000:0.0:1746147735.586794:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.586836:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.587033:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794256896 00000100:00100000:2.0:1746147735.587040:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794257152 00000100:00100000:3.0:1746147735.587043:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794256896 00000100:00100000:2.0:1746147735.587043:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794257152 00000100:00100000:1.0:1746147735.587044:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.587084:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5074 00000100:00100000:2.0:1746147735.587085:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12145 00000100:00100000:3.0:1746147735.587091:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+8:32581:x1830967794256896:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:2.0:1746147735.587091:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32585:x1830967794257152:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147735.587109:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.587126:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7f551 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb95 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.587216:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5642800/0xe64d3fbf12a7f558 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587227:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5642800/0xe64d3fbf12a7f558 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587237:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5642800/0xe64d3fbf12a7f558 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587248:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643000/0xe64d3fbf12a7f55f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587253:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643000/0xe64d3fbf12a7f55f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587258:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643000/0xe64d3fbf12a7f55f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000100:00100000:3.0:1746147735.587287:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+9:32581:x1830967794256896:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 196us (503us total) trans 8589946176 rc 0/0 00000100:00100000:3.0:1746147735.587293:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5074 00010000:00010000:2.0:1746147735.587345:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f566 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587351:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f566 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587357:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f566 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:2.0:1746147735.587366:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147735.587408:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5642800/0xe64d3fbf12a7f558 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587415:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5642800/0xe64d3fbf12a7f558 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587421:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5642800/0xe64d3fbf12a7f558 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00000100:00100000:0.0:1746147735.587451:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794257280 00000100:00100000:0.0:1746147735.587454:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794257280 00000100:00100000:0.0:1746147735.587485:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17243 00000100:00100000:0.0:1746147735.587490:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32583:x1830967794257280:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147735.587498:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147735.587508:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcb9c expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.587529:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013179e400/0xe64d3fbf12a7f4e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb48 expref: 22 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.587536:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f519 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb79 expref: 24 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.587541:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.587543:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.587546:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2658304->2674687] (req 2658304->2674687) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 22 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.587578:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f519 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb79 expref: 24 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.587590:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f519 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb79 expref: 24 pid: 22183 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746147735.587601:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796577408:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147735.587794:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5642800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147735.587798:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5642800/0xe64d3fbf12a7f558 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587806:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5642800/0xe64d3fbf12a7f558 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587817:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147735.587820:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147735.587823:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5642800/0xe64d3fbf12a7f558 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587832:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5642800/0xe64d3fbf12a7f558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587842:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643000/0xe64d3fbf12a7f55f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587846:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643000/0xe64d3fbf12a7f55f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587850:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643000/0xe64d3fbf12a7f55f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587853:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5643000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147735.587910:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643000/0xe64d3fbf12a7f55f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587915:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643000/0xe64d3fbf12a7f55f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587920:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a00f3f00) 00010000:00010000:2.0:1746147735.587922:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147735.587924:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643000/0xe64d3fbf12a7f55f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587928:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643000/0xe64d3fbf12a7f55f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147735.587957:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe64d3fbf12a7f551 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb95 expref: 328 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.587968:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f566 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb95 expref: 327 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.587978:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.587980:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147735.587982:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8ebc00, rc 0) 00010000:00010000:0.0:1746147735.587984:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013179e400/0xe64d3fbf12a7f4e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb48 expref: 22 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147735.587992:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013179e400/0xe64d3fbf12a7f4e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb48 expref: 22 pid: 10613 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746147735.588001:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796577536:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147735.588004:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32585:x1830967794257152:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 914us (1167us total) trans 8589946177 rc 0/0 00000100:00100000:2.0:1746147735.588010:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12145 00000100:00100000:0.0:1746147735.588130:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c07f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.591240:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.591311:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.591522:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796577408:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.591603:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794257536 00000100:00100000:1.0:1746147735.591610:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794257536 00010000:00010000:1.0:1746147735.591649:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f519 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb79 expref: 25 pid: 22183 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147735.591732:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794257664 00000100:00100000:3.0:1746147735.591738:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794257664 00000100:00100000:3.0:1746147735.591775:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5075 00000100:00100000:3.0:1746147735.591784:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+9:32581:x1830967794257664:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:3.0:1746147735.592052:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+10:32581:x1830967794257664:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 266us (738us total) trans 8589946178 rc 0/0 00000100:00100000:3.0:1746147735.592059:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5075 00000100:00100000:1.0:1746147735.592128:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8806 00000100:00100000:1.0:1746147735.592134:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6671050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794257536:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.592147:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.592168:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f519 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb79 expref: 25 pid: 22183 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.592179:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f519 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb79 expref: 25 pid: 22183 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.592201:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a650e600/0xe64d3fbf12a7f519 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb79 expref: 25 pid: 22183 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.592216:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147735.592231:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6671050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794257536:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 98us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.592236:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8806 00000100:00100000:2.0:1746147735.593358:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796577536:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147735.593388:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2658304->2674687] (req 2658304->2674687) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 22 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.593400:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0da600, rc 0) 00000100:00100000:2.0:1746147735.593436:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32583:x1830967794257280:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5945us (6393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.593443:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17243 00000100:00100000:0.0:1746147735.597223:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.597285:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794257792 00000100:00100000:2.0:1746147735.597294:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794257792 00010000:00010000:2.0:1746147735.597328:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013179e400/0xe64d3fbf12a7f4e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb48 expref: 22 pid: 10613 timeout: 914 lvb_type: 1 00000100:00100000:2.0:1746147735.599310:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8807 00000100:00100000:2.0:1746147735.599328:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967794257792:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147735.599346:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.599373:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013179e400/0xe64d3fbf12a7f4e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb48 expref: 22 pid: 10613 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746147735.599388:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013179e400/0xe64d3fbf12a7f4e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb48 expref: 22 pid: 10613 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746147735.599413:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013179e400/0xe64d3fbf12a7f4e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb48 expref: 22 pid: 10613 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746147735.599427:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.599429:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.599436:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->2674687) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 21 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.599444:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->2674687) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 21 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.599480:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->2674687) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 21 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.599492:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796577664:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147735.599586:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.601959:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796577664:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147735.601979:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.602035:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1959:x1830967794257792:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2711us (4821us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.602046:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8807 00000100:00100000:0.0:1746147735.605735:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.605787:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794258048 00000100:00100000:3.0:1746147735.605796:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794258048 00002000:00100000:3.0:1746147735.605837:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2658304->2662399) req@ffff88009fc12680 x1830967794258048/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.605847:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc12680 with x1830967794258048 ext(2658304->2662399) 00002000:00010000:3.0:1746147735.605853:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc12680 00000100:00100000:3.0:1746147735.605904:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7765 00000100:00100000:3.0:1746147735.605912:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794258048:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147735.606105:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794258048:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 192us (378us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147735.606111:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7765 00002000:00100000:3.0:1746147735.606116:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2658304->2662399) req@ffff88009fc12680 x1830967794258048/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/4536 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.606123:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc12680 with x1830967794258048 ext(2658304->2662399) 00002000:00010000:3.0:1746147735.606126:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc12680 00000100:00100000:0.0:1746147735.607710:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.607783:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794258304 00000100:00100000:2.0:1746147735.607793:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794258304 00002000:00100000:2.0:1746147735.607831:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (2670592->2674687) req@ffff88009fc12a00 x1830967794258304/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.607841:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc12a00 with x1830967794258304 ext(2670592->2674687) 00002000:00010000:2.0:1746147735.607845:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc12a00 00000100:00100000:2.0:1746147735.607946:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7766 00000100:00100000:2.0:1746147735.607956:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794258304:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147735.608149:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794258304:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 193us (441us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147735.608156:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7766 00002000:00100000:2.0:1746147735.608163:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (2670592->2674687) req@ffff88009fc12a00 x1830967794258304/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/4536 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.608170:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc12a00 with x1830967794258304 ext(2670592->2674687) 00002000:00010000:2.0:1746147735.608173:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc12a00 00000100:00100000:1.0:1746147735.610582:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.610641:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.610709:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794258688 00000100:00100000:2.0:1746147735.610713:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794258432 00000100:00100000:2.0:1746147735.610718:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794258432 00000100:00100000:0.0:1746147735.610718:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794258688 00000100:00100000:0.0:1746147735.610765:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5076 00000100:00100000:0.0:1746147735.610772:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a9e5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32583:x1830967794258688:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:2.0:1746147735.611253:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17244 00000100:00100000:2.0:1746147735.611264:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:32585:x1830967794258432:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147735.611277:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.611297:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcba3 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.611326:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7f4c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb25 expref: 21 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.611339:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8bb800/0xe64d3fbf12a7f4f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb56 expref: 39 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.611346:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.611348:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.611352:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [151552->458751] (req 151552->458751) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 39 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.611386:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8bb800/0xe64d3fbf12a7f4f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb56 expref: 39 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.611400:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f8bb800/0xe64d3fbf12a7f4f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb56 expref: 39 pid: 7050 timeout: 914 lvb_type: 1 00000100:00100000:2.0:1746147735.611413:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796577792:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147735.611724:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a9e5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32583:x1830967794258688:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 949us (1148us total) trans 8589946179 rc 0/0 00000100:00100000:0.0:1746147735.611732:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5076 00010000:00010000:2.0:1746147735.612417:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7f4c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb25 expref: 21 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.612431:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7f4c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb25 expref: 21 pid: 8468 timeout: 914 lvb_type: 1 00000100:00100000:2.0:1746147735.612441:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796577920:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147735.612487:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.614574:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796577792:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147735.614591:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796577920:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147735.614634:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [151552->458751] (req 151552->458751) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 39 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.614655:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8eb800, rc 0) 00000100:00100000:2.0:1746147735.614735:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:32585:x1830967794258432:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3470us (4091us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.614745:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17244 00000100:00100000:0.0:1746147735.615953:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.616003:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.616123:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794258816 00000100:00100000:2.0:1746147735.616132:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794258816 00010000:00010000:2.0:1746147735.616168:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8bb800/0xe64d3fbf12a7f4f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb56 expref: 39 pid: 7050 timeout: 914 lvb_type: 1 00000100:00100000:2.0:1746147735.616350:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794258944 00000100:00100000:2.0:1746147735.616355:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794258944 00010000:00010000:2.0:1746147735.616372:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7f4c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb25 expref: 22 pid: 8468 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.616418:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8808 00000100:00100000:1.0:1746147735.616430:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1960:x1830967794258816:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.616445:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.616471:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f8bb800/0xe64d3fbf12a7f4f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb56 expref: 39 pid: 7050 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.616481:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f8bb800/0xe64d3fbf12a7f4f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb56 expref: 39 pid: 7050 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.616507:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8bb800/0xe64d3fbf12a7f4f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb56 expref: 39 pid: 7050 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.616553:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147735.616598:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1960:x1830967794258816:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 170us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.616606:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8808 00000100:00100000:1.0:1746147735.616645:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8809 00000100:00100000:1.0:1746147735.616652:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967794258944:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.616661:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.616672:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7f4c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb25 expref: 22 pid: 8468 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.616681:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7f4c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb25 expref: 22 pid: 8468 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.616695:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5642a00/0xe64d3fbf12a7f4c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb25 expref: 22 pid: 8468 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.616706:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.616708:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.616715:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->458751) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 37 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.616724:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->458751) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 37 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.616758:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->458751) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 37 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.616772:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796578048:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147735.616839:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.618498:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796578048:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147735.618521:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.618935:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794258944:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2278us (2926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.618944:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8809 00000100:00100000:0.0:1746147735.619087:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.621422:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794259200 00000100:00100000:3.0:1746147735.621436:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794259200 00002000:00100000:3.0:1746147735.621486:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (151552->155647) req@ffff88009fc13480 x1830967794259200/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.621496:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13480 with x1830967794259200 ext(151552->155647) 00002000:00010000:3.0:1746147735.621501:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc13480 00000100:00100000:3.0:1746147735.621539:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7767 00000100:00100000:3.0:1746147735.621547:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967794259200:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147735.621783:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967794259200:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 236us (2696us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147735.621790:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7767 00002000:00100000:3.0:1746147735.621796:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (151552->155647) req@ffff88009fc13480 x1830967794259200/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/4536 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.621803:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13480 with x1830967794259200 ext(151552->155647) 00002000:00010000:3.0:1746147735.621806:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc13480 00000100:00100000:0.0:1746147735.625827:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.626174:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794259456 00000100:00100000:3.0:1746147735.626184:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794259456 00002000:00100000:3.0:1746147735.626229:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (454656->458751) req@ffff88009fc13100 x1830967794259456/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.626239:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13100 with x1830967794259456 ext(454656->458751) 00002000:00010000:3.0:1746147735.626245:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc13100 00000100:00100000:3.0:1746147735.626277:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7768 00000100:00100000:3.0:1746147735.626283:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1960:x1830967794259456:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147735.626450:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1960:x1830967794259456:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 166us (636us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147735.626456:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7768 00002000:00100000:3.0:1746147735.626461:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (454656->458751) req@ffff88009fc13100 x1830967794259456/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/4536 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.626469:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13100 with x1830967794259456 ext(454656->458751) 00002000:00010000:3.0:1746147735.626471:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc13100 00000100:00100000:0.0:1746147735.629857:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.630325:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794259712 00000100:00100000:3.0:1746147735.630334:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794259712 00000100:00100000:3.0:1746147735.630388:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5077 00000100:00100000:3.0:1746147735.630395:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32585:x1830967794259712:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147735.630647:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32585:x1830967794259712:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 251us (800us total) trans 8589946180 rc 0/0 00000100:00100000:3.0:1746147735.630654:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5077 00000100:00100000:0.0:1746147735.733190:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.733471:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794259968 00000100:00100000:2.0:1746147735.733481:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794259968 00000100:00100000:2.0:1746147735.733566:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12146 00000100:00100000:2.0:1746147735.733574:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32592:x1830967794259968:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147735.733601:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.733650:0:15085:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f582 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcbaa expref: -99 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.733775:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f589 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.733788:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.733798:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.733809:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f590 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.733813:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.733818:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.733945:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7f597 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.733952:0:15085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7f597 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.733957:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7f597 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00000004:00200000:2.0:1746147735.733965:0:15085:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147735.734041:0:15085:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.734047:0:15085:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f589 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.734054:0:15085:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f589 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.734059:0:15085:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8eb600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147735.734062:0:15085:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f589 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.734067:0:15085:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f589 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.734076:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147735.734079:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147735.734081:0:15085:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.734086:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eb600/0xe64d3fbf12a7f589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.734117:0:15085:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.734123:0:15085:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f590 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.734127:0:15085:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.734131:0:15085:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8eba00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147735.734132:0:15085:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.734137:0:15085:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f590 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.734146:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a00f3c00) 00010000:00010000:2.0:1746147735.734148:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147735.734150:0:15085:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f590 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.734154:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f590 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.734185:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f582 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbaa expref: 14 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.734195:0:15085:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7f597 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbaa expref: 13 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.734201:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.734202:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147735.734204:0:15085:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0da200, rc 0) 00000100:00100000:2.0:1746147735.736324:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32592:x1830967794259968:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2739us (3133us total) trans 8589946181 rc 0/0 00000100:00100000:2.0:1746147735.736336:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12146 00000100:00100000:0.0:1746147735.775031:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.775137:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794260096 00000100:00100000:2.0:1746147735.775147:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794260096 00000100:00100000:2.0:1746147735.775388:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17245 00000100:00100000:2.0:1746147735.775398:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32592:x1830967794260096:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147735.775418:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.775438:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcbb1 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.775472:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f4da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb3a expref: 22 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.775480:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f512 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb72 expref: 37 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.775486:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.775487:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.775491:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1765376->2097151] (req 1765376->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 22 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.775520:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb72 expref: 37 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.775530:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb72 expref: 37 pid: 8184 timeout: 914 lvb_type: 1 00000100:00100000:2.0:1746147735.775542:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796578176:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147735.775979:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f4da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb3a expref: 22 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.775988:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f4da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb3a expref: 22 pid: 8184 timeout: 914 lvb_type: 1 00000100:00100000:2.0:1746147735.775996:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796578304:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147735.776452:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90c180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.778311:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796578176:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147735.778322:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796578304:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147735.778353:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1765376->2097151] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 22 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.778371:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8ea600, rc 0) 00000100:00100000:2.0:1746147735.778412:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32592:x1830967794260096:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3016us (3392us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.778421:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17245 00000100:00100000:0.0:1746147735.779101:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.779151:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.779180:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794260224 00000100:00100000:0.0:1746147735.779186:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794260224 00010000:00010000:0.0:1746147735.779214:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb72 expref: 38 pid: 8184 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746147735.780134:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794260352 00000100:00100000:0.0:1746147735.780139:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794260352 00010000:00010000:0.0:1746147735.780158:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f4da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb3a expref: 22 pid: 8184 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746147735.780216:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8810 00000100:00100000:3.0:1746147735.780226:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967794260224:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.780238:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.780264:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb72 expref: 38 pid: 8184 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746147735.780275:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb72 expref: 38 pid: 8184 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746147735.780297:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800950e5400/0xe64d3fbf12a7f512 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb72 expref: 38 pid: 8184 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746147735.780420:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8811 00000100:00100000:1.0:1746147735.780429:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1957:x1830967794260352:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147735.780436:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147735.780446:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f4da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb3a expref: 22 pid: 8184 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.780456:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f4da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb3a expref: 22 pid: 8184 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.780469:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f4da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb3a expref: 22 pid: 8184 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746147735.780497:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.780498:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.780505:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 21 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.780513:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 21 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.780542:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 21 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.780559:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe42a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796578432:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147735.780735:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147735.780757:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1959:x1830967794260224:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 533us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.780761:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.780764:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8810 00000100:00100000:1.0:1746147735.782506:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe42a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796578432:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147735.782521:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147735.782809:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1957:x1830967794260352:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2378us (3654us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.782819:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8811 00000100:00100000:1.0:1746147735.783939:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.784560:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794260608 00000100:00100000:3.0:1746147735.784569:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794260608 00002000:00100000:3.0:1746147735.784613:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1765376->1769471) req@ffff88009fe42a00 x1830967794260608/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.784632:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe42a00 with x1830967794260608 ext(1765376->1769471) 00002000:00010000:3.0:1746147735.784637:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe42a00 00000100:00100000:3.0:1746147735.784667:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7769 00000100:00100000:3.0:1746147735.784675:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794260608:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147735.784837:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794260608:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 163us (902us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147735.784843:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7769 00002000:00100000:3.0:1746147735.784849:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1765376->1769471) req@ffff88009fe42a00 x1830967794260608/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/4536 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.784861:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe42a00 with x1830967794260608 ext(1765376->1769471) 00002000:00010000:3.0:1746147735.784863:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe42a00 00000100:00100000:0.0:1746147735.790159:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.790786:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794260736 00000100:00100000:2.0:1746147735.790796:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794260736 00000100:00100000:3.0:1746147735.791031:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17246 00000100:00100000:3.0:1746147735.791041:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32592:x1830967794260736:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147735.791061:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.791078:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcbb8 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.791109:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f4ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb4f expref: 36 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.791117:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f4fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb5d expref: 22 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.791123:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.791124:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.791127:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 5/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->2289663] (req 2097152->2289663) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 22 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.791155:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f4fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb5d expref: 22 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.791166:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f4fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb5d expref: 22 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.791178:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796578560:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.791284:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f4ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb4f expref: 36 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.791292:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f4ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb4f expref: 36 pid: 10613 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746147735.791300:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796578688:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.791318:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.794508:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.794551:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.794680:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796578560:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.794691:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796578688:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.794715:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->2289663] (req 2097152->2289663) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 22 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.794732:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8ba400, rc 0) 00000100:00100000:3.0:1746147735.794771:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32592:x1830967794260736:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3732us (4623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.794779:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17246 00000100:00100000:0.0:1746147735.795113:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794260864 00000100:00100000:0.0:1746147735.795119:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794260864 00010000:00010000:0.0:1746147735.795145:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f4fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb5d expref: 22 pid: 22183 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.795168:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794260992 00000100:00100000:0.0:1746147735.795169:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794260992 00010000:00010000:0.0:1746147735.795177:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f4ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb4f expref: 37 pid: 10613 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746147735.795187:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8812 00000100:00100000:0.0:1746147735.795192:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794260864:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147735.795202:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147735.795224:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f4fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb5d expref: 22 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.795233:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f4fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb5d expref: 22 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.795254:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a650e000/0xe64d3fbf12a7f4fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb5d expref: 22 pid: 22183 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.795267:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147735.795287:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794260864:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 95us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147735.795292:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8812 00000100:00100000:0.0:1746147735.795305:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8813 00000100:00100000:0.0:1746147735.795310:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6673850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1958:x1830967794260992:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147735.795315:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147735.795323:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f4ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb4f expref: 37 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.795331:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f4ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb4f expref: 37 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.795342:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a650fe00/0xe64d3fbf12a7f4ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb4f expref: 37 pid: 10613 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746147735.795350:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.795352:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147735.795359:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 20 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.795366:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 20 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.795393:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 20 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147735.795404:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796578816:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147735.795445:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c07f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.797492:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796578816:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147735.797519:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.797987:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6673850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1958:x1830967794260992:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2673us (3431us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.797999:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8813 00000100:00100000:0.0:1746147735.798795:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.798932:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794261248 00000100:00100000:2.0:1746147735.798939:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794261248 00002000:00100000:2.0:1746147735.798983:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (2285568->2289663) req@ffff88009fd19f80 x1830967794261248/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.798992:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19f80 with x1830967794261248 ext(2285568->2289663) 00002000:00010000:2.0:1746147735.798998:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd19f80 00000100:00100000:2.0:1746147735.799438:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7770 00000100:00100000:2.0:1746147735.799447:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794261248:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147735.799629:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1960:x1830967794261248:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 173us (826us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147735.799635:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7770 00002000:00100000:2.0:1746147735.799641:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (2285568->2289663) req@ffff88009fd19f80 x1830967794261248/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/4536 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.799647:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19f80 with x1830967794261248 ext(2285568->2289663) 00002000:00010000:2.0:1746147735.799651:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd19f80 00000100:00100000:0.0:1746147735.803071:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.803205:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794261504 00000100:00100000:3.0:1746147735.803214:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794261504 00000100:00100000:3.0:1746147735.803274:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5078 00000100:00100000:3.0:1746147735.803282:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32592:x1830967794261504:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147735.803525:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32592:x1830967794261504:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 243us (464us total) trans 8589946182 rc 0/0 00000100:00100000:3.0:1746147735.803532:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5078 00010000:00010000:1.0:1746147735.808331:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147735.825053:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.825094:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.825246:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794261632 00000100:00100000:3.0:1746147735.825256:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794261632 00000100:00100000:3.0:1746147735.825293:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794261760 00000100:00100000:3.0:1746147735.825295:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794261760 00000100:00100000:3.0:1746147735.825313:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17247 00000100:00100000:3.0:1746147735.825321:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794261632:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147735.825340:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.825358:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8bb800/0xe64d3fbf12a7f5b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcbbf expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.825418:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796578944:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147735.825635:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17248 00000100:00100000:1.0:1746147735.825642:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794261760:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.825651:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.825663:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f5ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcbc6 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147735.825688:0:10613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x68141998, atime: 0x68141997, ctime: 0x68141998, blocks: 0x81b 00010000:00010000:1.0:1746147735.825697:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.825699:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.825707:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f5ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbc6 expref: 22 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.825726:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f5ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbc6 expref: 22 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.825737:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0249e00, rc 0) 00000100:00100000:1.0:1746147735.825775:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794261760:12345-192.168.202.10@tcp:101:cat.0 Request processed in 134us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.825780:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17248 00000100:00100000:3.0:1746147735.826018:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.828292:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.828528:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.828695:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.828871:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.828965:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794261888 00000100:00100000:2.0:1746147735.828973:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794261888 00000100:00100000:2.0:1746147735.829012:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794262144 00000100:00100000:2.0:1746147735.829014:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794262144 00000100:00100000:2.0:1746147735.829032:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794262016 00000100:00100000:2.0:1746147735.829035:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794262016 00000100:00100000:2.0:1746147735.829055:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17249 00000100:00100000:2.0:1746147735.829062:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794261888:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.829080:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.829099:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c0dba00/0xe64d3fbf12a7f5c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcbcd expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.829121:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.829123:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.829132:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0dba00/0xe64d3fbf12a7f5c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbcd expref: 25 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.829147:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c0dba00/0xe64d3fbf12a7f5c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbcd expref: 25 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.829163:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0dba00, rc 0) 00000100:00100000:2.0:1746147735.829205:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794261888:12345-192.168.202.10@tcp:101:cat.0 Request processed in 143us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.829211:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17249 00000100:00100000:2.0:1746147735.829226:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17250 00000100:00100000:2.0:1746147735.829231:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1959:x1830967794262144:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.829237:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.829245:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f5c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcbdb expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.829282:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796579072:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147735.829324:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90c480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.829340:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17251 00000100:00100000:2.0:1746147735.829345:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967794262016:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.829350:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.829356:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f5cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcbd4 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.829377:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796579200:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147735.829393:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b54e13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.829693:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794262272 00000100:00100000:1.0:1746147735.829697:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794262272 00000100:00100000:1.0:1746147735.829717:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17252 00000100:00100000:1.0:1746147735.829721:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794262272:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.829727:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.829735:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7f5d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcbe2 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.829758:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796579328:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147735.829781:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.832297:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796579072:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147735.832330:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f5c8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbdb expref: 39 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.832349:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8eba00/0xe64d3fbf12a7f5c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbdb expref: 39 pid: 9615 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746147735.832490:0:20619:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime: 1746147735 -> 1746147736 00002000:00010000:3.0:1746147735.832493:0:20619:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime: 1746147735 -> 1746147736 00000100:00100000:3.0:1746147735.832503:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796578944:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147735.832520:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8bb800/0xe64d3fbf12a7f5b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbbf expref: 22 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.832527:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8bb800/0xe64d3fbf12a7f5b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbbf expref: 22 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.832540:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8bb800, rc 0) 00000100:00100000:3.0:1746147735.832580:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:1958:x1830967794261632:12345-192.168.202.10@tcp:101:cat.0 Request processed in 7260us (7537us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147735.832587:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17247 00002000:00010000:3.0:1746147735.832695:0:4591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime: 1746147735 -> 1746147736 00002000:00010000:3.0:1746147735.832697:0:4591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime: 1746147735 -> 1746147736 00000100:00100000:3.0:1746147735.832707:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796579200:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147735.832721:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f5cf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbd4 expref: 38 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.832729:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800950e4e00/0xe64d3fbf12a7f5cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbd4 expref: 38 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.832736:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950e4e00, rc 0) 00000100:00100000:3.0:1746147735.832756:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+37:1959:x1830967794262016:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3410us (4061us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147735.832765:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17251 00010000:00010000:2.0:1746147735.833091:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8eba00, rc 0) 00000100:00100000:2.0:1746147735.833115:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967794262144:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3883us (4587us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147735.833121:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17250 00002000:00010000:1.0:1746147735.834724:0:10613:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime: 1746147735 -> 1746147736 00002000:00010000:1.0:1746147735.834730:0:10613:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime: 1746147735 -> 1746147736 00000100:00100000:1.0:1746147735.834747:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796579328:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147735.834769:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7f5d6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbe2 expref: 26 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.834780:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7f5d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbe2 expref: 26 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.834804:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0249c00, rc 0) 00000100:00100000:1.0:1746147735.834846:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794262272:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5123us (5973us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147735.834853:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17252 00000100:00100000:0.0:1746147735.836850:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.837001:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794262400 00000100:00100000:1.0:1746147735.837009:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794262400 00000100:00100000:1.0:1746147735.837083:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17253 00000100:00100000:1.0:1746147735.837092:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32598:x1830967794262400:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.837110:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.837127:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f5dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcbe9 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.837157:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->458751) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 35 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.837164:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147735.837166:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147735.837170:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f5dd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbe9 expref: 22 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.837198:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->458751) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 35 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.837210:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->458751) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 35 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147735.837227:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796579456:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.837295:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.840182:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796579456:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147735.840212:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f5dd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbe9 expref: 22 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.840230:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248200, rc 0) 00000100:00100000:1.0:1746147735.840282:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32598:x1830967794262400:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3190us (3439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.840292:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17253 00000100:00100000:0.0:1746147735.842086:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.842211:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794262528 00000100:00100000:3.0:1746147735.842218:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794262528 00002000:00100000:3.0:1746147735.842259:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (151552->458751) req@ffff88009fd1ad80 x1830967794262528/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.842269:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1ad80 with x1830967794262528 ext(151552->458751) 00010000:00010000:3.0:1746147735.842277:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->458751) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 36 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.842290:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->458751) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 36 pid: 4591 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147735.842296:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd1ad80 00000100:00100000:3.0:1746147735.842315:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1575 00000100:00100000:3.0:1746147735.842321:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1960:x1830967794262528:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:0.0:1746147735.843196:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.843262:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.843427:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794262656 00000100:00100000:2.0:1746147735.843437:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794262656 00000100:00100000:2.0:1746147735.843464:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17254 00000100:00100000:2.0:1746147735.843471:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1960:x1830967794262656:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.843482:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.843499:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5642800/0xe64d3fbf12a7f5e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcbf0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.843553:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796579584:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147735.843608:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b54e13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.843636:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794262784 00000100:00100000:2.0:1746147735.843638:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794262784 00000100:00100000:2.0:1746147735.843656:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17255 00000100:00100000:2.0:1746147735.843660:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1960:x1830967794262784:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.843665:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.843673:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136404800/0xe64d3fbf12a7f5eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcbf7 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.843699:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796579712:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147735.843718:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.847970:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.848008:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.848066:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794262912 00000100:00100000:2.0:1746147735.848075:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794262912 00000100:00100000:2.0:1746147735.848117:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794263040 00000100:00100000:2.0:1746147735.848120:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794263040 00000100:00100000:2.0:1746147735.848139:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17256 00000100:00100000:2.0:1746147735.848146:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967794262912:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.848165:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147735.848167:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17257 00000100:00100000:0.0:1746147735.848175:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794263040:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.848184:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b600/0xe64d3fbf12a7f5f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcbfe expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147735.848184:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147735.848194:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f5f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc05 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.848233:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796579840:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147735.848233:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094691500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796579968:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147735.848396:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c07fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.848481:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cda9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.852613:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1960:x1830967794262528:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 10277us (10519us total) trans 17179874498 rc 0/0 00000100:00100000:3.0:1746147735.852636:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1575 00002000:00100000:3.0:1746147735.852651:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (151552->458751) req@ffff88009fd1ad80 x1830967794262528/t17179874498(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/448 e 0 to 0 dl 1746147746 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.852661:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1ad80 with x1830967794262528 ext(151552->458751) 00010000:00010000:3.0:1746147735.852671:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 151552->458751) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 44 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.852688:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 151552->458751) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 44 pid: 4591 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147735.852696:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd1ad80 00000100:00100000:2.0:1746147735.853438:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796579584:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147735.853470:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5642800/0xe64d3fbf12a7f5e4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbf0 expref: 43 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.853481:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5642800/0xe64d3fbf12a7f5e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbf0 expref: 43 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.853499:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5642800, rc 0) 00000100:00100000:2.0:1746147735.853526:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967794262656:12345-192.168.202.10@tcp:101:cat.0 Request processed in 10056us (10333us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147735.853533:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17254 00000100:00100000:2.0:1746147735.854034:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796579840:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147735.854050:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b600/0xe64d3fbf12a7f5f2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbfe expref: 41 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.854058:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1b600/0xe64d3fbf12a7f5f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbfe expref: 41 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.854065:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb1b600, rc 0) 00000100:00100000:2.0:1746147735.854088:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1960:x1830967794262912:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5942us (6128us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147735.854094:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17256 00000100:00100000:2.0:1746147735.854131:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796579712:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147735.854153:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136404800/0xe64d3fbf12a7f5eb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbf7 expref: 39 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.854161:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136404800/0xe64d3fbf12a7f5eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbf7 expref: 39 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.854169:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136404800, rc 0) 00000100:00100000:2.0:1746147735.854186:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1960:x1830967794262784:12345-192.168.202.10@tcp:101:cat.0 Request processed in 10526us (10924us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147735.854191:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17255 00000100:00100000:1.0:1746147735.854268:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094691500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8469:1830967796579968:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147735.854293:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f5f9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc05 expref: 26 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.854302:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a0600/0xe64d3fbf12a7f5f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc05 expref: 26 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.854324:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0600, rc 0) 00000100:00100000:1.0:1746147735.854341:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794263040:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6168us (6332us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147735.854346:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17257 00000100:00100000:0.0:1746147735.856970:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.857045:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794263296 00000100:00100000:2.0:1746147735.857054:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794263296 00000100:00100000:2.0:1746147735.857093:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12147 00000100:00100000:2.0:1746147735.857101:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32601:x1830967794263296:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147735.857133:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.857152:0:15085:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1aa00/0xe64d3fbf12a7f600 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc0c expref: -99 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.857243:0:15085:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.857257:0:15085:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f566 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb95 expref: 329 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.857264:0:15085:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7f597 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbaa expref: 13 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.857270:0:15085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.857300:0:15085:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7f597 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbaa expref: 13 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.857309:0:15085:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7f597 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbaa expref: 13 pid: 15085 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147735.857322:0:15085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc13800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15085:1830967796580096:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147735.857403:0:15085:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f566 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb95 expref: 329 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.857411:0:15085:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f566 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb95 expref: 329 pid: 14545 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147735.857423:0:15085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15085:1830967796580224:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147735.857440:0:15085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cda9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.858991:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.859174:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.859342:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794263424 00000100:00100000:2.0:1746147735.859349:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794263424 00010000:00010000:2.0:1746147735.859383:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->458751) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 38 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147735.859424:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8814 00000100:00100000:2.0:1746147735.859431:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967794263424:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147735.859443:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147735.859463:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 151552->458751) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 38 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147735.859475:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 151552->458751) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 38 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147735.859498:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8eb800/0xe64d3fbf12a7f57b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 151552->458751) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcba3 expref: 38 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147735.859513:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.859515:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147735.859522:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f5dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbe9 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.859530:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f5dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbe9 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.859559:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f5dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbe9 expref: 21 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147735.859570:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796580352:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147735.859639:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cdaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.859778:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.860085:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794263808 00000100:00100000:3.0:1746147735.860089:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794263808 00010000:00010000:3.0:1746147735.860109:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f566 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb95 expref: 330 pid: 14545 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147735.860129:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8815 00000100:00100000:3.0:1746147735.860135:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:1959:x1830967794263808:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.860144:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.860148:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f566 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb95 expref: 330 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.860156:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f566 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb95 expref: 330 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.860172:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147735.860176:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.860183:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.860188:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147735.860272:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794263552 00000100:00100000:1.0:1746147735.860277:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794263552 00000100:00100000:1.0:1746147735.860304:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17258 00000100:00100000:1.0:1746147735.860308:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:32599:x1830967794263552:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.860322:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.860333:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0248600/0xe64d3fbf12a7f60e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc13 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.860348:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.860350:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.860354:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0248600/0xe64d3fbf12a7f60e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc13 expref: 39 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.860366:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0248600/0xe64d3fbf12a7f60e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc13 expref: 39 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.860373:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248600, rc 0) 00000100:00100000:3.0:1746147735.860376:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:1959:x1830967794263808:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 240us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.860384:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8815 00000100:00100000:1.0:1746147735.860393:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:32599:x1830967794263552:12345-192.168.202.10@tcp:101:cat.0 Request processed in 84us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.860398:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17258 00000100:00100000:2.0:1746147735.860921:0:15085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc13800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15085:1830967796580096:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147735.860933:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ebc00/0xe64d3fbf12a7f566 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb95 expref: 329 pid: 14545 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147735.860944:0:15085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15085:1830967796580224:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147735.860947:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147735.860966:0:15085:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00000100:00100000:3.0:1746147735.861098:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794263680 00000100:00100000:3.0:1746147735.861102:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794263680 00010000:00010000:3.0:1746147735.861115:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7f597 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbaa expref: 14 pid: 15085 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147735.861140:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8816 00000100:00100000:3.0:1746147735.861146:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794263680:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.861155:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.861159:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7f597 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbaa expref: 14 pid: 15085 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.861168:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7f597 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbaa expref: 14 pid: 15085 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.861181:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c0da200/0xe64d3fbf12a7f597 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbaa expref: 14 pid: 15085 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.861203:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147735.861206:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.861213:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.861219:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15085 initiator: MDT0 00010000:00010000:3.0:1746147735.861233:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147735.861379:0:15085:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00010000:00010000:2.0:1746147735.861385:0:15085:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 00000004:00200000:2.0:1746147735.861404:0:15085:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147735.861539:0:15085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1aa00/0xe64d3fbf12a7f600 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc0c expref: 330 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.861549:0:15085:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc0c expref: 329 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.861555:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147735.861558:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147735.861560:0:15085:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb1a800, rc 0) 00000100:00100000:3.0:1746147735.861597:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794263680:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 450us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.861603:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8816 00000100:00100000:2.0:1746147735.862315:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:32601:x1830967794263296:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5212us (5351us total) trans 8589946183 rc 0/0 00000100:00100000:2.0:1746147735.862321:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12147 00000100:00100000:3.0:1746147735.862626:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796580352:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147735.862639:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147735.862660:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1959:x1830967794263424:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3229us (3676us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.862667:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8814 00000100:00100000:0.0:1746147735.870052:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.870087:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.870692:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.870989:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794264320 00000100:00100000:3.0:1746147735.871000:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794264320 00002000:00100000:3.0:1746147735.871048:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880094690700 x1830967794264320/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.871058:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094690700 with x1830967794264320 ext(1048576->2097151) 00002000:00010000:3.0:1746147735.871064:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094690700 00000100:00100000:3.0:1746147735.871083:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794264192 00000100:00100000:3.0:1746147735.871085:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794264192 00002000:00100000:3.0:1746147735.871098:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880094692300 x1830967794264192/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.871105:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094692300 with x1830967794264192 ext(0->1048575) 00002000:00010000:3.0:1746147735.871107:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094692300 00000100:00100000:3.0:1746147735.871123:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794264576 00000100:00100000:3.0:1746147735.871125:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794264576 00002000:00100000:3.0:1746147735.871138:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880094691500 x1830967794264576/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.871144:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094691500 with x1830967794264576 ext(1048576->2097151) 00002000:00010000:3.0:1746147735.871147:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094691500 00000100:00100000:3.0:1746147735.871164:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7771 00000100:00100000:3.0:1746147735.871171:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794264320:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147735.872062:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7772 00000100:00100000:1.0:1746147735.872072:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1960:x1830967794264192:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147735.872372:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7773 00000100:00100000:3.0:1746147735.872378:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794264576:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147735.874072:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.874095:0:31354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794264832 00000100:00100000:0.0:1746147735.874101:0:31354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794264832 00002000:00100000:0.0:1746147735.874132:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880094339880 x1830967794264832/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147735.874145:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094339880 with x1830967794264832 ext(0->1048575) 00002000:00010000:0.0:1746147735.874150:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094339880 00000100:00100000:0.0:1746147735.874164:0:31354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7774 00000100:00100000:0.0:1746147735.874170:0:31354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967794264832:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147735.875634:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.875657:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.875679:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.875697:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794265088 00000100:00100000:2.0:1746147735.875704:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794265088 00002000:00100000:2.0:1746147735.875732:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009fc13b80 x1830967794265088/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.875741:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13b80 with x1830967794265088 ext(1048576->2097151) 00002000:00010000:2.0:1746147735.875745:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc13b80 00000100:00100000:2.0:1746147735.875881:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794265344 00000100:00100000:2.0:1746147735.875900:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794265344 00002000:00100000:2.0:1746147735.875911:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009fc13800 x1830967794265344/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.875916:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13800 with x1830967794265344 ext(1048576->2097151) 00002000:00010000:2.0:1746147735.875918:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc13800 00000100:00100000:2.0:1746147735.875929:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794265600 00000100:00100000:2.0:1746147735.875930:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794265600 00002000:00100000:2.0:1746147735.875936:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1765375) req@ffff88009fc12300 x1830967794265600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.875940:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc12300 with x1830967794265600 ext(1048576->1765375) 00002000:00010000:2.0:1746147735.875942:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc12300 00000100:00100000:2.0:1746147735.875950:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7775 00000100:00100000:2.0:1746147735.875954:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967794265088:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147735.876050:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7776 00000100:00100000:1.0:1746147735.876058:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967794265344:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147735.876613:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7777 00000100:00100000:0.0:1746147735.876629:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794265600:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147735.890079:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794264320:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18896us (20025us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.890091:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7771 00002000:00100000:3.0:1746147735.890104:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880094690700 x1830967794264320/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.890115:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094690700 with x1830967794264320 ext(1048576->2097151) 00002000:00010000:3.0:1746147735.890121:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094690700 00000100:00100000:3.0:1746147735.892450:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794264576:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20056us (21743us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.892463:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7773 00002000:00100000:3.0:1746147735.892476:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880094691500 x1830967794264576/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.892486:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094691500 with x1830967794264576 ext(1048576->2097151) 00002000:00010000:3.0:1746147735.892493:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094691500 00000100:00100000:2.0:1746147735.894855:0:31354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794264832:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20672us (20775us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147735.894868:0:31354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7774 00002000:00100000:2.0:1746147735.894880:0:31354:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880094339880 x1830967794264832/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.894917:0:31354:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094339880 with x1830967794264832 ext(0->1048575) 00002000:00010000:2.0:1746147735.894923:0:31354:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094339880 00000100:00100000:3.0:1746147735.895172:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794265088:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19208us (19546us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.895183:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7775 00002000:00100000:3.0:1746147735.895194:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009fc13b80 x1830967794265088/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.895202:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13b80 with x1830967794265088 ext(1048576->2097151) 00002000:00010000:3.0:1746147735.895207:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc13b80 00000100:00100000:1.0:1746147735.903327:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967794265344:12345-192.168.202.10@tcp:3:cat.0 Request processed in 27259us (27657us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147735.903327:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967794265600:12345-192.168.202.10@tcp:3:cat.0 Request processed in 26699us (27638us total) trans 0 rc 716800/716800 00000100:00100000:0.0:1746147735.903339:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7777 00002000:00100000:0.0:1746147735.903352:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1765375) req@ffff88009fc12300 x1830967794265600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 716800/716800 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147735.903363:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc12300 with x1830967794265600 ext(1048576->1765375) 00002000:00010000:0.0:1746147735.903368:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc12300 00000100:00100000:2.0:1746147735.903715:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:1960:x1830967794264192:12345-192.168.202.10@tcp:3:cat.0 Request processed in 31644us (33626us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147735.903738:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7776 00002000:00100000:1.0:1746147735.903744:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009fc13800 x1830967794265344/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.903752:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc13800 with x1830967794265344 ext(1048576->2097151) 00002000:00010000:1.0:1746147735.903756:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc13800 00000100:00100000:2.0:1746147735.903798:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7772 00002000:00100000:2.0:1746147735.903804:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff880094692300 x1830967794264192/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.903811:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094692300 with x1830967794264192 ext(0->1048575) 00002000:00010000:2.0:1746147735.903814:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094692300 00000100:00100000:0.0:1746147735.912948:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.913038:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794265728 00000100:00100000:1.0:1746147735.913047:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794265728 00000100:00100000:1.0:1746147735.913097:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17259 00000100:00100000:1.0:1746147735.913105:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+38:32599:x1830967794265728:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.913124:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.913142:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f61c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc1a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.913173:0:8469:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 21 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.913180:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147735.913182:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147735.913185:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f61c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc1a expref: 39 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.913213:0:8469:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 21 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.913224:0:8469:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 21 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147735.913236:0:8469:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796580480:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147735.913326:0:8469:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147735.915240:0:8469:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8469:1830967796580480:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147735.915266:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f61c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc1a expref: 39 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.915282:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248400, rc 0) 00000100:00100000:1.0:1746147735.915321:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:32599:x1830967794265728:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2216us (2382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.915329:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17259 00000100:00100000:0.0:1746147735.915653:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.915704:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794265856 00000100:00100000:2.0:1746147735.915710:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794265856 00002000:00100000:2.0:1746147735.915746:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x457:0x0] (1765376->2097151) req@ffff88009433b800 x1830967794265856/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.915756:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433b800 with x1830967794265856 ext(1765376->2097151) 00010000:00010000:2.0:1746147735.915763:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 22 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147735.915780:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 22 pid: 4591 timeout: 915 lvb_type: 0 00002000:00010000:2.0:1746147735.915787:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009433b800 00000100:00100000:2.0:1746147735.915814:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1576 00000100:00100000:2.0:1746147735.915820:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1960:x1830967794265856:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147735.919380:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.919506:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794266112 00000100:00100000:1.0:1746147735.919516:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794266112 00000100:00100000:0.0:1746147735.919547:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00100000:1.0:1746147735.919560:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2289664->3338239) req@ffff880094338e00 x1830967794266112/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147735.919567:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00100000:1.0:1746147735.919571:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094338e00 with x1830967794266112 ext(2289664->3338239) 00002000:00010000:1.0:1746147735.919577:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094338e00 00000100:00100000:1.0:1746147735.919594:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794266368 00000100:00100000:1.0:1746147735.919596:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794266368 00000100:00100000:0.0:1746147735.919603:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00100000:1.0:1746147735.919608:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3338240->4194303) req@ffff88009433bb80 x1830967794266368/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.919614:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433bb80 with x1830967794266368 ext(3338240->4194303) 00000100:00100000:0.0:1746147735.919631:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794266624 00002000:00010000:1.0:1746147735.919634:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009433bb80 00000100:00100000:0.0:1746147735.919635:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794266624 00000100:00100000:1.0:1746147735.919651:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794266752 00000100:00100000:1.0:1746147735.919653:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794266752 00002000:00100000:0.0:1746147735.919653:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3162111) req@ffff88009433a300 x1830967794266624/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 504/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.919666:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3162112->4194303) req@ffff880094338380 x1830967794266752/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147735.919666:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433a300 with x1830967794266624 ext(2097152->3162111) 00002000:00010000:0.0:1746147735.919669:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009433a300 00002000:00100000:1.0:1746147735.919672:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094338380 with x1830967794266752 ext(3162112->4194303) 00002000:00010000:1.0:1746147735.919675:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094338380 00000100:00100000:1.0:1746147735.919704:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7778 00000100:00100000:1.0:1746147735.919712:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1957:x1830967794266112:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147735.919814:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7779 00000100:00100000:0.0:1746147735.919820:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1957:x1830967794266368:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147735.920009:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7780 00000100:00100000:1.0:1746147735.920014:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967794266624:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147735.920403:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7781 00000100:00100000:2.0:1746147735.920411:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1957:x1830967794266752:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147735.921700:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794265856:12345-192.168.202.10@tcp:4:cat.0 Request processed in 5871us (6040us total) trans 17179874499 rc 0/0 00000100:00100000:3.0:1746147735.921711:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1576 00002000:00100000:3.0:1746147735.921722:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x457:0x0] (1765376->2097151) req@ffff88009433b800 x1830967794265856/t17179874499(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/448 e 0 to 0 dl 1746147746 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.921731:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433b800 with x1830967794265856 ext(1765376->2097151) 00010000:00010000:3.0:1746147735.921740:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 26 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.921753:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 26 pid: 4591 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147735.921760:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009433b800 00000100:00100000:0.0:1746147735.929118:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.929456:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794267008 00000100:00100000:3.0:1746147735.929469:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794267008 00010000:00010000:3.0:1746147735.929505:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 28 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147735.929558:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8817 00000100:00100000:3.0:1746147735.929566:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1958:x1830967794267008:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.929580:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.929597:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 28 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.929608:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 28 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.929639:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ea600/0xe64d3fbf12a7f5a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb1 expref: 28 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147735.929649:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967794266752:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9237us (10044us total) trans 0 rc 1032192/1032192 00010000:00010000:3.0:1746147735.929656:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.929658:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147735.929659:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7781 00010000:00010000:3.0:1746147735.929664:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f61c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc1a expref: 38 pid: 8469 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147735.929666:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3162112->4194303) req@ffff880094338380 x1830967794266752/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1032192/1032192 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147735.929671:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f61c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc1a expref: 38 pid: 8469 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147735.929674:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094338380 with x1830967794266752 ext(3162112->4194303) 00002000:00010000:2.0:1746147735.929679:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094338380 00010000:00010000:3.0:1746147735.929700:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f61c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc1a expref: 38 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.929710:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796580608:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147735.929765:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147735.935722:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794266368:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15893us (16166us total) trans 0 rc 856064/856064 00000100:00100000:2.0:1746147735.935733:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7779 00002000:00100000:2.0:1746147735.935742:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x458:0x0] (3338240->4194303) req@ffff88009433bb80 x1830967794266368/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 856064/856064 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.935751:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433bb80 with x1830967794266368 ext(3338240->4194303) 00002000:00010000:2.0:1746147735.935756:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009433bb80 00000100:00100000:1.0:1746147735.936004:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967794266112:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16286us (16915us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147735.936013:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7778 00002000:00100000:1.0:1746147735.936022:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (2289664->3338239) req@ffff880094338e00 x1830967794266112/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.936030:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094338e00 with x1830967794266112 ext(2289664->3338239) 00002000:00010000:1.0:1746147735.936034:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094338e00 00000100:00100000:3.0:1746147735.936973:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796580608:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147735.936989:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147735.937015:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967794267008:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7450us (7908us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.937023:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8817 00000100:00100000:1.0:1746147735.937316:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794266624:12345-192.168.202.10@tcp:3:cat.0 Request processed in 17299us (17745us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147735.937323:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7780 00002000:00100000:1.0:1746147735.937328:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3162111) req@ffff88009433a300 x1830967794266624/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 504/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.937336:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433a300 with x1830967794266624 ext(2097152->3162111) 00002000:00010000:1.0:1746147735.937340:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009433a300 00000100:00100000:0.0:1746147735.940499:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.940584:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794267264 00000100:00100000:1.0:1746147735.940592:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794267264 00002000:00100000:1.0:1746147735.940651:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880094339180 x1830967794267264/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.940659:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094339180 with x1830967794267264 ext(1048576->2097151) 00002000:00010000:1.0:1746147735.940664:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094339180 00000100:00100000:1.0:1746147735.940694:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7782 00000100:00100000:1.0:1746147735.940701:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1959:x1830967794267264:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147735.947841:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.948043:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794267392 00000100:00100000:1.0:1746147735.948053:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794267392 00000100:00100000:1.0:1746147735.948116:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17260 00000100:00100000:1.0:1746147735.948125:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967794267392:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147735.948146:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147735.948165:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f818200/0xe64d3fbf12a7f623 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc21 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147735.948190:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.948192:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147735.948202:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f818200/0xe64d3fbf12a7f623 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc21 expref: 24 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.948218:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f818200/0xe64d3fbf12a7f623 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc21 expref: 24 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.948229:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f818200, rc 0) 00000100:00100000:1.0:1746147735.948287:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967794267392:12345-192.168.202.10@tcp:101:cat.0 Request processed in 162us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.948294:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17260 00000100:00100000:2.0:1746147735.948735:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1959:x1830967794267264:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8027us (8239us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147735.948745:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7782 00002000:00100000:2.0:1746147735.948755:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880094339180 x1830967794267264/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.948764:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094339180 with x1830967794267264 ext(1048576->2097151) 00002000:00010000:2.0:1746147735.948769:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094339180 00000100:00100000:0.0:1746147735.950823:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.950912:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794267648 00000100:00100000:2.0:1746147735.950919:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794267648 00002000:00100000:2.0:1746147735.950950:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009433b480 x1830967794267648/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.950958:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433b480 with x1830967794267648 ext(4194304->5017599) 00002000:00010000:2.0:1746147735.950962:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009433b480 00000100:00100000:2.0:1746147735.950977:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7783 00000100:00100000:2.0:1746147735.950983:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967794267648:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147735.955276:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.955337:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794267776 00000100:00100000:3.0:1746147735.955345:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794267776 00000100:00100000:2.0:1746147735.955383:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967794267648:12345-192.168.202.10@tcp:3:cat.0 Request processed in 4397us (4561us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147735.955394:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7783 00000100:00100000:3.0:1746147735.955397:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17261 00000100:00100000:3.0:1746147735.955404:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:32601:x1830967794267776:12345-192.168.202.10@tcp:101:multiop.0 00002000:00100000:2.0:1746147735.955405:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009433b480 x1830967794267648/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147735.955414:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009433b480 with x1830967794267648 ext(4194304->5017599) 00010000:00010000:3.0:1746147735.955419:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746147735.955420:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009433b480 00010000:00010000:3.0:1746147735.955436:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc28 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.955466:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.955474:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147735.955476:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147735.955479:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3575808->4194303] (req 3575808->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 40 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.955507:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.955518:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 23 pid: 20619 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147735.955530:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796580736:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147735.955594:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.958416:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.958461:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.958558:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796580736:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.958586:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3575808->4194303] (req 3575808->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 40 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147735.958602:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794268032 00010000:00010000:3.0:1746147735.958603:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350eb200, rc 0) 00000100:00100000:1.0:1746147735.958609:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794268032 00000100:00100000:3.0:1746147735.958651:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:32601:x1830967794267776:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3247us (3384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.958657:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794267904 00000100:00100000:3.0:1746147735.958658:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17261 00000100:00100000:1.0:1746147735.958659:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794267904 00000100:00100000:2.0:1746147735.958663:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17262 00000100:00100000:2.0:1746147735.958671:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794268032:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147735.958674:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17263 00000100:00100000:3.0:1746147735.958686:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1958:x1830967794267904:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.958687:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.958692:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.958704:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801350eb000/0xe64d3fbf12a7f631 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc2f expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.958704:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7f638 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc36 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.958741:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796580864:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147735.958745:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796580992:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147735.959095:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cda9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.959459:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.959475:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.959881:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.959914:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794268160 00000100:00100000:2.0:1746147735.959919:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794268160 00000100:00100000:2.0:1746147735.959943:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17264 00000100:00100000:2.0:1746147735.959948:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:32598:x1830967794268160:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.959959:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.959969:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f63f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc3d expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.959988:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147735.959990:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147735.959993:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f63f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [5013504->5242879] (req 5013504->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc3d expref: 25 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.960003:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f63f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [5013504->5242879] (req 5013504->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc3d expref: 25 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.960011:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248a00, rc 0) 00000100:00100000:2.0:1746147735.960032:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32598:x1830967794268160:12345-192.168.202.10@tcp:101:cat.0 Request processed in 84us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.960037:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17264 00000100:00100000:3.0:1746147735.960188:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794268288 00000100:00100000:3.0:1746147735.960192:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794268288 00002000:00100000:3.0:1746147735.960218:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->2289663) req@ffff88009fe43800 x1830967794268288/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.960229:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe43800 with x1830967794268288 ext(2097152->2289663) 00010000:00010000:3.0:1746147735.960235:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 25 pid: 20619 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.960251:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 25 pid: 20619 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147735.960257:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe43800 00000100:00100000:3.0:1746147735.960292:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1577 00000100:00100000:3.0:1746147735.960298:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794268288:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147735.961109:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1830967796581376:0@lo:400:kworker.0 00000100:00100000:1.0:1746147735.961139:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a634195-95c6-4e3b-860d-2cf2df4961a5:3303:1830967796581120:0@lo:400:kworker.0 00000100:00100000:2.0:1746147735.961141:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147735.961160:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746147735.961165:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796581504:0@lo:400:kworker.0 00000100:00100000:1.0:1746147735.961170:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147735.961183:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.961193:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796581632:0@lo:400:kworker.0 00000100:00100000:2.0:1746147735.961201:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796581376 00000100:00100000:2.0:1746147735.961203:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796581376 00000100:00100000:1.0:1746147735.961211:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.961225:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746147735.961229:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1746147735.961229:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1830967796581248:0@lo:400:kworker.0 00000100:00100000:2.0:1746147735.961234:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1830967796581376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147735.961246:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147735.961259:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1830967796581760:0@lo:400:kworker.0 00000100:00100000:2.0:1746147735.961262:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1830967796581376:12345-0@lo:400:kworker.0 Request processed in 28us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.961267:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1746147735.961273:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147735.961284:0:15085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796581248 00000100:00100000:2.0:1746147735.961287:0:15085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796581248 00000100:00100000:1.0:1746147735.961294:0:17544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796581760 00000100:00100000:1.0:1746147735.961297:0:17544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796581760 00000100:00100000:2.0:1746147735.961301:0:15085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1746147735.961304:0:15085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1830967796581248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147735.961316:0:17544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1746147735.961321:0:17544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1830967796581760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147735.961325:0:15085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1830967796581248:12345-0@lo:400:kworker.0 Request processed in 20us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.961330:0:15085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1746147735.961346:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796581504 00000100:00100000:2.0:1746147735.961348:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796581504 00000100:00100000:1.0:1746147735.961350:0:17544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1830967796581760:12345-0@lo:400:kworker.0 Request processed in 29us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.961356:0:17544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1746147735.961360:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796581632 00000100:00100000:2.0:1746147735.961362:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796581632 00000100:00100000:2.0:1746147735.961378:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1746147735.961382:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3301:x1830967796581504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147735.961382:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1746147735.961387:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3303:x1830967796581632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147735.961407:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3301:x1830967796581504:12345-0@lo:400:kworker.0 Request processed in 25us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.961412:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1746147735.961439:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796581888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746147735.961440:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796582016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746147735.961456:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147735.961475:0:8471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796581888 00000100:00100000:3.0:1746147735.961478:0:8471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796581888 00000100:00100000:1.0:1746147735.961484:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3303:x1830967796581632:12345-0@lo:400:kworker.0 Request processed in 24us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147735.961489:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1746147735.961513:0:8471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1746147735.961518:0:8471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+69:3301:x1830967796581888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746147735.961529:0:8471:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 622788608 pending 20447232 free 3850371072 avail 3848273920 00000100:00100000:0.0:1746147735.961868:0:14542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796581120 00000100:00100000:0.0:1746147735.961872:0:14542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796581120 00000100:00100000:0.0:1746147735.961907:0:14542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1746147735.961912:0:14542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a634195-95c6-4e3b-860d-2cf2df4961a5+18:3303:x1830967796581120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147735.962481:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796581504:0@lo:400:kworker.0 00000100:00100000:2.0:1746147735.962490:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1830967796581376:0@lo:400:kworker.0 00000100:00100000:2.0:1746147735.962548:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1830967796581248:0@lo:400:kworker.0 00000100:00100000:2.0:1746147735.962556:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1830967796581760:0@lo:400:kworker.0 00000100:00100000:3.0:1746147735.962557:0:8471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+69:3301:x1830967796581888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1037us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.962564:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796581632:0@lo:400:kworker.0 00000100:00100000:3.0:1746147735.962565:0:8471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1746147735.962598:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147735.962636:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796582016 00000100:00100000:3.0:1746147735.962639:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796582016 00000100:00100000:3.0:1746147735.962654:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1746147735.962659:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+77:3302:x1830967796582016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746147735.962672:0:8472:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 682295296 pending 32374784 free 3849322496 avail 3847225344 00000100:00100000:3.0:1746147735.962699:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+77:3302:x1830967796582016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.962705:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00002000:00010000:1.0:1746147735.962705:0:20619:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime: 1746147736 -> 1746147737 00000100:00100000:1.0:1746147735.962726:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796580992:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147735.962728:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796582016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1746147735.962753:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7f638 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc36 expref: 26 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.962771:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00ba400/0xe64d3fbf12a7f638 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc36 expref: 26 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147735.962798:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00ba400, rc 0) 00000100:00100000:1.0:1746147735.962826:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794268032:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4157us (4420us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147735.962832:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17262 00000100:00100000:0.0:1746147735.962955:0:14542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a634195-95c6-4e3b-860d-2cf2df4961a5+18:3303:x1830967796581120:12345-0@lo:400:kworker.0 Request processed in 1042us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147735.962961:0:14542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1746147735.962969:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3a634195-95c6-4e3b-860d-2cf2df4961a5:3303:1830967796581120:0@lo:400:kworker.0 00000100:00080000:0.0:1746147735.962984:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00010000:3.0:1746147735.963039:0:4591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147736 -> 1746147737 00000100:00100000:3.0:1746147735.963051:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796580864:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147735.963067:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801350eb000/0xe64d3fbf12a7f631 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc2f expref: 41 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.963077:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350eb000/0xe64d3fbf12a7f631 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc2f expref: 41 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147735.963089:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350eb000, rc 0) 00000100:00100000:3.0:1746147735.963109:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1958:x1830967794267904:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4428us (4647us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147735.963114:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17263 00000100:00100000:2.0:1746147735.963140:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796581888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746147735.964931:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794268288:12345-192.168.202.10@tcp:4:cat.0 Request processed in 4585us (5003us total) trans 17179874500 rc 0/0 00000100:00100000:3.0:1746147735.964943:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1577 00000100:00100000:0.0:1746147735.964947:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00100000:3.0:1746147735.964955:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->2289663) req@ffff88009fe43800 x1830967794268288/t17179874500(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/448 e 0 to 0 dl 1746147746 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.964964:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe43800 with x1830967794268288 ext(2097152->2289663) 00010000:00010000:3.0:1746147735.964975:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 27 pid: 20619 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.964990:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 27 pid: 20619 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147735.964998:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe43800 00000100:00100000:3.0:1746147735.965036:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794268416 00000100:00100000:3.0:1746147735.965041:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794268416 00000100:00100000:3.0:1746147735.965303:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17265 00000100:00100000:3.0:1746147735.965310:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:32599:x1830967794268416:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147735.965324:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147735.965340:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f646 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc44 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.965364:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147735.965366:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147735.965370:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f646 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc44 expref: 41 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.965381:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f646 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc44 expref: 41 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.965391:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0298800, rc 0) 00000100:00100000:3.0:1746147735.965743:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:32599:x1830967794268416:12345-192.168.202.10@tcp:101:cat.0 Request processed in 432us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.965748:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17265 00000100:00100000:0.0:1746147735.969666:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.969837:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794268544 00000100:00100000:3.0:1746147735.969847:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794268544 00010000:00010000:3.0:1746147735.970240:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 27 pid: 20619 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147735.970281:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8818 00000100:00100000:3.0:1746147735.970289:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967794268544:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.970306:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.970328:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 27 pid: 20619 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.970339:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 27 pid: 20619 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.970361:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ba400/0xe64d3fbf12a7f5ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbb8 expref: 27 pid: 20619 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.970374:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.970377:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.970384:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->5013503] (req 3575808->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 40 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.970392:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->5013503] (req 3575808->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 40 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.970399:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.970400:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.970403:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f63f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [5013504->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc3d expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.970410:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f63f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [5013504->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc3d expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.970416:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.970417:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.970420:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f646 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc44 expref: 40 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.970424:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f646 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc44 expref: 40 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.970454:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f646 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc44 expref: 40 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.970466:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796582144:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147735.970608:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f63f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [5013504->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc3d expref: 26 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.970627:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796582272:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147735.970652:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->5013503] (req 3575808->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 40 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.970660:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796582400:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147735.970675:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.972127:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796582144:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147735.972137:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796582400:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147735.972375:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.972462:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794268672 00000100:00100000:3.0:1746147735.972463:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796582272:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147735.972467:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794268672 00010000:00010000:3.0:1746147735.972489:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147735.972505:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17266 00000100:00100000:2.0:1746147735.972512:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967794268672:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.972526:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147735.972531:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967794268544:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2242us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.972539:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8818 00010000:00010000:2.0:1746147735.972540:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f64d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc4b expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.972567:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f64d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc4b expref: 27 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.972581:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7f64d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc4b expref: 27 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147735.972600:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a1600, rc 0) 00000100:00100000:2.0:1746147735.972631:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794268672:12345-192.168.202.10@tcp:101:cat.0 Request processed in 120us (258us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147735.972637:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17266 00000100:00100000:0.0:1746147735.973592:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.973652:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794268928 00000100:00100000:0.0:1746147735.973653:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.973658:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794268928 00002000:00100000:3.0:1746147735.973685:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a0227100 x1830967794268928/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.973696:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0227100 with x1830967794268928 ext(2097152->3145727) 00002000:00010000:3.0:1746147735.973700:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0227100 00000100:00100000:3.0:1746147735.973723:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794269184 00000100:00100000:3.0:1746147735.973725:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794269184 00002000:00100000:3.0:1746147735.973733:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3575808->3579903) req@ffff880094efa680 x1830967794269184/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.973740:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efa680 with x1830967794269184 ext(3575808->3579903) 00002000:00010000:3.0:1746147735.973746:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efa680 00000100:00100000:3.0:1746147735.973757:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7784 00000100:00100000:3.0:1746147735.973763:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967794268928:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147735.973781:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7785 00000100:00100000:1.0:1746147735.973789:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1959:x1830967794269184:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147735.974117:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1959:x1830967794269184:12345-192.168.202.10@tcp:3:cat.0 Request processed in 328us (463us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147735.974124:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7785 00002000:00100000:1.0:1746147735.974129:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3575808->3579903) req@ffff880094efa680 x1830967794269184/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/4536 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.974136:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efa680 with x1830967794269184 ext(3575808->3579903) 00002000:00010000:1.0:1746147735.974139:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efa680 00000100:00100000:0.0:1746147735.974218:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147735.974266:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794269440 00000100:00100000:1.0:1746147735.974270:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794269440 00002000:00100000:1.0:1746147735.974285:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (5013504->5017599) req@ffff880094ef9500 x1830967794269440/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.974292:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef9500 with x1830967794269440 ext(5013504->5017599) 00002000:00010000:1.0:1746147735.974295:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ef9500 00000100:00100000:1.0:1746147735.974313:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7786 00000100:00100000:1.0:1746147735.974319:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967794269440:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147735.974399:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967794269440:12345-192.168.202.10@tcp:3:cat.0 Request processed in 80us (181us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147735.974405:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7786 00002000:00100000:1.0:1746147735.974409:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (5013504->5017599) req@ffff880094ef9500 x1830967794269440/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 488/4536 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147735.974415:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef9500 with x1830967794269440 ext(5013504->5017599) 00002000:00010000:1.0:1746147735.974418:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ef9500 00000100:00100000:3.0:1746147735.981004:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1960:x1830967794268928:12345-192.168.202.10@tcp:3:cat.0 Request processed in 7229us (7486us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147735.981016:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7784 00002000:00100000:3.0:1746147735.981028:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a0227100 x1830967794268928/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.981038:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0227100 with x1830967794268928 ext(2097152->3145727) 00002000:00010000:3.0:1746147735.981045:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0227100 00000100:00100000:0.0:1746147735.983841:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.983904:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794269568 00000100:00100000:2.0:1746147735.983913:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794269568 00000100:00100000:2.0:1746147735.983949:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17267 00000100:00100000:2.0:1746147735.983955:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:32601:x1830967794269568:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147735.983971:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.983986:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc52 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.984011:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->2674687) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 21 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.984017:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147735.984018:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147735.984020:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->3276799] (req 3145728->3276799) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 26 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.984045:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->2674687) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 21 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.984052:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->2674687) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 21 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147735.984062:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796582528:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147735.985200:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cda9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147735.985436:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147735.985495:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794269696 00000100:00100000:2.0:1746147735.985503:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794269696 00000100:00100000:2.0:1746147735.985562:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17268 00000100:00100000:2.0:1746147735.985571:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:32599:x1830967794269696:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147735.985585:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147735.985601:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f65b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc59 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.985638:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147735.985640:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147735.985645:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f65b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc59 expref: 28 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.985657:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f65b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc59 expref: 28 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147735.985669:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5defc00, rc 0) 00000100:00100000:2.0:1746147735.985726:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:32599:x1830967794269696:12345-192.168.202.10@tcp:101:cat.0 Request processed in 155us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147735.985733:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17268 00000100:00100000:0.0:1746147735.986985:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.987027:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796582528:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147735.987046:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->3276799] (req 3145728->3276799) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 27 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.987056:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a1e00, rc 0) 00000100:00100000:3.0:1746147735.987085:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:32601:x1830967794269568:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3131us (3253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.987091:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17267 00000100:00100000:3.0:1746147735.987112:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794269824 00000100:00100000:3.0:1746147735.987115:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794269824 00002000:00100000:3.0:1746147735.987140:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2658304->2674687) req@ffff880094ef8e00 x1830967794269824/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 16872/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.987146:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef8e00 with x1830967794269824 ext(2658304->2674687) 00010000:00010000:3.0:1746147735.987151:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->2674687) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 22 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.987159:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->2674687) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 22 pid: 4591 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147735.987163:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094ef8e00 00000100:00100000:3.0:1746147735.987178:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1578 00000100:00100000:3.0:1746147735.987183:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1959:x1830967794269824:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147735.988339:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967794269824:12345-192.168.202.10@tcp:4:cat.0 Request processed in 1149us (1401us total) trans 21474841726 rc 0/0 00000100:00100000:3.0:1746147735.988351:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1578 00002000:00100000:3.0:1746147735.988359:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2658304->2674687) req@ffff880094ef8e00 x1830967794269824/t21474841726(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:356/0 lens 16872/448 e 0 to 0 dl 1746147746 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.988368:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef8e00 with x1830967794269824 ext(2658304->2674687) 00010000:00010000:3.0:1746147735.988375:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->2674687) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 24 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.988387:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->2674687) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 24 pid: 4591 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147735.988394:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094ef8e00 00000100:00100000:0.0:1746147735.994349:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.994464:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794269952 00000100:00100000:3.0:1746147735.994475:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794269952 00010000:00010000:3.0:1746147735.994516:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->2674687) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 24 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147735.994563:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8819 00000100:00100000:3.0:1746147735.994571:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794269952:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147735.994586:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147735.994609:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2658304->2674687) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 24 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.994633:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2658304->2674687) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 24 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.994663:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c0da600/0xe64d3fbf12a7f574 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2658304->2674687) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb9c expref: 24 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147735.994688:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.994690:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.994698:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3276799) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 26 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.994706:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3276799) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 26 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.994715:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.994716:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147735.994719:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f65b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc59 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.994725:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f65b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc59 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147735.994756:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f65b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc59 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.994768:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796582656:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147735.997284:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3276799) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 26 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147735.997308:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796582784:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147735.997418:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147735.997800:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796582656:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147735.998527:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796582784:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147735.998551:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147735.998598:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1960:x1830967794269952:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4026us (4257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147735.998608:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8819 00000100:00100000:0.0:1746147735.998608:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147735.998660:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794270208 00000100:00100000:3.0:1746147735.998666:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794270208 00002000:00100000:3.0:1746147735.998698:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880094ef8000 x1830967794270208/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147735.998707:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef8000 with x1830967794270208 ext(2097152->3145727) 00002000:00010000:3.0:1746147735.998713:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ef8000 00000100:00100000:3.0:1746147735.998737:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7787 00000100:00100000:3.0:1746147735.998745:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794270208:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147735.999054:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147735.999134:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794270464 00000100:00100000:0.0:1746147735.999138:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794270464 00002000:00100000:0.0:1746147735.999157:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3575807) req@ffff88009fe41500 x1830967794270464/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/0 e 0 to 0 dl 1746147746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147735.999165:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41500 with x1830967794270464 ext(3145728->3575807) 00002000:00010000:0.0:1746147735.999169:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe41500 00000100:00100000:0.0:1746147735.999180:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7788 00000100:00100000:0.0:1746147735.999184:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967794270464:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147736.000632:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.000738:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794270720 00000100:00100000:1.0:1746147736.000746:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794270720 00002000:00100000:1.0:1746147736.000782:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3272704->3276799) req@ffff880094efaa00 x1830967794270720/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.000790:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efaa00 with x1830967794270720 ext(3272704->3276799) 00002000:00010000:1.0:1746147736.000794:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efaa00 00000100:00100000:1.0:1746147736.000938:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7789 00000100:00100000:1.0:1746147736.000946:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794270720:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147736.001054:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794270720:12345-192.168.202.10@tcp:3:cat.0 Request processed in 109us (442us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147736.001061:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7789 00002000:00100000:1.0:1746147736.001067:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3272704->3276799) req@ffff880094efaa00 x1830967794270720/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/4536 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.001073:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efaa00 with x1830967794270720 ext(3272704->3276799) 00002000:00010000:1.0:1746147736.001076:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efaa00 00000100:00100000:2.0:1746147736.004150:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1959:x1830967794270464:12345-192.168.202.10@tcp:3:cat.0 Request processed in 4954us (5087us total) trans 0 rc 430080/430080 00000100:00100000:2.0:1746147736.004162:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7788 00002000:00100000:2.0:1746147736.004173:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x458:0x0] (3145728->3575807) req@ffff88009fe41500 x1830967794270464/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 430080/430080 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.004182:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41500 with x1830967794270464 ext(3145728->3575807) 00002000:00010000:2.0:1746147736.004188:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe41500 00000100:00100000:3.0:1746147736.006242:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794270208:12345-192.168.202.10@tcp:3:cat.0 Request processed in 7485us (7622us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147736.006254:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7787 00002000:00100000:3.0:1746147736.006265:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880094ef8000 x1830967794270208/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:356/0 lens 488/440 e 0 to 0 dl 1746147746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.006274:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef8000 with x1830967794270208 ext(2097152->3145727) 00002000:00010000:3.0:1746147736.006281:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ef8000 00000100:00100000:0.0:1746147736.012058:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.012213:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794270976 00000100:00100000:3.0:1746147736.012223:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794270976 00002000:00100000:3.0:1746147736.012265:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3276800->4194303) req@ffff880094ef9c00 x1830967794270976/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.012273:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef9c00 with x1830967794270976 ext(3276800->4194303) 00002000:00010000:3.0:1746147736.012278:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ef9c00 00000100:00100000:3.0:1746147736.012310:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7790 00000100:00100000:3.0:1746147736.012316:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967794270976:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147736.021572:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967794270976:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9244us (9511us total) trans 0 rc 917504/917504 00000100:00100000:3.0:1746147736.021586:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7790 00002000:00100000:3.0:1746147736.021642:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3276800->4194303) req@ffff880094ef9c00 x1830967794270976/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 917504/917504 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.021721:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ef9c00 with x1830967794270976 ext(3276800->4194303) 00002000:00010000:3.0:1746147736.021734:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ef9c00 00000100:00100000:0.0:1746147736.031368:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.031419:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.031578:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794271232 00000100:00100000:2.0:1746147736.031588:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794271232 00000100:00100000:2.0:1746147736.031653:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794271104 00000100:00100000:2.0:1746147736.031655:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794271104 00000100:00100000:3.0:1746147736.031659:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17269 00000100:00100000:3.0:1746147736.031671:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967794271232:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147736.031680:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17270 00000100:00100000:2.0:1746147736.031684:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1957:x1830967794271104:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147736.031692:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.031692:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.031708:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7f669 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc67 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.031709:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7f662 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc60 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.031740:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7f662 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc60 expref: 42 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.031750:0:8469:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0249c00/0xe64d3fbf12a7f662 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc60 expref: 42 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.031764:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0249c00, rc 0) 00000100:00100000:3.0:1746147736.031767:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796582912:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147736.031837:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147736.031868:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1957:x1830967794271104:12345-192.168.202.10@tcp:101:cat.0 Request processed in 123us (388us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147736.031875:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17270 00000100:00100000:2.0:1746147736.037498:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:3.0:1746147736.037602:0:4591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime: 1746147736 -> 1746147737 00002000:00010000:3.0:1746147736.037607:0:4591:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime: 1746147736 -> 1746147737 00000100:00100000:1.0:1746147736.037610:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794271488 00000100:00100000:3.0:1746147736.037642:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796582912:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147736.037644:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794271488 00010000:00010000:3.0:1746147736.037677:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7f669 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc67 expref: 28 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.037691:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136404800/0xe64d3fbf12a7f669 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc67 expref: 28 pid: 4591 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147736.037693:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12148 00000100:00100000:1.0:1746147736.037701:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32605:x1830967794271488:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147736.037707:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136404800, rc 0) 00010000:00010000:1.0:1746147736.037721:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147736.037736:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136272200/0xe64d3fbf12a7f670 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc6e expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147736.037748:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967794271232:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6080us (6391us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147736.037754:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17269 00010000:00010000:1.0:1746147736.037834:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136273000/0xe64d3fbf12a7f677 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.037847:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136273000/0xe64d3fbf12a7f677 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.037858:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136273000/0xe64d3fbf12a7f677 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000100:00080000:0.0:1746147736.037869:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746147736.037871:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f67e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.037877:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f67e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.037882:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f67e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038172:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7f685 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038180:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7f685 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038185:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7f685 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:1.0:1746147736.038196:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147736.038278:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136273000/0xe64d3fbf12a7f677 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038284:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136273000/0xe64d3fbf12a7f677 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038289:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136273000/0xe64d3fbf12a7f677 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038294:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136273000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147736.038298:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136273000/0xe64d3fbf12a7f677 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038304:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136273000/0xe64d3fbf12a7f677 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038315:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147736.038318:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147736.038322:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136273000/0xe64d3fbf12a7f677 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038326:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136273000/0xe64d3fbf12a7f677 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038351:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f67e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038355:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f67e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038360:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f67e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038368:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5286c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147736.038370:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f67e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038375:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f67e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038380:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012b0bd700) 00010000:00010000:1.0:1746147736.038382:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147736.038384:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f67e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038388:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f67e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.038429:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136272200/0xe64d3fbf12a7f670 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc6e expref: 16 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.038439:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7f685 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc6e expref: 15 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.038445:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147736.038447:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147736.038449:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5287e00, rc 0) 00000100:00100000:1.0:1746147736.038488:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32605:x1830967794271488:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 788us (1002us total) trans 8589946184 rc 0/0 00000100:00100000:1.0:1746147736.038596:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12148 00000100:00100000:0.0:1746147736.042024:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.042069:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794271616 00000100:00100000:3.0:1746147736.042079:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794271616 00000100:00100000:3.0:1746147736.042129:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17271 00000100:00100000:3.0:1746147736.042135:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:32599:x1830967794271616:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147736.042151:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.042168:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7f693 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc75 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.042195:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->5013503] (req 3575808->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 42 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.042202:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147736.042204:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147736.042207:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7f693 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [4194304->5017599] (req 4194304->5017599) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc75 expref: 42 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.042239:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->5013503] (req 3575808->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 42 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.042251:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->5013503] (req 3575808->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 42 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.042263:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796583040:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147736.042349:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.043185:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.043233:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794271744 00000100:00100000:1.0:1746147736.043238:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794271744 00000100:00100000:1.0:1746147736.043300:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17272 00000100:00100000:1.0:1746147736.043306:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:32605:x1830967794271744:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147736.043317:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147736.043331:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc7c expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746147736.043340:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746147736.043350:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3276799) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 26 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.043715:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147736.043717:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147736.043721:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3907584->3964927] (req 3907584->3964927) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 24 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.043746:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3276799) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 26 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.043755:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3276799) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 26 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.043766:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796583168:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147736.043821:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796583040:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147736.043831:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fd80 going to sleep for 11 seconds 00010000:00010000:3.0:1746147736.043854:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7f693 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [4194304->5017599] (req 4194304->5017599) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc75 expref: 42 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.043869:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095093400, rc 0) 00000100:00100000:3.0:1746147736.043960:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:32599:x1830967794271616:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1823us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.043967:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17271 00000100:00100000:0.0:1746147736.046753:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.046801:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.047009:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794272000 00000100:00100000:3.0:1746147736.047018:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794272000 00000100:00100000:1.0:1746147736.047076:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796583168:192.168.202.10@tcp:104: 00002000:00100000:3.0:1746147736.047080:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->3276799) req@ffff88009fe94700 x1830967794272000/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.047089:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe94700 with x1830967794272000 ext(3145728->3276799) 00010000:00010000:3.0:1746147736.047097:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3276799) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 27 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.047103:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3907584->3964927] (req 3907584->3964927) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 24 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.047113:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3276799) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 27 pid: 4591 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147736.047119:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe94700 00010000:00010000:1.0:1746147736.047121:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e60800, rc 0) 00000100:00100000:3.0:1746147736.047136:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794271872 00000100:00100000:3.0:1746147736.047139:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794271872 00002000:00100000:3.0:1746147736.047151:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3575808->4194303) req@ffff8800a08a8700 x1830967794271872/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147736.047152:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1579 00002000:00100000:3.0:1746147736.047157:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a8700 with x1830967794271872 ext(3575808->4194303) 00010000:00010000:3.0:1746147736.047162:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->5013503] (req 3575808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 42 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.047164:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967794272000:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147736.047165:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:32605:x1830967794271744:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3860us (3984us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147736.047169:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->5013503] (req 3575808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 42 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.047171:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17272 00002000:00010000:3.0:1746147736.047175:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a08a8700 00000100:00100000:3.0:1746147736.047190:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1580 00000100:00100000:3.0:1746147736.047197:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967794271872:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147736.050583:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967794272000:12345-192.168.202.10@tcp:4:cat.0 Request processed in 3417us (3832us total) trans 21474841727 rc 0/0 00000100:00100000:2.0:1746147736.050593:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1579 00002000:00100000:2.0:1746147736.050601:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3145728->3276799) req@ffff88009fe94700 x1830967794272000/t21474841727(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/448 e 0 to 0 dl 1746147747 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.050623:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe94700 with x1830967794272000 ext(3145728->3276799) 00010000:00010000:2.0:1746147736.050630:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3276799) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 29 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.050641:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3276799) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 29 pid: 4591 timeout: 915 lvb_type: 0 00002000:00010000:2.0:1746147736.050647:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe94700 00000100:00100000:0.0:1746147736.055629:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.056508:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794272128 00000100:00100000:2.0:1746147736.056519:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794272128 00010000:00010000:2.0:1746147736.056553:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3276799) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 29 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.056634:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8820 00000100:00100000:2.0:1746147736.056642:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6672850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794272128:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.056653:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.056670:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3276799) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 29 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.056680:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3276799) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 29 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.056699:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f654 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3276799) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc52 expref: 29 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.056730:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.056731:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.056812:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 3907584->3964927) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.056821:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 3907584->3964927) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.056852:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 3907584->3964927) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147736.056909:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796583296:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147736.056992:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cdaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147736.058679:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1960:x1830967794271872:12345-192.168.202.10@tcp:4:cat.0 Request processed in 11477us (11872us total) trans 17179874501 rc 0/0 00000100:00100000:3.0:1746147736.058688:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1580 00002000:00100000:3.0:1746147736.058697:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3575808->4194303) req@ffff8800a08a8700 x1830967794271872/t17179874501(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/448 e 0 to 0 dl 1746147747 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.058705:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a8700 with x1830967794271872 ext(3575808->4194303) 00010000:00010000:3.0:1746147736.058713:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->5013503] (req 3575808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 44 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.058726:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->5013503] (req 3575808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 44 pid: 4591 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147736.058732:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a08a8700 00000100:00100000:2.0:1746147736.059715:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796583296:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147736.059734:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.059770:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6672850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794272128:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3128us (4162us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.059780:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8820 00000100:00100000:0.0:1746147736.060077:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.060194:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794272384 00000100:00100000:3.0:1746147736.060202:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794272384 00002000:00100000:3.0:1746147736.060233:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3907584->3911679) req@ffff8800a08ab800 x1830967794272384/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.060240:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08ab800 with x1830967794272384 ext(3907584->3911679) 00002000:00010000:3.0:1746147736.060243:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a08ab800 00000100:00100000:3.0:1746147736.060261:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7791 00000100:00100000:3.0:1746147736.060267:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794272384:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147736.060457:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794272384:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 189us (381us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147736.060462:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7791 00002000:00100000:3.0:1746147736.060467:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3907584->3911679) req@ffff8800a08ab800 x1830967794272384/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/4536 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.060474:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08ab800 with x1830967794272384 ext(3907584->3911679) 00002000:00010000:3.0:1746147736.060476:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a08ab800 00000100:00100000:0.0:1746147736.061077:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.061173:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794272512 00000100:00100000:2.0:1746147736.061179:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794272512 00010000:00010000:2.0:1746147736.061203:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->5013503] (req 3575808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 44 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.061223:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8821 00000100:00100000:2.0:1746147736.061229:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1960:x1830967794272512:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.061239:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147736.061255:0:15900:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147736 -> 1746147737 00010000:00010000:2.0:1746147736.061261:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [3145728->5013503] (req 3575808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 44 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.061290:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [3145728->5013503] (req 3575808->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 44 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.061312:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350eb200/0xe64d3fbf12a7f62a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [3145728->5013503] (req 3575808->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc28 expref: 44 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.061340:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.061342:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.061353:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7f693 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc75 expref: 43 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.061363:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7f693 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc75 expref: 43 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.061393:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7f693 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc75 expref: 43 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147736.061405:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796583424:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147736.061474:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6cda9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.063355:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.063520:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794272768 00000100:00100000:3.0:1746147736.063526:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796583424:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147736.063534:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794272768 00010000:00010000:3.0:1746147736.063546:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147736.063585:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1960:x1830967794272512:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2355us (2510us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.063597:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8821 00002000:00100000:2.0:1746147736.063597:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3960832->3964927) req@ffff8800a08a8000 x1830967794272768/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.063626:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a8000 with x1830967794272768 ext(3960832->3964927) 00002000:00010000:2.0:1746147736.063634:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a08a8000 00000100:00100000:2.0:1746147736.063676:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7792 00000100:00100000:2.0:1746147736.063686:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967794272768:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147736.063941:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967794272768:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 256us (593us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147736.063948:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7792 00002000:00100000:2.0:1746147736.063954:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3960832->3964927) req@ffff8800a08a8000 x1830967794272768/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/4536 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.063963:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a8000 with x1830967794272768 ext(3960832->3964927) 00002000:00010000:2.0:1746147736.063966:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a08a8000 00000100:00100000:0.0:1746147736.064778:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.064972:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794273024 00000100:00100000:3.0:1746147736.064978:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794273024 00002000:00100000:3.0:1746147736.065010:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a08aa680 x1830967794273024/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.065019:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08aa680 with x1830967794273024 ext(4194304->5017599) 00002000:00010000:3.0:1746147736.065024:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08aa680 00000100:00100000:3.0:1746147736.065047:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7793 00000100:00100000:3.0:1746147736.065053:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1960:x1830967794273024:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147736.066442:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.068064:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794273280 00000100:00100000:1.0:1746147736.068075:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794273280 00000100:00100000:1.0:1746147736.068130:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5079 00000100:00100000:1.0:1746147736.068138:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32605:x1830967794273280:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:1.0:1746147736.069430:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32605:x1830967794273280:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 1285us (2987us total) trans 8589946185 rc 0/0 00000100:00100000:1.0:1746147736.069440:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5079 00000100:00100000:3.0:1746147736.076190:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1960:x1830967794273024:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11124us (11403us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746147736.076202:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7793 00002000:00100000:3.0:1746147736.076214:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff8800a08aa680 x1830967794273024/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.076224:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08aa680 with x1830967794273024 ext(4194304->5017599) 00002000:00010000:3.0:1746147736.076230:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08aa680 00000100:00100000:0.0:1746147736.081797:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.081852:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794273408 00000100:00100000:1.0:1746147736.081861:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794273408 00000100:00100000:1.0:1746147736.081930:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17273 00000100:00100000:1.0:1746147736.081938:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794273408:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147736.081956:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147736.081978:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095639400/0xe64d3fbf12a7f6a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc83 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147736.082033:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796583552:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147736.082143:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147736.083127:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796583552:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147736.083152:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095639400/0xe64d3fbf12a7f6a1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc83 expref: 29 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.083165:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095639400/0xe64d3fbf12a7f6a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc83 expref: 29 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.083217:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095639400, rc 0) 00000100:00100000:1.0:1746147736.083333:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794273408:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1394us (1543us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147736.083340:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17273 00000100:00100000:0.0:1746147736.086084:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.086141:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794273536 00000100:00100000:1.0:1746147736.086151:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794273536 00000100:00100000:1.0:1746147736.086218:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17274 00000100:00100000:1.0:1746147736.086227:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794273536:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147736.086244:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147736.086262:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f6a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc8a expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147736.086313:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796583680:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147736.086406:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147736.087971:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796583680:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147736.088007:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f6a8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc8a expref: 29 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.088020:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f6a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc8a expref: 29 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.088032:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb16200, rc 0) 00000100:00100000:1.0:1746147736.088069:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794273536:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1842us (1995us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147736.088081:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17274 00000100:00100000:0.0:1746147736.109562:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.109656:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794273664 00000100:00100000:1.0:1746147736.109668:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794273664 00000100:00100000:1.0:1746147736.109747:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12149 00000100:00100000:1.0:1746147736.109755:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+10:32608:x1830967794273664:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147736.109780:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147736.109798:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16400/0xe64d3fbf12a7f6af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc91 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.109857:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16600/0xe64d3fbf12a7f6b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.109868:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16600/0xe64d3fbf12a7f6b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.109878:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16600/0xe64d3fbf12a7f6b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000100:00080000:0.0:1746147736.109911:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746147736.109912:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16800/0xe64d3fbf12a7f6bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.109918:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16800/0xe64d3fbf12a7f6bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.109923:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16800/0xe64d3fbf12a7f6bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.110091:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.110100:0:14545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc0c expref: 328 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.110107:0:14545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.110137:0:14545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc0c expref: 328 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.110149:0:14545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc0c expref: 328 pid: 15085 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.110161:0:14545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14545:1830967796583808:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147736.110816:0:14545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147736.112855:0:14545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14545:1830967796583808:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147736.112878:0:14545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000100:00100000:0.0:1746147736.112984:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.113049:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794273920 00000100:00100000:1.0:1746147736.113055:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794273920 00000100:00080000:0.0:1746147736.113188:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147736.113266:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5080 00000100:00100000:1.0:1746147736.113275:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:7669:x1830967794273920:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147736.113507:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:7669:x1830967794273920:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 232us (523us total) trans 8589946186 rc 0/0 00000100:00100000:1.0:1746147736.113513:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5080 00000100:00100000:0.0:1746147736.115331:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.115390:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794274048 00000100:00100000:3.0:1746147736.115397:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794274048 00010000:00010000:3.0:1746147736.115433:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc0c expref: 330 pid: 15085 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.115472:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8822 00000100:00100000:3.0:1746147736.115480:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:1959:x1830967794274048:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147736.115493:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147736.115500:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc0c expref: 330 pid: 15085 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.115512:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc0c expref: 330 pid: 15085 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.115535:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1a800/0xe64d3fbf12a7f607 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc0c expref: 330 pid: 15085 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.115565:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147736.115570:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147736.115579:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147736.115586:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147736.115769:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147736.115990:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:1959:x1830967794274048:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 510us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.115997:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8822 00010000:00010000:1.0:1746147736.116081:0:14545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116089:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:1.0:1746147736.116134:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:1.0:1746147736.116139:0:14545:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147736.116155:0:14545:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116163:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116172:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16600/0xe64d3fbf12a7f6b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116178:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16600/0xe64d3fbf12a7f6b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116183:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16600/0xe64d3fbf12a7f6b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116188:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb16600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147736.116192:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16600/0xe64d3fbf12a7f6b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116198:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16600/0xe64d3fbf12a7f6b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116206:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147736.116209:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147736.116212:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16600/0xe64d3fbf12a7f6b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116217:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16600/0xe64d3fbf12a7f6b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116227:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16800/0xe64d3fbf12a7f6bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116232:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16800/0xe64d3fbf12a7f6bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116237:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16800/0xe64d3fbf12a7f6bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116241:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb16800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147736.116243:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16800/0xe64d3fbf12a7f6bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116248:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16800/0xe64d3fbf12a7f6bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116254:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5b4af00) 00010000:00010000:1.0:1746147736.116256:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147736.116258:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16800/0xe64d3fbf12a7f6bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116263:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16800/0xe64d3fbf12a7f6bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.116299:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16400/0xe64d3fbf12a7f6af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc91 expref: 12 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.116313:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc91 expref: 11 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.116320:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147736.116322:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147736.116324:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb16a00, rc 0) 00000100:00100000:1.0:1746147736.117077:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+11:32608:x1830967794273664:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 7320us (7523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.117086:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12149 00000100:00100000:0.0:1746147736.118815:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.119341:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794274176 00000100:00100000:1.0:1746147736.119350:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794274176 00000100:00100000:1.0:1746147736.119405:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17275 00000100:00100000:1.0:1746147736.119412:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794274176:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147736.119429:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147736.119445:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb16c00/0xe64d3fbf12a7f6cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc98 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.119468:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.119470:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.119477:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb16c00/0xe64d3fbf12a7f6cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc98 expref: 12 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.119493:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb16c00/0xe64d3fbf12a7f6cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc98 expref: 12 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.119502:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb16c00, rc 0) 00000100:00100000:1.0:1746147736.119540:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794274176:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 129us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.119546:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17275 00000100:00080000:0.0:1746147736.119590:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147736.120468:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.120519:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794274304 00000100:00100000:3.0:1746147736.120525:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794274304 00000100:00100000:3.0:1746147736.120584:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17276 00000100:00100000:3.0:1746147736.120591:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794274304:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147736.120602:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.120627:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800986f6400/0xe64d3fbf12a7f6d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcc9f expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.120649:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.120651:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.120656:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800986f6400/0xe64d3fbf12a7f6d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc9f expref: 13 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.120668:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800986f6400/0xe64d3fbf12a7f6d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc9f expref: 13 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.120676:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986f6400, rc 0) 00000100:00100000:3.0:1746147736.120704:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794274304:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 113us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.120710:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17276 00000100:00080000:0.0:1746147736.121002:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147736.121181:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.121316:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.121343:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.121367:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.121384:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794274432 00000100:00100000:0.0:1746147736.121388:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794274432 00000100:00100000:0.0:1746147736.121406:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794274560 00000100:00100000:0.0:1746147736.121409:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794274560 00000100:00100000:0.0:1746147736.121419:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794274688 00000100:00100000:0.0:1746147736.121420:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794274688 00000100:00100000:0.0:1746147736.121430:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794274816 00000100:00100000:0.0:1746147736.121431:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794274816 00000100:00100000:0.0:1746147736.121443:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17277 00000100:00100000:0.0:1746147736.121448:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794274432:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147736.121456:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147736.121466:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a734a600/0xe64d3fbf12a7f6d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcca6 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.121485:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.121487:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.121493:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734a600/0xe64d3fbf12a7f6d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcca6 expref: 15 pid: 10613 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147736.121499:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17278 00010000:00010000:0.0:1746147736.121503:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a734a600/0xe64d3fbf12a7f6d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcca6 expref: 15 pid: 10613 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147736.121506:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+13:1959:x1830967794274560:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147736.121511:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a734a600, rc 0) 00010000:00010000:3.0:1746147736.121514:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.121524:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800986f6200/0xe64d3fbf12a7f6e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafccad expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.121532:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+15:1960:x1830967794274432:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 83us (352us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147736.121535:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.121536:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147736.121538:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17277 00010000:00010000:3.0:1746147736.121541:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986f6200/0xe64d3fbf12a7f6e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccad expref: 14 pid: 8470 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147736.121550:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17279 00010000:00010000:3.0:1746147736.121551:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800986f6200/0xe64d3fbf12a7f6e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccad expref: 14 pid: 8470 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147736.121555:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794274688:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147736.121561:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.121563:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986f6200, rc 0) 00010000:00010000:0.0:1746147736.121568:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a734aa00/0xe64d3fbf12a7f6e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafccb4 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.121578:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.121579:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147736.121580:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+15:1959:x1830967794274560:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 76us (265us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147736.121583:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a734aa00/0xe64d3fbf12a7f6e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccb4 expref: 15 pid: 10613 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147736.121585:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17278 00010000:00010000:0.0:1746147736.121592:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a734aa00/0xe64d3fbf12a7f6e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccb4 expref: 15 pid: 10613 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147736.121598:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17280 00000100:00100000:3.0:1746147736.121602:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794274816:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147736.121604:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a734aa00, rc 0) 00010000:00010000:3.0:1746147736.121608:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.121630:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800986f6600/0xe64d3fbf12a7f6ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafccbb expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.121632:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794274688:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 77us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.121637:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17279 00000100:00100000:3.0:1746147736.121668:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796583936:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147736.121715:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147736.123352:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796583936:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147736.123391:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800986f6600/0xe64d3fbf12a7f6ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccbb expref: 15 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.123408:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800986f6600/0xe64d3fbf12a7f6ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccbb expref: 15 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.123431:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986f6600, rc 0) 00000100:00100000:3.0:1746147736.123478:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+14:1959:x1830967794274816:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 1874us (2109us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147736.123485:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17280 00000100:00100000:0.0:1746147736.126074:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.126171:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794275072 00000100:00100000:1.0:1746147736.126180:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794275072 00000100:00100000:1.0:1746147736.126573:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12150 00000100:00100000:1.0:1746147736.126582:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+11:32608:x1830967794275072:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147736.126601:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147736.126631:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17000/0xe64d3fbf12a7f6f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafccc2 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.126746:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17200/0xe64d3fbf12a7f6fc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.126759:0:14545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc91 expref: 12 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.126765:0:14545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17200/0xe64d3fbf12a7f6fc lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.126795:0:14545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc91 expref: 12 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.126806:0:14545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc91 expref: 12 pid: 14545 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.126818:0:14545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14545:1830967796584064:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147736.127774:0:14545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.129572:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.129682:0:14545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14545:1830967796584064:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147736.129708:0:14545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17200/0xe64d3fbf12a7f6fc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000100:00100000:3.0:1746147736.129725:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794275200 00000100:00100000:3.0:1746147736.129734:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794275200 00010000:00010000:3.0:1746147736.129765:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc91 expref: 13 pid: 14545 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.129803:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8823 00000100:00100000:3.0:1746147736.129811:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794275200:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147736.129825:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147736.129831:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc91 expref: 13 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.129841:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc91 expref: 13 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.129863:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb16a00/0xe64d3fbf12a7f6c4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc91 expref: 13 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.129909:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147736.129914:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17200/0xe64d3fbf12a7f6fc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147736.129924:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17200/0xe64d3fbf12a7f6fc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147736.129931:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17200/0xe64d3fbf12a7f6fc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147736.129953:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147736.130001:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794275200:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 191us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.130012:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8823 00010000:00010000:1.0:1746147736.130084:0:14545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17200/0xe64d3fbf12a7f6fc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.130091:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17200/0xe64d3fbf12a7f6fc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:1.0:1746147736.130111:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147736.130262:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17000/0xe64d3fbf12a7f6f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccc2 expref: 13 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.130294:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17200/0xe64d3fbf12a7f6fc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccc2 expref: 12 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.130301:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147736.130304:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147736.130306:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb17200, rc 0) 00000100:00100000:1.0:1746147736.130340:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+12:32608:x1830967794275072:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 3759us (4277us total) trans 8589946187 rc 0/0 00000100:00100000:1.0:1746147736.130346:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12150 00000100:00100000:0.0:1746147736.132416:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.132468:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794275456 00000100:00100000:1.0:1746147736.132476:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794275456 00000100:00100000:1.0:1746147736.132524:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12151 00000100:00100000:1.0:1746147736.132531:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+12:32608:x1830967794275456:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147736.132555:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147736.132558:0:14545:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147736.132583:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17200/0xe64d3fbf12a7f6fc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccc2 expref: 12 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.132599:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147736.132603:0:14545:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147736.132624:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17400/0xe64d3fbf12a7f70a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafccc9 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.132714:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17600/0xe64d3fbf12a7f711 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.132729:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17600/0xe64d3fbf12a7f711 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.132736:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17600/0xe64d3fbf12a7f711 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:1.0:1746147736.132747:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147736.132851:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17400/0xe64d3fbf12a7f70a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccc9 expref: 14 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.132861:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17600/0xe64d3fbf12a7f711 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccc9 expref: 13 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.132866:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147736.132868:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147736.132870:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb17600, rc 0) 00000100:00100000:1.0:1746147736.132954:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+13:32608:x1830967794275456:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 422us (545us total) trans 8589946188 rc 0/0 00000100:00100000:1.0:1746147736.132960:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12151 00000100:00100000:0.0:1746147736.134465:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.134596:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794275584 00000100:00100000:1.0:1746147736.134603:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794275584 00000100:00100000:1.0:1746147736.134660:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12152 00000100:00100000:1.0:1746147736.134668:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+13:32608:x1830967794275584:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147736.134687:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147736.134701:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17800/0xe64d3fbf12a7f71f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafccd0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.134748:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17800/0xe64d3fbf12a7f71f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccd0 expref: 14 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.134761:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17800/0xe64d3fbf12a7f71f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccd0 expref: 14 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.134776:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147736.134779:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147736.134781:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb17800, rc 0) 00000100:00100000:1.0:1746147736.134815:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+14:32608:x1830967794275584:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 148us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.134821:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12152 00000100:00100000:0.0:1746147736.137147:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.137185:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.137713:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794275712 00000100:00100000:3.0:1746147736.137722:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794275712 00000100:00100000:0.0:1746147736.137730:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.137750:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.137759:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794275968 00000100:00100000:2.0:1746147736.137764:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794275968 00000100:00100000:0.0:1746147736.137765:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.137850:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794276224 00000100:00100000:3.0:1746147736.137853:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794276224 00000100:00100000:0.0:1746147736.137861:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794275840 00000100:00100000:0.0:1746147736.137864:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794275840 00000100:00100000:3.0:1746147736.137869:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794276096 00000100:00100000:3.0:1746147736.137871:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794276096 00000100:00100000:0.0:1746147736.137906:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17281 00000100:00100000:3.0:1746147736.137914:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17282 00000100:00100000:0.0:1746147736.137916:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+16:1960:x1830967794275712:12345-192.168.202.10@tcp:1:mirror_io.0 00000100:00100000:3.0:1746147736.137920:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+15:1960:x1830967794275968:12345-192.168.202.10@tcp:1:mirror_io.0 00000100:00100000:1.0:1746147736.137946:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17283 00000100:00100000:1.0:1746147736.137955:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+16:1960:x1830967794276224:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147736.137961:0:8470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f726 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.137977:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb16e00/0xe64d3fbf12a7f72d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.137979:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7f50b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb6b expref: 27 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.137986:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a600/0xe64d3fbf12a7f6d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcca6 expref: 15 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.137989:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7f693 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc75 expref: 42 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.137993:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f527 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb8e expref: 23 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.137996:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a734aa00/0xe64d3fbf12a7f6e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccb4 expref: 16 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.137999:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.138001:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.138002:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f646 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc44 expref: 42 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.138004:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f726 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.138009:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f63f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [5013504->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc3d expref: 25 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.138018:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147736.138019:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147736.138021:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb16e00/0xe64d3fbf12a7f72d lrc: 7/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.138050:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f63f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [5013504->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc3d expref: 25 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.138062:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f63f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [5013504->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc3d expref: 25 pid: 10613 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746147736.138062:0:21480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a734a200/0xe64d3fbf12a7f734 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.138074:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f5dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbe9 expref: 25 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147736.138076:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796584192:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147736.138082:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb16c00/0xe64d3fbf12a7f6cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc98 expref: 16 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147736.138092:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248600/0xe64d3fbf12a7f60e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc13 expref: 42 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.138098:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.138100:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.138102:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a734a200/0xe64d3fbf12a7f734 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.138118:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0248600/0xe64d3fbf12a7f60e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc13 expref: 42 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.138126:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0248600/0xe64d3fbf12a7f60e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc13 expref: 42 pid: 8469 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746147736.138134:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796584320:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147736.138139:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f646 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc44 expref: 42 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.138146:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f646 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc44 expref: 42 pid: 8469 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.138153:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796584448:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147736.138167:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb16c00/0xe64d3fbf12a7f6cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc98 expref: 16 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147736.138174:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb16c00/0xe64d3fbf12a7f6cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc98 expref: 16 pid: 20619 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.138175:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a734aa00/0xe64d3fbf12a7f6e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccb4 expref: 16 pid: 10613 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147736.138181:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796584576:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147736.138182:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a734aa00/0xe64d3fbf12a7f6e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccb4 expref: 16 pid: 10613 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746147736.138193:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796584704:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147736.138203:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f5dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbe9 expref: 25 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.138211:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7f693 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc75 expref: 42 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.138214:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f5dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbe9 expref: 25 pid: 10613 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.138218:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7f693 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc75 expref: 42 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746147736.138220:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796584832:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147736.138224:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe41180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796584960:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147736.138237:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.138237:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c07f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.138257:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17284 00000100:00100000:0.0:1746147736.138263:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+15:1960:x1830967794275840:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147736.138278:0:10613:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f73b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147736.138280:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147736.138287:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f5ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbc6 expref: 23 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147736.138294:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800986f6400/0xe64d3fbf12a7f6d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc9f expref: 15 pid: 4591 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147736.138297:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794276352 00010000:00010000:0.0:1746147736.138299:0:10613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c0dba00/0xe64d3fbf12a7f5c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbcd expref: 27 pid: 9615 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147736.138300:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794276352 00010000:00010000:0.0:1746147736.138303:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.138305:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.138306:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f73b lrc: 6/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147736.138317:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17285 00010000:00010000:0.0:1746147736.138320:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c0dba00/0xe64d3fbf12a7f5c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbcd expref: 27 pid: 9615 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147736.138321:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+16:1960:x1830967794276096:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147736.138328:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c0dba00/0xe64d3fbf12a7f5c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbcd expref: 27 pid: 9615 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.138334:0:4592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f742 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.138336:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796585088:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147736.138343:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f61c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc1a expref: 42 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.138350:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800986f6200/0xe64d3fbf12a7f6e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccad expref: 16 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.138355:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f818200/0xe64d3fbf12a7f623 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc21 expref: 25 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.138360:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.138362:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.138363:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800986f6400/0xe64d3fbf12a7f6d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc9f expref: 16 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.138364:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f742 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.138371:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800986f6400/0xe64d3fbf12a7f6d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc9f expref: 16 pid: 4591 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.138377:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f818200/0xe64d3fbf12a7f623 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc21 expref: 25 pid: 8469 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147736.138378:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796585216:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147736.138384:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f818200/0xe64d3fbf12a7f623 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc21 expref: 25 pid: 8469 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746147736.138391:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796585344:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147736.138397:0:10613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f5ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbc6 expref: 23 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147736.138404:0:10613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f5ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbc6 expref: 23 pid: 10613 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746147736.138410:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800941b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796585472:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147736.138411:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800986f6200/0xe64d3fbf12a7f6e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccad expref: 16 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.138418:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800986f6200/0xe64d3fbf12a7f6e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccad expref: 16 pid: 8470 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746147736.138424:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c07fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147736.138425:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796585600:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147736.138453:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f61c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc1a expref: 42 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.138460:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f61c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc1a expref: 42 pid: 8469 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.138472:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe42680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796585728:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147736.138481:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147736.138498:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17286 00000100:00100000:1.0:1746147736.138502:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+16:1960:x1830967794276352:12345-192.168.202.10@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147736.138517:0:8468:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bcec600/0xe64d3fbf12a7f749 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.138525:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 3907584->3964927) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.138531:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f65b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc59 expref: 27 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.138536:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147736.138538:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147736.138540:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bcec600/0xe64d3fbf12a7f749 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.138553:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f65b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc59 expref: 27 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.138560:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f65b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc59 expref: 27 pid: 8469 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.138567:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796585856:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147736.138588:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 3907584->3964927) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.138595:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 3907584->3964927) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 23 pid: 20619 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.138601:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796585984:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147736.138611:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e90fc00 going to sleep for 11 seconds 00010000:00010000:3.0:1746147736.138665:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb8e expref: 23 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.138678:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb8e expref: 23 pid: 8470 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.138686:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796586112:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.138713:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a734a600/0xe64d3fbf12a7f6d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcca6 expref: 16 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.138720:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a734a600/0xe64d3fbf12a7f6d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcca6 expref: 16 pid: 10613 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.138727:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796586240:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.138749:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7f50b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb6b expref: 27 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.138757:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7f50b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb6b expref: 27 pid: 22183 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.138765:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796586368:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147736.138781:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094689b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.145450:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.145487:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.145510:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794276480 00000100:00100000:3.0:1746147736.145511:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794276608 00000100:00100000:3.0:1746147736.145518:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794276608 00000100:00100000:0.0:1746147736.145518:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794276480 00010000:00010000:3.0:1746147736.145554:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f63f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [5013504->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc3d expref: 26 pid: 10613 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746147736.145554:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f646 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc44 expref: 43 pid: 8469 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.145579:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8824 00000100:00100000:3.0:1746147736.145586:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967794276608:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147736.145598:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147736.145789:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796584320:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147736.145927:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796584192:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147736.145937:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796584448:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.145980:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f63f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [5013504->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc3d expref: 26 pid: 10613 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.145992:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f63f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [5013504->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc3d expref: 26 pid: 10613 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.146018:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f63f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [5013504->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc3d expref: 26 pid: 10613 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.146037:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147736.146077:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967794276608:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 491us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.146083:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8824 00000100:00100000:3.0:1746147736.146104:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8825 00000100:00100000:3.0:1746147736.146109:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1957:x1830967794276480:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147736.146116:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147736.146125:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f646 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc44 expref: 43 pid: 8469 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.146132:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f646 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc44 expref: 43 pid: 8469 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.146147:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f646 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc44 expref: 43 pid: 8469 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.146155:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147736.146168:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1957:x1830967794276480:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 59us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.146172:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8825 00000100:00080000:2.0:1746147736.146177:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147736.146427:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.146440:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794276864 00000100:00100000:0.0:1746147736.146443:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794276864 00010000:00010000:0.0:1746147736.146458:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a734aa00/0xe64d3fbf12a7f6e7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccb4 expref: 17 pid: 10613 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746147736.146472:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8826 00000100:00100000:0.0:1746147736.146477:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+17:1959:x1830967794276864:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147736.146483:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147736.146491:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a734aa00/0xe64d3fbf12a7f6e7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccb4 expref: 17 pid: 10613 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.146499:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a734aa00/0xe64d3fbf12a7f6e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccb4 expref: 17 pid: 10613 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.146510:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147736.146526:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+17:1959:x1830967794276864:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 49us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.146531:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8826 00000100:00100000:0.0:1746147736.146558:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.146567:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794276736 00000100:00100000:0.0:1746147736.146570:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794276736 00010000:00010000:0.0:1746147736.146578:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb16c00/0xe64d3fbf12a7f6cb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc98 expref: 17 pid: 20619 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746147736.146590:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8827 00000100:00100000:0.0:1746147736.146595:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6671c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+17:1959:x1830967794276736:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147736.146601:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147736.146610:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb16c00/0xe64d3fbf12a7f6cb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc98 expref: 17 pid: 20619 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.146629:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb16c00/0xe64d3fbf12a7f6cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc98 expref: 17 pid: 20619 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.146640:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147736.146654:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6671c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+17:1959:x1830967794276736:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 59us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.146659:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8827 00010000:00010000:3.0:1746147736.147012:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb16c00/0xe64d3fbf12a7f6cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc98 expref: 16 pid: 20619 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.147022:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796584576:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147736.147030:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796584832:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.147057:0:21480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a734a200/0xe64d3fbf12a7f734 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.147221:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a734aa00/0xe64d3fbf12a7f6e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccb4 expref: 15 pid: 10613 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746147736.147243:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796584704:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147736.147252:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe41180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796584960:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147736.147270:0:20619:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fb16e00/0xe64d3fbf12a7f72d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147736.148387:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796585088:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147736.148399:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796585216:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147736.149183:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.149208:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.149218:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796585856:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147736.149224:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.149233:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796585984:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147736.149244:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794277632 00000100:00100000:0.0:1746147736.149249:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794277632 00010000:00010000:2.0:1746147736.149258:0:8468:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009bcec600/0xe64d3fbf12a7f749 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.149280:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f5dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbe9 expref: 25 pid: 10613 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.149283:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794276992 00000100:00100000:2.0:1746147736.149286:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794276992 00010000:00010000:2.0:1746147736.149300:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0248600/0xe64d3fbf12a7f60e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc13 expref: 42 pid: 8469 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746147736.149304:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8828 00000100:00100000:0.0:1746147736.149310:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794277632:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147736.149316:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8829 00000100:00100000:2.0:1746147736.149320:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1959:x1830967794276992:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147736.149322:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.149329:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.149341:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0248600/0xe64d3fbf12a7f60e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc13 expref: 42 pid: 8469 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746147736.149342:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f5dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbe9 expref: 25 pid: 10613 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746147736.149351:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f5dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbe9 expref: 25 pid: 10613 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.149410:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796586112:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147736.149418:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796586240:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147736.149430:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796586368:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.149450:0:8470:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f726 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147736.149469:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794277888 00000100:00100000:3.0:1746147736.149472:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794277888 00002000:00100000:3.0:1746147736.149548:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3907584->3964927) req@ffff880135812300 x1830967794277888/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.149557:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812300 with x1830967794277888 ext(3907584->3964927) 00010000:00010000:3.0:1746147736.149563:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 3907584->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 24 pid: 20619 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.149572:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 3907584->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 24 pid: 20619 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147736.149578:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135812300 00000100:00100000:1.0:1746147736.149649:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796585344:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147736.149659:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796585600:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147736.149666:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe42680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4592:1830967796585728:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147736.149684:0:4592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f742 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147736.149747:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1581 00000100:00100000:3.0:1746147736.149753:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967794277888:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:1.0:1746147736.149963:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.149983:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794277760 00000100:00100000:1.0:1746147736.149986:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794277760 00010000:00010000:1.0:1746147736.150004:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7f693 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc75 expref: 43 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.150019:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8830 00000100:00100000:1.0:1746147736.150024:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1959:x1830967794277760:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147736.150031:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147736.150042:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7f693 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc75 expref: 43 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.150050:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7f693 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc75 expref: 43 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.150070:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095093400/0xe64d3fbf12a7f693 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5017599) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc75 expref: 43 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.150083:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.150085:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.150089:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb16e00/0xe64d3fbf12a7f72d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.150097:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb16e00/0xe64d3fbf12a7f72d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.150119:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.150138:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1959:x1830967794277760:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 113us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.150144:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8830 00010000:00010000:1.0:1746147736.150163:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fb16e00/0xe64d3fbf12a7f72d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.150170:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb16e00/0xe64d3fbf12a7f72d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.150171:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0248600/0xe64d3fbf12a7f60e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc13 expref: 41 pid: 8469 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746147736.150185:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f5dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbe9 expref: 25 pid: 10613 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.150189:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248600/0xe64d3fbf12a7f60e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc13 expref: 41 pid: 8469 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.150189:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb16e00/0xe64d3fbf12a7f72d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.150195:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb16e00/0xe64d3fbf12a7f72d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.150199:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.150200:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.150203:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fb16e00/0xe64d3fbf12a7f72d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.150203:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a734a200/0xe64d3fbf12a7f734 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.150208:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a734a200/0xe64d3fbf12a7f734 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.150212:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb16e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147736.150215:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb16e00/0xe64d3fbf12a7f72d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.150222:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb16e00/0xe64d3fbf12a7f72d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.150237:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fb16e00/0xe64d3fbf12a7f72d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.150243:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb16e00/0xe64d3fbf12a7f72d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147736.150286:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794276224:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 12333us (12557us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.150292:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17283 00010000:00010000:2.0:1746147736.150300:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147736.150306:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.150319:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1959:x1830967794276992:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 997us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.150321:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1959:x1830967794277632:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1012us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.150325:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8829 00000100:00100000:0.0:1746147736.150328:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8828 00010000:00010000:3.0:1746147736.150411:0:21480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a734a200/0xe64d3fbf12a7f734 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.150418:0:21480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a734a200/0xe64d3fbf12a7f734 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.150431:0:21480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a734a200/0xe64d3fbf12a7f734 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.150437:0:21480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a734a200/0xe64d3fbf12a7f734 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.150442:0:21480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a734a200/0xe64d3fbf12a7f734 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.150452:0:21480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a734a200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147736.150455:0:21480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a734a200/0xe64d3fbf12a7f734 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.150460:0:21480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a734a200/0xe64d3fbf12a7f734 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.150469:0:21480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a734a200/0xe64d3fbf12a7f734 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.150474:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a734a200/0xe64d3fbf12a7f734 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147736.150506:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794275712:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 12592us (13369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.150513:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17281 00000100:00100000:0.0:1746147736.150610:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.151188:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.151210:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.151264:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800941b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10613:1830967796585472:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.151288:0:10613:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f73b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.151720:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.152273:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.152307:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794277120 00000100:00100000:2.0:1746147736.152308:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794278144 00000100:00100000:1.0:1746147736.152312:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794277120 00000100:00100000:2.0:1746147736.152319:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794278144 00000100:00100000:0.0:1746147736.152320:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.152330:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147736.152336:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0dba00/0xe64d3fbf12a7f5c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbcd expref: 28 pid: 9615 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746147736.152341:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.152350:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.152353:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794277376 00010000:00010000:2.0:1746147736.152355:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734a600/0xe64d3fbf12a7f6d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcca6 expref: 17 pid: 10613 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746147736.152355:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794277376 00010000:00010000:1.0:1746147736.152365:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f818200/0xe64d3fbf12a7f623 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc21 expref: 24 pid: 8469 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746147736.152373:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794278016 00000100:00100000:0.0:1746147736.152373:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.152375:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794278016 00000100:00100000:2.0:1746147736.152383:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794278528 00010000:00010000:1.0:1746147736.152383:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f61c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc1a expref: 40 pid: 8469 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.152386:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794278528 00000100:00100000:1.0:1746147736.152392:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8831 00000100:00100000:1.0:1746147736.152398:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967794277120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.152399:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7f50b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb6b expref: 29 pid: 22183 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746147736.152410:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794277248 00010000:00010000:1.0:1746147736.152410:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147736.152412:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794277248 00010000:00010000:2.0:1746147736.152421:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800986f6400/0xe64d3fbf12a7f6d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc9f expref: 18 pid: 4591 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.152423:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c0dba00/0xe64d3fbf12a7f5c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbcd expref: 29 pid: 9615 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746147736.152429:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794277504 00000100:00100000:2.0:1746147736.152431:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794277504 00010000:00010000:1.0:1746147736.152432:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c0dba00/0xe64d3fbf12a7f5c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbcd expref: 29 pid: 9615 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.152440:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800986f6200/0xe64d3fbf12a7f6e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccad expref: 13 pid: 8470 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.152448:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c0dba00/0xe64d3fbf12a7f5c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbcd expref: 29 pid: 9615 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746147736.152449:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794278272 00000100:00100000:2.0:1746147736.152451:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794278272 00010000:00010000:2.0:1746147736.152459:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f65b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc59 expref: 29 pid: 8469 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.152460:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.152468:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794278400 00000100:00100000:2.0:1746147736.152470:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794278400 00010000:00010000:2.0:1746147736.152479:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb8e expref: 26 pid: 8470 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746147736.152487:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794278656 00000100:00100000:2.0:1746147736.152489:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794278656 00010000:00010000:2.0:1746147736.152496:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f5ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbc6 expref: 27 pid: 10613 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746147736.152508:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8832 00000100:00100000:2.0:1746147736.152515:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1957:x1830967794277376:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.152527:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.152545:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f818200/0xe64d3fbf12a7f623 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc21 expref: 24 pid: 8469 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.152556:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f818200/0xe64d3fbf12a7f623 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc21 expref: 24 pid: 8469 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.152575:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f818200/0xe64d3fbf12a7f623 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc21 expref: 24 pid: 8469 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.152589:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.153069:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967794277120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 669us (1880us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.153072:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1957:x1830967794277376:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 555us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.153075:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967794277888:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 3322us (3865us total) trans 21474841728 rc 0/0 00000100:00100000:1.0:1746147736.153076:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8831 00000100:00100000:2.0:1746147736.153080:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8832 00000100:00100000:3.0:1746147736.153082:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1581 00002000:00100000:3.0:1746147736.153090:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3907584->3964927) req@ffff880135812300 x1830967794277888/t21474841728(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/448 e 0 to 0 dl 1746147747 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147736.153092:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8833 00000100:00100000:2.0:1746147736.153097:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8834 00000100:00100000:1.0:1746147736.153099:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+18:1959:x1830967794278144:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147736.153104:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6670c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1957:x1830967794278016:12345-192.168.202.10@tcp:103:ldlm_bl.0 00002000:00100000:3.0:1746147736.153105:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135812300 with x1830967794277888 ext(3907584->3964927) 00010000:00010000:1.0:1746147736.153108:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147736.153111:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 3907584->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 28 pid: 20619 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.153112:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147736.153117:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a734a600/0xe64d3fbf12a7f6d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcca6 expref: 18 pid: 10613 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.153120:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f61c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc1a expref: 40 pid: 8469 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.153121:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 3907584->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 28 pid: 20619 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.153125:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a734a600/0xe64d3fbf12a7f6d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcca6 expref: 18 pid: 10613 timeout: 915 lvb_type: 1 00002000:00010000:3.0:1746147736.153126:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135812300 00010000:00010000:2.0:1746147736.153129:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f61c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc1a expref: 40 pid: 8469 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.153137:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a600/0xe64d3fbf12a7f6d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcca6 expref: 18 pid: 10613 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.153146:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f61c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc1a expref: 40 pid: 8469 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.153151:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147736.153156:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.153179:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+17:1959:x1830967794278144:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 80us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.153184:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8833 00000100:00100000:1.0:1746147736.153196:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8835 00000100:00100000:1.0:1746147736.153200:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967794278528:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147736.153206:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147736.153212:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7f50b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb6b expref: 28 pid: 22183 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.153219:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7f50b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb6b expref: 28 pid: 22183 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.153229:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a650f600/0xe64d3fbf12a7f50b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb6b expref: 28 pid: 22183 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.153234:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.153595:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6670c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1957:x1830967794278016:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 490us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.153602:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8834 00000100:00100000:2.0:1746147736.153655:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8836 00000100:00100000:2.0:1746147736.153661:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+16:1957:x1830967794277248:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.153669:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.153682:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800986f6400/0xe64d3fbf12a7f6d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc9f expref: 16 pid: 4591 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.153690:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800986f6400/0xe64d3fbf12a7f6d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc9f expref: 16 pid: 4591 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.153702:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800986f6400/0xe64d3fbf12a7f6d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc9f expref: 16 pid: 4591 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.153711:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.153738:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+15:1957:x1830967794277248:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 77us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.153743:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8836 00000100:00100000:2.0:1746147736.153754:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8837 00000100:00100000:2.0:1746147736.153759:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+13:1957:x1830967794277504:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.153765:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.153773:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800986f6200/0xe64d3fbf12a7f6e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccad expref: 13 pid: 8470 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.153780:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800986f6200/0xe64d3fbf12a7f6e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccad expref: 13 pid: 8470 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.153791:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800986f6200/0xe64d3fbf12a7f6e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccad expref: 13 pid: 8470 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.153798:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.153800:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.153804:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f742 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.153811:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f742 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.153843:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.153858:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+12:1957:x1830967794277504:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 99us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.153863:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8837 00000100:00100000:2.0:1746147736.153872:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8838 00000100:00100000:2.0:1746147736.153877:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967794278272:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.153903:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.153913:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f65b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc59 expref: 27 pid: 8469 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.153925:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f65b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc59 expref: 27 pid: 8469 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.153931:0:4592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f742 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.153936:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5defc00/0xe64d3fbf12a7f65b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc59 expref: 27 pid: 8469 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.153940:0:4592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f742 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.153945:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.153960:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967794278272:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 83us (1618us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147736.153962:0:4592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f742 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147736.153965:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8838 00010000:00010000:3.0:1746147736.153970:0:4592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f742 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147736.153975:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8839 00010000:00010000:3.0:1746147736.153978:0:4592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f742 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147736.153979:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794278400:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147736.153984:0:4592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb16200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147736.153985:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147736.153989:0:4592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f742 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.153993:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb8e expref: 27 pid: 8470 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746147736.154001:0:4592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f742 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.154001:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb8e expref: 27 pid: 8470 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746147736.154011:0:4592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f742 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.154012:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea800/0xe64d3fbf12a7f527 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcb8e expref: 27 pid: 8470 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746147736.154017:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb16200/0xe64d3fbf12a7f742 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.154020:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.154021:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.154024:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.154030:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f726 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147736.154033:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794278528:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 830us (1759us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.154041:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8835 00010000:00010000:2.0:1746147736.154045:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147736.154054:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:41587371-240a-4781-aecb-638f17200fbd+11:1960:x1830967794276096:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 15733us (16289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.154054:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8840 00000100:00100000:1.0:1746147736.154060:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794278656:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147736.154061:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17285 00000100:00100000:2.0:1746147736.154063:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794278400:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 82us (1710us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147736.154067:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147736.154069:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8839 00010000:00010000:1.0:1746147736.154075:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f5ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbc6 expref: 26 pid: 10613 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746147736.154081:0:8470:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.154083:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f5ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbc6 expref: 25 pid: 10613 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746147736.154088:0:8470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.154094:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f5ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcbc6 expref: 25 pid: 10613 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746147736.154099:0:8470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.154101:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.154102:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.154104:0:8470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.154106:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f73b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.154110:0:8470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f726 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.154113:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f73b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.154119:0:8470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800986f6e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147736.154122:0:8470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f726 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.154127:0:8470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f726 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.154135:0:8470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f726 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.154140:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f726 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.154140:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.154155:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794278656:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 95us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.154159:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8840 00000100:00100000:3.0:1746147736.154168:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794275968:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 16248us (16983us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.154173:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17282 00010000:00010000:2.0:1746147736.154809:0:10613:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f73b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.154818:0:10613:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f73b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.154835:0:10613:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f73b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.154841:0:10613:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f73b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.154847:0:10613:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f73b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.154853:0:10613:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a734a400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147736.154856:0:10613:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f73b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.154867:0:10613:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f73b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.154876:0:10613:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f73b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.154907:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f73b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147736.154956:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794275840:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 16693us (17205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.154963:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17284 00000100:00100000:0.0:1746147736.156003:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.156345:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794278784 00000100:00100000:1.0:1746147736.156354:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794278784 00010000:00010000:1.0:1746147736.156379:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3907584->18446744073709551615] (req 3907584->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 24 pid: 20619 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.156481:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8841 00000100:00100000:1.0:1746147736.156489:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6670450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1958:x1830967794278784:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147736.156501:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147736.156517:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 3907584->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 24 pid: 20619 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.156528:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 3907584->3964927) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 24 pid: 20619 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.156545:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e60800/0xe64d3fbf12a7f69a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3907584->18446744073709551615] (req 3907584->3964927) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc7c expref: 24 pid: 20619 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.156557:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.156559:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.156563:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bcec600/0xe64d3fbf12a7f749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.156569:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bcec600/0xe64d3fbf12a7f749 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.156602:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.156653:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6670450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967794278784:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 165us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.156659:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8841 00010000:00010000:2.0:1746147736.156730:0:8468:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009bcec600/0xe64d3fbf12a7f749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.156739:0:8468:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bcec600/0xe64d3fbf12a7f749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.156756:0:8468:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bcec600/0xe64d3fbf12a7f749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.156762:0:8468:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bcec600/0xe64d3fbf12a7f749 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.156769:0:8468:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bcec600/0xe64d3fbf12a7f749 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.156779:0:8468:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bcec600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147736.156781:0:8468:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bcec600/0xe64d3fbf12a7f749 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.156787:0:8468:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bcec600/0xe64d3fbf12a7f749 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.156796:0:8468:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bcec600/0xe64d3fbf12a7f749 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.156801:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bcec600/0xe64d3fbf12a7f749 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147736.156839:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794276352:12345-192.168.202.10@tcp:1:mirror_io.0 Request processed in 18336us (18559us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.156845:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17286 00000100:00100000:0.0:1746147736.157929:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.158004:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794279040 00000100:00100000:2.0:1746147736.158009:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794279040 00000100:00100000:2.0:1746147736.158091:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12153 00000100:00100000:2.0:1746147736.158098:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+14:32608:x1830967794279040:12345-192.168.202.10@tcp:36:mirror_io.0 00010000:00010000:2.0:1746147736.158145:0:5744:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.158164:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17800/0xe64d3fbf12a7f71f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccd0 expref: 14 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.158176:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147736.158180:0:5744:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147736.158203:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.158214:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca37 expref: 328 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.158220:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca3e expref: 328 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.158227:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f38a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca4c expref: 15 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.158233:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7f685 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc6e expref: 15 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.158239:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.158263:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7f685 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc6e expref: 15 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.158272:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7f685 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc6e expref: 15 pid: 14545 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.158286:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796586496:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147736.158425:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f38a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca4c expref: 15 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.158432:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f38a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca4c expref: 15 pid: 15085 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.158439:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796586624:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147736.158461:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca3e expref: 328 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.158469:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca3e expref: 328 pid: 5744 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.158475:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796586752:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147736.158493:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca37 expref: 328 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.158499:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca37 expref: 328 pid: 15085 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.158505:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172c700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796586880:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147736.158519:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c90ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.161756:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.161851:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796586496:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147736.161859:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796586624:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147736.161866:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796586752:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147736.161872:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172c700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796586880:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147736.161941:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147736.162016:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.162029:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.162544:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794279552 00000100:00100000:1.0:1746147736.162550:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794279552 00010000:00010000:1.0:1746147736.162583:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca37 expref: 329 pid: 15085 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.162622:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794279424 00000100:00100000:1.0:1746147736.162625:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794279424 00010000:00010000:1.0:1746147736.162633:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca3e expref: 330 pid: 5744 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.162645:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794279168 00000100:00100000:1.0:1746147736.162647:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794279168 00010000:00010000:1.0:1746147736.162656:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7f685 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc6e expref: 16 pid: 14545 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.162668:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8842 00000100:00100000:1.0:1746147736.162674:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:1958:x1830967794279552:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147736.162687:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147736.162693:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca37 expref: 330 pid: 15085 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.162702:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca37 expref: 330 pid: 15085 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.162723:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950e5800/0xe64d3fbf12a7f375 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca37 expref: 330 pid: 15085 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.162738:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147736.162743:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147736.162752:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.162792:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:1958:x1830967794279552:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 118us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.162798:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8842 00000100:00100000:1.0:1746147736.162811:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8843 00000100:00100000:1.0:1746147736.162816:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:1958:x1830967794279424:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147736.162822:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147736.162826:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca3e expref: 328 pid: 5744 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.162832:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca3e expref: 328 pid: 5744 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.162841:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a650fc00/0xe64d3fbf12a7f37c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca3e expref: 328 pid: 5744 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.162849:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147736.162852:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147736.162857:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.162869:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:1958:x1830967794279424:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 53us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.162874:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8843 00000100:00100000:1.0:1746147736.162882:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8844 00000100:00100000:1.0:1746147736.162905:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794279168:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147736.162911:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147736.162914:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7f685 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc6e expref: 16 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.162922:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7f685 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc6e expref: 16 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.162932:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5287e00/0xe64d3fbf12a7f685 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcc6e expref: 16 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.162942:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147736.162945:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147736.162950:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.162969:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794279168:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 64us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.162974:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8844 00000100:00100000:0.0:1746147736.163240:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.163281:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794279296 00000100:00100000:3.0:1746147736.163285:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794279296 00010000:00010000:3.0:1746147736.163301:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f38a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca4c expref: 15 pid: 15085 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.163331:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8845 00000100:00100000:3.0:1746147736.163337:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794279296:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147736.163348:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147736.163352:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f38a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca4c expref: 15 pid: 15085 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.163361:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f38a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca4c expref: 15 pid: 15085 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.163372:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f38a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafca4c expref: 15 pid: 15085 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.163380:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147736.163383:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147736.163389:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147736.163394:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147736.163414:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147736.163433:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967794279296:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 96us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.163438:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8845 00010000:00010000:0.0:1746147736.163471:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147736.163478:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000040:00080000:0.0:1746147736.164134:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3749, 88 off314288 00000004:00080000:0.0:1746147736.164144:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815338258757ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.164194:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3749, 88 off313936 00000004:00080000:0.0:1746147736.164199:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815338314883ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147736.164212:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3750, 88 off314024 00000004:00080000:0.0:1746147736.164214:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815338329918ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147736.164244:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3750, 88 off314376 00000004:00080000:0.0:1746147736.164247:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815338362270ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.164256:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3751, 88 off314464 00000004:00080000:0.0:1746147736.164258:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815338373693ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.164264:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3751, 88 off314112 00000004:00080000:0.0:1746147736.164267:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815338382285ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147736.164272:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3752, 88 off314200 00000004:00080000:0.0:1746147736.164274:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815338389475ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147736.164279:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3753, 88 off314288 00000004:00080000:0.0:1746147736.164281:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815338396747ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147736.164287:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3752, 88 off314552 00000004:00080000:0.0:1746147736.164289:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815338404998ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.164295:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3754, 88 off314376 00000004:00080000:0.0:1746147736.164298:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815338413960ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147736.164305:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3753, 88 off314640 00000004:00080000:0.0:1746147736.164307:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815338422695ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.164313:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3755, 88 off314464 00000004:00080000:0.0:1746147736.164315:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815338430925ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147736.164321:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3754, 88 off314728 00000004:00080000:0.0:1746147736.164325:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815338440613ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.164331:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3755, 88 off314816 00000004:00080000:0.0:1746147736.164333:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815338448641ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.164339:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3756, 88 off314904 00000004:00080000:0.0:1746147736.164341:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815338456486ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.164346:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3757, 88 off314992 00000004:00080000:0.0:1746147736.164348:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815338463797ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.164854:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3756, 88 off314552 00000004:00080000:0.0:1746147736.164861:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815338976441ns, next at 756024029964ns, rc = 0 00000004:00010000:2.0:1746147736.196334:0:5744:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a5e36a00 reply state ffff88009fcb0c00 transno 8589946189 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147736.196348:0:5744:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147736.196446:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+15:32608:x1830967794279040:12345-192.168.202.10@tcp:36:mirror_io.0 Request processed in 38345us (38517us total) trans 8589946189 rc 0/0 00000100:00100000:2.0:1746147736.196454:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12153 00000001:00080000:1.0:1746147736.196520:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946189 is committed 00000004:00080000:1.0:1746147736.196526:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2823 committed 00000004:00080000:1.0:1746147736.196532:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2824 committed 00000004:00080000:1.0:1746147736.196537:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2823 committed 00000004:00080000:1.0:1746147736.196538:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2822 committed 00000004:00080000:1.0:1746147736.196540:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2821 committed 00000004:00080000:1.0:1746147736.196541:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2822 committed 00000004:00080000:1.0:1746147736.196543:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2820 committed 00000004:00080000:1.0:1746147736.196544:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2821 committed 00000004:00080000:1.0:1746147736.196546:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2819 committed 00000004:00080000:1.0:1746147736.196547:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2820 committed 00000004:00080000:1.0:1746147736.196548:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2819 committed 00000004:00080000:1.0:1746147736.196550:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2818 committed 00000004:00080000:1.0:1746147736.196551:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2818 committed 00000004:00080000:1.0:1746147736.196552:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2817 committed 00000004:00080000:1.0:1746147736.196554:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2817 committed 00000004:00080000:1.0:1746147736.196555:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2816 committed 00000004:00080000:1.0:1746147736.196556:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2816 committed 00000001:00080000:1.0:1746147736.196562:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946179 is committed 00000001:00080000:1.0:1746147736.196573:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946186 is committed 00000001:00080000:1.0:1746147736.196576:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946185 is committed 00010000:00010000:1.0:1746147736.197712:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147736.197721:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147736.197727:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147736.197732:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57b3400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147736.197735:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147736.197741:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147736.197754:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147736.197756:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147736.197759:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147736.197764:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57b3400/0xe64d3fbf12a7f750 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147736.198022:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796587264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147736.198071:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147736.198112:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796587776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147736.198126:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147736.198138:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796588288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147736.198151:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147736.198159:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796588800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147736.198170:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147736.198183:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1746147736.198187:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796587392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147736.198198:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147736.198206:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796587904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147736.198216:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147736.198225:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796588416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147736.198235:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147736.198244:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796588928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147736.198255:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147736.198274:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796587264 00000100:00100000:2.0:1746147736.198280:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796587264 00000100:00100000:2.0:1746147736.198304:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796587776 00000100:00100000:2.0:1746147736.198307:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796587776 00000100:00100000:2.0:1746147736.198314:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796588288 00000100:00100000:2.0:1746147736.198316:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796588288 00000100:00100000:2.0:1746147736.198325:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796588800 00000100:00100000:2.0:1746147736.198326:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796588800 00000100:00100000:2.0:1746147736.198340:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796587392 00000100:00100000:2.0:1746147736.198342:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796587392 00000100:00100000:2.0:1746147736.198350:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796587904 00000100:00100000:2.0:1746147736.198351:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796587904 00000100:00100000:2.0:1746147736.198357:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796588416 00000100:00100000:2.0:1746147736.198359:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796588416 00000100:00100000:2.0:1746147736.198364:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796588928 00000100:00100000:2.0:1746147736.198366:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796588928 00000100:00100000:2.0:1746147736.198374:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17287 00000100:00100000:2.0:1746147736.198379:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+72:3301:x1830967796587264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147736.198555:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+73:3301:x1830967796587264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (484us total) trans 21474841729 rc 0/0 00000100:00100000:2.0:1746147736.198561:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17287 00000100:00100000:2.0:1746147736.198573:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17288 00000100:00100000:2.0:1746147736.198577:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+72:3301:x1830967796587776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147736.198661:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+73:3301:x1830967796587776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (533us total) trans 21474841730 rc 0/0 00000100:00100000:2.0:1746147736.198666:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17288 00000100:00100000:2.0:1746147736.198675:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17289 00000100:00100000:2.0:1746147736.198679:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+80:3301:x1830967796588288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147736.198772:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+81:3301:x1830967796588288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (620us total) trans 17179874502 rc 0/0 00000100:00100000:2.0:1746147736.198777:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17289 00000100:00100000:2.0:1746147736.198786:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17290 00000100:00100000:2.0:1746147736.198790:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+80:3301:x1830967796588800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147736.198856:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+81:3301:x1830967796588800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (685us total) trans 17179874503 rc 0/0 00000100:00100000:2.0:1746147736.198862:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17290 00000100:00100000:2.0:1746147736.198870:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17291 00000100:00100000:2.0:1746147736.198874:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+72:3301:x1830967796587392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147736.198965:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+73:3301:x1830967796587392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (766us total) trans 21474841731 rc 0/0 00000100:00100000:2.0:1746147736.198970:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17291 00000100:00100000:2.0:1746147736.198978:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17292 00000100:00100000:2.0:1746147736.198983:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+72:3301:x1830967796587904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147736.199045:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+73:3301:x1830967796587904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (827us total) trans 21474841732 rc 0/0 00000100:00100000:2.0:1746147736.199050:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17292 00000100:00100000:2.0:1746147736.199058:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17293 00000100:00100000:2.0:1746147736.199062:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+80:3301:x1830967796588416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147736.199122:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+81:3301:x1830967796588416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (886us total) trans 17179874504 rc 0/0 00000100:00100000:2.0:1746147736.199127:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17293 00000100:00100000:2.0:1746147736.199136:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17294 00000100:00100000:2.0:1746147736.199140:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+80:3301:x1830967796588928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147736.199203:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+81:3301:x1830967796588928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (947us total) trans 17179874505 rc 0/0 00000100:00100000:2.0:1746147736.199209:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17294 00000004:00080000:2.0:1746147736.199304:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b5f80/2, rc 0, transno 21474841731 00000100:00100000:2.0:1746147736.199310:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796587392:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147736.199316:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe42680/2, rc 0, transno 21474841732 00000100:00100000:2.0:1746147736.199318:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796587904:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147736.199325:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe41180/2, rc 0, transno 17179874504 00000100:00100000:2.0:1746147736.199331:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796588416:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147736.199337:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c0380/2, rc 0, transno 17179874505 00000100:00100000:2.0:1746147736.199340:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796588928:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147736.199345:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b7b80/2, rc 0, transno 21474841729 00000100:00100000:2.0:1746147736.199347:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796587264:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147736.199352:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b6a00/2, rc 0, transno 21474841730 00000100:00100000:2.0:1746147736.199355:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796587776:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147736.199360:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe43480/2, rc 0, transno 17179874502 00000100:00100000:2.0:1746147736.199362:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796588288:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147736.199368:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe40700/2, rc 0, transno 17179874503 00000100:00100000:2.0:1746147736.199370:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796588800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.199497:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796587008:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.199522:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147736.199556:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796587520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.199573:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147736.199583:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796588032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.199594:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147736.199602:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796588544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.199624:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147736.199633:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796589056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.199646:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147736.199657:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746147736.199661:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796587136:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.199680:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147736.199690:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796587648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.199701:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.199705:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796587008 00000100:00100000:3.0:1746147736.199708:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796588160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.199710:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796587008 00000100:00100000:3.0:1746147736.199719:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147736.199727:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796588672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.199737:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147736.199758:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796587520 00000100:00100000:3.0:1746147736.199761:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796587520 00000100:00100000:3.0:1746147736.199774:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796588032 00000100:00100000:3.0:1746147736.199775:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796588032 00000100:00100000:3.0:1746147736.199781:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796588544 00000100:00100000:3.0:1746147736.199783:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796588544 00000100:00100000:3.0:1746147736.199787:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796589056 00000100:00100000:3.0:1746147736.199788:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796589056 00000100:00100000:3.0:1746147736.199792:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796587136 00000100:00100000:3.0:1746147736.199793:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796587136 00000100:00100000:3.0:1746147736.199798:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796587648 00000100:00100000:3.0:1746147736.199799:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796587648 00000100:00100000:3.0:1746147736.199804:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796588160 00000100:00100000:3.0:1746147736.199805:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796588160 00000100:00100000:3.0:1746147736.199810:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796588672 00000100:00100000:3.0:1746147736.199812:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796588672 00000100:00100000:3.0:1746147736.199818:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17295 00000100:00100000:3.0:1746147736.199823:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3303:x1830967796587520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147736.199924:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:3.0:1746147736.199926:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:3.0:1746147736.199929:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147736.199930:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:3.0:1746147736.199932:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:3.0:1746147736.199952:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3303:x1830967796587520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (378us total) trans 21474841733 rc 0/0 00000100:00100000:3.0:1746147736.199957:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17295 00000100:00100000:3.0:1746147736.199970:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17296 00000100:00100000:3.0:1746147736.199973:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3303:x1830967796588032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.200050:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+86:3303:x1830967796588032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (454us total) trans 17179874506 rc 0/0 00000100:00100000:0.0:1746147736.200054:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17297 00000100:00100000:3.0:1746147736.200057:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17296 00000100:00100000:0.0:1746147736.200060:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+86:3303:x1830967796588544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.200066:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17298 00000100:00100000:3.0:1746147736.200070:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3303:x1830967796589056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.200104:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17299 00000100:00100000:3.0:1746147736.200109:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3303:x1830967796587136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.200169:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+86:3303:x1830967796588544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (553us total) trans 17179874507 rc 0/0 00000100:00100000:3.0:1746147736.200182:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3303:x1830967796587136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (500us total) trans 21474841734 rc 0/0 00000100:00100000:3.0:1746147736.200187:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17299 00000100:00100000:3.0:1746147736.200196:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17300 00000100:00100000:3.0:1746147736.200200:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3303:x1830967796587648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.200264:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3303:x1830967796587648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (561us total) trans 21474841735 rc 0/0 00000100:00100000:3.0:1746147736.200269:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17300 00000100:00100000:3.0:1746147736.200277:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17301 00000100:00100000:3.0:1746147736.200281:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:3303:x1830967796588160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.200355:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+87:3303:x1830967796588160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (634us total) trans 17179874508 rc 0/0 00000100:00100000:3.0:1746147736.200360:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17301 00000100:00100000:3.0:1746147736.200367:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17302 00000100:00100000:3.0:1746147736.200371:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:3303:x1830967796588672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.200378:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17297 00000100:00100000:0.0:1746147736.200391:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17303 00000100:00100000:0.0:1746147736.200396:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3303:x1830967796587008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.200441:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:3303:x1830967796588672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (702us total) trans 17179874509 rc 0/0 00000100:00100000:3.0:1746147736.200445:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17302 00000100:00100000:0.0:1746147736.200478:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+77:3303:x1830967796587008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (955us total) trans 21474841736 rc 0/0 00000100:00100000:0.0:1746147736.200486:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17303 00000100:00100000:2.0:1746147736.201680:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+86:3303:x1830967796589056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1608us (2031us total) trans 17179874510 rc 0/0 00000100:00100000:2.0:1746147736.201687:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17298 00000004:00080000:2.0:1746147736.201717:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b5500/2, rc 0, transno 21474841734 00000100:00100000:2.0:1746147736.201726:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796587136:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147736.201733:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b4000/2, rc 0, transno 21474841735 00000100:00100000:2.0:1746147736.201735:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796587648:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147736.201744:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe43b80/2, rc 0, transno 17179874508 00000100:00100000:2.0:1746147736.201746:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796588160:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147736.201752:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe40e00/2, rc 0, transno 17179874509 00000100:00100000:2.0:1746147736.201754:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796588672:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147736.201761:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b7480/2, rc 0, transno 21474841736 00000100:00100000:2.0:1746147736.201763:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796587008:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147736.201769:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800956b7100/2, rc 0, transno 21474841733 00000100:00100000:2.0:1746147736.201771:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800956b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796587520:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147736.201777:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe40a80/2, rc 0, transno 17179874506 00000100:00100000:2.0:1746147736.201779:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796588032:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147736.201784:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe40380/2, rc 0, transno 17179874507 00000100:00100000:2.0:1746147736.201786:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796588544:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147736.201790:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172d180/2, rc 0, transno 17179874510 00000100:00100000:2.0:1746147736.201792:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796589056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147736.202961:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.220275:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.220363:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794279680 00000100:00100000:0.0:1746147736.220374:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794279680 00000100:00100000:2.0:1746147736.220408:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794279936 00000100:00100000:0.0:1746147736.220433:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12154 00000100:00100000:0.0:1746147736.220441:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+7:32608:x1830967794279680:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147736.220465:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147736.220485:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f757 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafccd7 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147736.220521:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794279936 00010000:00010000:0.0:1746147736.220540:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f757 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccd7 expref: 8 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.220553:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f757 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccd7 expref: 8 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.220569:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147736.220573:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147736.220575:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0249e00, rc 0) 00000100:00100000:0.0:1746147736.220643:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+8:32608:x1830967794279680:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 202us (17684us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.220649:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12154 00000100:00100000:0.0:1746147736.220667:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12155 00000100:00100000:0.0:1746147736.220672:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:32611:x1830967794279936:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147736.220681:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147736.220688:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f75e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafccde expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.221095:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f765 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221103:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f765 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221110:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f765 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221121:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f76c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221126:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221131:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221228:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f773 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221233:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f773 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221239:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f773 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:0.0:1746147736.221248:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147736.221368:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f773 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221374:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f773 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221384:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f773 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221389:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0248400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147736.221393:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f773 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221399:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f773 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221409:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147736.221411:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147736.221414:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f773 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221418:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248400/0xe64d3fbf12a7f773 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221431:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f765 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221436:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f765 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221441:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f765 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221445:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0248a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147736.221447:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f765 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221452:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f765 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221461:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147736.221463:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147736.221465:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221469:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248a00/0xe64d3fbf12a7f765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221480:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221484:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f76c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221488:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f76c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221492:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0249a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147736.221494:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f76c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221499:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f76c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221504:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091544500) 00010000:00010000:0.0:1746147736.221506:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147736.221508:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f76c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221512:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f76c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.221542:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f75e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccde expref: 9 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.221549:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0248200/0xe64d3fbf12a7f75e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccde expref: 9 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.221555:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0248200, rc 0) 00000100:00100000:0.0:1746147736.221579:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32611:x1830967794279936:12345-192.168.202.10@tcp:101:cat.0 Request processed in 907us (1312us total) trans 8589946190 rc 301/301 00000100:00100000:0.0:1746147736.221585:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12155 00000100:00100000:1.0:1746147736.225267:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.226574:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794280192 00000100:00100000:3.0:1746147736.226584:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794280192 00000100:00100000:3.0:1746147736.226636:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5081 00000100:00100000:3.0:1746147736.226643:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:32611:x1830967794280192:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:3.0:1746147736.227132:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32611:x1830967794280192:12345-192.168.202.10@tcp:35:cat.0 Request processed in 488us (1871us total) trans 8589946191 rc 0/0 00000100:00100000:3.0:1746147736.227139:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5081 00000100:00100000:1.0:1746147736.227287:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.227378:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794280320 00000100:00100000:0.0:1746147736.227383:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794280320 00000100:00100000:0.0:1746147736.227418:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12156 00000100:00100000:0.0:1746147736.227424:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+8:32608:x1830967794280320:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147736.227434:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147736.227448:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10a200/0xe64d3fbf12a7f781 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcce5 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.227501:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10a400/0xe64d3fbf12a7f788 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.227513:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10a400/0xe64d3fbf12a7f788 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.227522:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10a400/0xe64d3fbf12a7f788 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:0.0:1746147736.227541:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:0.0:1746147736.227544:0:14545:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147736.227555:0:14545:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10a400/0xe64d3fbf12a7f788 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.227574:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10a200/0xe64d3fbf12a7f781 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcce5 expref: 10 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.227585:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10a400/0xe64d3fbf12a7f788 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcce5 expref: 9 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.227592:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147736.227595:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147736.227598:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b10a400, rc 0) 00000100:00100000:0.0:1746147736.227644:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41587371-240a-4781-aecb-638f17200fbd+9:32608:x1830967794280320:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 219us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.227649:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12156 00000100:00100000:0.0:1746147736.231083:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.233292:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.233776:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.233809:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.233826:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.233848:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.233860:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794280832 00000100:00100000:3.0:1746147736.233870:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794280832 00000100:00100000:2.0:1746147736.233870:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794280960 00000100:00100000:2.0:1746147736.233875:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794280960 00000100:00100000:1.0:1746147736.234082:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794280448 00000100:00100000:1.0:1746147736.234087:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794280448 00000100:00100000:1.0:1746147736.234121:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12157 00000100:00100000:1.0:1746147736.234128:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32611:x1830967794280448:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147736.234155:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147736.234176:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f78f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafccec expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.234258:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f796 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147736.234272:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f796 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147736.234283:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f796 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:1.0:1746147736.234309:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:1.0:1746147736.234314:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147736.234329:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f796 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147736.234352:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0299e00/0xe64d3fbf12a7f78f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccec expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.234366:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f796 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccec expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.234373:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147736.234376:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147736.234379:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0298800, rc 0) 00000100:00100000:1.0:1746147736.234425:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32611:x1830967794280448:12345-192.168.202.10@tcp:101:cat.0 Request processed in 297us (3351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.234431:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12157 00000100:00100000:1.0:1746147736.234466:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.234666:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794281088 00000100:00100000:3.0:1746147736.234670:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794281088 00000100:00100000:3.0:1746147736.234735:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794281216 00000100:00100000:3.0:1746147736.234738:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794281216 00000100:00100000:0.0:1746147736.234780:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.235015:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794281472 00000100:00100000:3.0:1746147736.235016:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794281344 00000100:00100000:3.0:1746147736.235019:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794281344 00000100:00100000:2.0:1746147736.235019:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794281472 00000100:00100000:3.0:1746147736.235044:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17304 00000100:00100000:3.0:1746147736.235051:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+13:1957:x1830967794280832:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147736.235069:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147736.235083:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17305 00010000:00010000:3.0:1746147736.235085:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800986f7600/0xe64d3fbf12a7f79d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafccfa expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147736.235091:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+14:1957:x1830967794281088:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147736.235101:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746147736.235105:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x68141998, atime: 0x68141997, ctime: 0x68141998, blocks: 0x7fd 00010000:00010000:2.0:1746147736.235113:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3c00/0xe64d3fbf12a7f7a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd08 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.235122:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.235124:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1746147736.235131:0:6715:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x68141998, atime: 0x68141997, ctime: 0x68141998, blocks: 0x821 00010000:00010000:3.0:1746147736.235132:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800986f7600/0xe64d3fbf12a7f79d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccfa expref: 14 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.235142:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.235144:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.235145:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800986f7600/0xe64d3fbf12a7f79d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccfa expref: 14 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.235151:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3c00/0xe64d3fbf12a7f7a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd08 expref: 15 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.235155:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986f7600, rc 0) 00010000:00010000:2.0:1746147736.235162:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3c00/0xe64d3fbf12a7f7a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd08 expref: 15 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.235170:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57b3c00, rc 0) 00000100:00100000:3.0:1746147736.235204:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+14:1957:x1830967794280832:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 154us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.235213:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17304 00000100:00100000:3.0:1746147736.235228:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17306 00000100:00100000:3.0:1746147736.235233:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+15:1957:x1830967794280960:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147736.235241:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.235251:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800986f6800/0xe64d3fbf12a7f7ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd01 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147736.235263:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x68141998, atime: 0x68141997, ctime: 0x68141998, blocks: 0x81b 00000100:00100000:0.0:1746147736.235268:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17307 00010000:00010000:3.0:1746147736.235273:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.235274:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.235278:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800986f6800/0xe64d3fbf12a7f7ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd01 expref: 16 pid: 8470 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147736.235278:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+13:1958:x1830967794281216:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147736.235286:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.235288:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800986f6800/0xe64d3fbf12a7f7ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd01 expref: 16 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.235294:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986f6800, rc 0) 00010000:00010000:0.0:1746147736.235296:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b10a000/0xe64d3fbf12a7f7b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd0f expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147736.235311:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x68141998, atime: 0x68141998, ctime: 0x68141998, blocks: 0x81f 00010000:00010000:0.0:1746147736.235320:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.235321:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.235326:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b10a000/0xe64d3fbf12a7f7b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd0f expref: 14 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147736.235341:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b10a000/0xe64d3fbf12a7f7b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd0f expref: 14 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147736.235348:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b10a000, rc 0) 00000100:00100000:2.0:1746147736.235384:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+16:1957:x1830967794281088:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 293us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.235388:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+16:1957:x1830967794280960:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 154us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.235390:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17305 00000100:00100000:3.0:1746147736.235394:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17306 00000100:00100000:2.0:1746147736.235404:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17308 00000100:00100000:3.0:1746147736.235409:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17309 00000100:00100000:2.0:1746147736.235410:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+14:1958:x1830967794281344:12345-192.168.202.10@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147736.235414:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+14:1958:x1830967794281472:12345-192.168.202.10@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147736.235416:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.235419:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.235423:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3e00/0xe64d3fbf12a7f7b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd16 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.235426:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800986f7400/0xe64d3fbf12a7f7c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd1d expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147736.235436:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x456:0x0] initial LVB size: 4194304, mtime: 0x68141999, atime: 0x68141999, ctime: 0x68141999, blocks: 0x1029 00002000:00010000:2.0:1746147736.235436:0:6715:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x458:0x0] initial LVB size: 5013696, mtime: 0x68141999, atime: 0x68141999, ctime: 0x68141998, blocks: 0x1691 00010000:00010000:3.0:1746147736.235442:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.235444:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.235445:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.235447:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800986f7400/0xe64d3fbf12a7f7c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd1d expref: 15 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.235447:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.235450:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3e00/0xe64d3fbf12a7f7b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd16 expref: 15 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.235455:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800986f7400/0xe64d3fbf12a7f7c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd1d expref: 15 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.235459:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3e00/0xe64d3fbf12a7f7b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd16 expref: 15 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.235466:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986f7400, rc 0) 00010000:00010000:2.0:1746147736.235466:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57b3e00, rc 0) 00000100:00100000:2.0:1746147736.235482:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+15:1958:x1830967794281344:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 73us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.235487:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41587371-240a-4781-aecb-638f17200fbd+15:1958:x1830967794281472:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 73us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.235487:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17308 00000100:00100000:3.0:1746147736.235491:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17309 00000100:00100000:0.0:1746147736.235576:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41587371-240a-4781-aecb-638f17200fbd+14:1958:x1830967794281216:12345-192.168.202.10@tcp:101:mirror_io.0 Request processed in 300us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.235582:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17307 00000100:00100000:1.0:1746147736.235797:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794280704 00000100:00100000:1.0:1746147736.235802:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794280704 00000100:00100000:1.0:1746147736.235825:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12158 00000100:00100000:1.0:1746147736.235830:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:32615:x1830967794280704:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147736.235841:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147736.235850:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f7c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafccf3 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.236878:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.236923:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.236936:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.236948:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.236974:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.237019:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.237037:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794281600 00000100:00100000:0.0:1746147736.237041:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794281600 00000100:00100000:0.0:1746147736.237062:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794281856 00000100:00100000:0.0:1746147736.237064:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794281856 00000100:00100000:0.0:1746147736.237074:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794281728 00000100:00100000:0.0:1746147736.237076:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794281728 00000100:00100000:0.0:1746147736.237085:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794282112 00000100:00100000:0.0:1746147736.237086:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794282112 00000100:00100000:0.0:1746147736.237094:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794281984 00000100:00100000:0.0:1746147736.237096:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794281984 00000100:00100000:0.0:1746147736.237103:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794282240 00000100:00100000:0.0:1746147736.237105:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794282240 00000100:00100000:0.0:1746147736.237116:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17310 00000100:00100000:0.0:1746147736.237121:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794281600:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147736.237131:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17311 00010000:00010000:0.0:1746147736.237135:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147736.237139:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794281856:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147736.237147:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147736.237147:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b10b400/0xe64d3fbf12a7f7ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd24 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.237155:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3800/0xe64d3fbf12a7f7d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd32 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.237163:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.237165:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.237166:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.237168:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.237171:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b10b400/0xe64d3fbf12a7f7ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd24 expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.237173:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3800/0xe64d3fbf12a7f7d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd32 expref: 26 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.237183:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3800/0xe64d3fbf12a7f7d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd32 expref: 26 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147736.237183:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b10b400/0xe64d3fbf12a7f7ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd24 expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.237189:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57b3800, rc 0) 00010000:00010000:0.0:1746147736.237190:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b10b400, rc 0) 00000100:00100000:0.0:1746147736.237217:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794281600:12345-192.168.202.10@tcp:101:cat.0 Request processed in 96us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.237222:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794281856:12345-192.168.202.10@tcp:101:cat.0 Request processed in 84us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.237222:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17310 00000100:00100000:2.0:1746147736.237231:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17311 00000100:00100000:0.0:1746147736.237244:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17312 00000100:00100000:2.0:1746147736.237247:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17313 00000100:00100000:0.0:1746147736.237249:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794281728:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147736.237252:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794282112:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147736.237254:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.237258:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147736.237260:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b10a800/0xe64d3fbf12a7f7dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd2b expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.237265:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3a00/0xe64d3fbf12a7f7e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd40 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.237270:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.237271:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.237275:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.237275:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b10a800/0xe64d3fbf12a7f7dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd2b expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.237277:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.237281:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3a00/0xe64d3fbf12a7f7e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd40 expref: 26 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147736.237284:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b10a800/0xe64d3fbf12a7f7dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd2b expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.237289:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3a00/0xe64d3fbf12a7f7e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd40 expref: 26 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147736.237291:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b10a800, rc 0) 00010000:00010000:2.0:1746147736.237296:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57b3a00, rc 0) 00000100:00100000:0.0:1746147736.237306:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794281728:12345-192.168.202.10@tcp:101:cat.0 Request processed in 57us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.237311:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17312 00000100:00100000:2.0:1746147736.237313:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794282112:12345-192.168.202.10@tcp:101:cat.0 Request processed in 60us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.237318:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17313 00000100:00100000:0.0:1746147736.237321:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17314 00000100:00100000:0.0:1746147736.237325:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794281984:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147736.237328:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17315 00010000:00010000:0.0:1746147736.237331:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147736.237333:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794282240:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147736.237336:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b10ac00/0xe64d3fbf12a7f7ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd39 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.237338:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.237345:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3600/0xe64d3fbf12a7f7f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd47 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.237346:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.237347:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.237351:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b10ac00/0xe64d3fbf12a7f7ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd39 expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.237356:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.237358:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.237359:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b10ac00/0xe64d3fbf12a7f7ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd39 expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.237362:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3600/0xe64d3fbf12a7f7f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd47 expref: 26 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147736.237366:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b10ac00, rc 0) 00010000:00010000:2.0:1746147736.237369:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3600/0xe64d3fbf12a7f7f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd47 expref: 26 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.237376:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57b3600, rc 0) 00000100:00100000:0.0:1746147736.237380:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794281984:12345-192.168.202.10@tcp:101:cat.0 Request processed in 54us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.237384:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17314 00000100:00100000:2.0:1746147736.237394:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794282240:12345-192.168.202.10@tcp:101:cat.0 Request processed in 61us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.237398:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17315 00010000:00010000:1.0:1746147736.237588:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f7f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.237600:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f7f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.237609:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f7f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.237643:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f7ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.237649:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f7ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.237659:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f7ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.237766:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.237776:0:14545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17600/0xe64d3fbf12a7f711 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccc9 expref: 8 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.237782:0:14545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.237811:0:14545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17600/0xe64d3fbf12a7f711 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccc9 expref: 8 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.237822:0:14545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17600/0xe64d3fbf12a7f711 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccc9 expref: 8 pid: 14545 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.237834:0:14545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14545:1830967796589184:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147736.237930:0:14545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147736.241369:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.241436:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794282368 00000100:00100000:3.0:1746147736.241447:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794282368 00000100:00100000:1.0:1746147736.241461:0:14545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14545:1830967796589184:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.241486:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17600/0xe64d3fbf12a7f711 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccc9 expref: 9 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.241489:0:14545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000100:00100000:3.0:1746147736.241514:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8846 00000100:00100000:3.0:1746147736.241522:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794282368:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147736.241534:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147736.241539:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17600/0xe64d3fbf12a7f711 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccc9 expref: 9 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.241549:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17600/0xe64d3fbf12a7f711 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccc9 expref: 9 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.241578:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb17600/0xe64d3fbf12a7f711 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccc9 expref: 9 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.241611:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147736.241624:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147736.241632:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147736.241638:0:7096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14545 initiator: MDT0 00010000:00010000:3.0:1746147736.241672:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147736.241724:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794282368:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 202us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.241730:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8846 00010000:00010000:1.0:1746147736.241878:0:14545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:1.0:1746147736.242023:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:1.0:1746147736.242040:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147736.242195:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242203:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242210:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242216:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02a0800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147736.242220:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242227:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242238:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147736.242240:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147736.242243:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242248:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0800/0xe64d3fbf12a7f806 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242266:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f7f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242270:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f7f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242274:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f7f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242278:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02a0000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147736.242280:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f7f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242283:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f7f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242292:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147736.242294:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147736.242296:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f7f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242299:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0000/0xe64d3fbf12a7f7f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242308:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f7ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242312:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f7ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242315:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f7ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242319:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02a1c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147736.242321:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f7ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242325:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f7ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242329:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fed9c00) 00010000:00010000:0.0:1746147736.242331:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147736.242332:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f7ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242336:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1c00/0xe64d3fbf12a7f7ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.242378:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f7c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccf3 expref: 324 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.242387:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f7c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccf3 expref: 324 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.242394:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0e00, rc 0) 00000100:00100000:0.0:1746147736.242429:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:32615:x1830967794280704:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 6598us (9147us total) trans 8589946192 rc 301/301 00000100:00100000:0.0:1746147736.242435:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12158 00000100:00100000:2.0:1746147736.245832:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.245867:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794282624 00000100:00100000:0.0:1746147736.245879:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794282624 00000100:00100000:0.0:1746147736.245956:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12159 00000100:00100000:0.0:1746147736.245965:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:32616:x1830967794282624:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147736.245989:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147736.246009:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b000/0xe64d3fbf12a7f814 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd4e expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.246117:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f81b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246129:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f81b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246140:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f81b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246152:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f822 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246157:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246163:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246264:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10ba00/0xe64d3fbf12a7f829 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246272:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10ba00/0xe64d3fbf12a7f829 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246277:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10ba00/0xe64d3fbf12a7f829 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:0.0:1746147736.246286:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147736.246359:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10ba00/0xe64d3fbf12a7f829 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246365:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10ba00/0xe64d3fbf12a7f829 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246371:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10ba00/0xe64d3fbf12a7f829 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246377:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b10ba00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147736.246380:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10ba00/0xe64d3fbf12a7f829 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246386:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10ba00/0xe64d3fbf12a7f829 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246397:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147736.246399:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147736.246403:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10ba00/0xe64d3fbf12a7f829 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246412:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10ba00/0xe64d3fbf12a7f829 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246424:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f81b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246428:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f81b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246432:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f81b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246436:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b10b600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147736.246438:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f81b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246442:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f81b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246448:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147736.246450:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147736.246452:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f81b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246456:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f81b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246463:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246468:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f822 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246472:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f822 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246476:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b10b800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147736.246478:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f822 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246482:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f822 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246487:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009320b700) 00010000:00010000:0.0:1746147736.246489:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147736.246490:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f822 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246494:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f822 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:0.0:1746147736.246526:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b000/0xe64d3fbf12a7f814 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd4e expref: 325 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.246533:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10b000/0xe64d3fbf12a7f814 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd4e expref: 325 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.246540:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b10b000, rc 0) 00000100:00100000:0.0:1746147736.246594:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32616:x1830967794282624:12345-192.168.202.10@tcp:101:cat.0 Request processed in 630us (770us total) trans 8589946193 rc 301/301 00000100:00100000:0.0:1746147736.246600:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12159 00000100:00100000:0.0:1746147736.252033:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.252197:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794282880 00000100:00100000:3.0:1746147736.252209:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794282880 00000100:00100000:3.0:1746147736.252271:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5082 00000100:00100000:3.0:1746147736.252279:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a9e4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32616:x1830967794282880:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:3.0:1746147736.253165:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a9e4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32616:x1830967794282880:12345-192.168.202.10@tcp:35:cat.0 Request processed in 885us (1141us total) trans 8589946194 rc 0/0 00000100:00100000:3.0:1746147736.253173:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5082 00000100:00100000:0.0:1746147736.265875:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.265944:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.265972:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.265985:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.266011:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.266028:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794283136 00000100:00100000:1.0:1746147736.266039:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794283136 00002000:00100000:1.0:1746147736.266089:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c265880 x1830967794283136/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.266098:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c265880 with x1830967794283136 ext(0->1048575) 00002000:00010000:1.0:1746147736.266104:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c265880 00000100:00100000:1.0:1746147736.266124:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794283392 00000100:00100000:1.0:1746147736.266127:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794283392 00002000:00100000:1.0:1746147736.266139:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009c265c00 x1830967794283392/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147736.266145:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794283648 00002000:00100000:1.0:1746147736.266146:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c265c00 with x1830967794283392 ext(1048576->2097151) 00002000:00010000:1.0:1746147736.266148:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c265c00 00000100:00100000:3.0:1746147736.266153:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794283648 00000100:00100000:1.0:1746147736.266160:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794283904 00000100:00100000:1.0:1746147736.266162:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794283904 00002000:00100000:1.0:1746147736.266171:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009c266300 x1830967794283904/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.266177:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c266300 with x1830967794283904 ext(1048576->2097151) 00002000:00010000:1.0:1746147736.266179:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c266300 00002000:00100000:3.0:1746147736.266187:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009c265f80 x1830967794283648/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147736.266191:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7794 00002000:00100000:3.0:1746147736.266197:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c265f80 with x1830967794283648 ext(1048576->2097151) 00000100:00100000:1.0:1746147736.266198:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794283136:12345-192.168.202.10@tcp:3:cat.0 00002000:00010000:3.0:1746147736.266201:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c265f80 00000100:00100000:3.0:1746147736.266220:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7795 00000100:00100000:3.0:1746147736.266227:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794283392:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147736.266271:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7796 00000100:00100000:2.0:1746147736.266278:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967794283904:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147736.267310:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7797 00000100:00100000:0.0:1746147736.267318:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967794283648:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147736.268806:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794284032 00000100:00100000:3.0:1746147736.268812:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794284032 00000100:00100000:3.0:1746147736.268842:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12160 00000100:00100000:3.0:1746147736.268847:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32616:x1830967794284032:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147736.268862:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.268877:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800986f7800/0xe64d3fbf12a7f837 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd55 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.268949:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800986f7a00/0xe64d3fbf12a7f83e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147736.268958:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800986f7a00/0xe64d3fbf12a7f83e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147736.268967:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800986f7a00/0xe64d3fbf12a7f83e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:3.0:1746147736.268987:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:3.0:1746147736.268990:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147736.269003:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800986f7a00/0xe64d3fbf12a7f83e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147736.269022:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800986f7800/0xe64d3fbf12a7f837 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd55 expref: 327 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.269042:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800986f7a00/0xe64d3fbf12a7f83e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd55 expref: 326 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.269049:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147736.269051:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147736.269054:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986f7a00, rc 0) 00000100:00100000:3.0:1746147736.274268:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32616:x1830967794284032:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5409us (8245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.274279:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12160 00000100:00100000:0.0:1746147736.302386:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.302463:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.303483:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967794283904:12345-192.168.202.10@tcp:3:cat.0 Request processed in 37201us (37491us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147736.303495:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7796 00002000:00100000:2.0:1746147736.303506:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009c266300 x1830967794283904/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.303513:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c266300 with x1830967794283904 ext(1048576->2097151) 00002000:00010000:2.0:1746147736.303519:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c266300 00000100:00100000:2.0:1746147736.303643:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794284416 00000100:00100000:2.0:1746147736.303650:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794284416 00000100:00100000:2.0:1746147736.303687:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794284160 00000100:00100000:2.0:1746147736.303689:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794284160 00000100:00100000:2.0:1746147736.303707:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12161 00000100:00100000:2.0:1746147736.303713:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32618:x1830967794284416:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147736.303730:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.303749:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79800/0xe64d3fbf12a7f845 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd63 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.303849:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79600/0xe64d3fbf12a7f84c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.303862:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79600/0xe64d3fbf12a7f84c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.303872:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79600/0xe64d3fbf12a7f84c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.303914:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79400/0xe64d3fbf12a7f853 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.303920:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79400/0xe64d3fbf12a7f853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.303926:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79400/0xe64d3fbf12a7f853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304024:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f85a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304033:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f85a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304039:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f85a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:2.0:1746147736.304047:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147736.304125:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f85a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304131:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f85a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304138:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f85a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304144:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0d79200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147736.304147:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f85a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304154:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f85a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304164:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147736.304167:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147736.304171:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f85a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304176:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f85a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304192:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79600/0xe64d3fbf12a7f84c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304198:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79600/0xe64d3fbf12a7f84c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304203:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79600/0xe64d3fbf12a7f84c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304207:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0d79600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147736.304209:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79600/0xe64d3fbf12a7f84c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304214:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79600/0xe64d3fbf12a7f84c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304220:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147736.304222:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147736.304224:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79600/0xe64d3fbf12a7f84c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304228:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79600/0xe64d3fbf12a7f84c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304235:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79400/0xe64d3fbf12a7f853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304239:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79400/0xe64d3fbf12a7f853 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304243:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79400/0xe64d3fbf12a7f853 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304247:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0d79400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147736.304249:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79400/0xe64d3fbf12a7f853 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304253:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79400/0xe64d3fbf12a7f853 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304258:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a00f3000) 00010000:00010000:2.0:1746147736.304260:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147736.304261:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79400/0xe64d3fbf12a7f853 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304265:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79400/0xe64d3fbf12a7f853 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147736.304294:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79800/0xe64d3fbf12a7f845 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd63 expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.304301:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79800/0xe64d3fbf12a7f845 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd63 expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.304307:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d79800, rc 0) 00000100:00100000:2.0:1746147736.304328:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32618:x1830967794284416:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 616us (1954us total) trans 8589946195 rc 301/301 00000100:00100000:2.0:1746147736.304334:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12161 00000100:00100000:2.0:1746147736.304345:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12162 00000100:00100000:2.0:1746147736.304350:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32615:x1830967794284160:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147736.304357:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.304363:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79c00/0xe64d3fbf12a7f868 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd5c expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.304381:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79c00/0xe64d3fbf12a7f868 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd5c expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.304390:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79c00/0xe64d3fbf12a7f868 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd5c expref: 327 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.304402:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147736.304403:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147736.304405:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d79c00, rc 0) 00000100:00100000:2.0:1746147736.304419:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32615:x1830967794284160:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 69us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.304425:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12162 00000100:00100000:1.0:1746147736.304952:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794283136:12345-192.168.202.10@tcp:3:cat.0 Request processed in 38753us (39082us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147736.304959:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7794 00002000:00100000:1.0:1746147736.304966:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c265880 x1830967794283136/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.304972:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c265880 with x1830967794283136 ext(0->1048575) 00002000:00010000:1.0:1746147736.304976:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c265880 00000100:00100000:3.0:1746147736.305293:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967794283392:12345-192.168.202.10@tcp:3:cat.0 Request processed in 39065us (39347us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147736.305300:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7795 00002000:00100000:3.0:1746147736.305306:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009c265c00 x1830967794283392/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.305313:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c265c00 with x1830967794283392 ext(1048576->2097151) 00002000:00010000:3.0:1746147736.305316:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c265c00 00000100:00100000:0.0:1746147736.316820:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794283648:12345-192.168.202.10@tcp:3:cat.0 Request processed in 49491us (50834us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147736.316832:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7797 00002000:00100000:0.0:1746147736.316844:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009c265f80 x1830967794283648/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147736.316852:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c265f80 with x1830967794283648 ext(1048576->2097151) 00002000:00010000:0.0:1746147736.316858:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c265f80 00000100:00100000:0.0:1746147736.324185:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.324225:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.324264:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.324594:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794284672 00000100:00100000:3.0:1746147736.324604:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794284672 00000100:00100000:3.0:1746147736.324667:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794284928 00000100:00100000:3.0:1746147736.324669:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794284928 00000100:00100000:3.0:1746147736.324685:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794285184 00000100:00100000:3.0:1746147736.324686:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794285184 00000100:00100000:3.0:1746147736.324703:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17316 00000100:00100000:3.0:1746147736.324711:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794284672:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147736.324766:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17317 00000100:00100000:1.0:1746147736.324773:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+39:1960:x1830967794284928:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147736.324786:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147736.324812:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f86f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd7f expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.324842:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.324844:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.324854:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f86f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd7f expref: 40 pid: 22183 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147736.324870:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17318 00010000:00010000:1.0:1746147736.324872:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f86f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd7f expref: 40 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.324911:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0c00, rc 0) 00000100:00100000:2.0:1746147736.324914:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794285184:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147736.324960:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+40:1960:x1830967794284928:12345-192.168.202.10@tcp:101:cat.0 Request processed in 187us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.324967:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17317 00010000:00010000:3.0:1746147736.325037:0:4592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.325050:0:4592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a734a000/0xe64d3fbf12a7f876 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd71 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.325062:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.325063:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.325068:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734a000/0xe64d3fbf12a7f876 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd71 expref: 27 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.325078:0:4592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a734a000/0xe64d3fbf12a7f876 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd71 expref: 27 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.325085:0:4592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a734a000, rc 0) 00000100:00100000:3.0:1746147736.325103:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794284672:12345-192.168.202.10@tcp:101:cat.0 Request processed in 393us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.325109:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17316 00010000:00010000:3.0:1746147736.325130:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.325137:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7f87d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd8d expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.325146:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.325147:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.325151:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7f87d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd8d expref: 27 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.325159:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7f87d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd8d expref: 27 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.325165:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a734ac00, rc 0) 00000100:00100000:3.0:1746147736.325179:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794285184:12345-192.168.202.10@tcp:101:cat.0 Request processed in 300us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.325184:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17318 00000100:00100000:2.0:1746147736.325387:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.325408:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.325434:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.325468:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.325554:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794285440 00000100:00100000:1.0:1746147736.325560:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794285440 00000100:00100000:1.0:1746147736.325590:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12163 00000100:00100000:1.0:1746147736.325595:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093623850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32615:x1830967794285440:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147736.325608:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147736.325611:0:14546:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00000100:00100000:0.0:1746147736.325646:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794284544 00010000:00010000:1.0:1746147736.325647:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800986f7a00/0xe64d3fbf12a7f83e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd55 expref: 327 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.325650:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794284544 00000100:00100000:0.0:1746147736.325669:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794284800 00000100:00100000:0.0:1746147736.325671:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794284800 00010000:00010000:1.0:1746147736.325673:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79c00/0xe64d3fbf12a7f868 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd5c expref: 326 pid: 5744 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.325681:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794285056 00010000:00010000:1.0:1746147736.325682:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00000100:00100000:0.0:1746147736.325683:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794285056 00010000:00010000:1.0:1746147736.325686:0:14546:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147736.325695:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f884 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd94 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.325696:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17319 00000100:00100000:0.0:1746147736.325701:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1960:x1830967794284544:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147736.325708:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147736.325716:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b10a600/0xe64d3fbf12a7f88b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd6a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.325729:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.325730:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.325734:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b10a600/0xe64d3fbf12a7f88b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd6a expref: 42 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.325737:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147736.325744:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b10a600/0xe64d3fbf12a7f88b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd6a expref: 42 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147736.325747:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f757 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccd7 expref: 7 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.325751:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b10a600, rc 0) 00010000:00010000:1.0:1746147736.325754:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10a400/0xe64d3fbf12a7f788 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcce5 expref: 7 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.325760:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f796 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccec expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.325766:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147736.325775:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967794284544:12345-192.168.202.10@tcp:101:cat.0 Request processed in 73us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.325779:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17319 00010000:00010000:1.0:1746147736.325789:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f796 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccec expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.325791:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17320 00000100:00100000:0.0:1746147736.325797:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794284800:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147736.325798:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f796 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccec expref: 10 pid: 14547 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746147736.325802:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147736.325808:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b10a200/0xe64d3fbf12a7f899 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd78 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147736.325809:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796589312:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147736.325818:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.325819:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.325829:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b10a200/0xe64d3fbf12a7f899 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd78 expref: 28 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147736.325839:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b10a200/0xe64d3fbf12a7f899 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd78 expref: 28 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147736.325850:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b10a200, rc 0) 00000100:00100000:0.0:1746147736.325865:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794284800:12345-192.168.202.10@tcp:101:cat.0 Request processed in 68us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.325870:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17320 00010000:00010000:1.0:1746147736.325877:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10a400/0xe64d3fbf12a7f788 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcce5 expref: 7 pid: 14545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.325881:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17321 00010000:00010000:1.0:1746147736.325904:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10a400/0xe64d3fbf12a7f788 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcce5 expref: 7 pid: 14545 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.325917:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796589440:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147736.325947:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f757 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccd7 expref: 7 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.325954:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f757 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccd7 expref: 7 pid: 14545 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.325961:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796589568:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147736.325977:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.325996:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+41:1960:x1830967794285056:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147736.326003:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147736.326009:0:8469:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b10bc00/0xe64d3fbf12a7f8a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd86 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.326018:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.326019:0:8469:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.326023:0:8469:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b10bc00/0xe64d3fbf12a7f8a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd86 expref: 42 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147736.326030:0:8469:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b10bc00/0xe64d3fbf12a7f8a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd86 expref: 42 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147736.326037:0:8469:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b10bc00, rc 0) 00000100:00100000:0.0:1746147736.326053:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967794285056:12345-192.168.202.10@tcp:101:cat.0 Request processed in 168us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.326058:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17321 00000100:00100000:2.0:1746147736.326356:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.326375:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794285696 00000100:00100000:2.0:1746147736.326378:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794285696 00000100:00100000:2.0:1746147736.326399:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12164 00000100:00100000:2.0:1746147736.326404:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32618:x1830967794285696:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147736.326421:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.326423:0:14547:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147736.326431:0:14547:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f796 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccec expref: 11 pid: 14547 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.326446:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147736.326450:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.326457:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.326461:0:14547:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147736.326478:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79600/0xe64d3fbf12a7f8a7 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcd9b expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.326517:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147736.326527:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.326532:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147736.326544:0:14547:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.326551:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746147736.327927:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.328059:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794285824 00000100:00100000:2.0:1746147736.328064:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794285824 00000100:00100000:2.0:1746147736.328102:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12165 00000100:00100000:2.0:1746147736.328108:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32611:x1830967794285824:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147736.328119:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.328130:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d78a00/0xe64d3fbf12a7f8b5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcda2 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.328168:0:14545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147736.328175:0:14545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d78a00/0xe64d3fbf12a7f8b5 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda2 expref: 14 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.328186:0:14545:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147736.328196:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d78a00/0xe64d3fbf12a7f8b5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda2 expref: 14 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.328207:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147736.328209:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147736.328212:0:14545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.328217:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d78a00, rc 0) 00000100:00100000:2.0:1746147736.328261:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32611:x1830967794285824:12345-192.168.202.10@tcp:101:cat.0 Request processed in 152us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.328267:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12165 00010000:00010000:2.0:1746147736.328370:0:14546:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.10@tcp) returned -22 from blocking AST (req@ffff8800954c0a80 x1830967796589312) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f796 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccec expref: 13 pid: 14547 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.328381:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0298800/0xe64d3fbf12a7f796 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccec expref: 13 pid: 14547 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.328408:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796589312:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147736.328760:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796589440:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147736.328769:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796589568:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147736.328793:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147736.328796:0:14546:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.328802:0:14546:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.328809:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147736.329350:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.329384:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.329421:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.329479:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794286080 00000100:00100000:2.0:1746147736.329483:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794286080 00010000:00010000:2.0:1746147736.329503:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f757 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccd7 expref: 8 pid: 14545 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.329520:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794285952 00000100:00100000:2.0:1746147736.329523:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794285952 00010000:00010000:2.0:1746147736.329530:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10a400/0xe64d3fbf12a7f788 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcce5 expref: 9 pid: 14545 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.329554:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8847 00000100:00100000:2.0:1746147736.329560:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794286080:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.329570:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.329575:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f757 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccd7 expref: 9 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.329587:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f757 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccd7 expref: 9 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.329602:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0249e00/0xe64d3fbf12a7f757 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccd7 expref: 9 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.329610:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147736.329627:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.329636:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.329640:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.329663:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794286080:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 103us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.329669:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8847 00000100:00100000:2.0:1746147736.329679:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8848 00000100:00100000:2.0:1746147736.329683:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794285952:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.329690:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.329693:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10a400/0xe64d3fbf12a7f788 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcce5 expref: 7 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.329700:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10a400/0xe64d3fbf12a7f788 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcce5 expref: 7 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.329709:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b10a400/0xe64d3fbf12a7f788 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcce5 expref: 7 pid: 14545 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.329718:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147736.329721:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.329727:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.329733:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.329742:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147736.329746:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147736.329757:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.329771:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+6:1960:x1830967794285952:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 88us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.329781:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8848 00000100:00100000:2.0:1746147736.329821:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794286208 00000100:00100000:2.0:1746147736.329824:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794286208 00010000:00010000:3.0:1746147736.329828:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00000100:00100000:2.0:1746147736.329840:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12166 00010000:00010000:3.0:1746147736.329841:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00000100:00100000:2.0:1746147736.329844:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32616:x1830967794286208:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147736.329854:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.329862:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79c00/0xe64d3fbf12a7f8bc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcda9 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.329912:0:14545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79c00/0xe64d3fbf12a7f8bc lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda9 expref: 328 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.329921:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79c00/0xe64d3fbf12a7f8bc lrc: 3/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda9 expref: 328 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.329928:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147736.329930:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147736.329932:0:14545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147736.329940:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d79c00, rc 0) 00000100:00100000:2.0:1746147736.329956:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32616:x1830967794286208:12345-192.168.202.10@tcp:101:cat.0 Request processed in 112us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.329961:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12166 00000040:00080000:3.0:1746147736.330414:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3758, 88 off315080 00000004:00080000:3.0:1746147736.330420:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815504534946ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147736.330473:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3757, 88 off314640 00000004:00080000:3.0:1746147736.330476:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815504591479ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147736.330495:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3758, 88 off314728 00000004:00080000:3.0:1746147736.330499:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815504614127ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147736.330645:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3759, 88 off315168 00000004:00080000:3.0:1746147736.330650:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815504765709ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147736.330669:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3760, 88 off315256 00000004:00080000:3.0:1746147736.330671:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815504787090ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147736.330680:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3759, 88 off314816 00000004:00080000:3.0:1746147736.330682:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815504797957ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147736.330699:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3760, 88 off314904 00000004:00080000:3.0:1746147736.330702:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815504817446ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147736.330708:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3761, 88 off314992 00000004:00080000:3.0:1746147736.330710:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815504825572ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147736.330716:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3761, 88 off315344 00000004:00080000:3.0:1746147736.330718:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815504833664ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147736.330724:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3762, 88 off315080 00000004:00080000:3.0:1746147736.330726:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815504841696ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147736.330734:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3762, 88 off315432 00000004:00080000:3.0:1746147736.330736:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815504851837ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147736.330741:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3763, 88 off315168 00000004:00080000:3.0:1746147736.330745:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815504860319ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147736.330753:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3763, 88 off315520 00000004:00080000:3.0:1746147736.330755:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815504870799ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147736.330761:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3764, 88 off315608 00000004:00080000:3.0:1746147736.330763:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815504878450ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147736.330768:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3765, 88 off315696 00000004:00080000:3.0:1746147736.330770:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815504885619ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147736.330775:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3766, 88 off315784 00000004:00080000:3.0:1746147736.330777:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815504892842ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147736.330783:0:14546:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3764, 88 off315256 00000004:00080000:3.0:1746147736.330785:0:14546:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815504900547ns, next at 756024029964ns, rc = 0 00000001:00080000:1.0:1746147736.349702:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946193 is committed 00000001:00080000:1.0:1746147736.349717:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946190 is committed 00000001:00080000:1.0:1746147736.349722:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946195 is committed 00000001:00080000:1.0:1746147736.349728:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946196 is committed 00000004:00080000:1.0:1746147736.349732:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2831 committed 00000004:00080000:1.0:1746147736.349739:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2833 committed 00000004:00080000:1.0:1746147736.349753:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2832 committed 00000004:00080000:1.0:1746147736.349755:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2831 committed 00000004:00080000:1.0:1746147736.349756:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2830 committed 00000004:00080000:1.0:1746147736.349758:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2830 committed 00000004:00080000:1.0:1746147736.349761:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2829 committed 00000004:00080000:1.0:1746147736.349762:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2829 committed 00000004:00080000:1.0:1746147736.349764:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2828 committed 00000004:00080000:1.0:1746147736.349765:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2828 committed 00000004:00080000:1.0:1746147736.349767:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2827 committed 00000004:00080000:1.0:1746147736.349768:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2826 committed 00000004:00080000:1.0:1746147736.349770:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2827 committed 00000004:00080000:1.0:1746147736.349772:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2826 committed 00000004:00080000:1.0:1746147736.349777:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2825 committed 00000004:00080000:1.0:1746147736.349779:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2824 committed 00000004:00080000:1.0:1746147736.349781:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2825 committed 00010000:00010000:3.0:1746147736.349936:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd94 expref: 325 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.349948:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147736.349951:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147736.349954:0:14546:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147736.349963:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd94 expref: 325 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.349968:0:14546:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746147736.349989:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd94 expref: 325 pid: 14546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.350048:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796589824:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147736.350061:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd94 expref: 325 pid: 14546 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.350071:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796590080:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147736.350267:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147736.350284:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.350294:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796590464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.350312:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.350323:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796590976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.350335:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.350344:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796591488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.350351:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796589952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.350358:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147736.350369:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.350374:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796590208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.350381:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796590592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.350389:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.350399:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796590720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.350400:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796589824 00000100:00100000:3.0:1746147736.350407:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796589824 00000100:00100000:0.0:1746147736.350417:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.350428:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796591232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.350437:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796590464 00000100:00100000:3.0:1746147736.350439:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796590464 00000100:00100000:0.0:1746147736.350442:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147736.350450:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796590976 00000100:00100000:0.0:1746147736.350451:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796591744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.350452:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796590976 00000100:00100000:3.0:1746147736.350461:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796591488 00000100:00100000:3.0:1746147736.350463:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796591488 00000100:00100000:0.0:1746147736.350463:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.350474:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746147736.350475:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17322 00000100:00100000:0.0:1746147736.350477:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796589696:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.350481:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+88:3301:x1830967796589824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.350489:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.350494:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796590336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.350504:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.350510:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009172d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796590848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.350520:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.350526:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796591360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.350536:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.350554:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796589952 00000100:00100000:0.0:1746147736.350556:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796589952 00000100:00100000:0.0:1746147736.350568:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796590208 00000100:00100000:0.0:1746147736.350570:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796590208 00000100:00100000:0.0:1746147736.350575:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796590720 00000100:00100000:0.0:1746147736.350577:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796590720 00000100:00100000:0.0:1746147736.350582:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796591232 00000100:00100000:0.0:1746147736.350584:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796591232 00000100:00100000:0.0:1746147736.350589:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796591744 00000100:00100000:0.0:1746147736.350590:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796591744 00000100:00100000:0.0:1746147736.350595:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796589696 00000100:00100000:0.0:1746147736.350596:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796589696 00000100:00100000:0.0:1746147736.350602:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796590336 00000100:00100000:0.0:1746147736.350603:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796590336 00000100:00100000:0.0:1746147736.350608:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796590848 00000100:00100000:0.0:1746147736.350610:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796590848 00000100:00100000:0.0:1746147736.350633:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796591360 00000100:00100000:0.0:1746147736.350634:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796591360 00000100:00100000:0.0:1746147736.350641:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17323 00000100:00100000:0.0:1746147736.350646:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+93:3301:x1830967796590464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147736.350664:0:4592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147736.350667:0:4592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147736 -> 1746147736 00002000:00010000:3.0:1746147736.350669:0:4592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:3.0:1746147736.350671:0:4592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:3.0:1746147736.350673:0:4592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 2045 -> 2045 00000100:00100000:3.0:1746147736.350702:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+94:3301:x1830967796589824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 221us (435us total) trans 17179874511 rc 0/0 00000100:00100000:3.0:1746147736.350708:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17322 00000100:00100000:3.0:1746147736.350723:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17324 00000100:00100000:0.0:1746147736.350726:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+93:3301:x1830967796590464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (413us total) trans 17179874512 rc 0/0 00000100:00100000:3.0:1746147736.350727:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+93:3301:x1830967796590976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.350731:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17323 00000100:00100000:0.0:1746147736.350739:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17325 00000100:00100000:0.0:1746147736.350743:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+82:3301:x1830967796591488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.350797:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+93:3301:x1830967796590976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (462us total) trans 17179874513 rc 0/0 00000100:00100000:3.0:1746147736.350802:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17324 00000100:00100000:3.0:1746147736.350810:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17326 00000100:00100000:3.0:1746147736.350813:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+92:3302:x1830967796589952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.350832:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+83:3301:x1830967796591488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (472us total) trans 21474841737 rc 0/0 00000100:00100000:0.0:1746147736.350836:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17325 00000100:00100000:0.0:1746147736.350847:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17327 00000100:00100000:0.0:1746147736.350850:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+92:3303:x1830967796590208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147736.350876:0:4592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147736.350879:0:4592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147736 -> 1746147736 00002000:00010000:3.0:1746147736.350881:0:4592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147736 -> 1746147736 00002000:00010000:3.0:1746147736.350902:0:4592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:3.0:1746147736.350904:0:4592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746147736.350922:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+94:3302:x1830967796589952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (552us total) trans 17179874514 rc 0/0 00000100:00100000:3.0:1746147736.350927:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17326 00002000:00010000:0.0:1746147736.350937:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00000100:00100000:3.0:1746147736.350938:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17328 00002000:00010000:0.0:1746147736.350940:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147737 -> 1746147737 00002000:00010000:0.0:1746147736.350941:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147737 -> 1746147737 00000100:00100000:3.0:1746147736.350942:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+82:3303:x1830967796590720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147736.350943:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:0.0:1746147736.350945:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:0.0:1746147736.350962:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+93:3303:x1830967796590208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (573us total) trans 17179874515 rc 0/0 00000100:00100000:0.0:1746147736.350968:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17327 00000100:00100000:0.0:1746147736.350976:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17329 00000100:00100000:0.0:1746147736.350979:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+82:3303:x1830967796591232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.351015:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17330 00000100:00100000:0.0:1746147736.351025:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+83:3303:x1830967796591744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147736.351060:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17331 00000100:00100000:2.0:1746147736.351066:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+83:3303:x1830967796589696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147736.351214:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17332 00000100:00100000:1.0:1746147736.351219:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+92:3303:x1830967796590336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147736.351309:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+93:3303:x1830967796590336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (803us total) trans 17179874516 rc 0/0 00000100:00100000:1.0:1746147736.351314:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17332 00000100:00100000:1.0:1746147736.351329:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17333 00000100:00100000:1.0:1746147736.351332:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+92:3303:x1830967796590848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147736.351407:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+93:3303:x1830967796590848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (884us total) trans 17179874517 rc 0/0 00000100:00100000:1.0:1746147736.351412:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17333 00000100:00100000:1.0:1746147736.351421:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17334 00000100:00100000:1.0:1746147736.351426:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+83:3303:x1830967796591360:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147736.352095:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172f100/2, rc 0, transno 17179874516 00000100:00100000:0.0:1746147736.352105:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796590336:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147736.352112:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172d500/2, rc 0, transno 17179874517 00000100:00100000:0.0:1746147736.352115:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796590848:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147736.352122:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172fb80/2, rc 0, transno 17179874515 00000100:00100000:0.0:1746147736.352125:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796590208:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147736.352139:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172ea00/2, rc 0, transno 17179874512 00000100:00100000:0.0:1746147736.352142:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796590464:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147736.352148:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e34700/2, rc 0, transno 17179874513 00000100:00100000:0.0:1746147736.352151:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796590976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147736.352160:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c3b80/2, rc 0, transno 21474841737 00000100:00100000:0.0:1746147736.352162:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796591488:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147736.352168:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172c700/2, rc 0, transno 17179874511 00000100:00100000:0.0:1746147736.352171:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796589824:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147736.352195:0:7050:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147736.352198:0:7050:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147736 -> 1746147736 00002000:00010000:2.0:1746147736.352200:0:7050:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:2.0:1746147736.352202:0:7050:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:2.0:1746147736.352203:0:7050:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2075 -> 2075 00000100:00100000:2.0:1746147736.352228:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+84:3303:x1830967796589696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1162us (1737us total) trans 21474841739 rc 0/0 00000100:00100000:2.0:1746147736.352232:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17331 00000004:00080000:0.0:1746147736.352236:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c0700/2, rc 0, transno 21474841739 00000100:00100000:0.0:1746147736.352238:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796589696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.352350:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796591872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.352373:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746147736.352477:0:4592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147736.352479:0:4592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147736 -> 1746147736 00002000:00010000:3.0:1746147736.352481:0:4592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:3.0:1746147736.352483:0:4592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:3.0:1746147736.352484:0:4592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147736.352507:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+83:3303:x1830967796590720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1564us (2089us total) trans 21474841738 rc 0/0 00000100:00100000:3.0:1746147736.352512:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17328 00000100:00100000:3.0:1746147736.352523:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796591872 00000100:00100000:3.0:1746147736.352526:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796591872 00000100:00100000:3.0:1746147736.352544:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17335 00000100:00100000:3.0:1746147736.352548:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+93:3304:x1830967796591872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.352655:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+94:3304:x1830967796591872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (281us total) trans 17179874518 rc 0/0 00000100:00100000:3.0:1746147736.352660:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17335 00000100:00100000:3.0:1746147736.352697:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147736.352713:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796591104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.352731:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147736.352742:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796591616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.352758:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147736.352777:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172d880/2, rc 0, transno 17179874514 00000100:00100000:3.0:1746147736.352780:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796589952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.352792:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796590592 00000100:00100000:3.0:1746147736.352795:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796590592 00000100:00100000:3.0:1746147736.352807:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796591104 00000100:00100000:3.0:1746147736.352809:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796591104 00000100:00100000:3.0:1746147736.352817:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796591616 00000100:00100000:3.0:1746147736.352818:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796591616 00000100:00100000:3.0:1746147736.352826:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17336 00000100:00100000:3.0:1746147736.352830:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+94:3302:x1830967796590592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.352927:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+95:3302:x1830967796590592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (229us total) trans 17179874519 rc 0/0 00000100:00100000:3.0:1746147736.352931:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17336 00000100:00100000:3.0:1746147736.352939:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17337 00000100:00100000:3.0:1746147736.352944:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+84:3302:x1830967796591104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.353008:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17338 00000100:00100000:0.0:1746147736.353014:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+85:3302:x1830967796591616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147736.353016:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147736.353018:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147737 -> 1746147737 00002000:00010000:3.0:1746147736.353020:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147737 -> 1746147737 00002000:00010000:3.0:1746147736.353021:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147737 -> 1746147737 00002000:00010000:3.0:1746147736.353023:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746147736.353038:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3302:x1830967796591104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (306us total) trans 21474841740 rc 0/0 00000100:00100000:3.0:1746147736.353043:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17337 00000004:00080000:0.0:1746147736.353061:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e35180/2, rc 0, transno 17179874518 00000004:00080000:3.0:1746147736.353062:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009172e680/2, rc 0, transno 17179874519 00000100:00100000:3.0:1746147736.353065:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009172e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796590592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.353065:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796591872:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147736.353074:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c3800/2, rc 0, transno 21474841740 00000100:00100000:3.0:1746147736.353076:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796591104:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147736.353076:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c3480/2, rc 0, transno 21474841738 00000100:00100000:0.0:1746147736.353079:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796590720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.353094:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796590080:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.353258:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a1e00/0xe64d3fbf12a7f884 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd94 expref: 325 pid: 14546 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746147736.353277:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd94 expref: 324 pid: 14546 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.353286:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd94 expref: 324 pid: 14546 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.353310:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a0e00, rc 0) 00000100:00100000:1.0:1746147736.353421:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+86:3303:x1830967796591232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2440us (2977us total) trans 21474841741 rc 0/0 00000100:00100000:1.0:1746147736.353427:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17329 00000004:00080000:1.0:1746147736.353445:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c1180/2, rc 0, transno 21474841741 00000100:00100000:1.0:1746147736.353448:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796591232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.353487:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+85:3303:x1830967796591744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2467us (3022us total) trans 21474841742 rc 0/0 00000100:00100000:0.0:1746147736.353492:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17330 00000100:00100000:0.0:1746147736.353542:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+85:3302:x1830967796591616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 529us (783us total) trans 21474841743 rc 0/0 00000100:00100000:0.0:1746147736.353547:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17338 00002000:00010000:0.0:1746147736.353593:0:4591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:0.0:1746147736.353595:0:4591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147736.353597:0:4591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147736.353599:0:4591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:0.0:1746147736.353601:0:4591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000100:00100000:0.0:1746147736.353628:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+85:3303:x1830967796591360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2202us (3090us total) trans 21474841744 rc 0/0 00000100:00100000:0.0:1746147736.353633:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17334 00000004:00080000:1.0:1746147736.353676:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c0a80/2, rc 0, transno 21474841744 00000100:00100000:1.0:1746147736.353679:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796591360:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147736.353684:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093054000/2, rc 0, transno 21474841742 00000100:00100000:1.0:1746147736.353686:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796591744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.353755:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093623850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32615:x1830967794285440:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 28156us (28283us total) trans 8589946196 rc 0/0 00000100:00100000:3.0:1746147736.353761:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12163 00000004:00080000:0.0:1746147736.354032:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954c2d80/2, rc 0, transno 21474841743 00000100:00100000:0.0:1746147736.354037:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796591616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.356320:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.356372:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794286336 00000100:00100000:2.0:1746147736.356380:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794286336 00010000:00010000:2.0:1746147736.356412:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd94 expref: 324 pid: 14546 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.356446:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8849 00000100:00100000:2.0:1746147736.356452:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:1958:x1830967794286336:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.356466:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.356471:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd94 expref: 324 pid: 14546 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.356487:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd94 expref: 324 pid: 14546 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.356509:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02a0e00/0xe64d3fbf12a7f892 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd94 expref: 324 pid: 14546 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.356523:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147736.356527:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147736.356537:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147736.356544:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147736.356551:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d78a00/0xe64d3fbf12a7f8b5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda2 expref: 9 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.356741:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.356794:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:1958:x1830967794286336:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 341us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.356800:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8849 00010000:00010000:0.0:1746147736.356804:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147736.356810:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00000040:00080000:0.0:1746147736.357572:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3767, 88 off315872 00000004:00080000:0.0:1746147736.357580:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815531694466ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.357841:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3765, 88 off315344 00000004:00080000:0.0:1746147736.357845:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815531960180ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147736.357867:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3766, 88 off315432 00000004:00080000:0.0:1746147736.357869:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815531985010ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147736.357877:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3768, 88 off315960 00000004:00080000:0.0:1746147736.357880:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815531995624ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.357905:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3769, 88 off316048 00000004:00080000:0.0:1746147736.357908:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815532023970ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.357915:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3767, 88 off315520 00000004:00080000:0.0:1746147736.357918:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815532033155ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147736.357924:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3768, 88 off315608 00000004:00080000:0.0:1746147736.357926:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815532041499ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147736.357934:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3769, 88 off315696 00000004:00080000:0.0:1746147736.357937:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815532052370ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147736.357943:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3770, 88 off316136 00000004:00080000:0.0:1746147736.357945:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815532060625ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.357979:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3770, 88 off315784 00000004:00080000:0.0:1746147736.357982:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815532097176ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147736.358159:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3771, 88 off316224 00000004:00080000:0.0:1746147736.358163:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815532278398ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.358341:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3771, 88 off315872 00000004:00080000:0.0:1746147736.358345:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815532460340ns, next at 756024029964ns, rc = 0 00000040:00080000:0.0:1746147736.358391:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3772, 88 off316312 00000004:00080000:0.0:1746147736.358394:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815532509920ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.358401:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3773, 88 off316400 00000004:00080000:0.0:1746147736.358403:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815532518511ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.358409:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3774, 88 off316488 00000004:00080000:0.0:1746147736.358411:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815532527026ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.358417:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3775, 88 off316576 00000004:00080000:0.0:1746147736.358420:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815532535261ns, next at 756039729591ns, rc = 0 00000040:00080000:0.0:1746147736.358427:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3772, 88 off315960 00000004:00080000:0.0:1746147736.358429:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815532544899ns, next at 756024029964ns, rc = 0 00000001:00080000:1.0:1746147736.373132:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946197 is committed 00010000:00010000:0.0:1746147736.373136:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd9b expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746147736.373140:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2839 committed 00010000:00010000:0.0:1746147736.373160:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147736.373163:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746147736.373166:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d78a00/0xe64d3fbf12a7f8b5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda2 expref: 10 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.373181:0:14547:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d78a00/0xe64d3fbf12a7f8b5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda2 expref: 10 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.373187:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d78a00/0xe64d3fbf12a7f8b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda2 expref: 10 pid: 14545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746147736.373235:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2842 committed 00010000:00010000:0.0:1746147736.373235:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79c00/0xe64d3fbf12a7f8bc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda9 expref: 322 pid: 14545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746147736.373241:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2841 committed 00000004:00080000:1.0:1746147736.373242:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2840 committed 00010000:00010000:0.0:1746147736.373243:0:14547:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79c00/0xe64d3fbf12a7f8bc lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda9 expref: 322 pid: 14545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746147736.373244:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2839 committed 00000004:00080000:1.0:1746147736.373245:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2838 committed 00000004:00080000:1.0:1746147736.373247:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2838 committed 00000004:00080000:1.0:1746147736.373248:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2837 committed 00010000:00010000:0.0:1746147736.373249:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79c00/0xe64d3fbf12a7f8bc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda9 expref: 322 pid: 14545 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746147736.373250:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2837 committed 00000004:00080000:1.0:1746147736.373251:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2836 committed 00000004:00080000:1.0:1746147736.373253:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2835 committed 00000004:00080000:1.0:1746147736.373254:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2834 committed 00000004:00080000:1.0:1746147736.373255:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2836 committed 00000004:00080000:1.0:1746147736.373256:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2835 committed 00000004:00080000:1.0:1746147736.373257:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2833 committed 00000004:00080000:1.0:1746147736.373260:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2832 committed 00000004:00080000:1.0:1746147736.373261:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2834 committed 00010000:00010000:0.0:1746147736.373285:0:14547:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79c00/0xe64d3fbf12a7f8bc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda9 expref: 322 pid: 14545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.373297:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fce5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796592000:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147736.373378:0:14547:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d78a00/0xe64d3fbf12a7f8b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda2 expref: 10 pid: 14545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.373385:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fce6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796592768:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147736.373395:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796592256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.373400:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4cf6000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.373413:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796592128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.373439:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796592512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147736.373689:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.373716:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147736.373720:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796592896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.373729:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796593152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147736.373737:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.373751:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796592256 00000100:00100000:1.0:1746147736.373756:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796593408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.373757:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796592256 00000100:00100000:1.0:1746147736.373771:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147736.373780:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796593920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.373788:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796592512 00000100:00100000:0.0:1746147736.373790:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796592512 00000100:00100000:1.0:1746147736.373793:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.373801:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796592896 00000100:00100000:1.0:1746147736.373802:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746147736.373802:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796592896 00000100:00100000:1.0:1746147736.373806:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796593280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.373811:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796593408 00000100:00100000:0.0:1746147736.373813:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796593408 00000100:00100000:1.0:1746147736.373819:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.373826:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17339 00000100:00100000:1.0:1746147736.373828:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796593792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.373833:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+87:3302:x1830967796592256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147736.373840:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147736.373857:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796592384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147736.373871:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147736.373880:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796593024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147736.373912:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147736.373922:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796593536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147736.373934:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147736.373940:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796594048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147736.373953:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147736.373959:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746147736.373962:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796593664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147736.373975:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147736.373980:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796594176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147736.373993:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147736.374009:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796593920 00000100:00100000:1.0:1746147736.374011:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796593920 00000100:00100000:1.0:1746147736.374024:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796593280 00000100:00100000:1.0:1746147736.374026:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796593280 00002000:00010000:0.0:1746147736.374030:0:4591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147736.374032:0:4591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147736 -> 1746147736 00002000:00010000:0.0:1746147736.374034:0:4591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:0.0:1746147736.374036:0:4591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:0.0:1746147736.374037:0:4591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147736.374042:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796593792 00000100:00100000:1.0:1746147736.374044:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796593792 00000100:00100000:1.0:1746147736.374049:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796592384 00000100:00100000:1.0:1746147736.374051:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796592384 00000100:00100000:1.0:1746147736.374056:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796593024 00000100:00100000:1.0:1746147736.374057:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796593024 00000100:00100000:0.0:1746147736.374062:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+90:3302:x1830967796592256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (630us total) trans 21474841745 rc 0/0 00000100:00100000:1.0:1746147736.374063:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796593536 00000100:00100000:1.0:1746147736.374064:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796593536 00000100:00100000:0.0:1746147736.374068:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17339 00000100:00100000:1.0:1746147736.374072:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796594048 00000100:00100000:1.0:1746147736.374073:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796594048 00000100:00100000:1.0:1746147736.374079:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796593664 00000100:00100000:1.0:1746147736.374080:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796593664 00000100:00100000:0.0:1746147736.374084:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796594176 00000100:00100000:0.0:1746147736.374086:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796594176 00000100:00100000:1.0:1746147736.374088:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17340 00000100:00100000:1.0:1746147736.374092:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+89:3304:x1830967796592512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.374093:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17341 00000100:00100000:0.0:1746147736.374096:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+89:3302:x1830967796592896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147736.374118:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17342 00000100:00100000:1.0:1746147736.374122:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+102:3302:x1830967796593408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.374170:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+90:3302:x1830967796592896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (432us total) trans 21474841746 rc 0/0 00000100:00100000:0.0:1746147736.374175:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17341 00000100:00100000:0.0:1746147736.374184:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17343 00000100:00100000:0.0:1746147736.374187:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+102:3302:x1830967796593920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147736.374219:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147736.374222:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147736 -> 1746147736 00002000:00010000:1.0:1746147736.374223:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147736 -> 1746147736 00002000:00010000:1.0:1746147736.374225:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:1.0:1746147736.374227:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746147736.374245:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+104:3302:x1830967796593408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 123us (473us total) trans 17179874520 rc 0/0 00000100:00100000:0.0:1746147736.374247:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+104:3302:x1830967796593920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (454us total) trans 17179874521 rc 0/0 00000100:00100000:1.0:1746147736.374250:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17342 00000100:00100000:0.0:1746147736.374253:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17343 00000100:00100000:1.0:1746147736.374259:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17344 00000100:00100000:0.0:1746147736.374261:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17345 00000100:00100000:1.0:1746147736.374263:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+102:3302:x1830967796593280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.374265:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+102:3302:x1830967796593792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147736.374294:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17346 00000100:00100000:1.0:1746147736.374299:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+89:3303:x1830967796592384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.374335:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+103:3302:x1830967796593792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (493us total) trans 17179874522 rc 0/0 00000100:00100000:0.0:1746147736.374341:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17345 00000100:00100000:0.0:1746147736.374348:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17347 00000100:00100000:0.0:1746147736.374352:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+89:3303:x1830967796593024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147736.374367:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147736.374369:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147737 -> 1746147737 00002000:00010000:1.0:1746147736.374371:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147737 -> 1746147737 00002000:00010000:1.0:1746147736.374373:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147737 -> 1746147737 00002000:00010000:1.0:1746147736.374375:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746147736.374394:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+90:3303:x1830967796592384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (521us total) trans 21474841747 rc 0/0 00000100:00100000:1.0:1746147736.374399:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17346 00000100:00100000:1.0:1746147736.374407:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17348 00000100:00100000:1.0:1746147736.374411:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+102:3303:x1830967796593536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.374417:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+90:3303:x1830967796593024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (504us total) trans 21474841748 rc 0/0 00000100:00100000:0.0:1746147736.374421:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17347 00000100:00100000:0.0:1746147736.374428:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17349 00000100:00100000:0.0:1746147736.374432:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+102:3303:x1830967796594048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147736.374475:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:1.0:1746147736.374477:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147737 -> 1746147737 00002000:00010000:1.0:1746147736.374479:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147737 -> 1746147737 00002000:00010000:1.0:1746147736.374481:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:1.0:1746147736.374483:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5777 -> 5777 00000100:00100000:1.0:1746147736.374497:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+104:3303:x1830967796593536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (562us total) trans 17179874523 rc 0/0 00000100:00100000:0.0:1746147736.374497:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+104:3303:x1830967796594048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (543us total) trans 17179874524 rc 0/0 00000100:00100000:1.0:1746147736.374502:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17348 00000100:00100000:0.0:1746147736.374504:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17349 00000100:00100000:1.0:1746147736.374510:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17350 00000100:00100000:0.0:1746147736.374512:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17351 00000100:00100000:1.0:1746147736.374514:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+102:3303:x1830967796593664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.374516:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+102:3303:x1830967796594176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147736.375768:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+103:3303:x1830967796594176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1247us (1769us total) trans 17179874525 rc 0/0 00000100:00100000:2.0:1746147736.375775:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17351 00000100:00100000:3.0:1746147736.375913:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+103:3303:x1830967796593664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1397us (1935us total) trans 17179874526 rc 0/0 00000100:00100000:3.0:1746147736.375919:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17350 00000100:00100000:1.0:1746147736.376452:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+90:3304:x1830967796592512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2357us (2733us total) trans 21474841749 rc 0/0 00000100:00100000:1.0:1746147736.376458:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17340 00000004:00080000:1.0:1746147736.376501:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e36a00/2, rc 0, transno 17179874526 00000100:00100000:1.0:1746147736.376520:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796593664:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147736.376531:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0435c00/2, rc 0, transno 17179874525 00000100:00100000:1.0:1746147736.376534:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796594176:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147736.376545:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093054a80/2, rc 0, transno 21474841747 00000100:00100000:1.0:1746147736.376549:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796592384:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147736.376557:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093055880/2, rc 0, transno 21474841748 00000100:00100000:1.0:1746147736.376560:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796593024:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147736.376566:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e34000/2, rc 0, transno 17179874523 00000100:00100000:1.0:1746147736.376568:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796593536:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147736.376574:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0435880/2, rc 0, transno 17179874524 00000100:00100000:1.0:1746147736.376576:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796594048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.376824:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.376848:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796592640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.376874:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147736.376903:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796594304:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147736.377011:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147736.377014:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147736 -> 1746147736 00002000:00010000:1.0:1746147736.377016:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:1.0:1746147736.377018:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:1.0:1746147736.377020:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 2045 -> 2045 00000100:00100000:1.0:1746147736.377042:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+103:3302:x1830967796593280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2778us (3221us total) trans 17179874527 rc 0/0 00000100:00100000:1.0:1746147736.377047:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17344 00000100:00100000:1.0:1746147736.377059:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796592128 00000100:00100000:1.0:1746147736.377064:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796592128 00000100:00100000:1.0:1746147736.377098:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796592640 00000100:00100000:1.0:1746147736.377100:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796592640 00000100:00100000:1.0:1746147736.377112:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17352 00000100:00100000:1.0:1746147736.377117:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+91:3301:x1830967796592128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147736.377124:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17353 00000100:00100000:3.0:1746147736.377130:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+91:3301:x1830967796592640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147736.377231:0:9615:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb size from disk: 1609728 -> 1609728 00002000:00010000:3.0:1746147736.377234:0:9615:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb mtime from disk: 1746147683 -> 1746147683 00002000:00010000:3.0:1746147736.377236:0:9615:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147736.377237:0:9615:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb ctime from disk: 1746147683 -> 1746147683 00002000:00010000:3.0:1746147736.377240:0:9615:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x457:0x0] updating lvb blocks from disk: 1123 -> 1123 00000004:00080000:1.0:1746147736.377297:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e36d80/2, rc 0, transno 17179874527 00000100:00100000:1.0:1746147736.377301:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796593280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147736.377338:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0437b80/2, rc 0, transno 17179874522 00000100:00100000:1.0:1746147736.377341:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796593792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.377346:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+92:3301:x1830967796592640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 217us (471us total) trans 21474841750 rc 0/0 00000004:00080000:1.0:1746147736.377349:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5e36300/2, rc 0, transno 17179874520 00000100:00100000:1.0:1746147736.377351:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796593408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147736.377352:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17353 00000004:00080000:1.0:1746147736.377359:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0436680/2, rc 0, transno 17179874521 00000100:00100000:1.0:1746147736.377362:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796593920:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147736.377370:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093054700/2, rc 0, transno 21474841745 00000100:00100000:1.0:1746147736.377372:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796592256:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147736.377379:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093055500/2, rc 0, transno 21474841746 00000100:00100000:1.0:1746147736.377382:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796592896:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147736.377385:0:8470:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147736.377387:0:8470:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147736 -> 1746147736 00002000:00010000:3.0:1746147736.377389:0:8470:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147735 -> 1746147735 00002000:00010000:3.0:1746147736.377391:0:8470:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147736 -> 1746147736 00002000:00010000:3.0:1746147736.377393:0:8470:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2075 -> 2075 00000100:00100000:3.0:1746147736.377409:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+92:3301:x1830967796592128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 292us (586us total) trans 21474841751 rc 0/0 00000100:00100000:3.0:1746147736.377413:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17352 00000100:00100000:0.0:1746147736.377575:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147736.377592:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093054380/2, rc 0, transno 21474841751 00000100:00100000:0.0:1746147736.377595:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796592128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147736.377601:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093055180/2, rc 0, transno 21474841750 00000100:00100000:0.0:1746147736.377603:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796592640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.377636:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147736.377656:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093054e00/2, rc 0, transno 21474841749 00000100:00100000:0.0:1746147736.377659:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796592512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.377682:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fce5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796592000:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147736.377689:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fce6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14547:1830967796592768:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147736.377724:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79600/0xe64d3fbf12a7f8a7 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd9b expref: 10 pid: 14547 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746147736.377741:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd9b expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.377765:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0d79200, rc 0) 00000100:00100000:0.0:1746147736.377809:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32618:x1830967794285696:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 51404us (51453us total) trans 8589946197 rc 0/0 00000100:00100000:0.0:1746147736.377816:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12164 00000100:00100000:0.0:1746147736.377837:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796594304 00000100:00100000:0.0:1746147736.377841:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796594304 00000100:00100000:0.0:1746147736.377853:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796593152 00000100:00100000:0.0:1746147736.377856:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796593152 00000100:00100000:0.0:1746147736.377864:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17354 00000100:00100000:0.0:1746147736.377869:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+103:3301:x1830967796594304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147736.377986:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+104:3301:x1830967796594304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (411us total) trans 17179874528 rc 0/0 00000100:00100000:0.0:1746147736.377992:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17354 00000100:00100000:0.0:1746147736.378001:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17355 00000100:00100000:0.0:1746147736.378005:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+92:3304:x1830967796593152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147736.378082:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+93:3304:x1830967796593152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (445us total) trans 21474841752 rc 0/0 00000100:00100000:0.0:1746147736.378087:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17355 00000004:00080000:0.0:1746147736.378201:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093055c00/2, rc 0, transno 21474841752 00000100:00100000:0.0:1746147736.378204:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796593152:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147736.378215:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0434a80/2, rc 0, transno 17179874528 00000100:00100000:0.0:1746147736.378217:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796594304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147736.378358:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.378378:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.378412:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794286464 00000100:00100000:1.0:1746147736.378415:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794286464 00000100:00100000:2.0:1746147736.378417:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.378434:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794286592 00000100:00100000:1.0:1746147736.378436:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794286592 00000100:00100000:2.0:1746147736.378439:0:16639:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5083 00000100:00100000:2.0:1746147736.378445:0:16639:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32611:x1830967794286464:12345-192.168.202.10@tcp:49:cat.0 00000100:00100000:1.0:1746147736.378448:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5084 00000100:00100000:1.0:1746147736.378452:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:32616:x1830967794286592:12345-192.168.202.10@tcp:49:cat.0 00000100:00100000:2.0:1746147736.378502:0:16639:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32611:x1830967794286464:12345-192.168.202.10@tcp:49:cat.0 Request processed in 58us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.378508:0:16639:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5083 00000100:00100000:1.0:1746147736.378509:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:32616:x1830967794286592:12345-192.168.202.10@tcp:49:cat.0 Request processed in 56us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.378515:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5084 00000100:00100000:0.0:1746147736.378610:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794286720 00000100:00100000:0.0:1746147736.378623:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794286720 00000100:00100000:0.0:1746147736.378643:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12167 00000100:00100000:0.0:1746147736.378647:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:32615:x1830967794286720:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147736.378655:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147736.378666:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f8c3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcdb0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.378699:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f8c3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb0 expref: 324 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.378715:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f8c3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb0 expref: 324 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.378726:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147736.378729:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147736.378732:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800986f6e00, rc 0) 00000100:00100000:0.0:1746147736.379066:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32615:x1830967794286720:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 416us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.379074:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12167 00000100:00100000:0.0:1746147736.381105:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.381145:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.381152:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794286976 00000100:00100000:3.0:1746147736.381183:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794286848 00000100:00100000:3.0:1746147736.381187:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794286848 00000100:00100000:3.0:1746147736.381221:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17356 00000100:00100000:3.0:1746147736.381227:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:32615:x1830967794286848:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147736.381243:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.381262:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcdb7 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.381291:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3c00/0xe64d3fbf12a7f7a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd08 expref: 14 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.381299:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b10a200/0xe64d3fbf12a7f899 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd78 expref: 29 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.381305:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3800/0xe64d3fbf12a7f7d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd32 expref: 25 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.381311:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.381313:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.381316:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 6/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1662976->2097151] (req 1662976->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 29 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.381341:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3800/0xe64d3fbf12a7f7d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd32 expref: 25 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.381351:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3800/0xe64d3fbf12a7f7d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd32 expref: 25 pid: 7050 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.381362:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796594432:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.381442:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b10a200/0xe64d3fbf12a7f899 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd78 expref: 29 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.381449:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b10a200/0xe64d3fbf12a7f899 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd78 expref: 29 pid: 8469 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.381457:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796594560:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.381481:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3c00/0xe64d3fbf12a7f7a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd08 expref: 14 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.381489:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3c00/0xe64d3fbf12a7f7a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd08 expref: 14 pid: 6715 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.381506:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796594688:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147736.381524:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147736.381694:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794286976 00000100:00100000:2.0:1746147736.381723:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 910 00000100:00100000:2.0:1746147736.381728:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:1957:x1830967794286976:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.381737:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.381755:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800986f6e00/0xe64d3fbf12a7f8c3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb0 expref: 324 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.381766:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147736.381770:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.381793:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:1957:x1830967794286976:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 64us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.381798:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 910 00000100:00100000:3.0:1746147736.382685:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796594432:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147736.383204:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.383251:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794287232 00000100:00100000:1.0:1746147736.383255:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794287232 00010000:00010000:1.0:1746147736.383275:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3c00/0xe64d3fbf12a7f7a4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd08 expref: 15 pid: 6715 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746147736.383307:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8850 00000100:00100000:1.0:1746147736.383313:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+15:1958:x1830967794287232:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147736.383322:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147736.383342:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147736.383343:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3c00/0xe64d3fbf12a7f7a4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd08 expref: 15 pid: 6715 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.383357:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3c00/0xe64d3fbf12a7f7a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd08 expref: 15 pid: 6715 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746147736.383398:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794287104 00000100:00100000:2.0:1746147736.383401:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794287104 00010000:00010000:1.0:1746147736.383419:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.383458:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+15:1958:x1830967794287232:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 144us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.383465:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8850 00010000:00010000:2.0:1746147736.383510:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b10a200/0xe64d3fbf12a7f899 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd78 expref: 30 pid: 8469 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746147736.383525:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8851 00000100:00100000:2.0:1746147736.383529:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794287104:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.383539:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.383547:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b10a200/0xe64d3fbf12a7f899 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd78 expref: 30 pid: 8469 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.383554:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b10a200/0xe64d3fbf12a7f899 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd78 expref: 30 pid: 8469 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.383566:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.383580:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794287104:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 51us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.383586:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8851 00010000:00010000:3.0:1746147736.383655:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b10a200/0xe64d3fbf12a7f899 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd78 expref: 29 pid: 8469 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.383667:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796594560:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.383677:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3c00/0xe64d3fbf12a7f7a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd08 expref: 14 pid: 6715 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.383685:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796594688:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.383712:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1662976->2097151] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 28 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.383723:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a734a800, rc 0) 00000100:00100000:3.0:1746147736.383743:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:32615:x1830967794286848:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2516us (2597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.383749:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17356 00000100:00100000:0.0:1746147736.387293:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.387334:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.387357:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794287488 00000100:00100000:1.0:1746147736.387366:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794287488 00000100:00100000:0.0:1746147736.387369:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.387385:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794287872 00000100:00100000:3.0:1746147736.387388:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794287616 00000100:00100000:0.0:1746147736.387388:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794287872 00000100:00100000:3.0:1746147736.387393:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794287616 00010000:00010000:1.0:1746147736.387397:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3800/0xe64d3fbf12a7f7d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd32 expref: 26 pid: 7050 timeout: 915 lvb_type: 1 00002000:00100000:3.0:1746147736.387416:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fce4700 x1830967794287616/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147736.387416:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009fce4380 x1830967794287872/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147736.387423:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8852 00002000:00100000:3.0:1746147736.387424:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce4700 with x1830967794287616 ext(0->1048575) 00002000:00100000:0.0:1746147736.387424:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce4380 with x1830967794287872 ext(1048576->2097151) 00002000:00010000:0.0:1746147736.387428:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fce4380 00002000:00010000:3.0:1746147736.387429:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fce4700 00000100:00100000:1.0:1746147736.387429:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794287488:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147736.387439:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7798 00010000:00010000:1.0:1746147736.387443:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147736.387443:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794287872:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147736.387451:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7799 00000100:00100000:3.0:1746147736.387456:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967794287616:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:1.0:1746147736.387464:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3800/0xe64d3fbf12a7f7d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd32 expref: 26 pid: 7050 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.387475:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3800/0xe64d3fbf12a7f7d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd32 expref: 26 pid: 7050 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.387495:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3800/0xe64d3fbf12a7f7d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd32 expref: 26 pid: 7050 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.387512:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.387514:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.387521:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 28 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.387528:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 28 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.387556:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 28 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147736.387567:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796594816:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147736.387644:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.390639:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.390755:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796594816:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147736.390773:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.390804:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1957:x1830967794287488:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3375us (3523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.390812:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8852 00000100:00100000:3.0:1746147736.391697:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794288000 00000100:00100000:3.0:1746147736.391707:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794288000 00000100:00100000:3.0:1746147736.391756:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17357 00000100:00100000:3.0:1746147736.391761:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32618:x1830967794288000:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147736.391779:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.391794:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcdbe expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.391819:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800986f6800/0xe64d3fbf12a7f7ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd01 expref: 13 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.391825:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a000/0xe64d3fbf12a7f876 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd71 expref: 29 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.391829:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b10a800/0xe64d3fbf12a7f7dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd2b expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.391832:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.391834:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.391836:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [1191936->1232895] (req 1191936->1232895) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.391862:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b10a800/0xe64d3fbf12a7f7dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd2b expref: 26 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.391874:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b10a800/0xe64d3fbf12a7f7dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd2b expref: 26 pid: 8468 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.391906:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796594944:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.391970:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a734a000/0xe64d3fbf12a7f876 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd71 expref: 29 pid: 4592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.391975:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a734a000/0xe64d3fbf12a7f876 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd71 expref: 29 pid: 4592 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.391980:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796595072:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.391995:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800986f6800/0xe64d3fbf12a7f7ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd01 expref: 13 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.392004:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800986f6800/0xe64d3fbf12a7f7ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd01 expref: 13 pid: 8470 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.392009:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796595200:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147736.392018:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.393983:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.394039:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794288256 00000100:00100000:3.0:1746147736.394047:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794288256 00002000:00100000:3.0:1746147736.394093:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1662976->1667071) req@ffff88009fce6680 x1830967794288256/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.394103:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce6680 with x1830967794288256 ext(1662976->1667071) 00002000:00010000:3.0:1746147736.394110:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fce6680 00000100:00100000:3.0:1746147736.394137:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7800 00000100:00100000:3.0:1746147736.394145:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967794288256:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147736.394324:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967794288256:12345-192.168.202.10@tcp:3:cat.0 Request processed in 179us (350us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147736.394330:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7800 00002000:00100000:3.0:1746147736.394335:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1662976->1667071) req@ffff88009fce6680 x1830967794288256/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/4536 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.394342:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce6680 with x1830967794288256 ext(1662976->1667071) 00002000:00010000:3.0:1746147736.394345:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fce6680 00000100:00100000:2.0:1746147736.396152:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.396550:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794288512 00000100:00100000:3.0:1746147736.396559:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794288512 00002000:00100000:3.0:1746147736.396595:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88012f515500 x1830967794288512/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.396604:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f515500 with x1830967794288512 ext(1048576->2097151) 00010000:00010000:3.0:1746147736.396625:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b10a800/0xe64d3fbf12a7f7dc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd2b expref: 27 pid: 8468 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746147736.396639:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b10a800/0xe64d3fbf12a7f7dc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd2b expref: 27 pid: 8468 timeout: 915 lvb_type: 1 00002000:00010000:3.0:1746147736.396647:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f515500 00000100:00100000:3.0:1746147736.396679:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1582 00000100:00100000:3.0:1746147736.396687:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794288512:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147736.396917:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1960:x1830967794287616:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9371us (9457us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147736.396927:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7799 00002000:00100000:0.0:1746147736.396934:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009fce4700 x1830967794287616/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147736.396945:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce4700 with x1830967794287616 ext(0->1048575) 00002000:00010000:0.0:1746147736.396949:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fce4700 00000100:00100000:2.0:1746147736.398690:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796594944:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147736.398752:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.398791:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794288640 00000100:00100000:0.0:1746147736.398796:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794288640 00000100:00100000:3.0:1746147736.398872:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796595072:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147736.398902:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796595200:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.398936:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [1191936->1232895] (req 1191936->1232895) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 28 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.398955:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a734a400, rc 0) 00010000:00010000:0.0:1746147736.398973:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800986f6800/0xe64d3fbf12a7f7ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd01 expref: 14 pid: 8470 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.398982:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32618:x1830967794288000:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 7220us (8352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.398989:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17357 00000100:00100000:0.0:1746147736.398994:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8853 00000100:00100000:0.0:1746147736.398999:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+14:1960:x1830967794288640:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147736.399009:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147736.399024:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800986f6800/0xe64d3fbf12a7f7ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd01 expref: 14 pid: 8470 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.399159:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800986f6800/0xe64d3fbf12a7f7ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd01 expref: 14 pid: 8470 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.399184:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800986f6800/0xe64d3fbf12a7f7ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd01 expref: 14 pid: 8470 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.399199:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147736.399281:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794288640:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 282us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.399287:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8853 00000100:00100000:0.0:1746147736.399529:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794287872:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12084us (12194us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147736.399536:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7798 00002000:00100000:0.0:1746147736.399544:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009fce4380 x1830967794287872/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147736.399553:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce4380 with x1830967794287872 ext(1048576->2097151) 00010000:00010000:0.0:1746147736.399559:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a000/0xe64d3fbf12a7f876 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd71 expref: 28 pid: 4592 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.399569:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a734a000/0xe64d3fbf12a7f876 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd71 expref: 28 pid: 4592 timeout: 915 lvb_type: 1 00002000:00010000:0.0:1746147736.399575:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fce4380 00000100:00100000:0.0:1746147736.402090:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.402149:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794288768 00000100:00100000:3.0:1746147736.402158:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794288768 00000100:00100000:3.0:1746147736.402198:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17358 00000100:00100000:3.0:1746147736.402204:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:32615:x1830967794288768:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147736.402222:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.402237:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcdc5 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.402262:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b10a000/0xe64d3fbf12a7f7b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd0f expref: 13 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.402269:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f86f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd7f expref: 43 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.402275:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b10ac00/0xe64d3fbf12a7f7ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd39 expref: 25 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.402280:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.402282:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.402284:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [1048576->1167359] (req 1048576->1167359) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 43 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.402311:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b10ac00/0xe64d3fbf12a7f7ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd39 expref: 25 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.402319:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b10ac00/0xe64d3fbf12a7f7ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd39 expref: 25 pid: 8468 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.402329:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796595328:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.402397:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f86f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd7f expref: 43 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.402403:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f86f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd7f expref: 43 pid: 22183 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.402409:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796595456:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.402428:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b10a000/0xe64d3fbf12a7f7b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd0f expref: 13 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.402434:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b10a000/0xe64d3fbf12a7f7b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd0f expref: 13 pid: 8468 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.402439:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796595584:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147736.402453:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.403193:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.403303:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794288896 00000100:00100000:2.0:1746147736.403307:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794288896 00010000:00010000:2.0:1746147736.403329:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734a000/0xe64d3fbf12a7f876 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd71 expref: 28 pid: 4592 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746147736.403350:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8854 00000100:00100000:2.0:1746147736.403356:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794288896:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.403365:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.403383:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a734a000/0xe64d3fbf12a7f876 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd71 expref: 28 pid: 4592 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.403393:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a734a000/0xe64d3fbf12a7f876 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd71 expref: 28 pid: 4592 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.403413:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a000/0xe64d3fbf12a7f876 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd71 expref: 28 pid: 4592 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.403427:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147736.403658:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794288512:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 6970us (7514us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147736.403659:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794288896:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 300us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.403665:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8854 00000100:00100000:3.0:1746147736.403667:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1582 00002000:00100000:3.0:1746147736.403675:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88012f515500 x1830967794288512/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.403684:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f515500 with x1830967794288512 ext(1048576->2097151) 00010000:00010000:3.0:1746147736.403690:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b10a800/0xe64d3fbf12a7f7dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd2b expref: 26 pid: 8468 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746147736.403699:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b10a800/0xe64d3fbf12a7f7dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd2b expref: 26 pid: 8468 timeout: 915 lvb_type: 1 00002000:00010000:3.0:1746147736.403706:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f515500 00000100:00100000:0.0:1746147736.404339:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.404402:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794289152 00000100:00100000:3.0:1746147736.404406:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794289152 00002000:00100000:3.0:1746147736.404430:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1662975) req@ffff88009fce6300 x1830967794289152/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.404438:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce6300 with x1830967794289152 ext(1048576->1662975) 00002000:00010000:3.0:1746147736.404441:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fce6300 00000100:00100000:3.0:1746147736.404453:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7801 00000100:00100000:3.0:1746147736.404457:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794289152:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147736.405533:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796595328:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147736.406117:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.406137:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794289280 00000100:00100000:0.0:1746147736.406142:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794289280 00010000:00010000:0.0:1746147736.406167:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b10ac00/0xe64d3fbf12a7f7ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd39 expref: 26 pid: 8468 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746147736.406205:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8855 00000100:00100000:0.0:1746147736.406212:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967794289280:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147736.406224:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147736.406244:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b10ac00/0xe64d3fbf12a7f7ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd39 expref: 26 pid: 8468 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746147736.406253:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147736.406254:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b10ac00/0xe64d3fbf12a7f7ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd39 expref: 26 pid: 8468 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.406282:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b10ac00/0xe64d3fbf12a7f7ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd39 expref: 26 pid: 8468 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.406299:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147736.406325:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967794289280:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 113us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.406331:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8855 00000100:00100000:2.0:1746147736.406475:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796595456:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147736.406484:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796595584:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147736.406511:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1167359] (req 1048576->1167359) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 43 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.406521:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b10b800, rc 0) 00000100:00100000:2.0:1746147736.406539:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:32615:x1830967794288768:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4336us (4458us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.406546:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17358 00000100:00100000:0.0:1746147736.407039:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794289408 00000100:00100000:0.0:1746147736.407043:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794289408 00010000:00010000:0.0:1746147736.407056:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b10a000/0xe64d3fbf12a7f7b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd0f expref: 14 pid: 8468 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746147736.407074:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8856 00000100:00100000:0.0:1746147736.407078:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+14:1957:x1830967794289408:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147736.407171:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147736.407180:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b10a000/0xe64d3fbf12a7f7b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd0f expref: 14 pid: 8468 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.407188:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b10a000/0xe64d3fbf12a7f7b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd0f expref: 14 pid: 8468 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.407201:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b10a000/0xe64d3fbf12a7f7b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd0f expref: 14 pid: 8468 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.407210:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147736.407233:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+13:1957:x1830967794289408:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 150us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147736.407239:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8856 00000100:00100000:2.0:1746147736.411982:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.412016:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.412027:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794289664 00000100:00100000:0.0:1746147736.412038:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794289664 00002000:00100000:0.0:1746147736.412083:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88012f514700 x1830967794289664/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147736.412094:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514700 with x1830967794289664 ext(1048576->2097151) 00010000:00010000:0.0:1746147736.412104:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f86f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd7f expref: 43 pid: 22183 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.412118:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f86f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd7f expref: 43 pid: 22183 timeout: 915 lvb_type: 1 00002000:00010000:0.0:1746147736.412125:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f514700 00000100:00100000:0.0:1746147736.412207:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1583 00000100:00100000:0.0:1746147736.412215:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1959:x1830967794289664:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147736.412352:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.412392:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794289792 00000100:00100000:1.0:1746147736.412396:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794289792 00000100:00100000:2.0:1746147736.412398:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.412425:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794289920 00000100:00100000:1.0:1746147736.412427:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794289920 00000100:00100000:2.0:1746147736.412434:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17359 00000100:00100000:2.0:1746147736.412441:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32611:x1830967794289792:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147736.412451:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17360 00010000:00010000:2.0:1746147736.412455:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147736.412456:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32616:x1830967794289920:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147736.412463:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.412470:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f8df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcdcc expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.412471:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb39400/0xe64d3fbf12a7f8e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcdd3 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.412489:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.412493:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 30 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.412494:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1191936->1232895] (req 1191936->1232895) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.412499:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147736.412499:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147736.412501:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147736.412503:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb39400/0xe64d3fbf12a7f8e6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdd3 expref: 30 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.412504:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f8df lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdcc expref: 27 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.412530:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 30 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.412536:0:8470:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1191936->1232895] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.412540:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 30 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.412548:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb39400/0xe64d3fbf12a7f8e6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdd3 expref: 30 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147736.412552:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796595840:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147736.412558:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb39400, rc 0) 00000100:00100000:1.0:1746147736.412595:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32616:x1830967794289920:12345-192.168.202.10@tcp:101:cat.0 Request processed in 138us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.412601:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17360 00000100:00100000:2.0:1746147736.412627:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147736.413378:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794289152:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8917us (9037us total) trans 0 rc 614400/614400 00000100:00100000:3.0:1746147736.413386:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7801 00002000:00100000:3.0:1746147736.413393:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1662975) req@ffff88009fce6300 x1830967794289152/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 614400/614400 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.413401:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce6300 with x1830967794289152 ext(1048576->1662975) 00010000:00010000:3.0:1746147736.413407:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 28 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.413415:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 28 pid: 9615 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147736.413421:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fce6300 00000100:00100000:0.0:1746147736.414317:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794290048 00000100:00100000:0.0:1746147736.414325:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794290048 00010000:00010000:0.0:1746147736.414349:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b10a800/0xe64d3fbf12a7f7dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd2b expref: 28 pid: 8468 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746147736.414388:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8857 00000100:00100000:0.0:1746147736.414395:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967794290048:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147736.414406:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147736.414424:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b10a800/0xe64d3fbf12a7f7dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd2b expref: 28 pid: 8468 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.414433:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b10a800/0xe64d3fbf12a7f7dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd2b expref: 28 pid: 8468 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.414455:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b10a800/0xe64d3fbf12a7f7dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd2b expref: 28 pid: 8468 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746147736.414468:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.414470:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.414476:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.414484:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.414512:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.414522:0:7095:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 27 pid: 9615 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746147736.414539:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fce7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796595968:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147736.414591:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6170c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147736.416583:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796595840:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147736.416625:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f8df lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdcc expref: 27 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.416642:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0249a00, rc 0) 00000100:00100000:2.0:1746147736.416683:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32611:x1830967794289792:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4241us (4664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.416694:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17359 00000100:00100000:0.0:1746147736.416778:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.417847:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794290176 00000100:00100000:3.0:1746147736.417855:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794290176 00002000:00100000:3.0:1746147736.417929:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1662976->2097151) req@ffff88009fce7800 x1830967794290176/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.417939:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce7800 with x1830967794290176 ext(1662976->2097151) 00010000:00010000:3.0:1746147736.417951:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 28 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.417967:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 28 pid: 9615 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147736.417974:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fce7800 00000100:00100000:3.0:1746147736.417993:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1584 00000100:00100000:3.0:1746147736.418001:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794290176:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147736.421733:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fce7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796595968:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147736.421753:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.421809:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794290048:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7414us (9409us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.421821:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8857 00000100:00100000:0.0:1746147736.421839:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.421866:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794290432 00000100:00100000:0.0:1746147736.421871:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794290432 00002000:00100000:0.0:1746147736.421932:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x454:0x0] (1191936->1196031) req@ffff88009fce7b80 x1830967794290432/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147736.421942:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce7b80 with x1830967794290432 ext(1191936->1196031) 00010000:00010000:0.0:1746147736.421950:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 26 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746147736.421961:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 26 pid: 9615 timeout: 915 lvb_type: 0 00002000:00010000:0.0:1746147736.421968:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fce7b80 00000100:00100000:0.0:1746147736.421990:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1585 00000100:00100000:0.0:1746147736.421997:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794290432:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147736.422268:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794290432:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 270us (428us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147736.422274:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1585 00002000:00100000:0.0:1746147736.422279:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x454:0x0] (1191936->1196031) req@ffff88009fce7b80 x1830967794290432/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/4536 e 0 to 0 dl 1746147747 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147736.422292:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce7b80 with x1830967794290432 ext(1191936->1196031) 00010000:00010000:0.0:1746147736.422296:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 26 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746147736.422304:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 26 pid: 9615 timeout: 915 lvb_type: 0 00002000:00010000:0.0:1746147736.422309:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fce7b80 00000100:00100000:1.0:1746147736.422412:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1959:x1830967794289664:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10197us (10440us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147736.422421:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1583 00002000:00100000:1.0:1746147736.422426:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88012f514700 x1830967794289664/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.422433:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514700 with x1830967794289664 ext(1048576->2097151) 00010000:00010000:1.0:1746147736.422438:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f86f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd7f expref: 43 pid: 22183 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.422450:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f86f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd7f expref: 43 pid: 22183 timeout: 915 lvb_type: 1 00002000:00010000:1.0:1746147736.422455:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f514700 00000100:00100000:3.0:1746147736.426256:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794290176:12345-192.168.202.10@tcp:4:cat.0 Request processed in 8202us (9425us total) trans 21474841753 rc 0/0 00000100:00100000:3.0:1746147736.426272:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1584 00002000:00100000:3.0:1746147736.426286:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1662976->2097151) req@ffff88009fce7800 x1830967794290176/t21474841753(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/448 e 0 to 0 dl 1746147747 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.426295:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce7800 with x1830967794290176 ext(1662976->2097151) 00010000:00010000:3.0:1746147736.426305:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 30 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.426318:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 30 pid: 9615 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147736.426325:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fce7800 00000100:00100000:2.0:1746147736.426474:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.426592:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.426662:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794290688 00000100:00100000:3.0:1746147736.426669:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794290688 00002000:00100000:3.0:1746147736.426701:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1228800->1232895) req@ffff88012f514e00 x1830967794290688/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.426709:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514e00 with x1830967794290688 ext(1228800->1232895) 00010000:00010000:3.0:1746147736.426714:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 26 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.426722:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 26 pid: 9615 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147736.426728:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f514e00 00000100:00100000:3.0:1746147736.426743:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1586 00000100:00100000:3.0:1746147736.426749:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967794290688:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147736.426868:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967794290688:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 119us (394us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147736.426877:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1586 00002000:00100000:3.0:1746147736.426881:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1228800->1232895) req@ffff88012f514e00 x1830967794290688/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/4536 e 0 to 0 dl 1746147747 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.426909:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514e00 with x1830967794290688 ext(1228800->1232895) 00010000:00010000:3.0:1746147736.426913:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 26 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.426920:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 26 pid: 9615 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147736.426925:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f514e00 00000100:00100000:1.0:1746147736.427162:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794290816 00000100:00100000:1.0:1746147736.427166:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794290816 00010000:00010000:1.0:1746147736.427276:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f86f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd7f expref: 43 pid: 22183 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746147736.427295:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8858 00000100:00100000:1.0:1746147736.427299:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1959:x1830967794290816:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147736.427309:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147736.427327:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f86f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd7f expref: 43 pid: 22183 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.427336:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f86f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd7f expref: 43 pid: 22183 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.427362:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a0c00/0xe64d3fbf12a7f86f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd7f expref: 43 pid: 22183 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746147736.427389:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.427391:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.427398:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 42 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.427407:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 42 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.427439:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 42 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147736.427451:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796596096:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147736.427516:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147736.429465:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796596096:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147736.429485:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.429534:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1959:x1830967794290816:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2232us (2940us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.429545:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8858 00000100:00100000:0.0:1746147736.430610:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.430673:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794291072 00000100:00100000:1.0:1746147736.430680:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794291072 00010000:00010000:1.0:1746147736.430713:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 30 pid: 9615 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.430760:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8859 00000100:00100000:1.0:1746147736.430768:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1957:x1830967794291072:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147736.430781:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147736.430800:0:7095:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147736 -> 1746147737 00002000:00010000:1.0:1746147736.430803:0:7095:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147736 -> 1746147737 00010000:00010000:1.0:1746147736.430809:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 30 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.430821:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 30 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.430844:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a800/0xe64d3fbf12a7f8ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdb7 expref: 30 pid: 9615 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746147736.430844:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147736.430861:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.430862:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147736.430865:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794291200 00000100:00100000:0.0:1746147736.430869:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794291200 00010000:00010000:1.0:1746147736.430870:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f8df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdcc expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.430877:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f8df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdcc expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746147736.430924:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1163264->1167359) req@ffff88009fce5c00 x1830967794291200/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746147736.430928:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f8df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdcc expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746147736.430933:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce5c00 with x1830967794291200 ext(1163264->1167359) 00002000:00010000:0.0:1746147736.430938:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fce5c00 00000100:00100000:1.0:1746147736.430945:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796596224:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147736.430957:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7802 00000100:00100000:0.0:1746147736.430961:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1959:x1830967794291200:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147736.431002:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.431096:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1959:x1830967794291200:12345-192.168.202.10@tcp:3:cat.0 Request processed in 133us (251us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147736.431101:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7802 00002000:00100000:0.0:1746147736.431106:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1163264->1167359) req@ffff88009fce5c00 x1830967794291200/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/4536 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147736.431112:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce5c00 with x1830967794291200 ext(1163264->1167359) 00002000:00010000:0.0:1746147736.431115:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fce5c00 00000100:00100000:0.0:1746147736.431494:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.431524:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794291456 00000100:00100000:2.0:1746147736.431529:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794291456 00002000:00100000:2.0:1746147736.431547:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1191936->1232895) req@ffff88009fce4e00 x1830967794291456/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.431554:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce4e00 with x1830967794291456 ext(1191936->1232895) 00010000:00010000:2.0:1746147736.431560:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 26 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.431573:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 26 pid: 9615 timeout: 915 lvb_type: 0 00002000:00010000:2.0:1746147736.431579:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fce4e00 00000100:00100000:2.0:1746147736.431601:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1587 00000100:00100000:2.0:1746147736.431606:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794291456:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:0.0:1746147736.434191:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.434489:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794291712 00000100:00100000:1.0:1746147736.434499:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794291712 00000100:00100000:1.0:1746147736.434536:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5085 00000100:00100000:1.0:1746147736.434543:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32618:x1830967794291712:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:3.0:1746147736.434784:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967794291456:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 3176us (3288us total) trans 21474841754 rc 0/0 00000100:00100000:1.0:1746147736.434784:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32618:x1830967794291712:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 239us (601us total) trans 8589946198 rc 0/0 00000100:00100000:1.0:1746147736.434791:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5085 00000100:00100000:3.0:1746147736.434793:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1587 00002000:00100000:3.0:1746147736.434800:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x454:0x0] (1191936->1232895) req@ffff88009fce4e00 x1830967794291456/t21474841754(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/448 e 0 to 0 dl 1746147747 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.434810:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce4e00 with x1830967794291456 ext(1191936->1232895) 00010000:00010000:3.0:1746147736.434818:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 28 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.434832:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 28 pid: 9615 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147736.434840:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fce4e00 00000100:00100000:2.0:1746147736.435697:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.435739:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794291968 00000100:00100000:0.0:1746147736.435744:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794291968 00000100:00100000:1.0:1746147736.435779:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796596224:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147736.435779:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5086 00000100:00100000:0.0:1746147736.435785:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:32615:x1830967794291968:12345-192.168.202.10@tcp:35:multiop.0 00010000:00010000:1.0:1746147736.435797:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.435836:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967794291072:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5068us (5231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.435843:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8859 00000100:00100000:0.0:1746147736.435923:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32615:x1830967794291968:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 138us (229us total) trans 8589946199 rc 0/0 00000100:00100000:0.0:1746147736.435929:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5086 00000100:00100000:0.0:1746147736.436342:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.436397:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.436436:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794292352 00000100:00100000:1.0:1746147736.436439:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794292352 00010000:00010000:1.0:1746147736.436456:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 28 pid: 9615 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.436482:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8860 00000100:00100000:1.0:1746147736.436488:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967794292352:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147736.436497:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147736.436511:0:7095:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147736 -> 1746147737 00002000:00010000:1.0:1746147736.436515:0:7095:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147736 -> 1746147737 00010000:00010000:1.0:1746147736.436519:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 28 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.436530:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 28 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.436553:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a734a400/0xe64d3fbf12a7f8d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1232895) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdbe expref: 28 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.436573:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.436575:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.436583:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39400/0xe64d3fbf12a7f8e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdd3 expref: 28 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.436591:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb39400/0xe64d3fbf12a7f8e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdd3 expref: 28 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147736.436595:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794292224 00000100:00100000:2.0:1746147736.436599:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794292224 00010000:00010000:1.0:1746147736.436629:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb39400/0xe64d3fbf12a7f8e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdd3 expref: 28 pid: 8470 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147736.436630:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009fce4000 x1830967794292224/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.436638:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce4000 with x1830967794292224 ext(1048576->2097151) 00000100:00100000:1.0:1746147736.436641:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796596352:192.168.202.10@tcp:105: 00002000:00010000:2.0:1746147736.436642:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fce4000 00000100:00100000:2.0:1746147736.436654:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7803 00000100:00100000:2.0:1746147736.436659:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967794292224:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147736.436685:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147736.439276:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796596352:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147736.439303:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.439351:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967794292352:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2861us (2952us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.439364:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8860 00000100:00100000:0.0:1746147736.444044:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.444150:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794292608 00000100:00100000:2.0:1746147736.444160:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794292608 00002000:00100000:2.0:1746147736.444207:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880093055f80 x1830967794292608/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.444217:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093055f80 with x1830967794292608 ext(1048576->2097151) 00002000:00010000:2.0:1746147736.444223:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093055f80 00000100:00100000:2.0:1746147736.444253:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7804 00000100:00100000:2.0:1746147736.444261:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967794292608:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147736.446203:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794292224:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 9532us (9850us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147736.446215:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7803 00002000:00100000:3.0:1746147736.446227:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009fce4000 x1830967794292224/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.446236:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce4000 with x1830967794292224 ext(1048576->2097151) 00002000:00010000:3.0:1746147736.446242:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fce4000 00000100:00100000:2.0:1746147736.452401:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967794292608:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8128us (8357us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147736.452415:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7804 00002000:00100000:2.0:1746147736.452427:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880093055f80 x1830967794292608/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.452438:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093055f80 with x1830967794292608 ext(1048576->2097151) 00002000:00010000:2.0:1746147736.452444:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093055f80 00000100:00100000:0.0:1746147736.453251:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.453393:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794292736 00000100:00100000:2.0:1746147736.453401:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794292736 00000100:00100000:2.0:1746147736.453680:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17361 00000100:00100000:2.0:1746147736.453688:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32611:x1830967794292736:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147736.453705:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.453719:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bd1c600/0xe64d3fbf12a7f8ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcdda expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.453746:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 41 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.453754:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147736.453756:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147736.453759:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd1c600/0xe64d3fbf12a7f8ed lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdda expref: 26 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.453787:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 41 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.453797:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 41 pid: 9615 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.453807:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796596480:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147736.454547:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147736.456719:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796596480:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147736.456752:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bd1c600/0xe64d3fbf12a7f8ed lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdda expref: 26 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.456771:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd1c600, rc 0) 00000100:00100000:2.0:1746147736.456827:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32611:x1830967794292736:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3137us (3576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.456835:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17361 00000100:00100000:0.0:1746147736.458653:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.458735:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794292992 00000100:00100000:2.0:1746147736.458743:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794292992 00000100:00100000:3.0:1746147736.459063:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17362 00000100:00100000:3.0:1746147736.459074:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32616:x1830967794292992:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147736.459093:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.459111:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f8f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcde1 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.459144:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.459146:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.459153:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f8f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde1 expref: 30 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.459168:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f8f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde1 expref: 30 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.459177:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b10b600, rc 0) 00000100:00100000:3.0:1746147736.459217:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32616:x1830967794292992:12345-192.168.202.10@tcp:101:cat.0 Request processed in 145us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.459222:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17362 00000100:00100000:0.0:1746147736.459413:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.459547:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794292864 00000100:00100000:3.0:1746147736.459552:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794292864 00002000:00100000:3.0:1746147736.459581:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1167359) req@ffff880093056a00 x1830967794292864/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.459590:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093056a00 with x1830967794292864 ext(1048576->1167359) 00010000:00010000:3.0:1746147736.459597:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 42 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.459609:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 42 pid: 9615 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746147736.459628:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093056a00 00000100:00100000:3.0:1746147736.459651:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1588 00000100:00100000:3.0:1746147736.459657:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+42:1959:x1830967794292864:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:0.0:1746147736.465366:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.465713:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794293248 00000100:00100000:1.0:1746147736.465722:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794293248 00002000:00100000:1.0:1746147736.465760:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880093057100 x1830967794293248/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.465769:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093057100 with x1830967794293248 ext(1048576->2097151) 00002000:00010000:1.0:1746147736.465775:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093057100 00000100:00100000:2.0:1746147736.465840:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1959:x1830967794292864:12345-192.168.202.10@tcp:4:cat.0 Request processed in 6180us (6424us total) trans 17179874529 rc 0/0 00000100:00100000:2.0:1746147736.465857:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1588 00002000:00100000:2.0:1746147736.465863:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1167359) req@ffff880093056a00 x1830967794292864/t17179874529(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/448 e 0 to 0 dl 1746147747 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.465870:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093056a00 with x1830967794292864 ext(1048576->1167359) 00010000:00010000:2.0:1746147736.465877:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 44 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.465911:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 44 pid: 9615 timeout: 915 lvb_type: 0 00002000:00010000:2.0:1746147736.465917:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093056a00 00000100:00100000:2.0:1746147736.465937:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7805 00000100:00100000:2.0:1746147736.465944:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967794293248:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147736.469847:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.469918:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794293376 00000100:00100000:1.0:1746147736.469928:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794293376 00010000:00010000:1.0:1746147736.469967:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 44 pid: 9615 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746147736.470001:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8861 00000100:00100000:1.0:1746147736.470007:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1960:x1830967794293376:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147736.470017:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147736.470034:0:7095:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147736 -> 1746147737 00002000:00010000:1.0:1746147736.470036:0:7095:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147736 -> 1746147737 00010000:00010000:1.0:1746147736.470039:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 44 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.470048:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 44 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.470067:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b10b800/0xe64d3fbf12a7f8d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1167359) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdc5 expref: 44 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.470091:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.470092:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147736.470098:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd1c600/0xe64d3fbf12a7f8ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdda expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.470104:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd1c600/0xe64d3fbf12a7f8ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdda expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147736.470132:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd1c600/0xe64d3fbf12a7f8ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdda expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147736.470145:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796596608:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147736.470239:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147736.473674:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796596608:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147736.473698:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147736.473810:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:1960:x1830967794293376:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3800us (3972us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147736.473821:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8861 00000100:00100000:0.0:1746147736.474120:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.474290:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967794293248:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8345us (8933us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147736.474298:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7805 00002000:00100000:3.0:1746147736.474310:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880093057100 x1830967794293248/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.474319:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093057100 with x1830967794293248 ext(1048576->2097151) 00002000:00010000:3.0:1746147736.474325:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093057100 00000100:00100000:3.0:1746147736.474341:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794293632 00000100:00100000:3.0:1746147736.474347:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794293632 00002000:00100000:3.0:1746147736.474376:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880093057480 x1830967794293632/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.474382:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093057480 with x1830967794293632 ext(1048576->2097151) 00002000:00010000:3.0:1746147736.474386:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093057480 00000100:00100000:3.0:1746147736.474400:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7806 00000100:00100000:3.0:1746147736.474407:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794293632:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147736.480132:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.480282:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794293760 00000100:00100000:3.0:1746147736.480293:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794293760 00000100:00100000:3.0:1746147736.480372:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17363 00000100:00100000:3.0:1746147736.480383:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+43:32616:x1830967794293760:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147736.480406:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.480450:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f8fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcde8 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.480481:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.480483:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.480493:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f8fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde8 expref: 44 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.480509:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f8fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde8 expref: 44 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.480521:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5286c00, rc 0) 00000100:00100000:3.0:1746147736.480600:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:32616:x1830967794293760:12345-192.168.202.10@tcp:101:cat.0 Request processed in 217us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.480607:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17363 00000100:00100000:3.0:1746147736.486476:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794293632:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 12057us (12349us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147736.486490:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7806 00002000:00100000:3.0:1746147736.486505:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880093057480 x1830967794293632/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.486515:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093057480 with x1830967794293632 ext(1048576->2097151) 00002000:00010000:3.0:1746147736.486522:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093057480 00000100:00100000:0.0:1746147736.487080:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.487159:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794294016 00000100:00100000:3.0:1746147736.487168:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794294016 00002000:00100000:3.0:1746147736.487207:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880093057b80 x1830967794294016/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.487215:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093057b80 with x1830967794294016 ext(1048576->2097151) 00002000:00010000:3.0:1746147736.487218:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093057b80 00000100:00100000:3.0:1746147736.487869:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7807 00000100:00100000:3.0:1746147736.487880:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1959:x1830967794294016:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147736.495209:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.495339:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794294144 00000100:00100000:2.0:1746147736.495351:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794294144 00000100:00100000:2.0:1746147736.495413:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17364 00000100:00100000:2.0:1746147736.495420:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1957:x1830967794294144:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147736.495436:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.495452:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd1dc00/0xe64d3fbf12a7f902 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcdef expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.495472:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.495474:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.495481:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd1dc00/0xe64d3fbf12a7f902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdef expref: 28 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.495499:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd1dc00/0xe64d3fbf12a7f902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdef expref: 28 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147736.495509:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd1dc00, rc 0) 00000100:00100000:2.0:1746147736.495562:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967794294144:12345-192.168.202.10@tcp:101:cat.0 Request processed in 143us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.495566:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17364 00000100:00100000:3.0:1746147736.504467:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1959:x1830967794294016:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16580us (17381us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147736.504480:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7807 00002000:00100000:3.0:1746147736.504493:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880093057b80 x1830967794294016/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.504502:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093057b80 with x1830967794294016 ext(1048576->2097151) 00002000:00010000:3.0:1746147736.504507:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093057b80 00000100:00100000:0.0:1746147736.520443:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.520487:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.520562:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794294656 00000100:00100000:3.0:1746147736.520573:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794294656 00002000:00100000:3.0:1746147736.520653:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880093cd5180 x1830967794294656/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.520663:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5180 with x1830967794294656 ext(3145728->4194303) 00002000:00010000:3.0:1746147736.520668:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd5180 00000100:00100000:3.0:1746147736.520692:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794294528 00000100:00100000:3.0:1746147736.520694:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794294528 00002000:00100000:3.0:1746147736.520705:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880093cd4700 x1830967794294528/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.520712:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4700 with x1830967794294528 ext(2097152->3145727) 00002000:00010000:3.0:1746147736.520714:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd4700 00000100:00100000:3.0:1746147736.520726:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7808 00000100:00100000:3.0:1746147736.520732:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967794294656:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147736.522031:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7809 00000100:00100000:1.0:1746147736.522048:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1959:x1830967794294528:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147736.522363:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.522434:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.522475:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794294912 00000100:00100000:0.0:1746147736.522482:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794294912 00000100:00100000:2.0:1746147736.522502:0:8475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794295040 00000100:00100000:2.0:1746147736.522509:0:8475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794295040 00002000:00100000:0.0:1746147736.522517:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880093cd4a80 x1830967794294912/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147736.522527:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4a80 with x1830967794294912 ext(2097152->3145727) 00002000:00010000:0.0:1746147736.522532:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd4a80 00002000:00100000:2.0:1746147736.522533:0:8475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009172dc00 x1830967794295040/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.522540:0:8475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172dc00 with x1830967794295040 ext(3145728->4194303) 00002000:00010000:2.0:1746147736.522544:0:8475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009172dc00 00000100:00100000:0.0:1746147736.523217:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7810 00000100:00100000:0.0:1746147736.523228:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967794294912:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147736.523229:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7811 00000100:00100000:3.0:1746147736.523237:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967794295040:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147736.537545:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.538238:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.538417:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794295680 00000100:00100000:2.0:1746147736.538427:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794295680 00002000:00100000:2.0:1746147736.538475:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009172f480 x1830967794295680/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.538486:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172f480 with x1830967794295680 ext(3145728->4194303) 00002000:00010000:2.0:1746147736.538492:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009172f480 00000100:00100000:2.0:1746147736.538511:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794295552 00000100:00100000:2.0:1746147736.538514:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794295552 00002000:00100000:2.0:1746147736.538524:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009172f800 x1830967794295552/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.538531:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172f800 with x1830967794295552 ext(2097152->3145727) 00002000:00010000:2.0:1746147736.538534:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009172f800 00000100:00100000:2.0:1746147736.538547:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7812 00000100:00100000:2.0:1746147736.538554:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794295680:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147736.538936:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7813 00000100:00100000:3.0:1746147736.538947:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794295552:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147736.539170:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.539190:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.539380:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794295936 00000100:00100000:3.0:1746147736.539386:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794295936 00002000:00100000:3.0:1746147736.539452:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800954c1880 x1830967794295936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.539460:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1880 with x1830967794295936 ext(2097152->3145727) 00002000:00010000:3.0:1746147736.539464:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c1880 00000100:00100000:1.0:1746147736.539846:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1960:x1830967794294912:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16619us (17485us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147736.539857:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7810 00002000:00100000:1.0:1746147736.539863:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880093cd4a80 x1830967794294912/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.539870:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4a80 with x1830967794294912 ext(2097152->3145727) 00002000:00010000:1.0:1746147736.539874:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cd4a80 00000100:00100000:1.0:1746147736.539928:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794296064 00000100:00100000:1.0:1746147736.539931:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794296064 00002000:00100000:1.0:1746147736.539946:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800954c1f80 x1830967794296064/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.539953:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1f80 with x1830967794296064 ext(3145728->4194303) 00002000:00010000:1.0:1746147736.539955:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c1f80 00000100:00100000:3.0:1746147736.540967:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7814 00000100:00100000:3.0:1746147736.540978:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1960:x1830967794295936:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147736.541231:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7815 00000100:00100000:1.0:1746147736.541239:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1960:x1830967794296064:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147736.546375:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967794295040:12345-192.168.202.10@tcp:3:cat.0 Request processed in 23123us (23927us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147736.546393:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7811 00002000:00100000:3.0:1746147736.546408:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009172dc00 x1830967794295040/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.546417:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172dc00 with x1830967794295040 ext(3145728->4194303) 00002000:00010000:3.0:1746147736.546424:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009172dc00 00000100:00100000:2.0:1746147736.547580:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967794294656:12345-192.168.202.10@tcp:3:cat.0 Request processed in 26842us (27164us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147736.547591:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7808 00002000:00100000:2.0:1746147736.547599:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880093cd5180 x1830967794294656/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.547607:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd5180 with x1830967794294656 ext(3145728->4194303) 00002000:00010000:2.0:1746147736.547625:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd5180 00000100:00100000:1.0:1746147736.549039:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794294528:12345-192.168.202.10@tcp:3:cat.0 Request processed in 26991us (28545us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147736.549048:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7809 00002000:00100000:1.0:1746147736.549057:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880093cd4700 x1830967794294528/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.549066:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cd4700 with x1830967794294528 ext(2097152->3145727) 00002000:00010000:1.0:1746147736.549072:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cd4700 00000100:00100000:1.0:1746147736.554401:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1960:x1830967794296064:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13151us (15196us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147736.554413:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7815 00002000:00100000:1.0:1746147736.554427:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800954c1f80 x1830967794296064/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.554436:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1f80 with x1830967794296064 ext(3145728->4194303) 00002000:00010000:1.0:1746147736.554442:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c1f80 00000100:00100000:2.0:1746147736.554515:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794295680:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15960us (16981us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147736.554523:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7812 00002000:00100000:2.0:1746147736.554529:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009172f480 x1830967794295680/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.554536:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172f480 with x1830967794295680 ext(3145728->4194303) 00002000:00010000:2.0:1746147736.554540:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009172f480 00000100:00100000:3.0:1746147736.557967:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794295552:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19013us (19718us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147736.557979:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7813 00002000:00100000:3.0:1746147736.557992:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009172f800 x1830967794295552/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.558002:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172f800 with x1830967794295552 ext(2097152->3145727) 00002000:00010000:3.0:1746147736.558008:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009172f800 00000100:00100000:0.0:1746147736.558537:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.559361:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1960:x1830967794295936:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18384us (20188us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147736.559369:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7814 00002000:00100000:3.0:1746147736.559375:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800954c1880 x1830967794295936/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.559383:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c1880 with x1830967794295936 ext(2097152->3145727) 00002000:00010000:3.0:1746147736.559387:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c1880 00000100:00100000:3.0:1746147736.559402:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794296448 00000100:00100000:3.0:1746147736.559408:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794296448 00002000:00100000:3.0:1746147736.559433:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009172ed80 x1830967794296448/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147736.559444:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172ed80 with x1830967794296448 ext(4194304->5017599) 00002000:00010000:3.0:1746147736.559447:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172ed80 00000100:00100000:3.0:1746147736.560480:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7816 00000100:00100000:3.0:1746147736.560490:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794296448:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147736.568979:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.569142:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794296704 00000100:00100000:2.0:1746147736.569155:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794296704 00002000:00100000:2.0:1746147736.569494:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009172c380 x1830967794296704/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.569504:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172c380 with x1830967794296704 ext(4194304->5017599) 00002000:00010000:2.0:1746147736.569510:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172c380 00000100:00100000:2.0:1746147736.569696:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7817 00000100:00100000:2.0:1746147736.569705:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1959:x1830967794296704:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147736.570765:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.570905:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794296960 00000100:00100000:3.0:1746147736.570911:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794296960 00000100:00100000:3.0:1746147736.570951:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12168 00000100:00100000:3.0:1746147736.570957:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32623:x1830967794296960:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147736.570979:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.570997:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482600/0xe64d3fbf12a7f909 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcdf6 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.571090:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482800/0xe64d3fbf12a7f910 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571102:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482800/0xe64d3fbf12a7f910 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571112:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482800/0xe64d3fbf12a7f910 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571126:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482a00/0xe64d3fbf12a7f917 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571131:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482a00/0xe64d3fbf12a7f917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571135:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482a00/0xe64d3fbf12a7f917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571233:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482c00/0xe64d3fbf12a7f91e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571240:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482c00/0xe64d3fbf12a7f91e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00000100:00100000:2.0:1746147736.571244:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794296448:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10755us (12708us total) trans 0 rc 823296/823296 00010000:00010000:3.0:1746147736.571246:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482c00/0xe64d3fbf12a7f91e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:2.0:1746147736.571253:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7816 00000004:00200000:3.0:1746147736.571254:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00002000:00100000:2.0:1746147736.571261:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009172ed80 x1830967794296448/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.571270:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172ed80 with x1830967794296448 ext(4194304->5017599) 00002000:00010000:2.0:1746147736.571275:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172ed80 00010000:00010000:3.0:1746147736.571324:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482c00/0xe64d3fbf12a7f91e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571330:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482c00/0xe64d3fbf12a7f91e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571336:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482c00/0xe64d3fbf12a7f91e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571342:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5482c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147736.571346:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482c00/0xe64d3fbf12a7f91e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571352:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482c00/0xe64d3fbf12a7f91e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571362:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147736.571365:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147736.571368:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482c00/0xe64d3fbf12a7f91e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571373:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482c00/0xe64d3fbf12a7f91e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571401:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482800/0xe64d3fbf12a7f910 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571407:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482800/0xe64d3fbf12a7f910 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571411:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482800/0xe64d3fbf12a7f910 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571415:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5482800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147736.571417:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482800/0xe64d3fbf12a7f910 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571421:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482800/0xe64d3fbf12a7f910 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571427:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147736.571429:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147736.571431:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482800/0xe64d3fbf12a7f910 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571436:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482800/0xe64d3fbf12a7f910 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571443:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482a00/0xe64d3fbf12a7f917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571447:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482a00/0xe64d3fbf12a7f917 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571451:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482a00/0xe64d3fbf12a7f917 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571455:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5482a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147736.571458:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482a00/0xe64d3fbf12a7f917 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571462:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482a00/0xe64d3fbf12a7f917 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571468:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcc4300) 00010000:00010000:3.0:1746147736.571470:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147736.571472:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482a00/0xe64d3fbf12a7f917 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571477:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482a00/0xe64d3fbf12a7f917 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.571504:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482600/0xe64d3fbf12a7f909 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdf6 expref: 326 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.571511:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482600/0xe64d3fbf12a7f909 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdf6 expref: 326 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.571517:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5482600, rc 0) 00000100:00100000:3.0:1746147736.571535:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32623:x1830967794296960:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 579us (772us total) trans 8589946200 rc 301/301 00000100:00100000:3.0:1746147736.571541:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12168 00000100:00100000:2.0:1746147736.581540:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1959:x1830967794296704:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11825us (12565us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147736.581553:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7817 00002000:00100000:2.0:1746147736.581564:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009172c380 x1830967794296704/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.581573:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009172c380 with x1830967794296704 ext(4194304->5017599) 00002000:00010000:2.0:1746147736.581579:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009172c380 00000100:00100000:0.0:1746147736.666011:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.666075:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794297216 00000100:00100000:3.0:1746147736.666085:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794297216 00000100:00100000:3.0:1746147736.666144:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12169 00000100:00100000:3.0:1746147736.666152:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32627:x1830967794297216:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147736.666178:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.666196:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f92c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcdfd expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.666303:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483000/0xe64d3fbf12a7f933 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666314:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483000/0xe64d3fbf12a7f933 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666325:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483000/0xe64d3fbf12a7f933 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666339:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f93a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666343:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f93a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666347:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f93a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666600:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483400/0xe64d3fbf12a7f941 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666646:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483400/0xe64d3fbf12a7f941 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666658:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483400/0xe64d3fbf12a7f941 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:3.0:1746147736.666668:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147736.666739:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483400/0xe64d3fbf12a7f941 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666745:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483400/0xe64d3fbf12a7f941 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666754:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483400/0xe64d3fbf12a7f941 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666759:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5483400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147736.666762:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483400/0xe64d3fbf12a7f941 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666768:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483400/0xe64d3fbf12a7f941 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666776:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147736.666779:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147736.666782:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483400/0xe64d3fbf12a7f941 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666786:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483400/0xe64d3fbf12a7f941 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666826:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483000/0xe64d3fbf12a7f933 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666831:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483000/0xe64d3fbf12a7f933 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666835:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483000/0xe64d3fbf12a7f933 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666839:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5483000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147736.666841:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483000/0xe64d3fbf12a7f933 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666845:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483000/0xe64d3fbf12a7f933 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666854:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147736.666856:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147736.666859:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483000/0xe64d3fbf12a7f933 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666863:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483000/0xe64d3fbf12a7f933 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666870:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f93a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666874:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f93a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666878:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f93a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666937:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5483200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147736.666939:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f93a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666944:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f93a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666950:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcc4300) 00010000:00010000:3.0:1746147736.666952:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147736.666954:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f93a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666958:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f93a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.666998:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f92c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdfd expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.667006:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f92c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdfd expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.667013:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5482e00, rc 0) 00000100:00100000:3.0:1746147736.667441:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32627:x1830967794297216:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1284us (1433us total) trans 8589946201 rc 301/301 00000100:00100000:3.0:1746147736.667450:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12169 00000100:00100000:0.0:1746147736.713707:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.715393:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794297472 00000100:00100000:3.0:1746147736.715405:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794297472 00000100:00100000:3.0:1746147736.715472:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12170 00000100:00100000:3.0:1746147736.715480:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009172c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32632:x1830967794297472:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147736.715507:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.715527:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483600/0xe64d3fbf12a7f94f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce04 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.715645:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f956 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.715657:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f956 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.715666:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f956 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.715679:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f95d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.715684:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f95d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.715689:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f95d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.715783:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483c00/0xe64d3fbf12a7f964 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.715791:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483c00/0xe64d3fbf12a7f964 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.715797:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483c00/0xe64d3fbf12a7f964 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:3.0:1746147736.715806:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147736.715899:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483c00/0xe64d3fbf12a7f964 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.715906:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483c00/0xe64d3fbf12a7f964 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.715912:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483c00/0xe64d3fbf12a7f964 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.715917:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5483c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147736.715920:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483c00/0xe64d3fbf12a7f964 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.715926:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483c00/0xe64d3fbf12a7f964 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.715935:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147736.715937:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147736.715940:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483c00/0xe64d3fbf12a7f964 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.715949:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483c00/0xe64d3fbf12a7f964 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716265:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f956 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716270:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f956 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716274:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f956 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716277:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5483800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147736.716279:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f956 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716283:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f956 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716289:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147736.716290:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147736.716293:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f956 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716297:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f956 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716303:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f95d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716307:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f95d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716311:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f95d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716315:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5483a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147736.716317:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f95d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716321:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f95d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716325:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcc4100) 00010000:00010000:3.0:1746147736.716326:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147736.716328:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f95d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716331:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f95d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.716358:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483600/0xe64d3fbf12a7f94f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce04 expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.716364:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483600/0xe64d3fbf12a7f94f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce04 expref: 13 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.716370:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5483600, rc 0) 00000100:00100000:3.0:1746147736.716427:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009172c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32632:x1830967794297472:12345-192.168.202.10@tcp:101:cat.0 Request processed in 948us (2730us total) trans 8589946202 rc 301/301 00000100:00100000:3.0:1746147736.716433:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12170 00000100:00100000:0.0:1746147736.721560:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.721671:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794297728 00000100:00100000:2.0:1746147736.721681:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794297728 00000100:00100000:2.0:1746147736.721843:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5087 00000100:00100000:2.0:1746147736.721853:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a9e7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32632:x1830967794297728:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:2.0:1746147736.724639:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a9e7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32632:x1830967794297728:12345-192.168.202.10@tcp:35:cat.0 Request processed in 2776us (3078us total) trans 8589946203 rc 0/0 00000100:00100000:2.0:1746147736.724651:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5087 00000100:00100000:0.0:1746147736.728638:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.730564:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794297984 00000100:00100000:3.0:1746147736.730576:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794297984 00000100:00100000:3.0:1746147736.730652:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12171 00000100:00100000:3.0:1746147736.730661:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32633:x1830967794297984:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147736.730684:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.730700:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483e00/0xe64d3fbf12a7f972 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce0b expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147736.730733:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.730804:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794298112 00000100:00100000:0.0:1746147736.730811:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794298112 00000100:00100000:0.0:1746147736.730843:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12172 00000100:00100000:0.0:1746147736.730849:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32632:x1830967794298112:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147736.730866:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147736.730880:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7f979 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce12 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.730971:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7f980 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147736.730985:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7f980 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147736.730996:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7f980 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746147736.731020:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:0.0:1746147736.731024:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147736.731039:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7f980 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147736.731059:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5652a00/0xe64d3fbf12a7f979 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce12 expref: 15 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.731092:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7f980 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce12 expref: 14 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.731101:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147736.731104:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147736.731107:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9213a00, rc 0) 00010000:00010000:3.0:1746147736.731115:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483600/0xe64d3fbf12a7f987 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731125:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483600/0xe64d3fbf12a7f987 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731134:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483600/0xe64d3fbf12a7f987 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731145:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f98e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147736.731149:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32632:x1830967794298112:12345-192.168.202.10@tcp:101:cat.0 Request processed in 300us (420us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147736.731150:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f98e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731155:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f98e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147736.731156:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12172 00010000:00010000:3.0:1746147736.731237:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f995 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731244:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f995 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731250:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f995 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:3.0:1746147736.731257:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147736.731321:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f995 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731331:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f995 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731336:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f995 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731341:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5483800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147736.731344:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f995 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731349:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f995 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731358:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147736.731360:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147736.731364:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f995 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731367:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483800/0xe64d3fbf12a7f995 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731394:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483600/0xe64d3fbf12a7f987 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731399:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483600/0xe64d3fbf12a7f987 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731403:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483600/0xe64d3fbf12a7f987 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731407:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5483600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147736.731408:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483600/0xe64d3fbf12a7f987 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731416:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483600/0xe64d3fbf12a7f987 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731421:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147736.731423:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147736.731426:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483600/0xe64d3fbf12a7f987 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731429:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483600/0xe64d3fbf12a7f987 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731436:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f98e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731439:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f98e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731443:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f98e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731447:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5483a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147736.731449:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f98e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731453:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f98e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731457:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcc4b00) 00010000:00010000:3.0:1746147736.731459:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147736.731460:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f98e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731464:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483a00/0xe64d3fbf12a7f98e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147736.731493:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483e00/0xe64d3fbf12a7f972 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce0b expref: 327 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.731499:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5483e00/0xe64d3fbf12a7f972 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce0b expref: 327 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.731506:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5483e00, rc 0) 00000100:00100000:3.0:1746147736.731557:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32633:x1830967794297984:12345-192.168.202.10@tcp:101:cat.0 Request processed in 898us (2930us total) trans 8589946204 rc 301/301 00000100:00100000:3.0:1746147736.731563:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12171 00000100:00100000:1.0:1746147736.736633:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.736702:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794298368 00000100:00100000:2.0:1746147736.736711:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794298368 00000100:00100000:2.0:1746147736.736761:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5088 00000100:00100000:2.0:1746147736.736770:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+326:32633:x1830967794298368:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:2.0:1746147736.737002:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32633:x1830967794298368:12345-192.168.202.10@tcp:35:cat.0 Request processed in 233us (379us total) trans 8589946205 rc 0/0 00000100:00100000:2.0:1746147736.737009:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5088 00000100:00100000:3.0:1746147736.739532:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.739987:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.740190:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794298624 00000100:00100000:2.0:1746147736.740198:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794298624 00000100:00100000:2.0:1746147736.740243:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12173 00000100:00100000:2.0:1746147736.740249:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+327:32633:x1830967794298624:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147736.740270:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.740288:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9a3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce19 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.740363:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d200/0xe64d3fbf12a7f9aa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.740377:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d200/0xe64d3fbf12a7f9aa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.740388:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d200/0xe64d3fbf12a7f9aa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147736.740412:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147736.740416:0:14546:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147736.740428:0:14546:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d200/0xe64d3fbf12a7f9aa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:3.0:1746147736.741044:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.741722:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794298752 00000100:00100000:0.0:1746147736.741728:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794298752 00002000:00100000:0.0:1746147736.741762:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009d0dd500 x1830967794298752/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147736.741771:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dd500 with x1830967794298752 ext(0->1048575) 00002000:00010000:0.0:1746147736.741775:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d0dd500 00000100:00100000:0.0:1746147736.741797:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794299008 00000100:00100000:0.0:1746147736.741800:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794299008 00002000:00100000:0.0:1746147736.741812:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009d0dc000 x1830967794299008/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147736.741819:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dc000 with x1830967794299008 ext(1048576->2097151) 00002000:00010000:0.0:1746147736.741822:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0dc000 00000100:00100000:0.0:1746147736.741832:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7818 00000100:00100000:0.0:1746147736.741837:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794298752:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147736.742343:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7819 00000100:00100000:1.0:1746147736.742351:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967794299008:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:2.0:1746147736.742549:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9a3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce19 expref: 329 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.742572:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d200/0xe64d3fbf12a7f9aa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce19 expref: 328 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.742580:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147736.742583:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147736.742586:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd1d200, rc 0) 00000100:00100000:2.0:1746147736.742651:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32633:x1830967794298624:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2402us (3127us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.742658:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12173 00000100:00100000:0.0:1746147736.755837:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.756131:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794299136 00000100:00100000:2.0:1746147736.756141:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794299136 00000100:00100000:2.0:1746147736.756716:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17365 00000100:00100000:2.0:1746147736.756725:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32623:x1830967794299136:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147736.756745:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.756763:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce20 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.756795:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f8df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdcc expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.756803:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f8f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde1 expref: 31 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.756809:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.756810:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.756813:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1867776->2097151] (req 1867776->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 31 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.756842:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f8f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde1 expref: 31 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.756852:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f8f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde1 expref: 31 pid: 9615 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.756864:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796596736:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147736.758413:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f8df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdcc expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.758429:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f8df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdcc expref: 29 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.758441:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796596864:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147736.758849:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147736.759931:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967794299008:12345-192.168.202.10@tcp:3:cat.0 Request processed in 17576us (18884us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147736.759942:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7819 00002000:00100000:1.0:1746147736.759953:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff88009d0dc000 x1830967794299008/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.759964:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dc000 with x1830967794299008 ext(1048576->2097151) 00002000:00010000:1.0:1746147736.759969:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d0dc000 00000100:00100000:0.0:1746147736.760927:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.761347:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794298752:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19506us (21357us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147736.761356:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7818 00002000:00100000:1.0:1746147736.761362:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009d0dd500 x1830967794298752/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.761370:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d0dd500 with x1830967794298752 ext(0->1048575) 00002000:00010000:1.0:1746147736.761374:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d0dd500 00000100:00100000:3.0:1746147736.761461:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794299264 00000100:00100000:3.0:1746147736.761468:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794299264 00000100:00100000:3.0:1746147736.761495:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17366 00000100:00100000:3.0:1746147736.761500:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32627:x1830967794299264:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147736.761514:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.761529:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce27 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.761554:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800986f7400/0xe64d3fbf12a7f7c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd1d expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.761561:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7f87d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd8d expref: 31 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.761569:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3600/0xe64d3fbf12a7f7f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd47 expref: 29 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.761574:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.761575:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.761577:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [2285568->3080191] (req 2285568->3080191) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 29 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.761600:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3600/0xe64d3fbf12a7f7f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd47 expref: 29 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.761607:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3600/0xe64d3fbf12a7f7f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd47 expref: 29 pid: 7050 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.761629:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796596992:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.761682:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7f87d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd8d expref: 31 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.761688:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7f87d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd8d expref: 31 pid: 7050 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.761693:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796597120:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.761708:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800986f7400/0xe64d3fbf12a7f7c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd1d expref: 12 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147736.761717:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800986f7400/0xe64d3fbf12a7f7c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd1d expref: 12 pid: 8470 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.761721:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796597248:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147736.761730:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.762316:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.762386:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796596736:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147736.762394:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796596864:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147736.762414:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1867776->2097151] (req 1867776->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 31 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.762426:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd1d400, rc 0) 00000100:00100000:2.0:1746147736.762457:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:32623:x1830967794299136:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5733us (6630us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.762466:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17365 00000100:00100000:2.0:1746147736.762501:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794299392 00000100:00100000:2.0:1746147736.762504:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794299392 00010000:00010000:2.0:1746147736.762518:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f8f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde1 expref: 31 pid: 9615 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.762546:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8862 00000100:00100000:2.0:1746147736.762551:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1958:x1830967794299392:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.762561:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.762580:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f8f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde1 expref: 31 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.762590:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f8f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde1 expref: 31 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.762667:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7f8f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde1 expref: 31 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.762682:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.762701:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967794299392:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 150us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.762707:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8862 00000100:00100000:2.0:1746147736.765983:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.766009:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794299776 00000100:00100000:2.0:1746147736.766017:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794299776 00000100:00100000:3.0:1746147736.766052:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796596992:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147736.766053:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800986f7400/0xe64d3fbf12a7f7c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd1d expref: 13 pid: 8470 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746147736.766066:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796597120:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147736.766082:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8863 00000100:00100000:2.0:1746147736.766089:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+13:1957:x1830967794299776:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.766105:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.766126:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800986f7400/0xe64d3fbf12a7f7c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd1d expref: 13 pid: 8470 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.766135:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800986f7400/0xe64d3fbf12a7f7c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd1d expref: 13 pid: 8470 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.766160:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.766197:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+13:1957:x1830967794299776:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 109us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.766204:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8863 00000100:00100000:2.0:1746147736.766245:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.766257:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794299648 00000100:00100000:2.0:1746147736.766260:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794299648 00010000:00010000:3.0:1746147736.766265:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800986f7400/0xe64d3fbf12a7f7c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd1d expref: 12 pid: 8470 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.766269:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3600/0xe64d3fbf12a7f7f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd47 expref: 30 pid: 7050 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746147736.766284:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8864 00000100:00100000:2.0:1746147736.766288:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1957:x1830967794299648:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.766294:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147736.766295:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796597248:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147736.766301:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3600/0xe64d3fbf12a7f7f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd47 expref: 30 pid: 7050 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.766314:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3600/0xe64d3fbf12a7f7f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd47 expref: 30 pid: 7050 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.766327:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57b3600/0xe64d3fbf12a7f7f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd47 expref: 30 pid: 7050 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746147736.766328:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 6 type: EXT [2285568->3080191] (req 2285568->3080191) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 30 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.766338:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147736.766342:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5482400, rc 0) 00000100:00100000:2.0:1746147736.766351:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1957:x1830967794299648:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 62us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.766356:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8864 00000100:00100000:3.0:1746147736.766385:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32627:x1830967794299264:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4883us (5461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.766392:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17366 00000100:00100000:1.0:1746147736.769451:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.769507:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.769759:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794299520 00000100:00100000:2.0:1746147736.769768:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794299520 00010000:00010000:2.0:1746147736.769803:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f8df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdcc expref: 28 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.769839:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794299904 00000100:00100000:2.0:1746147736.769842:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794299904 00010000:00010000:2.0:1746147736.769854:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7f87d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd8d expref: 30 pid: 7050 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746147736.769861:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8865 00000100:00100000:0.0:1746147736.769871:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967794299520:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147736.769899:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147736.769920:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f8df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdcc expref: 28 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746147736.769931:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f8df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdcc expref: 28 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746147736.769954:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0249a00/0xe64d3fbf12a7f8df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdcc expref: 28 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746147736.769981:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.769984:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.769991:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.770004:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.770036:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.770048:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c264e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796597376:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147736.770118:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6170c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147736.771149:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8866 00000100:00100000:2.0:1746147736.771158:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794299904:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147736.771171:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147736.771187:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7f87d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd8d expref: 30 pid: 7050 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.771202:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7f87d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd8d expref: 30 pid: 7050 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.771222:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7f87d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd8d expref: 30 pid: 7050 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746147736.771237:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.771238:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147736.771243:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->3080191) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.771250:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->3080191) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.771272:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->3080191) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147736.771282:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe42d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796597504:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147736.771317:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.771339:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147736.771360:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794300032 00000100:00100000:2.0:1746147736.771363:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794300032 00000100:00100000:2.0:1746147736.771459:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17367 00000100:00100000:2.0:1746147736.771466:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32632:x1830967794300032:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147736.771480:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.771492:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd1ca00/0xe64d3fbf12a7f9bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce2e expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.771508:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.771514:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147736.771515:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147736.771518:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd1ca00/0xe64d3fbf12a7f9bf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce2e expref: 29 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.771536:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.771546:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 29 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746147736.771555:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796597632:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147736.771589:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c226c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147736.773356:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.773378:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c264e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796597376:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147736.773446:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.773462:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794300288 00000100:00100000:1.0:1746147736.773467:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794300288 00002000:00100000:1.0:1746147736.773499:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1867776->1871871) req@ffff88012f517100 x1830967794300288/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.773508:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f517100 with x1830967794300288 ext(1867776->1871871) 00010000:00010000:1.0:1746147736.773515:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 30 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746147736.773527:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 30 pid: 4591 timeout: 915 lvb_type: 0 00002000:00010000:1.0:1746147736.773533:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f517100 00010000:00010000:2.0:1746147736.773570:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.773604:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967794299520:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3735us (4162us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.773622:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8865 00000100:00100000:2.0:1746147736.773651:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe42d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796597504:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147736.773660:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.773674:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794299904:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2519us (4168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.773682:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8866 00000100:00100000:2.0:1746147736.773703:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794300544 00000100:00100000:2.0:1746147736.773707:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794300544 00002000:00100000:2.0:1746147736.773721:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2285568->2289663) req@ffff88012f514000 x1830967794300544/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.773729:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514000 with x1830967794300544 ext(2285568->2289663) 00002000:00010000:2.0:1746147736.773732:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f514000 00000100:00100000:2.0:1746147736.773744:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1589 00000100:00100000:2.0:1746147736.773748:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967794300288:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147736.773841:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7820 00000100:00100000:1.0:1746147736.773848:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967794300544:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147736.773877:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967794300288:12345-192.168.202.10@tcp:3:cat.0 Request processed in 128us (527us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147736.773897:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1589 00002000:00100000:2.0:1746147736.773902:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x455:0x0] (1867776->1871871) req@ffff88012f517100 x1830967794300288/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/4536 e 0 to 0 dl 1746147747 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.773909:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f517100 with x1830967794300288 ext(1867776->1871871) 00010000:00010000:2.0:1746147736.773913:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 29 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.773922:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 29 pid: 4591 timeout: 915 lvb_type: 0 00002000:00010000:2.0:1746147736.773928:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f517100 00000100:00100000:1.0:1746147736.773934:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967794300544:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 86us (487us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147736.773944:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7820 00002000:00100000:1.0:1746147736.773949:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2285568->2289663) req@ffff88012f514000 x1830967794300544/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/4536 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147736.773956:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f514000 with x1830967794300544 ext(2285568->2289663) 00002000:00010000:1.0:1746147736.773959:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f514000 00000100:00100000:3.0:1746147736.774042:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796597632:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.774059:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd1ca00/0xe64d3fbf12a7f9bf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce2e expref: 28 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.774075:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd1ca00, rc 0) 00000100:00100000:3.0:1746147736.774095:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32632:x1830967794300032:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2629us (2778us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.774100:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17367 00000100:00100000:0.0:1746147736.777669:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.777725:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.777730:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794300800 00000100:00100000:2.0:1746147736.777739:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794300800 00000100:00100000:3.0:1746147736.777769:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794300928 00000100:00100000:3.0:1746147736.777772:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794300928 00002000:00100000:2.0:1746147736.777780:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x455:0x0] (1867776->2097151) req@ffff88009c265500 x1830967794300800/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.777788:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c265500 with x1830967794300800 ext(1867776->2097151) 00010000:00010000:2.0:1746147736.777796:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 29 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.777806:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17368 00010000:00010000:2.0:1746147736.777809:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 29 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.777812:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:32623:x1830967794300928:12345-192.168.202.10@tcp:101:multiop.0 00002000:00010000:2.0:1746147736.777815:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c265500 00010000:00010000:3.0:1746147736.777823:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147736.777833:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1590 00010000:00010000:3.0:1746147736.777837:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce35 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147736.777838:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967794300800:12345-192.168.202.10@tcp:4:cat.0 00010000:00010000:3.0:1746147736.777860:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd1c600/0xe64d3fbf12a7f8ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdda expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.777866:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f8fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde8 expref: 45 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.777871:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.777872:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.777875:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1814527] (req 1048576->1814527) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 45 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.777921:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f8fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde8 expref: 45 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.778165:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f8fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde8 expref: 45 pid: 9615 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.778178:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796597760:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.778678:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd1c600/0xe64d3fbf12a7f8ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdda expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.778688:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bd1c600/0xe64d3fbf12a7f8ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdda expref: 25 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.778696:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796597888:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147736.778718:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147736.779294:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.779828:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794301184 00000100:00100000:2.0:1746147736.779833:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794301184 00002000:00100000:2.0:1746147736.779860:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x456:0x0] (3076096->3080191) req@ffff88009c264000 x1830967794301184/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.779869:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c264000 with x1830967794301184 ext(3076096->3080191) 00002000:00010000:2.0:1746147736.779873:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c264000 00000100:00100000:2.0:1746147736.779918:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7821 00000100:00100000:2.0:1746147736.779925:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967794301184:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147736.780078:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967794301184:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 152us (784us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147736.780085:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7821 00002000:00100000:2.0:1746147736.780091:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x456:0x0] (3076096->3080191) req@ffff88009c264000 x1830967794301184/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/4536 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.780104:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c264000 with x1830967794301184 ext(3076096->3080191) 00002000:00010000:2.0:1746147736.780107:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c264000 00000100:00100000:3.0:1746147736.781335:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796597760:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147736.781371:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796597888:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.781394:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1814527] (req 1048576->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 45 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.781407:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5483200, rc 0) 00000100:00100000:3.0:1746147736.781437:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:32623:x1830967794300928:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3624us (3711us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.781444:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17368 00000100:00100000:0.0:1746147736.782269:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.782531:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794301312 00000100:00100000:3.0:1746147736.782536:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794301312 00010000:00010000:3.0:1746147736.782562:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd1c600/0xe64d3fbf12a7f8ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdda expref: 26 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.782584:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8867 00000100:00100000:3.0:1746147736.782590:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967794301312:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147736.782601:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147736.782630:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd1c600/0xe64d3fbf12a7f8ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdda expref: 26 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.782640:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd1c600/0xe64d3fbf12a7f8ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdda expref: 26 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.782660:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd1c600/0xe64d3fbf12a7f8ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdda expref: 26 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.782684:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147736.782708:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967794301312:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 118us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.782714:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8867 00000100:00100000:2.0:1746147736.782784:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967794300800:12345-192.168.202.10@tcp:4:cat.0 Request processed in 4945us (5124us total) trans 21474841755 rc 0/0 00000100:00100000:2.0:1746147736.782791:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1590 00002000:00100000:2.0:1746147736.782798:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1867776->2097151) req@ffff88009c265500 x1830967794300800/t21474841755(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/448 e 0 to 0 dl 1746147747 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.782805:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c265500 with x1830967794300800 ext(1867776->2097151) 00010000:00010000:2.0:1746147736.782812:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 31 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.782820:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 31 pid: 4591 timeout: 915 lvb_type: 0 00002000:00010000:2.0:1746147736.782826:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c265500 00000100:00100000:1.0:1746147736.783495:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147736.783549:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.783600:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794301696 00000100:00100000:0.0:1746147736.783605:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794301696 00000100:00100000:0.0:1746147736.783640:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5089 00000100:00100000:0.0:1746147736.783645:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32627:x1830967794301696:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:0.0:1746147736.783790:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32627:x1830967794301696:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 143us (239us total) trans 8589946206 rc 0/0 00000100:00100000:0.0:1746147736.783796:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5089 00000100:00100000:0.0:1746147736.783812:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794301440 00000100:00100000:0.0:1746147736.783815:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794301440 00010000:00010000:0.0:1746147736.783826:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f8fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde8 expref: 45 pid: 9615 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746147736.783845:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8868 00000100:00100000:0.0:1746147736.783851:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1959:x1830967794301440:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147736.783859:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147736.783869:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f8fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde8 expref: 45 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746147736.783906:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f8fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde8 expref: 45 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746147736.783920:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5286c00/0xe64d3fbf12a7f8fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcde8 expref: 45 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746147736.783934:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.783936:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147736.783943:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 44 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.783955:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 44 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147736.783986:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 44 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147736.783998:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c266a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796598016:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147736.784658:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6170c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147736.784803:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.784904:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794301824 00000100:00100000:3.0:1746147736.784908:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794301824 00010000:00010000:3.0:1746147736.784923:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 31 pid: 4591 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.784971:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8869 00000100:00100000:3.0:1746147736.784976:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1958:x1830967794301824:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147736.784984:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147736.784997:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 31 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.785005:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 31 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.785019:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1d400/0xe64d3fbf12a7f9b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce20 expref: 31 pid: 4591 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.785029:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.785030:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.785034:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1ca00/0xe64d3fbf12a7f9bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce2e expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.785041:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd1ca00/0xe64d3fbf12a7f9bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce2e expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.785060:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd1ca00/0xe64d3fbf12a7f9bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce2e expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147736.785069:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796598144:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147736.785362:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147736.787768:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c266a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7095:1830967796598016:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147736.787786:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147736.787827:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1959:x1830967794301440:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3975us (4332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147736.787835:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8868 00000100:00100000:3.0:1746147736.787947:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796598144:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147736.787955:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147736.787967:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1958:x1830967794301824:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2992us (3165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.787971:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8869 00000100:00100000:0.0:1746147736.788425:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.788702:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794302080 00000100:00100000:2.0:1746147736.788709:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794302080 00002000:00100000:2.0:1746147736.788743:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009c266d80 x1830967794302080/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.788756:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c266d80 with x1830967794302080 ext(1048576->2097151) 00002000:00010000:2.0:1746147736.788760:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c266d80 00000100:00100000:2.0:1746147736.788776:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7822 00000100:00100000:2.0:1746147736.788782:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967794302080:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147736.790955:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.791599:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794302336 00000100:00100000:2.0:1746147736.791615:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794302336 00002000:00100000:2.0:1746147736.791653:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x457:0x0] (1810432->1814527) req@ffff88009fce5f80 x1830967794302336/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.791663:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce5f80 with x1830967794302336 ext(1810432->1814527) 00002000:00010000:2.0:1746147736.791668:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fce5f80 00000100:00100000:2.0:1746147736.791698:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7823 00000100:00100000:2.0:1746147736.791705:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1959:x1830967794302336:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147736.791828:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1959:x1830967794302336:12345-192.168.202.10@tcp:3:cat.0 Request processed in 123us (879us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147736.791835:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7823 00002000:00100000:2.0:1746147736.791840:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x457:0x0] (1810432->1814527) req@ffff88009fce5f80 x1830967794302336/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/4536 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.791846:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce5f80 with x1830967794302336 ext(1810432->1814527) 00002000:00010000:2.0:1746147736.791849:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fce5f80 00000100:00100000:2.0:1746147736.796197:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1957:x1830967794302080:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 7401us (7758us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147736.796210:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7822 00002000:00100000:2.0:1746147736.796222:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009c266d80 x1830967794302080/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.796231:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c266d80 with x1830967794302080 ext(1048576->2097151) 00002000:00010000:2.0:1746147736.796237:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c266d80 00000100:00100000:0.0:1746147736.796971:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.797023:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794302592 00000100:00100000:2.0:1746147736.797030:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794302592 00000100:00100000:2.0:1746147736.797059:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5090 00000100:00100000:2.0:1746147736.797065:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+328:32623:x1830967794302592:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:2.0:1746147736.797317:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:32623:x1830967794302592:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 251us (348us total) trans 8589946207 rc 0/0 00000100:00100000:2.0:1746147736.797323:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5090 00000100:00100000:0.0:1746147736.800995:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.801039:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794302720 00000100:00100000:3.0:1746147736.801048:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794302720 00000100:00100000:3.0:1746147736.801094:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17369 00000100:00100000:3.0:1746147736.801100:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32632:x1830967794302720:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147736.801118:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147736.801135:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f9cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce3c expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.801164:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 43 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.801170:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147736.801172:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147736.801175:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f9cd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce3c expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.801201:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 43 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.801211:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 43 pid: 9615 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.801222:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796598272:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147736.801310:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147736.803189:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796598272:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147736.803219:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f9cd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce3c expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.803241:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5482e00, rc 0) 00000100:00100000:3.0:1746147736.803286:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32632:x1830967794302720:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2185us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.803294:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17369 00000100:00100000:0.0:1746147736.803774:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.803814:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794302848 00000100:00100000:2.0:1746147736.803821:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794302848 00002000:00100000:2.0:1746147736.803856:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1814527) req@ffff88009c266a00 x1830967794302848/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.803866:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c266a00 with x1830967794302848 ext(1048576->1814527) 00010000:00010000:2.0:1746147736.803872:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 44 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.803913:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 44 pid: 9615 timeout: 915 lvb_type: 0 00002000:00010000:2.0:1746147736.803920:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c266a00 00000100:00100000:2.0:1746147736.803936:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1591 00000100:00100000:2.0:1746147736.803943:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+44:1959:x1830967794302848:12345-192.168.202.10@tcp:4:cat.0 00010000:00010000:2.0:1746147736.809046:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147736.819576:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1959:x1830967794302848:12345-192.168.202.10@tcp:4:cat.0 Request processed in 15619us (15789us total) trans 17179874530 rc 0/0 00000100:00100000:2.0:1746147736.819591:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1591 00002000:00100000:2.0:1746147736.819605:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1814527) req@ffff88009c266a00 x1830967794302848/t17179874530(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:357/0 lens 488/448 e 0 to 0 dl 1746147747 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.819628:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c266a00 with x1830967794302848 ext(1048576->1814527) 00010000:00010000:2.0:1746147736.819638:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 46 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746147736.819656:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 46 pid: 9615 timeout: 915 lvb_type: 0 00002000:00010000:2.0:1746147736.819664:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c266a00 00000100:00100000:0.0:1746147736.825484:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147736.825864:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794302976 00000100:00100000:3.0:1746147736.825873:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794302976 00010000:00010000:3.0:1746147736.825942:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 46 pid: 9615 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746147736.825980:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8870 00000100:00100000:3.0:1746147736.825987:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1958:x1830967794302976:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147736.826002:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147736.826023:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 46 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.826034:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 46 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.826058:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5483200/0xe64d3fbf12a7f9c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce35 expref: 46 pid: 9615 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746147736.826826:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.826828:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147736.826838:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f9cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce3c expref: 25 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.826852:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f9cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce3c expref: 25 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147736.827014:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f9cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce3c expref: 25 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147736.827027:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796598400:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147736.827324:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147736.832447:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796598400:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147736.832470:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147736.832517:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1958:x1830967794302976:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6529us (7044us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147736.832527:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8870 00000100:00100000:0.0:1746147736.832748:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.833524:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794303232 00000100:00100000:2.0:1746147736.833531:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794303232 00002000:00100000:2.0:1746147736.833571:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009fc10380 x1830967794303232/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.833581:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10380 with x1830967794303232 ext(1048576->2097151) 00002000:00010000:2.0:1746147736.833586:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc10380 00000100:00100000:2.0:1746147736.833603:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7824 00000100:00100000:2.0:1746147736.833622:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794303232:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147736.845201:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794303232:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 11578us (12440us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147736.845220:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7824 00002000:00100000:2.0:1746147736.845234:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009fc10380 x1830967794303232/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.845245:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc10380 with x1830967794303232 ext(1048576->2097151) 00002000:00010000:2.0:1746147736.845252:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc10380 00000100:00100000:0.0:1746147736.855107:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.855178:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794303488 00000100:00100000:2.0:1746147736.855188:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794303488 00002000:00100000:2.0:1746147736.855234:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3940351) req@ffff88009fc11500 x1830967794303488/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 504/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.855245:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc11500 with x1830967794303488 ext(2097152->3940351) 00002000:00010000:2.0:1746147736.855250:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc11500 00000100:00100000:2.0:1746147736.855279:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7825 00000100:00100000:2.0:1746147736.855287:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967794303488:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147736.855765:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147736.860774:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794303744 00000100:00100000:0.0:1746147736.860789:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794303744 00002000:00100000:0.0:1746147736.860838:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x456:0x0] (3940352->4194303) req@ffff88009fce7480 x1830967794303744/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/0 e 0 to 0 dl 1746147747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147736.860849:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce7480 with x1830967794303744 ext(3940352->4194303) 00002000:00010000:0.0:1746147736.860855:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fce7480 00000100:00100000:1.0:1746147736.860909:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7826 00000100:00100000:1.0:1746147736.860919:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967794303744:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147736.874481:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967794303744:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13552us (18704us total) trans 0 rc 253952/253952 00000100:00100000:2.0:1746147736.874494:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7826 00002000:00100000:2.0:1746147736.874506:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (3940352->4194303) req@ffff88009fce7480 x1830967794303744/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 488/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 253952/253952 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.874515:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce7480 with x1830967794303744 ext(3940352->4194303) 00002000:00010000:2.0:1746147736.874521:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fce7480 00000100:00100000:2.0:1746147736.875961:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1960:x1830967794303488:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20669us (20859us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147736.875970:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7825 00002000:00100000:2.0:1746147736.875979:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3940351) req@ffff88009fc11500 x1830967794303488/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:357/0 lens 504/440 e 0 to 0 dl 1746147747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147736.875987:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc11500 with x1830967794303488 ext(2097152->3940351) 00002000:00010000:2.0:1746147736.875991:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc11500 00000100:00100000:0.0:1746147736.913817:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.913929:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794304000 00000100:00100000:2.0:1746147736.913938:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794304000 00000100:00100000:2.0:1746147736.914001:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12174 00000100:00100000:2.0:1746147736.914010:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+329:32639:x1830967794304000:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147736.914035:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.914055:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c000/0xe64d3fbf12a7f9d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce43 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.914163:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1de00/0xe64d3fbf12a7f9db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914175:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1de00/0xe64d3fbf12a7f9db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914187:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1de00/0xe64d3fbf12a7f9db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914201:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d800/0xe64d3fbf12a7f9e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914206:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d800/0xe64d3fbf12a7f9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914211:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d800/0xe64d3fbf12a7f9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914311:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c200/0xe64d3fbf12a7f9e9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914319:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c200/0xe64d3fbf12a7f9e9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914324:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c200/0xe64d3fbf12a7f9e9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147736.914332:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147736.914406:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c200/0xe64d3fbf12a7f9e9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914412:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c200/0xe64d3fbf12a7f9e9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914418:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c200/0xe64d3fbf12a7f9e9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914424:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bd1c200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147736.914428:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c200/0xe64d3fbf12a7f9e9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914434:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c200/0xe64d3fbf12a7f9e9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914444:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147736.914447:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147736.914451:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c200/0xe64d3fbf12a7f9e9 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914455:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c200/0xe64d3fbf12a7f9e9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914481:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1de00/0xe64d3fbf12a7f9db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914489:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1de00/0xe64d3fbf12a7f9db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914494:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1de00/0xe64d3fbf12a7f9db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914497:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bd1de00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147736.914500:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1de00/0xe64d3fbf12a7f9db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914504:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1de00/0xe64d3fbf12a7f9db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914510:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147736.914512:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147736.914514:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1de00/0xe64d3fbf12a7f9db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914518:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1de00/0xe64d3fbf12a7f9db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914525:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d800/0xe64d3fbf12a7f9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914529:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d800/0xe64d3fbf12a7f9e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914538:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d800/0xe64d3fbf12a7f9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914542:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bd1d800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147736.914544:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d800/0xe64d3fbf12a7f9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914552:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d800/0xe64d3fbf12a7f9e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914557:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a02f4400) 00010000:00010000:2.0:1746147736.914560:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147736.914561:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d800/0xe64d3fbf12a7f9e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914566:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d800/0xe64d3fbf12a7f9e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.914598:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c000/0xe64d3fbf12a7f9d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce43 expref: 331 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.914605:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c000/0xe64d3fbf12a7f9d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce43 expref: 331 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.914624:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd1c000, rc 0) 00000100:00100000:2.0:1746147736.914686:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:32639:x1830967794304000:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 677us (879us total) trans 8589946208 rc 301/301 00000100:00100000:2.0:1746147736.914693:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12174 00000100:00100000:0.0:1746147736.983545:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147736.984402:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794304256 00000100:00100000:2.0:1746147736.984413:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794304256 00000100:00100000:2.0:1746147736.984580:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12175 00000100:00100000:2.0:1746147736.984589:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+330:32642:x1830967794304256:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147736.984641:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147736.984661:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c400/0xe64d3fbf12a7f9f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce4a expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.984774:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1da00/0xe64d3fbf12a7f9fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.984787:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1da00/0xe64d3fbf12a7f9fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.984799:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1da00/0xe64d3fbf12a7f9fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.984811:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.984817:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.984822:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.985916:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d000/0xe64d3fbf12a7fa0c lrc: 3/1,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.985928:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d000/0xe64d3fbf12a7fa0c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.985936:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d000/0xe64d3fbf12a7fa0c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147736.985944:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147736.986029:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d000/0xe64d3fbf12a7fa0c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986036:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d000/0xe64d3fbf12a7fa0c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986046:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d000/0xe64d3fbf12a7fa0c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986052:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bd1d000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147736.986055:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d000/0xe64d3fbf12a7fa0c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986061:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d000/0xe64d3fbf12a7fa0c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986071:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147736.986073:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147736.986077:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d000/0xe64d3fbf12a7fa0c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986081:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d000/0xe64d3fbf12a7fa0c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986108:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1da00/0xe64d3fbf12a7f9fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986113:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1da00/0xe64d3fbf12a7f9fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986118:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1da00/0xe64d3fbf12a7f9fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986122:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bd1da00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147736.986124:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1da00/0xe64d3fbf12a7f9fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986128:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1da00/0xe64d3fbf12a7f9fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986144:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147736.986146:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147736.986148:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1da00/0xe64d3fbf12a7f9fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986153:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1da00/0xe64d3fbf12a7f9fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986159:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986166:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986171:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986175:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bd1cc00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147736.986177:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986181:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986186:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a02f4b00) 00010000:00010000:2.0:1746147736.986187:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147736.986189:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986193:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147736.986227:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c400/0xe64d3fbf12a7f9f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce4a expref: 332 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.986235:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1c400/0xe64d3fbf12a7f9f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce4a expref: 332 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147736.986242:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd1c400, rc 0) 00000100:00100000:2.0:1746147736.986312:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+331:32642:x1830967794304256:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1724us (2777us total) trans 8589946209 rc 301/301 00000100:00100000:2.0:1746147736.986319:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12175 00000100:00100000:0.0:1746147737.018438:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.020119:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794304512 00000100:00100000:3.0:1746147737.020131:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794304512 00000100:00100000:3.0:1746147737.020177:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5091 00000100:00100000:3.0:1746147737.020183:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+331:32642:x1830967794304512:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:1.0:1746147737.020354:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.020387:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794304768 00000100:00100000:1.0:1746147737.020389:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794304768 00000100:00100000:1.0:1746147737.020411:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12176 00000100:00100000:1.0:1746147737.020415:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32647:x1830967794304768:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147737.020427:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147737.020444:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f993000/0xe64d3fbf12a7fa1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce51 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.020529:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992c00/0xe64d3fbf12a7fa21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020542:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992c00/0xe64d3fbf12a7fa21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020552:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992c00/0xe64d3fbf12a7fa21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020563:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992a00/0xe64d3fbf12a7fa28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020568:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992a00/0xe64d3fbf12a7fa28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020573:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992a00/0xe64d3fbf12a7fa28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020681:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa2f lrc: 3/1,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020690:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa2f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020696:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa2f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:1.0:1746147737.020704:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147737.020783:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa2f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020790:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa2f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020795:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa2f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020800:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f992800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147737.020803:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa2f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020808:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa2f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020818:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147737.020821:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147737.020825:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa2f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020829:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa2f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020847:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992c00/0xe64d3fbf12a7fa21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020851:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992c00/0xe64d3fbf12a7fa21 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020856:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992c00/0xe64d3fbf12a7fa21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020859:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f992c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147737.020860:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992c00/0xe64d3fbf12a7fa21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020864:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992c00/0xe64d3fbf12a7fa21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020868:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147737.020869:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147737.020871:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992c00/0xe64d3fbf12a7fa21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020875:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992c00/0xe64d3fbf12a7fa21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020880:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992a00/0xe64d3fbf12a7fa28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020899:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992a00/0xe64d3fbf12a7fa28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020904:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992a00/0xe64d3fbf12a7fa28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020908:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f992a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147737.020910:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992a00/0xe64d3fbf12a7fa28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020914:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992a00/0xe64d3fbf12a7fa28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020919:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fed9a00) 00010000:00010000:1.0:1746147737.020921:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147737.020922:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992a00/0xe64d3fbf12a7fa28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020925:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992a00/0xe64d3fbf12a7fa28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.020953:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f993000/0xe64d3fbf12a7fa1a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce51 expref: 17 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.020958:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f993000/0xe64d3fbf12a7fa1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce51 expref: 17 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.020965:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f993000, rc 0) 00000100:00100000:3.0:1746147737.021141:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+332:32642:x1830967794304512:12345-192.168.202.10@tcp:35:cat.0 Request processed in 957us (2715us total) trans 8589946211 rc 0/0 00000100:00100000:3.0:1746147737.021148:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5091 00000100:00100000:1.0:1746147737.021216:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32647:x1830967794304768:12345-192.168.202.10@tcp:101:cat.0 Request processed in 800us (862us total) trans 8589946210 rc 301/301 00000100:00100000:1.0:1746147737.021221:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12176 00000100:00100000:2.0:1746147737.025085:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.025174:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.025201:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.025224:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794305024 00000100:00100000:2.0:1746147737.025232:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794305024 00000100:00100000:2.0:1746147737.025597:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794304896 00000100:00100000:2.0:1746147737.025601:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794304896 00000100:00100000:0.0:1746147737.025645:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794305152 00000100:00100000:0.0:1746147737.025649:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794305152 00000100:00100000:0.0:1746147737.025667:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17370 00000100:00100000:0.0:1746147737.025673:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1960:x1830967794305024:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147737.025694:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147737.025712:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a734a800/0xe64d3fbf12a7fa3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce5f expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147737.025736:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147737.025738:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147737.025747:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a734a800/0xe64d3fbf12a7fa3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce5f expref: 46 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147737.025767:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a734a800/0xe64d3fbf12a7fa3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce5f expref: 46 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147737.025778:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a734a800, rc 0) 00000100:00100000:0.0:1746147737.025821:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1960:x1830967794305024:12345-192.168.202.10@tcp:101:cat.0 Request processed in 148us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147737.025827:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17370 00000100:00100000:0.0:1746147737.025843:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17371 00000100:00100000:0.0:1746147737.025848:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967794304896:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147737.025855:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147737.025865:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7fa44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce58 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147737.025875:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147737.025876:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147737.025880:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7fa44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce58 expref: 32 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147737.025907:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7fa44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce58 expref: 32 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147737.025913:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a734ac00, rc 0) 00000100:00100000:0.0:1746147737.025928:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967794304896:12345-192.168.202.10@tcp:101:cat.0 Request processed in 79us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147737.025933:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17371 00000100:00100000:0.0:1746147737.025943:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17372 00000100:00100000:0.0:1746147737.025948:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794305152:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147737.025953:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147737.025960:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7fa4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce66 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147737.025993:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce62680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796598528:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147737.026048:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617900 going to sleep for 11 seconds 00000100:00080000:0.0:1746147737.026075:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147737.026078:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147737.026123:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.026434:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794305408 00000100:00100000:1.0:1746147737.026439:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794305408 00000100:00100000:1.0:1746147737.026465:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5092 00000100:00100000:1.0:1746147737.026471:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32647:x1830967794305408:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:1.0:1746147737.026642:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32647:x1830967794305408:12345-192.168.202.10@tcp:35:cat.0 Request processed in 170us (518us total) trans 8589946212 rc 0/0 00000100:00100000:1.0:1746147737.026651:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5092 00000100:00100000:0.0:1746147737.032049:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce62680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796598528:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147737.032086:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7fa4b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce66 expref: 32 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147737.032099:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b10b600/0xe64d3fbf12a7fa4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce66 expref: 32 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147737.032125:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b10b600, rc 0) 00000100:00100000:0.0:1746147737.032180:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794305152:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6230us (6976us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147737.032189:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17372 00000100:00100000:0.0:1746147737.039178:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.039274:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794305664 00000100:00100000:1.0:1746147737.039282:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794305664 00000100:00100000:1.0:1746147737.039334:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12177 00000100:00100000:1.0:1746147737.039340:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32645:x1830967794305664:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147737.039364:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147737.039382:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992a00/0xe64d3fbf12a7fa52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce6d expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.039483:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039496:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039507:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039520:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992e00/0xe64d3fbf12a7fa60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039525:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992e00/0xe64d3fbf12a7fa60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039530:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992e00/0xe64d3fbf12a7fa60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039633:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992600/0xe64d3fbf12a7fa67 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039641:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992600/0xe64d3fbf12a7fa67 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039647:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992600/0xe64d3fbf12a7fa67 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:1.0:1746147737.039655:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:1.0:1746147737.039729:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992600/0xe64d3fbf12a7fa67 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039735:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992600/0xe64d3fbf12a7fa67 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039740:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992600/0xe64d3fbf12a7fa67 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039745:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f992600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147737.039748:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992600/0xe64d3fbf12a7fa67 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039753:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992600/0xe64d3fbf12a7fa67 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039762:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147737.039765:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147737.039768:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992600/0xe64d3fbf12a7fa67 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039772:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992600/0xe64d3fbf12a7fa67 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039782:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039786:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa59 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039794:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039798:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f992800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147737.039799:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039803:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039807:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147737.039808:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147737.039810:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039813:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992800/0xe64d3fbf12a7fa59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039818:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992e00/0xe64d3fbf12a7fa60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039821:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992e00/0xe64d3fbf12a7fa60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039825:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992e00/0xe64d3fbf12a7fa60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039828:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f992e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147737.039829:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992e00/0xe64d3fbf12a7fa60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039833:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992e00/0xe64d3fbf12a7fa60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039841:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fed9a00) 00010000:00010000:1.0:1746147737.039842:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147737.039844:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992e00/0xe64d3fbf12a7fa60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039847:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992e00/0xe64d3fbf12a7fa60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147737.039873:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992a00/0xe64d3fbf12a7fa52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce6d expref: 19 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.039879:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f992a00/0xe64d3fbf12a7fa52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce6d expref: 19 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.039918:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f992a00, rc 0) 00000100:00100000:1.0:1746147737.039972:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32645:x1830967794305664:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 632us (806us total) trans 8589946213 rc 301/301 00000100:00100000:1.0:1746147737.039977:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12177 00000100:00100000:0.0:1746147737.058004:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.058078:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.058213:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794305920 00000100:00100000:3.0:1746147737.058224:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794305920 00002000:00100000:3.0:1746147737.058273:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009ce61500 x1830967794305920/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.058287:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61500 with x1830967794305920 ext(1048576->2097151) 00002000:00010000:3.0:1746147737.058292:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce61500 00000100:00100000:2.0:1746147737.058298:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794306176 00000100:00100000:2.0:1746147737.058302:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794306176 00000100:00100000:3.0:1746147737.058318:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7827 00002000:00100000:2.0:1746147737.058324:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009ce62d80 x1830967794306176/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147737.058326:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967794305920:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:2.0:1746147737.058331:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce62d80 with x1830967794306176 ext(1048576->2097151) 00002000:00010000:2.0:1746147737.058334:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce62d80 00000100:00100000:2.0:1746147737.058346:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7828 00000100:00100000:2.0:1746147737.058351:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1959:x1830967794306176:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147737.074836:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967794305920:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16499us (16830us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147737.074847:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7827 00002000:00100000:3.0:1746147737.074859:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009ce61500 x1830967794305920/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.074868:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce61500 with x1830967794305920 ext(1048576->2097151) 00002000:00010000:3.0:1746147737.074874:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce61500 00000100:00100000:2.0:1746147737.075079:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1959:x1830967794306176:12345-192.168.202.10@tcp:3:cat.0 Request processed in 16727us (17000us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147737.075085:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7828 00002000:00100000:2.0:1746147737.075091:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88009ce62d80 x1830967794306176/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.075097:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce62d80 with x1830967794306176 ext(1048576->2097151) 00002000:00010000:2.0:1746147737.075100:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ce62d80 00000100:00100000:0.0:1746147737.090367:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.090569:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794306304 00000100:00100000:2.0:1746147737.090580:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794306304 00000100:00100000:2.0:1746147737.090669:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17373 00000100:00100000:2.0:1746147737.090676:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:32642:x1830967794306304:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.090691:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.090706:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce74 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.090730:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->3080191) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.090737:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.090739:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.090742:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa75 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce74 expref: 32 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.090768:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->3080191) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 27 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.090777:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->3080191) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 27 pid: 9615 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.090788:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796598656:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147737.090869:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c22b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147737.093136:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.093244:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796598656:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.093274:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa75 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce74 expref: 32 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.093294:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd1cc00, rc 0) 00000100:00100000:2.0:1746147737.093355:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:32642:x1830967794306304:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2678us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.093364:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17373 00000100:00100000:3.0:1746147737.093747:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794306432 00000100:00100000:3.0:1746147737.093754:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794306432 00002000:00100000:3.0:1746147737.093792:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2285568->3080191) req@ffff88009fd18a80 x1830967794306432/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.093802:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18a80 with x1830967794306432 ext(2285568->3080191) 00010000:00010000:3.0:1746147737.093808:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->3080191) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 28 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.093820:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->3080191) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 28 pid: 9615 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746147737.093826:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd18a80 00000100:00100000:3.0:1746147737.093854:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1592 00000100:00100000:3.0:1746147737.093861:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1959:x1830967794306432:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147737.110488:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967794306432:12345-192.168.202.10@tcp:4:cat.0 Request processed in 16612us (17348us total) trans 21474841756 rc 0/0 00000100:00100000:3.0:1746147737.110504:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1592 00002000:00100000:3.0:1746147737.110517:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2285568->3080191) req@ffff88009fd18a80 x1830967794306432/t21474841756(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/448 e 0 to 0 dl 1746147748 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.110527:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18a80 with x1830967794306432 ext(2285568->3080191) 00010000:00010000:3.0:1746147737.110538:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->3080191) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 30 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.110555:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->3080191) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 30 pid: 9615 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746147737.110562:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd18a80 00000100:00100000:0.0:1746147737.118880:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.120632:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794306560 00000100:00100000:3.0:1746147737.120654:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794306560 00010000:00010000:3.0:1746147737.120711:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->3080191) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 30 pid: 9615 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.120761:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8871 00000100:00100000:3.0:1746147737.120771:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1960:x1830967794306560:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.120788:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147737.120813:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2285568->3080191) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 30 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.120830:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2285568->3080191) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 30 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.120856:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5482400/0xe64d3fbf12a7f9b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2285568->3080191) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce27 expref: 30 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.120915:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.120918:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.120928:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa75 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce74 expref: 31 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.120938:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce74 expref: 31 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.120978:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce74 expref: 31 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147737.120994:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796598784:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147737.121129:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147737.126433:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.126508:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.126550:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794306816 00000100:00100000:3.0:1746147737.126560:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796598784:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147737.126560:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794306816 00010000:00010000:3.0:1746147737.126578:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746147737.126599:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fd1bb80 x1830967794306816/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.126623:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1bb80 with x1830967794306816 ext(2097152->3145727) 00002000:00010000:2.0:1746147737.126628:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1bb80 00000100:00100000:3.0:1746147737.126645:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967794306560:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5876us (7776us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.126647:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794306944 00000100:00100000:2.0:1746147737.126650:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794306944 00000100:00100000:3.0:1746147737.126655:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8871 00002000:00100000:2.0:1746147737.126661:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fd19c00 x1830967794306944/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.126667:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19c00 with x1830967794306944 ext(3145728->4194303) 00002000:00010000:2.0:1746147737.126670:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd19c00 00000100:00100000:1.0:1746147737.126677:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7829 00000100:00100000:1.0:1746147737.126689:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967794306816:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147737.126693:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7830 00000100:00100000:3.0:1746147737.126700:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794306944:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147737.130119:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.130947:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794307200 00000100:00100000:3.0:1746147737.130957:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794307200 00000100:00100000:3.0:1746147737.131009:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17374 00000100:00100000:3.0:1746147737.131017:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:32639:x1830967794307200:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147737.131031:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147737.131045:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce7b expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.131067:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3e00/0xe64d3fbf12a7f7b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd16 expref: 12 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.131074:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b10bc00/0xe64d3fbf12a7f8a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd86 expref: 47 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.131081:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3a00/0xe64d3fbf12a7f7e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd40 expref: 25 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.131086:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.131088:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.131091:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 47 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.131116:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3a00/0xe64d3fbf12a7f7e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd40 expref: 25 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.131127:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3a00/0xe64d3fbf12a7f7e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd40 expref: 25 pid: 7050 timeout: 916 lvb_type: 1 00000100:00100000:3.0:1746147737.131142:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796598912:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147737.131278:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b10bc00/0xe64d3fbf12a7f8a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd86 expref: 47 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.131286:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b10bc00/0xe64d3fbf12a7f8a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd86 expref: 47 pid: 8469 timeout: 916 lvb_type: 1 00000100:00100000:3.0:1746147737.131293:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796599040:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147737.131318:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3e00/0xe64d3fbf12a7f7b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd16 expref: 12 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.131326:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3e00/0xe64d3fbf12a7f7b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd16 expref: 12 pid: 6715 timeout: 916 lvb_type: 1 00000100:00100000:3.0:1746147737.131333:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796599168:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147737.131365:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.139171:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796598912:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147737.139178:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967794306944:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12476us (12669us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147737.139183:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796599040:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147737.139188:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7830 00002000:00100000:3.0:1746147737.139198:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fd19c00 x1830967794306944/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.139207:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19c00 with x1830967794306944 ext(3145728->4194303) 00002000:00010000:3.0:1746147737.139211:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd19c00 00000100:00100000:2.0:1746147737.141585:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.141680:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796599168:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.141712:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2940928->3145727] (req 2940928->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 47 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.141726:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0ff0800, rc 0) 00000100:00100000:2.0:1746147737.141766:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:32639:x1830967794307200:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 10749us (11654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.141775:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17374 00000100:00100000:2.0:1746147737.141824:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.141899:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794307328 00000100:00100000:2.0:1746147737.141905:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794307328 00010000:00010000:2.0:1746147737.141927:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b10bc00/0xe64d3fbf12a7f8a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd86 expref: 47 pid: 8469 timeout: 916 lvb_type: 1 00000100:00100000:2.0:1746147737.141942:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794307456 00000100:00100000:2.0:1746147737.141944:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794307456 00010000:00010000:2.0:1746147737.141953:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3a00/0xe64d3fbf12a7f7e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd40 expref: 26 pid: 7050 timeout: 916 lvb_type: 1 00000100:00100000:2.0:1746147737.141964:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8872 00000100:00100000:2.0:1746147737.141969:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1960:x1830967794307328:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147737.141979:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147737.141996:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b10bc00/0xe64d3fbf12a7f8a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd86 expref: 47 pid: 8469 timeout: 916 lvb_type: 1 00010000:00010000:2.0:1746147737.142005:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b10bc00/0xe64d3fbf12a7f8a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd86 expref: 47 pid: 8469 timeout: 916 lvb_type: 1 00010000:00010000:2.0:1746147737.142027:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b10bc00/0xe64d3fbf12a7f8a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd86 expref: 47 pid: 8469 timeout: 916 lvb_type: 1 00010000:00010000:2.0:1746147737.142041:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147737.142058:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1960:x1830967794307328:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 89us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.142062:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8872 00000100:00100000:2.0:1746147737.142072:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8873 00000100:00100000:2.0:1746147737.142076:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794307456:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147737.142082:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147737.142101:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3a00/0xe64d3fbf12a7f7e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd40 expref: 26 pid: 7050 timeout: 916 lvb_type: 1 00010000:00010000:2.0:1746147737.142108:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3a00/0xe64d3fbf12a7f7e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd40 expref: 26 pid: 7050 timeout: 916 lvb_type: 1 00010000:00010000:2.0:1746147737.142118:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3a00/0xe64d3fbf12a7f7e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd40 expref: 26 pid: 7050 timeout: 916 lvb_type: 1 00010000:00010000:2.0:1746147737.142126:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147737.142140:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794307456:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 63us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.142145:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8873 00000100:00100000:1.0:1746147737.142477:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967794306816:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15791us (16057us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147737.142484:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7829 00002000:00100000:1.0:1746147737.142490:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fd1bb80 x1830967794306816/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.142498:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1bb80 with x1830967794306816 ext(2097152->3145727) 00002000:00010000:1.0:1746147737.142502:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1bb80 00000100:00100000:0.0:1746147737.142738:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.142797:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.142940:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794307584 00000100:00100000:3.0:1746147737.142962:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794307584 00010000:00010000:3.0:1746147737.142977:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3e00/0xe64d3fbf12a7f7b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd16 expref: 13 pid: 6715 timeout: 916 lvb_type: 1 00000100:00100000:3.0:1746147737.142994:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8874 00000100:00100000:3.0:1746147737.143000:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+13:1959:x1830967794307584:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.143007:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147737.143016:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3e00/0xe64d3fbf12a7f7b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd16 expref: 13 pid: 6715 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746147737.143030:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3e00/0xe64d3fbf12a7f7b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd16 expref: 13 pid: 6715 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746147737.143042:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57b3e00/0xe64d3fbf12a7f7b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd16 expref: 13 pid: 6715 timeout: 916 lvb_type: 1 00000100:00100000:2.0:1746147737.143052:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794307712 00000100:00100000:2.0:1746147737.143056:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794307712 00010000:00010000:3.0:1746147737.143064:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.143065:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.143071:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 45 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147737.143076:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17375 00010000:00010000:3.0:1746147737.143079:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 45 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147737.143081:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:32645:x1830967794307712:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147737.143093:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147737.143103:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 45 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.143104:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce82 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147737.143117:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796599296:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147737.143121:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1ca00/0xe64d3fbf12a7f9bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce2e expref: 30 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.143129:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7fa44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce58 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.143133:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.143134:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.143137:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1712128->2097151] (req 1712128->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 30 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.143153:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7fa44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce58 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.143161:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7fa44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce58 expref: 31 pid: 8468 timeout: 916 lvb_type: 1 00000100:00100000:3.0:1746147737.143163:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.143168:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f515880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796599424:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.143195:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd1ca00/0xe64d3fbf12a7f9bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce2e expref: 30 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.143206:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bd1ca00/0xe64d3fbf12a7f9bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce2e expref: 30 pid: 9615 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.143213:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796599552:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147737.143247:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c22b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147737.145089:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.145150:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f515880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796599424:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147737.145165:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d0dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796599296:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147737.145177:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147737.145208:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794307584:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2208us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.145216:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8874 00000100:00100000:0.0:1746147737.145370:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794307968 00000100:00100000:0.0:1746147737.145375:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794307968 00002000:00100000:0.0:1746147737.145404:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (2940928->2945023) req@ffff8800a08a9180 x1830967794307968/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147737.145412:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a9180 with x1830967794307968 ext(2940928->2945023) 00002000:00010000:0.0:1746147737.145416:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08a9180 00000100:00100000:0.0:1746147737.145440:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7831 00000100:00100000:0.0:1746147737.145445:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1959:x1830967794307968:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147737.145571:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1959:x1830967794307968:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 126us (485us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147737.145576:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7831 00002000:00100000:0.0:1746147737.145580:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (2940928->2945023) req@ffff8800a08a9180 x1830967794307968/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/4536 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147737.145586:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a9180 with x1830967794307968 ext(2940928->2945023) 00002000:00010000:0.0:1746147737.145588:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a08a9180 00000100:00100000:0.0:1746147737.146704:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.146741:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.146793:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794308352 00000100:00100000:3.0:1746147737.146798:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794308352 00010000:00010000:3.0:1746147737.146818:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7fa44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce58 expref: 32 pid: 8468 timeout: 916 lvb_type: 1 00000100:00100000:3.0:1746147737.146852:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8875 00000100:00100000:3.0:1746147737.146858:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1958:x1830967794308352:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.146868:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147737.146903:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7fa44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce58 expref: 32 pid: 8468 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746147737.146913:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7fa44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce58 expref: 32 pid: 8468 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746147737.146931:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a734ac00/0xe64d3fbf12a7fa44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce58 expref: 32 pid: 8468 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746147737.146945:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147737.146950:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0435500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796599552:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147737.146969:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1958:x1830967794308352:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 111us (227us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147737.146970:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1712128->2097151] (req 1712128->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 30 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147737.146974:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8875 00010000:00010000:2.0:1746147737.146980:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c647a00, rc 0) 00000100:00100000:2.0:1746147737.147001:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:32645:x1830967794307712:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3920us (4204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.147006:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17375 00000100:00100000:2.0:1746147737.147024:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794308224 00000100:00100000:2.0:1746147737.147027:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794308224 00002000:00100000:2.0:1746147737.147405:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fd19500 x1830967794308224/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.147418:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19500 with x1830967794308224 ext(3145728->4194303) 00002000:00010000:2.0:1746147737.147420:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd19500 00000100:00100000:2.0:1746147737.147446:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7832 00000100:00100000:2.0:1746147737.147452:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1960:x1830967794308224:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147737.151855:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.151923:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.151994:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794308480 00000100:00100000:0.0:1746147737.152004:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794308480 00000100:00100000:0.0:1746147737.152043:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17376 00000100:00100000:0.0:1746147737.152051:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:32639:x1830967794308480:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147737.152070:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147737.152088:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce89 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.152098:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794308608 00000100:00100000:1.0:1746147737.152102:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794308608 00010000:00010000:0.0:1746147737.152117:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa75 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce74 expref: 32 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.152122:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd1ca00/0xe64d3fbf12a7f9bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce2e expref: 30 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746147737.152124:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147737.152126:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147737.152129:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->2883583] (req 2097152->2883583) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 32 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147737.152155:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce74 expref: 32 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147737.152166:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce74 expref: 32 pid: 8468 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746147737.152184:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796599680:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147737.152265:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147737.152326:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8876 00000100:00100000:1.0:1746147737.152334:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1960:x1830967794308608:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147737.152342:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147737.152363:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd1ca00/0xe64d3fbf12a7f9bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce2e expref: 30 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.152374:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd1ca00/0xe64d3fbf12a7f9bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce2e expref: 30 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.152392:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1ca00/0xe64d3fbf12a7f9bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce2e expref: 30 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.152407:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147737.152409:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147737.152414:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 29 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.152421:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 29 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.152443:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 29 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.152453:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796599808:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147737.152495:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147737.153995:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796599808:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147737.154013:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147737.154041:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967794308608:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1708us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147737.154049:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8876 00000100:00100000:2.0:1746147737.154197:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796599680:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.154226:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->2883583] (req 2097152->2883583) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 32 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.154241:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb39600, rc 0) 00000100:00100000:2.0:1746147737.154281:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:32639:x1830967794308480:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2230us (2435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.154288:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17376 00000100:00100000:3.0:1746147737.154339:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1960:x1830967794308224:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 6885us (7634us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147737.154351:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7832 00002000:00100000:3.0:1746147737.154359:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fd19500 x1830967794308224/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.154367:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19500 with x1830967794308224 ext(3145728->4194303) 00002000:00010000:3.0:1746147737.154372:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd19500 00000100:00100000:0.0:1746147737.154822:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.154877:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794308864 00000100:00100000:3.0:1746147737.154904:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794308864 00002000:00100000:3.0:1746147737.154927:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1712128->1716223) req@ffff88009fd1b100 x1830967794308864/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.154934:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1b100 with x1830967794308864 ext(1712128->1716223) 00002000:00010000:3.0:1746147737.154937:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1b100 00000100:00100000:3.0:1746147737.154949:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7833 00000100:00100000:3.0:1746147737.154954:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967794308864:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147737.155390:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967794308864:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 435us (567us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147737.155396:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7833 00002000:00100000:3.0:1746147737.155400:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1712128->1716223) req@ffff88009fd1b100 x1830967794308864/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/4536 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.155407:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1b100 with x1830967794308864 ext(1712128->1716223) 00002000:00010000:3.0:1746147737.155409:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd1b100 00000100:00100000:0.0:1746147737.159955:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.161207:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.161251:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794309120 00000100:00100000:0.0:1746147737.161254:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.161260:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794309120 00010000:00010000:1.0:1746147737.161296:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce74 expref: 32 pid: 8468 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746147737.161324:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8877 00000100:00100000:1.0:1746147737.161331:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1957:x1830967794309120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147737.161344:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147737.161367:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce74 expref: 32 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.161378:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce74 expref: 32 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.161402:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1cc00/0xe64d3fbf12a7fa75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce74 expref: 32 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.161420:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147737.161422:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147737.161428:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 31 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.161436:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 31 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.161464:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 31 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.161476:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796599936:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147737.161537:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.161866:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794308992 00000100:00100000:2.0:1746147737.161870:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794308992 00000100:00100000:2.0:1746147737.161879:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794309248 00000100:00100000:2.0:1746147737.161880:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794309248 00000100:00100000:2.0:1746147737.161915:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17377 00000100:00100000:2.0:1746147737.161920:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32645:x1830967794309248:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147737.162224:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.162243:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce97 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.162262:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f9cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce3c expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.162270:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a734a800/0xe64d3fbf12a7fa3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce5f expref: 45 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.162275:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.162276:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.162279:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1425407] (req 1048576->1425407) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.162295:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a734a800/0xe64d3fbf12a7fa3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce5f expref: 45 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.162305:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a734a800/0xe64d3fbf12a7fa3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce5f expref: 45 pid: 8468 timeout: 916 lvb_type: 1 00000100:00100000:2.0:1746147737.162313:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796600064:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.162346:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f9cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce3c expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.162354:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f9cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce3c expref: 26 pid: 9615 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.162361:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796600192:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147737.162376:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c22b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.162469:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17378 00000100:00100000:2.0:1746147737.162474:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:32642:x1830967794308992:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.162482:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.162488:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c647200/0xe64d3fbf12a7fa98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce90 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.162501:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 33 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.162506:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.162507:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.162510:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c647200/0xe64d3fbf12a7fa98 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce90 expref: 33 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.162523:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 33 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.162531:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 33 pid: 8468 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.162538:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796600320:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147737.162555:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c22d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147737.170081:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796599936:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147737.170105:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147737.170145:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1957:x1830967794309120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 8813us (8939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147737.170154:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8877 00000100:00100000:1.0:1746147737.170220:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796600192:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147737.170282:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796600064:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147737.170305:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1425407] (req 1048576->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.170357:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c646e00, rc 0) 00000100:00100000:1.0:1746147737.170380:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32645:x1830967794309248:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 8459us (9125us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147737.170386:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17377 00000100:00100000:2.0:1746147737.170576:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796600320:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.170601:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c647200/0xe64d3fbf12a7fa98 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce90 expref: 32 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.170627:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c647200, rc 0) 00000100:00100000:2.0:1746147737.170668:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:32642:x1830967794308992:12345-192.168.202.10@tcp:101:cat.0 Request processed in 8193us (10723us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.170676:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17378 00000100:00100000:1.0:1746147737.171100:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.171165:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794309376 00000100:00100000:1.0:1746147737.171171:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794309376 00010000:00010000:1.0:1746147737.171211:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f9cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce3c expref: 26 pid: 9615 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746147737.171233:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8878 00000100:00100000:1.0:1746147737.171240:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794309376:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147737.171252:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147737.171272:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f9cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce3c expref: 26 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.171282:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f9cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce3c expref: 26 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.171304:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5482e00/0xe64d3fbf12a7f9cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce3c expref: 26 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.171313:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147737.171330:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1957:x1830967794309376:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 91us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147737.171335:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8878 00000100:00100000:1.0:1746147737.171403:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.171417:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794309504 00000100:00100000:1.0:1746147737.171420:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794309504 00010000:00010000:1.0:1746147737.171432:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a734a800/0xe64d3fbf12a7fa3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce5f expref: 46 pid: 8468 timeout: 916 lvb_type: 1 00000100:00100000:1.0:1746147737.172811:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8879 00000100:00100000:1.0:1746147737.172821:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1959:x1830967794309504:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147737.172834:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147737.172850:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a734a800/0xe64d3fbf12a7fa3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce5f expref: 46 pid: 8468 timeout: 916 lvb_type: 1 00010000:00010000:1.0:1746147737.172860:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a734a800/0xe64d3fbf12a7fa3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce5f expref: 46 pid: 8468 timeout: 916 lvb_type: 1 00010000:00010000:1.0:1746147737.172877:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a734a800/0xe64d3fbf12a7fa3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce5f expref: 46 pid: 8468 timeout: 916 lvb_type: 1 00010000:00010000:1.0:1746147737.172900:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147737.172902:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147737.172909:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 24 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.172917:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 24 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.172947:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 24 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.172958:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08ab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796600448:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147737.173010:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147737.173098:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.173202:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794309760 00000100:00100000:3.0:1746147737.173213:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794309760 00002000:00100000:3.0:1746147737.173250:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2879488->2883583) req@ffff8800a08a8380 x1830967794309760/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.173260:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a8380 with x1830967794309760 ext(2879488->2883583) 00010000:00010000:3.0:1746147737.173267:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 32 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.173279:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 32 pid: 8468 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746147737.173285:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a08a8380 00000100:00100000:3.0:1746147737.173488:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1593 00000100:00100000:3.0:1746147737.173496:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794309760:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147737.173631:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794309760:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 136us (532us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147737.173637:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1593 00002000:00100000:3.0:1746147737.173641:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x456:0x0] (2879488->2883583) req@ffff8800a08a8380 x1830967794309760/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/4536 e 0 to 0 dl 1746147748 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.173649:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a8380 with x1830967794309760 ext(2879488->2883583) 00010000:00010000:3.0:1746147737.173652:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 32 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.173661:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 32 pid: 8468 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746147737.173666:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a08a8380 00000100:00100000:1.0:1746147737.174879:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08ab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796600448:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147737.174907:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147737.174934:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1959:x1830967794309504:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2115us (3530us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147737.174943:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8879 00000100:00100000:0.0:1746147737.177479:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.177506:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794310016 00000100:00100000:3.0:1746147737.177514:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794310016 00002000:00100000:3.0:1746147737.177547:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x457:0x0] (1421312->1425407) req@ffff88009fd1a680 x1830967794310016/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.177556:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1a680 with x1830967794310016 ext(1421312->1425407) 00002000:00010000:3.0:1746147737.177561:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd1a680 00000100:00100000:3.0:1746147737.177577:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7834 00000100:00100000:3.0:1746147737.177584:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794310016:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147737.177736:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794310016:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 151us (263us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147737.177742:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7834 00002000:00100000:3.0:1746147737.177748:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x457:0x0] (1421312->1425407) req@ffff88009fd1a680 x1830967794310016/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/4536 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.177754:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1a680 with x1830967794310016 ext(1421312->1425407) 00002000:00010000:3.0:1746147737.177756:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd1a680 00000100:00100000:0.0:1746147737.180172:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.180205:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.180418:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794310528 00000100:00100000:1.0:1746147737.180425:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794310528 00000100:00100000:1.0:1746147737.180454:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5093 00000100:00100000:1.0:1746147737.180460:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130ebf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+332:32639:x1830967794310528:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:1.0:1746147737.180703:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130ebf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:32639:x1830967794310528:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 241us (534us total) trans 8589946214 rc 0/0 00000100:00100000:1.0:1746147737.180709:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5093 00000100:00100000:3.0:1746147737.181147:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794310272 00000100:00100000:3.0:1746147737.181151:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794310272 00002000:00100000:3.0:1746147737.181172:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x456:0x0] (2097152->2883583) req@ffff88009fd1b800 x1830967794310272/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.181181:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1b800 with x1830967794310272 ext(2097152->2883583) 00010000:00010000:3.0:1746147737.181188:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 32 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.181200:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 32 pid: 8468 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746147737.181212:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd1b800 00000100:00100000:3.0:1746147737.181224:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1594 00000100:00100000:3.0:1746147737.181229:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794310272:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:0.0:1746147737.187664:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.188373:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794310784 00000100:00100000:0.0:1746147737.188381:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794310784 00000100:00100000:2.0:1746147737.189515:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12178 00000100:00100000:2.0:1746147737.189526:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:32651:x1830967794310784:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.189545:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.189560:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646200/0xe64d3fbf12a7fa9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafce9e expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.189656:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646400/0xe64d3fbf12a7faa6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189666:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646400/0xe64d3fbf12a7faa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189675:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646400/0xe64d3fbf12a7faa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189685:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c647e00/0xe64d3fbf12a7faad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189689:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c647e00/0xe64d3fbf12a7faad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189694:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c647e00/0xe64d3fbf12a7faad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189775:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646c00/0xe64d3fbf12a7fab4 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189782:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646c00/0xe64d3fbf12a7fab4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189787:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646c00/0xe64d3fbf12a7fab4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:2.0:1746147737.189795:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147737.189864:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646c00/0xe64d3fbf12a7fab4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189869:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646c00/0xe64d3fbf12a7fab4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189874:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646c00/0xe64d3fbf12a7fab4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189878:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c646c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147737.189897:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646c00/0xe64d3fbf12a7fab4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189903:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646c00/0xe64d3fbf12a7fab4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189912:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147737.189914:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147737.189918:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646c00/0xe64d3fbf12a7fab4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189924:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646c00/0xe64d3fbf12a7fab4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189936:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646400/0xe64d3fbf12a7faa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189941:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646400/0xe64d3fbf12a7faa6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189945:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646400/0xe64d3fbf12a7faa6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189953:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c646400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147737.189955:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646400/0xe64d3fbf12a7faa6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189959:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646400/0xe64d3fbf12a7faa6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189965:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147737.189967:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147737.189969:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646400/0xe64d3fbf12a7faa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189972:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646400/0xe64d3fbf12a7faa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189979:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c647e00/0xe64d3fbf12a7faad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189983:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c647e00/0xe64d3fbf12a7faad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189987:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c647e00/0xe64d3fbf12a7faad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189990:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c647e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147737.189993:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c647e00/0xe64d3fbf12a7faad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.189996:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c647e00/0xe64d3fbf12a7faad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.190002:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a02f4d00) 00010000:00010000:2.0:1746147737.190003:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147737.190006:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c647e00/0xe64d3fbf12a7faad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.190010:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c647e00/0xe64d3fbf12a7faad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.190043:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646200/0xe64d3fbf12a7fa9f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce9e expref: 20 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.190050:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c646200/0xe64d3fbf12a7fa9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce9e expref: 20 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.190058:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c646200, rc 0) 00000100:00100000:2.0:1746147737.190107:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:32651:x1830967794310784:12345-192.168.202.10@tcp:101:cat.0 Request processed in 584us (2451us total) trans 8589946215 rc 301/301 00000100:00100000:2.0:1746147737.190113:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12178 00000100:00100000:0.0:1746147737.192203:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.192299:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794311040 00000100:00100000:1.0:1746147737.192306:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794311040 00000100:00100000:1.0:1746147737.192336:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5094 00000100:00100000:1.0:1746147737.192342:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+19:32645:x1830967794311040:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:1.0:1746147737.192487:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32645:x1830967794311040:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 144us (288us total) trans 8589946216 rc 0/0 00000100:00100000:1.0:1746147737.192493:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5094 00000100:00100000:1.0:1746147737.198069:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.198093:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794311296 00000100:00100000:1.0:1746147737.198100:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794311296 00000100:00100000:1.0:1746147737.198131:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5095 00000100:00100000:1.0:1746147737.198137:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+20:32651:x1830967794311296:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:1.0:1746147737.198298:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32651:x1830967794311296:12345-192.168.202.10@tcp:35:cat.0 Request processed in 160us (235us total) trans 8589946217 rc 0/0 00000100:00100000:1.0:1746147737.198304:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5095 00000100:00100000:1.0:1746147737.204282:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.204344:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.204366:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794311424 00000100:00100000:1.0:1746147737.204373:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794311424 00000100:00100000:1.0:1746147737.204406:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794311552 00000100:00100000:1.0:1746147737.204408:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794311552 00000100:00100000:1.0:1746147737.204421:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17379 00000100:00100000:1.0:1746147737.204427:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794311424:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147737.204441:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147737.204457:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a734a000/0xe64d3fbf12a7fac2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcea5 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.204504:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a08a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796600576:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147737.205205:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147737.205222:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17380 00000100:00100000:1.0:1746147737.205229:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967794311552:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147737.205237:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147737.205246:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a734b000/0xe64d3fbf12a7fac9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafceac expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.205270:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f517b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796600704:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147737.205289:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147737.207375:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967794310272:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 26141us (27165us total) trans 21474841757 rc 0/0 00000100:00100000:1.0:1746147737.207386:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1594 00002000:00100000:1.0:1746147737.207395:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x456:0x0] (2097152->2883583) req@ffff88009fd1b800 x1830967794310272/t21474841757(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/448 e 0 to 0 dl 1746147748 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.207403:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd1b800 with x1830967794310272 ext(2097152->2883583) 00010000:00010000:1.0:1746147737.207410:0:21459:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 34 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.207422:0:21459:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 34 pid: 8468 timeout: 916 lvb_type: 0 00002000:00010000:1.0:1746147737.207428:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd1b800 00000100:00100000:1.0:1746147737.216508:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.216754:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794311680 00000100:00100000:1.0:1746147737.216761:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794311680 00010000:00010000:1.0:1746147737.216792:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 34 pid: 8468 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746147737.216815:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8880 00000100:00100000:1.0:1746147737.216822:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1959:x1830967794311680:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147737.216833:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147737.216848:0:15900:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147737 -> 1746147738 00002000:00010000:1.0:1746147737.216851:0:15900:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147737 -> 1746147738 00010000:00010000:1.0:1746147737.216855:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 34 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.216869:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 34 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.216905:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147737.216907:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147737.216914:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c647200/0xe64d3fbf12a7fa98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce90 expref: 34 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.216921:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c647200/0xe64d3fbf12a7fa98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce90 expref: 34 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.216950:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c647200/0xe64d3fbf12a7fa98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce90 expref: 34 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.216960:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce60380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796600832:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147737.217017:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f000 going to sleep for 11 seconds 00002000:00010000:1.0:1746147737.217049:0:9615:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime: 1746147737 -> 1746147738 00010000:00010000:1.0:1746147737.217058:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39600/0xe64d3fbf12a7fa8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce89 expref: 34 pid: 8468 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746147737.217074:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f517b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796600704:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147737.217097:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a734b000/0xe64d3fbf12a7fac9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceac expref: 30 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.217109:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a734b000/0xe64d3fbf12a7fac9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceac expref: 30 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.217116:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a734b000, rc 0) 00000100:00100000:1.0:1746147737.217139:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1960:x1830967794311552:12345-192.168.202.10@tcp:101:cat.0 Request processed in 11910us (12794us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147737.217145:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17380 00002000:00010000:1.0:1746147737.217175:0:4591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime: 1746147737 -> 1746147738 00002000:00010000:1.0:1746147737.217177:0:4591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147737 -> 1746147738 00002000:00010000:1.0:1746147737.217179:0:4591:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime: 1746147736 -> 1746147738 00000100:00100000:1.0:1746147737.217190:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a08a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796600576:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147737.217205:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a734a000/0xe64d3fbf12a7fac2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcea5 expref: 26 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.217212:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a734a000/0xe64d3fbf12a7fac2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcea5 expref: 26 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.217220:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a734a000, rc 0) 00000100:00100000:1.0:1746147737.217236:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1959:x1830967794311424:12345-192.168.202.10@tcp:101:cat.0 Request processed in 12809us (12962us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147737.217241:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17379 00000100:00100000:1.0:1746147737.224742:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ce60380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796600832:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147737.224762:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147737.224797:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967794311680:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7975us (8294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147737.224806:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8880 00000100:00100000:1.0:1746147737.229676:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.229707:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794312064 00000100:00100000:1.0:1746147737.229715:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794312064 00002000:00100000:1.0:1746147737.229754:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009ce60380 x1830967794312064/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.229763:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60380 with x1830967794312064 ext(3145728->4194303) 00002000:00010000:1.0:1746147737.229768:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60380 00000100:00100000:1.0:1746147737.229787:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7835 00000100:00100000:1.0:1746147737.229793:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794312064:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147737.237022:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.237052:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.237546:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794312320 00000100:00100000:1.0:1746147737.237554:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794312320 00000100:00100000:2.0:1746147737.237577:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794312576 00000100:00100000:2.0:1746147737.237579:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794312576 00002000:00100000:2.0:1746147737.237616:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1425408->2097151) req@ffff88012f517b80 x1830967794312576/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.237625:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f517b80 with x1830967794312576 ext(1425408->2097151) 00002000:00010000:2.0:1746147737.237629:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f517b80 00000100:00100000:2.0:1746147737.237644:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7836 00000100:00100000:2.0:1746147737.237650:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1957:x1830967794312576:12345-192.168.202.10@tcp:3:cat.0 00002000:00100000:1.0:1746147737.237790:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1712127) req@ffff8800a08a8a80 x1830967794312320/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.237797:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a8a80 with x1830967794312320 ext(1048576->1712127) 00002000:00010000:1.0:1746147737.237800:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a08a8a80 00000100:00100000:1.0:1746147737.237810:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7837 00000100:00100000:1.0:1746147737.237814:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a08a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1957:x1830967794312320:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147737.242103:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.242178:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794312832 00000100:00100000:1.0:1746147737.242184:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794312832 00000100:00100000:1.0:1746147737.242216:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5096 00000100:00100000:1.0:1746147737.242223:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41587371-240a-4781-aecb-638f17200fbd+6:32608:x1830967794312832:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147737.242387:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41587371-240a-4781-aecb-638f17200fbd+7:32608:x1830967794312832:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 165us (289us total) trans 8589946218 rc 0/0 00000100:00100000:1.0:1746147737.242397:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5096 00000100:00100000:1.0:1746147737.245630:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794312064:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 15830us (15955us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147737.245641:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7835 00002000:00100000:1.0:1746147737.245652:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009ce60380 x1830967794312064/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.245661:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ce60380 with x1830967794312064 ext(3145728->4194303) 00002000:00010000:1.0:1746147737.245666:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ce60380 00000100:00100000:3.0:1746147737.247226:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1957:x1830967794312576:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9570us (10168us total) trans 0 rc 671744/671744 00000100:00100000:3.0:1746147737.247234:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7836 00002000:00100000:3.0:1746147737.247241:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1425408->2097151) req@ffff88012f517b80 x1830967794312576/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 671744/671744 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.247250:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f517b80 with x1830967794312576 ext(1425408->2097151) 00002000:00010000:3.0:1746147737.247253:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f517b80 00000100:00100000:3.0:1746147737.256470:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.256661:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.256686:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.256762:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794313088 00000100:00100000:1.0:1746147737.256770:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794313088 00000100:00100000:1.0:1746147737.256804:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5097 00000100:00100000:1.0:1746147737.256811:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41587371-240a-4781-aecb-638f17200fbd+7:32608:x1830967794313088:12345-192.168.202.10@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147737.257000:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41587371-240a-4781-aecb-638f17200fbd+8:32608:x1830967794313088:12345-192.168.202.10@tcp:35:mirror_io.0 Request processed in 188us (537us total) trans 8589946219 rc 0/0 00000100:00100000:1.0:1746147737.257006:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5097 00000100:00100000:1.0:1746147737.257448:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a08a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1957:x1830967794312320:12345-192.168.202.10@tcp:3:cat.0 Request processed in 19632us (20431us total) trans 0 rc 663552/663552 00000100:00100000:1.0:1746147737.257457:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7837 00002000:00100000:1.0:1746147737.257465:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1712127) req@ffff8800a08a8a80 x1830967794312320/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 663552/663552 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.257474:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a08a8a80 with x1830967794312320 ext(1048576->1712127) 00002000:00010000:1.0:1746147737.257479:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a08a8a80 00000100:00100000:1.0:1746147737.257904:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794313344 00000100:00100000:1.0:1746147737.257908:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794313344 00000100:00100000:1.0:1746147737.258452:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794313216 00000100:00100000:1.0:1746147737.258455:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794313216 00000100:00100000:1.0:1746147737.258471:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17381 00000100:00100000:1.0:1746147737.258476:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1959:x1830967794313344:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147737.258485:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147737.258499:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0029800/0xe64d3fbf12a7fad0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafceba expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.258538:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796600960:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147737.258599:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147737.258621:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17382 00000100:00100000:1.0:1746147737.258626:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967794313216:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147737.258632:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147737.258640:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0028600/0xe64d3fbf12a7fad7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafceb3 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.258658:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796601088:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147737.258674:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013662f000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.263454:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.263475:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.263480:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794313472 00000100:00100000:2.0:1746147737.263488:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794313472 00000100:00100000:2.0:1746147737.263631:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794313600 00000100:00100000:2.0:1746147737.263634:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794313600 00000100:00100000:2.0:1746147737.263650:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17383 00000100:00100000:2.0:1746147737.263657:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967794313472:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.263670:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.263683:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134b2f400/0xe64d3fbf12a7fade lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcec1 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147737.263726:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796601216:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147737.263780:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c226c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.263795:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17384 00000100:00100000:2.0:1746147737.263800:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1958:x1830967794313600:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.263807:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.263816:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fae5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcec8 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.263827:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.263829:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.263836:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fae5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcec8 expref: 30 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.263848:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fae5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcec8 expref: 30 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.263858:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2ea00, rc 0) 00000100:00100000:2.0:1746147737.263877:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1958:x1830967794313600:12345-192.168.202.10@tcp:101:cat.0 Request processed in 77us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.263882:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17384 00002000:00010000:1.0:1746147737.264020:0:4591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime: 1746147737 -> 1746147738 00002000:00010000:1.0:1746147737.264023:0:4591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime: 1746147736 -> 1746147738 00002000:00010000:1.0:1746147737.264025:0:4591:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime: 1746147737 -> 1746147738 00000100:00100000:1.0:1746147737.264041:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796600960:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147737.264060:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0029800/0xe64d3fbf12a7fad0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceba expref: 46 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.264072:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0029800/0xe64d3fbf12a7fad0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceba expref: 46 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.264079:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0029800, rc 0) 00000100:00100000:1.0:1746147737.264097:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1959:x1830967794313344:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5621us (7436us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147737.264102:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17381 00002000:00010000:1.0:1746147737.264125:0:9615:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime: 1746147737 -> 1746147738 00002000:00010000:1.0:1746147737.264127:0:9615:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime: 1746147735 -> 1746147738 00002000:00010000:1.0:1746147737.264128:0:9615:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime: 1746147737 -> 1746147738 00000100:00100000:1.0:1746147737.264141:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796601088:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147737.264153:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0028600/0xe64d3fbf12a7fad7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceb3 expref: 34 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.264161:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0028600/0xe64d3fbf12a7fad7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceb3 expref: 34 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.264168:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0028600, rc 0) 00000100:00100000:1.0:1746147737.264185:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1959:x1830967794313216:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5559us (7498us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147737.264190:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17382 00000001:00080000:0.0:1746147737.272787:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841752 is committed 00000001:00080000:0.0:1746147737.272814:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841707 is committed 00000001:00080000:0.0:1746147737.272904:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841645 is committed 00000001:00080000:0.0:1746147737.272912:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841755 is committed 00000001:00080000:0.0:1746147737.272932:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841724 is committed 00000001:00080000:0.0:1746147737.272982:0:458:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841756 is committed 00000100:00100000:2.0:1746147737.273951:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796601216:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147737.273980:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134b2f400/0xe64d3fbf12a7fade lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcec1 expref: 26 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.273994:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134b2f400/0xe64d3fbf12a7fade lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcec1 expref: 26 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.274004:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2f400, rc 0) 00000100:00100000:2.0:1746147737.274040:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1958:x1830967794313472:12345-192.168.202.10@tcp:101:cat.0 Request processed in 10383us (10593us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147737.274047:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17383 00000100:00100000:0.0:1746147737.277569:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.277689:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794313728 00000100:00100000:2.0:1746147737.277698:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794313728 00000100:00100000:2.0:1746147737.277748:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17385 00000100:00100000:2.0:1746147737.277755:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:32651:x1830967794313728:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.277769:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.277783:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff1a00/0xe64d3fbf12a7faec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcecf expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.277809:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 44 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.277815:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.277817:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.277820:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff1a00/0xe64d3fbf12a7faec lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcecf expref: 26 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.277847:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 44 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.277857:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 44 pid: 8468 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.277867:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796601344:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147737.277961:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c226c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147737.278328:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.278430:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794313984 00000100:00100000:2.0:1746147737.278434:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794313984 00002000:00100000:2.0:1746147737.278457:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880091633b80 x1830967794313984/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.278465:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091633b80 with x1830967794313984 ext(4194304->5017599) 00010000:00010000:2.0:1746147737.278471:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 45 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746147737.278480:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 45 pid: 8468 timeout: 916 lvb_type: 0 00002000:00010000:2.0:1746147737.278486:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091633b80 00000100:00100000:2.0:1746147737.278498:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1595 00000100:00100000:2.0:1746147737.278503:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+45:1959:x1830967794313984:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147737.285861:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.285899:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794314112 00000100:00100000:0.0:1746147737.285906:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794314112 00002000:00100000:0.0:1746147737.285937:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2940928->3145727) req@ffff8800951d7b80 x1830967794314112/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147737.285947:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d7b80 with x1830967794314112 ext(2940928->3145727) 00010000:00010000:0.0:1746147737.285955:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 47 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746147737.285968:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 47 pid: 8468 timeout: 916 lvb_type: 0 00002000:00010000:0.0:1746147737.285975:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800951d7b80 00000100:00100000:0.0:1746147737.285993:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1596 00000100:00100000:0.0:1746147737.286000:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1959:x1830967794314112:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147737.286719:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796601344:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.286740:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff1a00/0xe64d3fbf12a7faec lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcecf expref: 26 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.286757:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0ff1a00, rc 0) 00000100:00100000:2.0:1746147737.286784:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32651:x1830967794313728:12345-192.168.202.10@tcp:101:cat.0 Request processed in 9030us (9224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.286790:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17385 00000100:00100000:0.0:1746147737.301707:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+49:1959:x1830967794314112:12345-192.168.202.10@tcp:4:cat.0 Request processed in 15699us (15844us total) trans 17179874531 rc 0/0 00000100:00100000:0.0:1746147737.301718:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1596 00002000:00100000:0.0:1746147737.301727:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2940928->3145727) req@ffff8800951d7b80 x1830967794314112/t17179874531(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/448 e 0 to 0 dl 1746147748 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147737.301735:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d7b80 with x1830967794314112 ext(2940928->3145727) 00010000:00010000:0.0:1746147737.301744:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 49 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746147737.301756:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 49 pid: 8468 timeout: 916 lvb_type: 0 00002000:00010000:0.0:1746147737.301762:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800951d7b80 00000100:00100000:2.0:1746147737.304181:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1959:x1830967794313984:12345-192.168.202.10@tcp:3:cat.0 Request processed in 25670us (25846us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746147737.304190:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1595 00002000:00100000:2.0:1746147737.304198:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880091633b80 x1830967794313984/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:H/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.304205:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091633b80 with x1830967794313984 ext(4194304->5017599) 00010000:00010000:2.0:1746147737.304212:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 47 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746147737.304226:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 47 pid: 8468 timeout: 916 lvb_type: 0 00002000:00010000:2.0:1746147737.304231:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091633b80 00000100:00100000:1.0:1746147737.310547:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.310588:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.310674:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.310697:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794314368 00000100:00100000:1.0:1746147737.310704:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794314368 00000100:00100000:1.0:1746147737.310733:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794314240 00000100:00100000:1.0:1746147737.310735:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794314240 00000100:00100000:1.0:1746147737.310743:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794314496 00000100:00100000:1.0:1746147737.310745:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794314496 00000100:00100000:1.0:1746147737.310758:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17386 00000100:00100000:1.0:1746147737.310764:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+48:1957:x1830967794314368:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147737.310777:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147737.310791:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0029400/0xe64d3fbf12a7faf3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcedd expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.310834:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796601472:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147737.310910:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147737.310925:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17387 00000100:00100000:1.0:1746147737.310930:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1957:x1830967794314240:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147737.310937:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147737.310946:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0029a00/0xe64d3fbf12a7fafa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafced6 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.310968:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091632300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796601600:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147737.310987:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f8780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147737.311001:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17388 00000100:00100000:1.0:1746147737.311005:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+49:1957:x1830967794314496:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147737.311010:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147737.311016:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0028600/0xe64d3fbf12a7fb01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcee4 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.311035:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796601728:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147737.311052:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095567840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.311274:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.311536:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794314624 00000100:00100000:1.0:1746147737.311539:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794314624 00010000:00010000:1.0:1746147737.311556:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 51 pid: 8468 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746147737.311574:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8881 00000100:00100000:1.0:1746147737.311579:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+51:1960:x1830967794314624:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147737.311586:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147737.311671:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 51 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.311683:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 51 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.311699:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147737.311700:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147737.311706:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff1a00/0xe64d3fbf12a7faec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcecf expref: 25 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.311713:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff1a00/0xe64d3fbf12a7faec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcecf expref: 25 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.311734:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff1a00/0xe64d3fbf12a7faec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcecf expref: 25 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.311742:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796601856:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147737.311781:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095567780 going to sleep for 11 seconds 00010000:00010000:3.0:1746147737.313706:0:4591:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.10@tcp) returned -22 from glimpse AST (req@ffff880091630700 x1830967796601728) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 51 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.313729:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0800/0xe64d3fbf12a7fa7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2940928->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce7b expref: 51 pid: 8468 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.313738:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796601728:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147737.313762:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0028600/0xe64d3fbf12a7fb01 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcee4 expref: 50 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.313771:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0028600/0xe64d3fbf12a7fb01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcee4 expref: 50 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.313777:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0028600, rc 0) 00000100:00100000:3.0:1746147737.313807:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+49:1957:x1830967794314496:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2800us (3133us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147737.313813:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17388 00000100:00100000:2.0:1746147737.314075:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091632300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796601600:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147737.314090:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0029a00/0xe64d3fbf12a7fafa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafced6 expref: 18 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.314098:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0029a00/0xe64d3fbf12a7fafa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafced6 expref: 18 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.314110:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0029a00, rc 0) 00000100:00100000:2.0:1746147737.314128:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1957:x1830967794314240:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3198us (3539us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147737.314133:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17387 00000100:00100000:1.0:1746147737.314223:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796601472:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147737.314239:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0029400/0xe64d3fbf12a7faf3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcedd expref: 48 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.314248:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0029400/0xe64d3fbf12a7faf3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcedd expref: 48 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.314256:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0029400, rc 0) 00000100:00100000:1.0:1746147737.314275:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1957:x1830967794314368:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3511us (3734us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147737.314280:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17386 00000100:00100000:1.0:1746147737.314301:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796601856:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147737.314312:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147737.314326:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1960:x1830967794314624:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2747us (3053us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147737.314333:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8881 00000100:00100000:3.0:1746147737.322783:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.322813:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794314752 00000100:00100000:3.0:1746147737.322819:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.322822:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794314752 00000100:00100000:3.0:1746147737.322844:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.322860:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17389 00000100:00100000:1.0:1746147737.322867:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:32642:x1830967794314752:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147737.322898:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147737.322912:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:1.0:1746147737.322912:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7fb08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafceeb expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.322933:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147737.322934:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147737.322943:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7fb08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceeb expref: 47 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.322956:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7fb08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceeb expref: 47 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147737.322960:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794315264 00010000:00010000:1.0:1746147737.322965:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3c600, rc 0) 00000100:00100000:3.0:1746147737.322966:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.323005:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:32642:x1830967794314752:12345-192.168.202.10@tcp:101:cat.0 Request processed in 138us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147737.323011:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17389 00000100:00100000:1.0:1746147737.323029:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794315136 00000100:00100000:1.0:1746147737.323031:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794315136 00000100:00100000:0.0:1746147737.323038:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794315264 00002000:00100000:1.0:1746147737.323054:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880091630700 x1830967794315136/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.323063:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091630700 with x1830967794315136 ext(2097152->3145727) 00002000:00010000:1.0:1746147737.323067:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091630700 00000100:00100000:1.0:1746147737.323076:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794315520 00000100:00100000:1.0:1746147737.323078:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794315520 00002000:00100000:0.0:1746147737.323082:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880091632300 x1830967794315264/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.323088:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009fce4a80 x1830967794315520/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147737.323092:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091632300 with x1830967794315264 ext(3145728->4194303) 00002000:00100000:1.0:1746147737.323094:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce4a80 with x1830967794315520 ext(2097152->3145727) 00002000:00010000:1.0:1746147737.323097:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fce4a80 00002000:00010000:0.0:1746147737.323097:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091632300 00000100:00100000:1.0:1746147737.323104:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794315648 00000100:00100000:1.0:1746147737.323106:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794315648 00002000:00100000:1.0:1746147737.323113:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009c264a80 x1830967794315648/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.323119:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c264a80 with x1830967794315648 ext(3145728->4194303) 00002000:00010000:1.0:1746147737.323122:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c264a80 00000100:00100000:0.0:1746147737.323130:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7838 00000100:00100000:0.0:1746147737.323139:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1958:x1830967794315136:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147737.323317:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7839 00000100:00100000:1.0:1746147737.323322:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7840 00000100:00100000:3.0:1746147737.323327:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967794315520:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147737.323329:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1958:x1830967794315264:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147737.323398:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7841 00000100:00100000:1.0:1746147737.323403:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1958:x1830967794315648:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147737.326619:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.326660:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794315904 00000100:00100000:2.0:1746147737.326672:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794315904 00000100:00100000:2.0:1746147737.326722:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17390 00000100:00100000:2.0:1746147737.326730:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1960:x1830967794315904:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.326746:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.326764:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0ff0200/0xe64d3fbf12a7fb0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcef2 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147737.326816:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796601984:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147737.327101:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c229c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.327500:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.327522:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794316032 00000100:00100000:2.0:1746147737.327525:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794316032 00000100:00100000:2.0:1746147737.327544:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17391 00000100:00100000:2.0:1746147737.327549:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1959:x1830967794316032:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.327556:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.327565:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0000/0xe64d3fbf12a7fb16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcef9 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147737.327591:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796602112:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147737.327628:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c22b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.331354:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796601984:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147737.331387:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0ff0200/0xe64d3fbf12a7fb0f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcef2 expref: 18 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.331400:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0ff0200/0xe64d3fbf12a7fb0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcef2 expref: 18 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.331410:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0ff0200, rc 0) 00000100:00100000:2.0:1746147737.331452:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1960:x1830967794315904:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4721us (5580us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147737.331460:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17390 00002000:00010000:2.0:1746147737.332836:0:6715:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2079 -> 2081 00000100:00100000:2.0:1746147737.332844:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796602112:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147737.332864:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0000/0xe64d3fbf12a7fb16 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcef9 expref: 48 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.332874:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff0000/0xe64d3fbf12a7fb16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcef9 expref: 48 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.332882:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0ff0000, rc 0) 00000100:00100000:2.0:1746147737.332924:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1959:x1830967794316032:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5374us (5425us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147737.332929:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17391 00000100:00100000:0.0:1746147737.349992:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.350239:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794316288 00000100:00100000:3.0:1746147737.350250:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794316288 00002000:00100000:3.0:1746147737.350284:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (5013504->5017599) req@ffff8800951d6a00 x1830967794316288/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.350293:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d6a00 with x1830967794316288 ext(5013504->5017599) 00002000:00010000:3.0:1746147737.350297:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800951d6a00 00000100:00100000:3.0:1746147737.350317:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7842 00000100:00100000:3.0:1746147737.350323:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1958:x1830967794316288:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147737.350452:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1958:x1830967794316288:12345-192.168.202.10@tcp:3:cat.0 Request processed in 129us (470us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147737.350459:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7842 00002000:00100000:3.0:1746147737.350463:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (5013504->5017599) req@ffff8800951d6a00 x1830967794316288/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/4536 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.350469:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d6a00 with x1830967794316288 ext(5013504->5017599) 00002000:00010000:3.0:1746147737.350471:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800951d6a00 00000100:00100000:1.0:1746147737.362026:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1958:x1830967794315136:12345-192.168.202.10@tcp:3:cat.0 Request processed in 38881us (39173us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147737.362038:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7838 00002000:00100000:1.0:1746147737.362050:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff880091630700 x1830967794315136/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.362059:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091630700 with x1830967794315136 ext(2097152->3145727) 00002000:00010000:1.0:1746147737.362064:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091630700 00000100:00100000:0.0:1746147737.362346:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:1958:x1830967794315648:12345-192.168.202.10@tcp:3:cat.0 Request processed in 38930us (39367us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147737.362361:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7841 00002000:00100000:0.0:1746147737.362376:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009c264a80 x1830967794315648/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147737.362386:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c264a80 with x1830967794315648 ext(3145728->4194303) 00002000:00010000:0.0:1746147737.362392:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c264a80 00000100:00100000:3.0:1746147737.365952:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1958:x1830967794315264:12345-192.168.202.10@tcp:3:cat.0 Request processed in 42610us (43118us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147737.365966:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7840 00002000:00100000:3.0:1746147737.365981:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880091632300 x1830967794315264/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.365991:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091632300 with x1830967794315264 ext(3145728->4194303) 00002000:00010000:3.0:1746147737.365997:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091632300 00000100:00100000:0.0:1746147737.366919:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1958:x1830967794315520:12345-192.168.202.10@tcp:3:cat.0 Request processed in 43590us (44001us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147737.366929:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7839 00002000:00100000:0.0:1746147737.366938:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff88009fce4a80 x1830967794315520/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147737.366956:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce4a80 with x1830967794315520 ext(2097152->3145727) 00002000:00010000:0.0:1746147737.366961:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fce4a80 00000100:00100000:2.0:1746147737.385618:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.385663:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794316544 00000100:00100000:2.0:1746147737.385674:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794316544 00002000:00100000:2.0:1746147737.385729:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009c9ab800 x1830967794316544/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.385740:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9ab800 with x1830967794316544 ext(4194304->5017599) 00002000:00010000:2.0:1746147737.385745:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9ab800 00000100:00100000:2.0:1746147737.385775:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7843 00000100:00100000:2.0:1746147737.385785:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794316544:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147737.404337:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1957:x1830967794316544:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18541us (18731us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746147737.404350:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7843 00002000:00100000:3.0:1746147737.404363:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009c9ab800 x1830967794316544/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.404373:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9ab800 with x1830967794316544 ext(4194304->5017599) 00002000:00010000:3.0:1746147737.404378:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9ab800 00000100:00100000:2.0:1746147737.419128:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.419240:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794316800 00000100:00100000:3.0:1746147737.419249:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794316800 00000100:00100000:3.0:1746147737.419293:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12179 00000100:00100000:3.0:1746147737.419303:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+333:32657:x1830967794316800:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147737.419327:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147737.419345:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a732ce00/0xe64d3fbf12a7fb1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf00 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.419462:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095516a00/0xe64d3fbf12a7fb24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419475:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095516a00/0xe64d3fbf12a7fb24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419486:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095516a00/0xe64d3fbf12a7fb24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419499:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8000/0xe64d3fbf12a7fb2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419504:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8000/0xe64d3fbf12a7fb2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419510:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8000/0xe64d3fbf12a7fb2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419616:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8200/0xe64d3fbf12a7fb32 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419625:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8200/0xe64d3fbf12a7fb32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419631:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8200/0xe64d3fbf12a7fb32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:3.0:1746147737.419639:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147737.419718:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095516a00/0xe64d3fbf12a7fb24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419725:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095516a00/0xe64d3fbf12a7fb24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419731:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095516a00/0xe64d3fbf12a7fb24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419736:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095516a00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147737.419740:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095516a00/0xe64d3fbf12a7fb24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419746:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095516a00/0xe64d3fbf12a7fb24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419756:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147737.419758:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147737.419763:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095516a00/0xe64d3fbf12a7fb24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419767:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095516a00/0xe64d3fbf12a7fb24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419778:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8000/0xe64d3fbf12a7fb2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419783:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8000/0xe64d3fbf12a7fb2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419788:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8000/0xe64d3fbf12a7fb2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419791:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8ce8000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147737.419793:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8000/0xe64d3fbf12a7fb2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419801:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8000/0xe64d3fbf12a7fb2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419806:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a0276700) 00010000:00010000:3.0:1746147737.419808:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147737.419809:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8000/0xe64d3fbf12a7fb2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419813:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8000/0xe64d3fbf12a7fb2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147737.419844:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a732ce00/0xe64d3fbf12a7fb1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf00 expref: 336 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.419856:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8200/0xe64d3fbf12a7fb32 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf00 expref: 335 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.419862:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147737.419864:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147737.419866:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8ce8200, rc 0) 00000100:00100000:3.0:1746147737.419934:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:32657:x1830967794316800:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 632us (813us total) trans 8589946220 rc 0/0 00000100:00100000:3.0:1746147737.419941:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12179 00000100:00100000:3.0:1746147737.427108:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.427165:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794316928 00000100:00100000:1.0:1746147737.427175:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794316928 00000100:00100000:1.0:1746147737.427234:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 911 00000100:00100000:1.0:1746147737.427241:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:1957:x1830967794316928:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147737.427255:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147737.427278:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8200/0xe64d3fbf12a7fb32 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf00 expref: 335 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.427307:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147737.427310:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147737.427353:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:1957:x1830967794316928:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 113us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147737.427359:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 911 00000100:00100000:3.0:1746147737.433818:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.433852:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794317184 00000100:00100000:3.0:1746147737.433861:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794317184 00000100:00100000:3.0:1746147737.433924:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12180 00000100:00100000:3.0:1746147737.433933:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+21:32659:x1830967794317184:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147737.433960:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147737.433979:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8a00/0xe64d3fbf12a7fb40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf07 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.434078:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9c00/0xe64d3fbf12a7fb47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.434093:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9c00/0xe64d3fbf12a7fb47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.434108:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9c00/0xe64d3fbf12a7fb47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.434121:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8e00/0xe64d3fbf12a7fb4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.434127:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8e00/0xe64d3fbf12a7fb4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.434132:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8e00/0xe64d3fbf12a7fb4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.434407:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9000/0xe64d3fbf12a7fb55 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.434415:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9000/0xe64d3fbf12a7fb55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.434421:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9000/0xe64d3fbf12a7fb55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147737.434429:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147737.435037:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9c00/0xe64d3fbf12a7fb47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.435048:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9c00/0xe64d3fbf12a7fb47 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.435055:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9c00/0xe64d3fbf12a7fb47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.435060:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8ce9c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147737.435064:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9c00/0xe64d3fbf12a7fb47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.435071:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9c00/0xe64d3fbf12a7fb47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.435083:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:3.0:1746147737.435086:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147737.435090:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9c00/0xe64d3fbf12a7fb47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.435095:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9c00/0xe64d3fbf12a7fb47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.435105:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8e00/0xe64d3fbf12a7fb4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.435109:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8e00/0xe64d3fbf12a7fb4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.435113:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8e00/0xe64d3fbf12a7fb4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.435117:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8ce8e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147737.435119:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8e00/0xe64d3fbf12a7fb4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.435127:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8e00/0xe64d3fbf12a7fb4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.435133:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136487600) 00010000:00010000:3.0:1746147737.435134:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147737.435136:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8e00/0xe64d3fbf12a7fb4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.435140:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8e00/0xe64d3fbf12a7fb4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147737.435176:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce8a00/0xe64d3fbf12a7fb40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf07 expref: 24 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.435187:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9000/0xe64d3fbf12a7fb55 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf07 expref: 23 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.435194:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147737.435196:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147737.435198:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8ce9000, rc 0) 00000100:00100000:3.0:1746147737.435266:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:32659:x1830967794317184:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1330us (1450us total) trans 8589946221 rc 0/0 00000100:00100000:3.0:1746147737.435273:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12180 00000100:00100000:1.0:1746147737.436780:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.436986:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794317312 00000100:00100000:0.0:1746147737.436994:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794317312 00000100:00100000:0.0:1746147737.437046:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 912 00000100:00100000:0.0:1746147737.437052:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:1958:x1830967794317312:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147737.437171:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147737.437193:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8ce9000/0xe64d3fbf12a7fb55 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf07 expref: 23 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147737.437207:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147737.437211:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147737.437240:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:1958:x1830967794317312:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 188us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147737.437249:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 912 00000100:00100000:1.0:1746147737.438538:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.438925:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794317440 00000100:00100000:2.0:1746147737.438931:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794317440 00000100:00100000:2.0:1746147737.438961:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17392 00000100:00100000:2.0:1746147737.438966:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32659:x1830967794317440:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147737.438981:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.438996:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf0e expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.439022:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff1a00/0xe64d3fbf12a7faec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcecf expref: 27 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.439031:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7fb08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceeb expref: 46 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.439038:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.439039:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.439043:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2883584->2985983] (req 2883584->2985983) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 27 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.439069:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7fb08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceeb expref: 46 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.439080:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7fb08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceeb expref: 46 pid: 6715 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.439091:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796602240:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.439741:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff1a00/0xe64d3fbf12a7faec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcecf expref: 27 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.439750:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff1a00/0xe64d3fbf12a7faec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcecf expref: 27 pid: 8470 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.439758:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796602368:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147737.439779:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.442311:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.442519:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796602240:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147737.442530:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796602368:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.442556:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2883584->2985983] (req 2883584->2985983) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 27 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.442575:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941bba00, rc 0) 00000100:00100000:2.0:1746147737.442622:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32659:x1830967794317440:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3654us (4084us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.442630:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17392 00000100:00100000:0.0:1746147737.442702:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794317568 00000100:00100000:0.0:1746147737.442708:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794317568 00010000:00010000:0.0:1746147737.442732:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7fb08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceeb expref: 47 pid: 6715 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746147737.442752:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8882 00000100:00100000:0.0:1746147737.442758:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+47:1960:x1830967794317568:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147737.442769:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147737.442789:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7fb08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceeb expref: 47 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746147737.442799:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7fb08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceeb expref: 47 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746147737.442819:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3c600/0xe64d3fbf12a7fb08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5013504->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafceeb expref: 47 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746147737.442829:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147737.442845:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+46:1960:x1830967794317568:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 88us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147737.442851:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8882 00000100:00100000:1.0:1746147737.446029:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.446197:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794317696 00000100:00100000:2.0:1746147737.446207:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794317696 00010000:00010000:2.0:1746147737.446428:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff1a00/0xe64d3fbf12a7faec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcecf expref: 27 pid: 8470 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.446518:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8883 00000100:00100000:2.0:1746147737.446526:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:1960:x1830967794317696:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147737.446541:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147737.446563:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff1a00/0xe64d3fbf12a7faec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcecf expref: 27 pid: 8470 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746147737.446576:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff1a00/0xe64d3fbf12a7faec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcecf expref: 27 pid: 8470 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746147737.446597:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0ff1a00/0xe64d3fbf12a7faec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcecf expref: 27 pid: 8470 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746147737.446623:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.446625:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.446632:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->2985983) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 26 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.446640:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->2985983) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 26 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.446670:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->2985983) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 26 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147737.446687:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796602496:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147737.447006:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56f83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.450521:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796602496:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147737.450540:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147737.450583:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794317696:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4057us (4563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.450597:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8883 00000100:00100000:1.0:1746147737.452372:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.452838:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794317952 00000100:00100000:3.0:1746147737.452849:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794317952 00002000:00100000:3.0:1746147737.452951:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2883584->2887679) req@ffff880135849f80 x1830967794317952/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.452962:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849f80 with x1830967794317952 ext(2883584->2887679) 00002000:00010000:3.0:1746147737.452969:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135849f80 00000100:00100000:3.0:1746147737.452999:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7844 00000100:00100000:3.0:1746147737.453010:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794317952:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147737.453285:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1959:x1830967794317952:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 275us (918us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147737.453293:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7844 00002000:00100000:3.0:1746147737.453300:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2883584->2887679) req@ffff880135849f80 x1830967794317952/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/4536 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.453307:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849f80 with x1830967794317952 ext(2883584->2887679) 00002000:00010000:3.0:1746147737.453310:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135849f80 00000100:00100000:1.0:1746147737.457244:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.457861:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794318208 00000100:00100000:2.0:1746147737.457872:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794318208 00002000:00100000:2.0:1746147737.457968:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (2981888->2985983) req@ffff880135849880 x1830967794318208/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.457979:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849880 with x1830967794318208 ext(2981888->2985983) 00002000:00010000:2.0:1746147737.457985:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135849880 00000100:00100000:2.0:1746147737.458392:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7845 00000100:00100000:2.0:1746147737.458405:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794318208:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147737.458600:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:1960:x1830967794318208:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 196us (1359us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147737.458622:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7845 00002000:00100000:2.0:1746147737.458630:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (2981888->2985983) req@ffff880135849880 x1830967794318208/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/4536 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.458637:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135849880 with x1830967794318208 ext(2981888->2985983) 00002000:00010000:2.0:1746147737.458640:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135849880 00000100:00100000:3.0:1746147737.460852:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.461452:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794318464 00000100:00100000:1.0:1746147737.461462:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794318464 00000100:00100000:1.0:1746147737.461525:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5098 00000100:00100000:1.0:1746147737.461536:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+22:32659:x1830967794318464:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:1.0:1746147737.461801:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:32659:x1830967794318464:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 264us (955us total) trans 8589946222 rc 0/0 00000100:00100000:1.0:1746147737.461808:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5098 00000001:00080000:2.0:1746147737.464570:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874528 is committed 00000001:00080000:2.0:1746147737.464670:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874423 is committed 00000001:00080000:2.0:1746147737.464707:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874478 is committed 00000001:00080000:2.0:1746147737.464731:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874411 is committed 00000001:00080000:2.0:1746147737.464737:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874406 is committed 00000001:00080000:2.0:1746147737.464743:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874530 is committed 00000001:00080000:2.0:1746147737.464772:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874464 is committed 00000001:00080000:2.0:1746147737.464832:0:2158:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874500 is committed 00000100:00100000:0.0:1746147737.466422:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.466539:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794318592 00000100:00100000:2.0:1746147737.466548:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794318592 00000100:00100000:2.0:1746147737.466595:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17393 00000100:00100000:2.0:1746147737.466618:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:32657:x1830967794318592:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147737.466638:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.466656:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf15 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.466685:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c647200/0xe64d3fbf12a7fa98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce90 expref: 18 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.466693:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fae5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcec8 expref: 7 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.466699:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.466700:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.466703:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4022272->4194303] (req 4022272->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 18 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.466733:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fae5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcec8 expref: 7 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.466745:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fae5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcec8 expref: 7 pid: 22183 timeout: 916 lvb_type: 1 00000100:00100000:2.0:1746147737.466757:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796602624:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.466846:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c647200/0xe64d3fbf12a7fa98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce90 expref: 18 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.466859:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c647200/0xe64d3fbf12a7fa98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce90 expref: 18 pid: 4591 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.466868:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796602752:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147737.466924:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6176c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.468282:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796602624:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147737.468291:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796602752:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.468311:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4022272->4194303] (req 4022272->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 18 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.468324:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941ba600, rc 0) 00000100:00100000:2.0:1746147737.468357:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:32657:x1830967794318592:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1753us (1942us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.468364:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17393 00000100:00100000:0.0:1746147737.469131:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.469234:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794318720 00000100:00100000:3.0:1746147737.469240:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794318720 00010000:00010000:3.0:1746147737.469264:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c647200/0xe64d3fbf12a7fa98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce90 expref: 18 pid: 4591 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.469420:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8884 00000100:00100000:3.0:1746147737.469425:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1959:x1830967794318720:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.469433:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147737.469450:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c647200/0xe64d3fbf12a7fa98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce90 expref: 18 pid: 4591 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.469457:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c647200/0xe64d3fbf12a7fa98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce90 expref: 18 pid: 4591 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.469474:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c647200/0xe64d3fbf12a7fa98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce90 expref: 18 pid: 4591 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.469492:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147737.469554:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1959:x1830967794318720:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 129us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.469558:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8884 00000100:00100000:0.0:1746147737.469845:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.469879:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794318848 00000100:00100000:3.0:1746147737.469911:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794318848 00010000:00010000:3.0:1746147737.469923:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fae5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcec8 expref: 8 pid: 22183 timeout: 916 lvb_type: 1 00000100:00100000:3.0:1746147737.470021:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8885 00000100:00100000:3.0:1746147737.470066:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1960:x1830967794318848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.470074:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147737.470082:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fae5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcec8 expref: 8 pid: 22183 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746147737.470091:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fae5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcec8 expref: 8 pid: 22183 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746147737.470104:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fae5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcec8 expref: 8 pid: 22183 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746147737.470112:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.470114:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.470121:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4022272->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 16 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.470128:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4022272->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 16 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.470155:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4022272->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 16 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147737.470167:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796602880:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147737.470442:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.471405:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796602880:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147737.471417:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147737.471437:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1960:x1830967794318848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1411us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.471444:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8885 00000100:00100000:0.0:1746147737.471635:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.471674:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794319104 00000100:00100000:3.0:1746147737.471680:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794319104 00002000:00100000:3.0:1746147737.471706:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (4022272->4026367) req@ffff8800a8acd180 x1830967794319104/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.471721:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acd180 with x1830967794319104 ext(4022272->4026367) 00002000:00010000:3.0:1746147737.471724:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acd180 00000100:00100000:3.0:1746147737.471745:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7846 00000100:00100000:3.0:1746147737.471750:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1958:x1830967794319104:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147737.471912:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1958:x1830967794319104:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 161us (277us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147737.471918:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7846 00002000:00100000:3.0:1746147737.471922:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (4022272->4026367) req@ffff8800a8acd180 x1830967794319104/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/4536 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.471929:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acd180 with x1830967794319104 ext(4022272->4026367) 00002000:00010000:3.0:1746147737.471932:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8acd180 00000100:00100000:0.0:1746147737.474109:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.474220:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794319232 00000100:00100000:2.0:1746147737.474227:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794319232 00000100:00100000:2.0:1746147737.474489:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17394 00000100:00100000:2.0:1746147737.474496:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:32657:x1830967794319232:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147737.474516:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.474532:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf1c expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.474561:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->2985983) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 7 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.474572:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.474574:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.474577:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [4194304->4587519] (req 4194304->4587519) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 21 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.474670:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->2985983) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 7 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.474682:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->2985983) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 7 pid: 6715 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.474693:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796603008:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147737.474928:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6176c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147737.476002:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.476007:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:6715:1830967796603008:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.476024:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [4194304->4587519] (req 4194304->4587519) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 21 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.476035:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941bac00, rc 0) 00000100:00100000:3.0:1746147737.476044:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794319360 00000100:00100000:3.0:1746147737.476048:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794319360 00000100:00100000:2.0:1746147737.476069:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32657:x1830967794319232:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1573us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.476076:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17394 00002000:00100000:3.0:1746147737.476077:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2883584->2985983) req@ffff8800a8aced80 x1830967794319360/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.476085:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8aced80 with x1830967794319360 ext(2883584->2985983) 00010000:00010000:3.0:1746147737.476090:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 8 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.476100:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 8 pid: 6715 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746147737.476106:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a8aced80 00000100:00100000:3.0:1746147737.476124:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1597 00000100:00100000:3.0:1746147737.476131:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1960:x1830967794319360:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:3.0:1746147737.478186:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794319360:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 2045us (2175us total) trans 17179874532 rc 0/0 00000100:00100000:3.0:1746147737.478195:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1597 00002000:00100000:3.0:1746147737.478202:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2883584->2985983) req@ffff8800a8aced80 x1830967794319360/t17179874532(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/448 e 0 to 0 dl 1746147748 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.478211:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8aced80 with x1830967794319360 ext(2883584->2985983) 00010000:00010000:3.0:1746147737.478218:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 10 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.478230:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 10 pid: 6715 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746147737.478236:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a8aced80 00000100:00100000:0.0:1746147737.482116:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.482210:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794319488 00000100:00100000:3.0:1746147737.482219:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794319488 00010000:00010000:3.0:1746147737.482252:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 10 pid: 6715 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.482282:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8886 00000100:00100000:3.0:1746147737.482289:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1957:x1830967794319488:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.482300:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147737.482320:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2883584->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 10 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.482335:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2883584->2985983) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 10 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.482356:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941bba00/0xe64d3fbf12a7fb63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2883584->2985983) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf0e expref: 10 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.482369:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.482372:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.482379:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 20 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.482386:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 20 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.482412:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 20 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147737.482422:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796603136:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147737.482508:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.484498:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796603136:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147737.484519:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147737.484557:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1957:x1830967794319488:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2268us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.484566:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8886 00000100:00100000:0.0:1746147737.486449:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.486565:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794319744 00000100:00100000:3.0:1746147737.486574:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794319744 00002000:00100000:3.0:1746147737.486629:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4583424->4587519) req@ffff8800a8acea00 x1830967794319744/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.486640:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acea00 with x1830967794319744 ext(4583424->4587519) 00002000:00010000:3.0:1746147737.486645:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acea00 00000100:00100000:3.0:1746147737.486680:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7847 00000100:00100000:3.0:1746147737.486689:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794319744:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147737.486923:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794319744:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 235us (480us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147737.486930:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7847 00002000:00100000:3.0:1746147737.486935:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4583424->4587519) req@ffff8800a8acea00 x1830967794319744/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/4536 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.486942:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8acea00 with x1830967794319744 ext(4583424->4587519) 00002000:00010000:3.0:1746147737.486945:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8acea00 00000100:00100000:0.0:1746147737.488192:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.488366:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794320000 00000100:00100000:2.0:1746147737.488372:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794320000 00000100:00100000:2.0:1746147737.488411:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5099 00000100:00100000:2.0:1746147737.488417:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130ebd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:32657:x1830967794320000:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:2.0:1746147737.488841:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130ebd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:32657:x1830967794320000:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 422us (651us total) trans 8589946223 rc 0/0 00000100:00100000:2.0:1746147737.488847:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5099 00000100:00100000:0.0:1746147737.588468:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.589018:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794320128 00000100:00100000:2.0:1746147737.589039:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794320128 00000100:00100000:2.0:1746147737.589136:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17395 00000100:00100000:2.0:1746147737.589145:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1957:x1830967794320128:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.589161:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.589196:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941ba800/0xe64d3fbf12a7fb78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf23 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147737.589613:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.589988:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794320256 00000100:00100000:3.0:1746147737.589996:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794320256 00000100:00100000:3.0:1746147737.590033:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17396 00000100:00100000:3.0:1746147737.590040:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967794320256:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147737.590054:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147737.590069:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3cc00/0xe64d3fbf12a7fb7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf2a expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147737.590116:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796603264:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147737.590207:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.594128:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796603392:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147737.595054:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.595292:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796603264:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147737.595327:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3cc00/0xe64d3fbf12a7fb7f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf2a expref: 22 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.595343:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3cc00/0xe64d3fbf12a7fb7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf2a expref: 22 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.595371:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3cc00, rc 0) 00000100:00100000:3.0:1746147737.595416:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967794320256:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5374us (5813us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147737.595425:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17396 00000100:00100000:2.0:1746147737.600136:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796603392:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147737.600173:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941ba800/0xe64d3fbf12a7fb78 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf23 expref: 18 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.600190:0:6715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941ba800/0xe64d3fbf12a7fb78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf23 expref: 18 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.600418:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941ba800, rc 0) 00000100:00100000:2.0:1746147737.600811:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:1957:x1830967794320128:12345-192.168.202.10@tcp:101:cat.0 Request processed in 11666us (12352us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147737.600820:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17395 00000100:00100000:0.0:1746147737.609184:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.609250:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794320384 00000100:00100000:2.0:1746147737.609260:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794320384 00000100:00100000:2.0:1746147737.609558:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17397 00000100:00100000:2.0:1746147737.609567:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+17:32665:x1830967794320384:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.609587:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.609617:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7fb86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf31 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.609651:0:6715:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 6 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.609659:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.609661:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.609665:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7fb86 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf31 expref: 18 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.609695:0:6715:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 6 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.609708:0:6715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 6 pid: 8468 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.609721:0:6715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796603520:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147737.609813:0:6715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147737.613445:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.613805:0:6715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:6715:1830967796603520:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.613831:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7fb86 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf31 expref: 18 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.613854:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941bb600, rc 0) 00000100:00100000:3.0:1746147737.614075:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794320512 00000100:00100000:3.0:1746147737.614082:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794320512 00002000:00100000:3.0:1746147737.614122:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1712128->2097151) req@ffff880091118e00 x1830967794320512/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.614131:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091118e00 with x1830967794320512 ext(1712128->2097151) 00010000:00010000:3.0:1746147737.614137:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 7 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.614149:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 7 pid: 8468 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746147737.614155:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091118e00 00000100:00100000:3.0:1746147737.614183:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1598 00000100:00100000:3.0:1746147737.614190:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+7:1960:x1830967794320512:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:2.0:1746147737.614373:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:32665:x1830967794320384:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4797us (5190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.614383:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17397 00000100:00100000:3.0:1746147737.622950:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967794320512:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 8748us (9503us total) trans 21474841758 rc 0/0 00000100:00100000:3.0:1746147737.622963:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1598 00002000:00100000:3.0:1746147737.622974:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1712128->2097151) req@ffff880091118e00 x1830967794320512/t21474841758(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/448 e 0 to 0 dl 1746147748 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.622983:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091118e00 with x1830967794320512 ext(1712128->2097151) 00010000:00010000:3.0:1746147737.622993:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 9 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.623010:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 9 pid: 8468 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746147737.623017:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091118e00 00000100:00100000:0.0:1746147737.627139:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.627248:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794320640 00000100:00100000:3.0:1746147737.627258:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794320640 00010000:00010000:3.0:1746147737.627294:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 9 pid: 8468 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.628152:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8887 00000100:00100000:3.0:1746147737.628161:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1957:x1830967794320640:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.628175:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147737.628199:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 9 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.628211:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 9 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.628239:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c647a00/0xe64d3fbf12a7fa83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce82 expref: 9 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.628263:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.628265:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.628273:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7fb86 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf31 expref: 17 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.628281:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7fb86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf31 expref: 17 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.628315:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7fb86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf31 expref: 17 pid: 6715 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147737.628328:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796603648:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147737.628418:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.630164:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796603648:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147737.630181:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147737.630212:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+8:1957:x1830967794320640:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2053us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.630222:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8887 00000100:00100000:0.0:1746147737.635050:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.635619:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794320896 00000100:00100000:3.0:1746147737.635629:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794320896 00002000:00100000:3.0:1746147737.635674:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009111a300 x1830967794320896/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.635691:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111a300 with x1830967794320896 ext(1048576->2097151) 00002000:00010000:3.0:1746147737.635696:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009111a300 00000100:00100000:3.0:1746147737.635731:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7848 00000100:00100000:3.0:1746147737.635737:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1959:x1830967794320896:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147737.646219:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.646282:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794321024 00000100:00100000:0.0:1746147737.646282:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.646292:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794321024 00000100:00100000:0.0:1746147737.646321:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.646338:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794321152 00000100:00100000:2.0:1746147737.646340:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794321152 00000100:00100000:2.0:1746147737.646360:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794321280 00000100:00100000:2.0:1746147737.646362:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794321280 00000100:00100000:3.0:1746147737.646388:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17398 00000100:00100000:2.0:1746147737.646400:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17399 00000100:00100000:3.0:1746147737.646405:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794321024:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147737.646407:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794321152:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:1.0:1746147737.646417:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17400 00010000:00010000:2.0:1746147737.646424:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147737.646424:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794321280:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147737.646425:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147737.646430:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.646442:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941ba800/0xe64d3fbf12a7fb94 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf3f expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.646442:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009170c400/0xe64d3fbf12a7fb8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf46 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.646444:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a542e200/0xe64d3fbf12a7fb9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf38 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.646465:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.646467:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.646474:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a542e200/0xe64d3fbf12a7fb9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf38 expref: 11 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.646488:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a542e200/0xe64d3fbf12a7fb9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf38 expref: 11 pid: 4591 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147737.646488:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796603904:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147737.646488:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796603776:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147737.646497:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a542e200, rc 0) 00000100:00100000:1.0:1746147737.646554:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.646681:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.646698:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794321024:12345-192.168.202.10@tcp:101:cat.0 Request processed in 300us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.646704:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17398 00000100:00100000:3.0:1746147737.647250:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1959:x1830967794320896:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11511us (12210us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147737.647260:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7848 00002000:00100000:3.0:1746147737.647267:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff88009111a300 x1830967794320896/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.647275:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111a300 with x1830967794320896 ext(1048576->2097151) 00002000:00010000:3.0:1746147737.647279:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009111a300 00000100:00100000:1.0:1746147737.647730:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796603776:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147737.647751:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009170c400/0xe64d3fbf12a7fb8d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf46 expref: 10 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.647761:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009170c400/0xe64d3fbf12a7fb8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf46 expref: 10 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.647785:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009170c400, rc 0) 00000100:00100000:1.0:1746147737.647805:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794321280:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1382us (1483us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147737.647811:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17400 00000100:00100000:3.0:1746147737.648414:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796603904:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147737.648430:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941ba800/0xe64d3fbf12a7fb94 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf3f expref: 10 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.648439:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941ba800/0xe64d3fbf12a7fb94 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf3f expref: 10 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.648459:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941ba800, rc 0) 00000100:00100000:3.0:1746147737.648479:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794321152:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2073us (2197us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147737.648485:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17399 00000100:00100000:0.0:1746147737.652088:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.652521:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794321408 00000100:00100000:3.0:1746147737.652530:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794321408 00000100:00100000:3.0:1746147737.652590:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17401 00000100:00100000:3.0:1746147737.652598:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32665:x1830967794321408:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147737.652628:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147737.652646:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fba2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf4d expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.652678:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 8 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.652686:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147737.652688:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147737.652691:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fba2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf4d expref: 22 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.652721:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 8 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.652733:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 8 pid: 9615 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.652744:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796604032:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147737.653251:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.654874:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796604032:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147737.654925:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fba2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf4d expref: 22 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.654942:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3ca00, rc 0) 00000100:00100000:3.0:1746147737.654980:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:32665:x1830967794321408:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2383us (2903us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.654988:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17401 00000100:00100000:0.0:1746147737.655340:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.655379:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.655922:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794321536 00000100:00100000:3.0:1746147737.655930:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794321536 00002000:00100000:3.0:1746147737.655969:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1425407) req@ffff88009111b480 x1830967794321536/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.655984:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111b480 with x1830967794321536 ext(1048576->1425407) 00000100:00100000:2.0:1746147737.655989:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794321792 00010000:00010000:3.0:1746147737.655991:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 9 pid: 9615 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.655993:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794321792 00010000:00010000:3.0:1746147737.656003:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 9 pid: 9615 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746147737.656009:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009111b480 00002000:00100000:2.0:1746147737.656011:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880091118700 x1830967794321792/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.656017:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091118700 with x1830967794321792 ext(1048576->2097151) 00002000:00010000:2.0:1746147737.656020:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091118700 00000100:00100000:3.0:1746147737.656027:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1599 00000100:00100000:3.0:1746147737.656034:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1957:x1830967794321536:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147737.656045:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7849 00000100:00100000:2.0:1746147737.656050:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1957:x1830967794321792:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147737.663725:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967794321536:12345-192.168.202.10@tcp:4:cat.0 Request processed in 7679us (8374us total) trans 17179874533 rc 0/0 00000100:00100000:3.0:1746147737.663737:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1599 00002000:00100000:3.0:1746147737.663749:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1425407) req@ffff88009111b480 x1830967794321536/t17179874533(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/448 e 0 to 0 dl 1746147748 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.663757:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009111b480 with x1830967794321536 ext(1048576->1425407) 00010000:00010000:3.0:1746147737.663766:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 11 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.663780:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 11 pid: 9615 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746147737.663786:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009111b480 00000100:00100000:3.0:1746147737.664453:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1957:x1830967794321792:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8399us (9071us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147737.664461:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7849 00002000:00100000:3.0:1746147737.664578:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880091118700 x1830967794321792/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.664587:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091118700 with x1830967794321792 ext(1048576->2097151) 00002000:00010000:3.0:1746147737.664590:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091118700 00000100:00100000:0.0:1746147737.666097:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.666192:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794321920 00000100:00100000:3.0:1746147737.666200:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794321920 00010000:00010000:3.0:1746147737.666235:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 11 pid: 9615 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.666275:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8888 00000100:00100000:3.0:1746147737.666283:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794321920:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.666297:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147737.666317:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 11 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.666329:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 11 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.666352:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c646e00/0xe64d3fbf12a7fa91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce97 expref: 11 pid: 9615 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.667065:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.667068:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.667077:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fba2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf4d expref: 21 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.667090:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fba2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf4d expref: 21 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.667305:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fba2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf4d expref: 21 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147737.667318:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796604160:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147737.667392:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147737.670736:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.670837:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794322048 00000100:00100000:3.0:1746147737.670845:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794322048 00000100:00100000:3.0:1746147737.670902:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17402 00000100:00100000:3.0:1746147737.670908:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32668:x1830967794322048:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147737.670926:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147737.670942:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7fba9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf54 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.670962:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.670964:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.670970:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7fba9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf54 expref: 12 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.670982:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7fba9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf54 expref: 12 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.670992:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095092400, rc 0) 00000100:00100000:3.0:1746147737.671028:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32668:x1830967794322048:12345-192.168.202.10@tcp:101:cat.0 Request processed in 121us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.671033:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17402 00000100:00100000:2.0:1746147737.671194:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796604160:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147737.671210:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147737.671232:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794321920:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4950us (5142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.671240:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8888 00000100:00100000:0.0:1746147737.672081:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.672144:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794322304 00000100:00100000:3.0:1746147737.672148:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794322304 00002000:00100000:3.0:1746147737.672174:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800949d5500 x1830967794322304/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.672182:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d5500 with x1830967794322304 ext(1048576->2097151) 00002000:00010000:3.0:1746147737.672187:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d5500 00000100:00100000:3.0:1746147737.672200:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7850 00000100:00100000:3.0:1746147737.672206:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794322304:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147737.677297:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.677336:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794322560 00000100:00100000:1.0:1746147737.677344:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794322560 00002000:00100000:1.0:1746147737.677388:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88013584b480 x1830967794322560/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.677398:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584b480 with x1830967794322560 ext(1048576->2097151) 00002000:00010000:1.0:1746147737.677404:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584b480 00000100:00100000:1.0:1746147737.677433:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7851 00000100:00100000:1.0:1746147737.677440:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794322560:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147737.686217:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794322304:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13998us (14124us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147737.686230:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7850 00002000:00100000:3.0:1746147737.686243:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800949d5500 x1830967794322304/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.686253:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d5500 with x1830967794322304 ext(1048576->2097151) 00000100:00100000:2.0:1746147737.686307:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.686346:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794322816 00000100:00100000:2.0:1746147737.686353:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794322816 00000100:00100000:2.0:1746147737.686388:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12181 00000100:00100000:2.0:1746147737.686393:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+23:32670:x1830967794322816:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147737.686412:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.686430:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051600/0xe64d3fbf12a7fbb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf5b expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.686438:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794322560:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8999us (9155us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147737.686444:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7851 00002000:00100000:1.0:1746147737.686448:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff88013584b480 x1830967794322560/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.686454:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013584b480 with x1830967794322560 ext(1048576->2097151) 00002000:00010000:1.0:1746147737.686458:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013584b480 00010000:00010000:2.0:1746147737.686526:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.686540:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7f980 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce12 expref: 24 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.686547:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d200/0xe64d3fbf12a7f9aa lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce19 expref: 334 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.686554:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.686701:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d200/0xe64d3fbf12a7f9aa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce19 expref: 334 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.686713:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d200/0xe64d3fbf12a7f9aa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce19 expref: 334 pid: 14546 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.686725:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796604288:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.686798:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7f980 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce12 expref: 24 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.686806:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7f980 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce12 expref: 24 pid: 14547 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.686815:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796604416:192.168.202.10@tcp:104: 00002000:00010000:3.0:1746147737.686849:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d5500 00000100:00100000:2.0:1746147737.687387:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.688794:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796604288:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147737.689223:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.689238:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796604416:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.689260:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:1.0:1746147737.689324:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.689378:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794322944 00000100:00100000:3.0:1746147737.689384:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794322944 00000100:00100000:0.0:1746147737.689406:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794323072 00000100:00100000:0.0:1746147737.689410:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794323072 00010000:00010000:3.0:1746147737.689413:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d200/0xe64d3fbf12a7f9aa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce19 expref: 335 pid: 14546 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746147737.689421:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7f980 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce12 expref: 25 pid: 14547 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.689444:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8889 00000100:00100000:0.0:1746147737.689468:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8890 00000100:00100000:0.0:1746147737.689474:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+25:1960:x1830967794323072:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147737.689486:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147737.689492:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7f980 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce12 expref: 25 pid: 14547 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746147737.689501:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7f980 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce12 expref: 25 pid: 14547 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.689504:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+335:1958:x1830967794322944:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.689511:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147737.689514:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d200/0xe64d3fbf12a7f9aa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce19 expref: 335 pid: 14546 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746147737.689557:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9213a00/0xe64d3fbf12a7f980 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce12 expref: 25 pid: 14547 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.689559:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d200/0xe64d3fbf12a7f9aa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce19 expref: 335 pid: 14546 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.689575:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd1d200/0xe64d3fbf12a7f9aa lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafce19 expref: 335 pid: 14546 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746147737.689582:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147737.689587:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147737.689595:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147737.689614:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147737.689630:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147737.689646:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.689651:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147737.689663:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:1960:x1830967794323072:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 189us (340us total) trans 0 rc 0/0 00000004:00200000:2.0:1746147737.689668:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:0.0:1746147737.689669:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8890 00010000:00010000:3.0:1746147737.689765:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147737.689768:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147737.689789:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013584bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:1958:x1830967794322944:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 338us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.689795:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8889 00010000:00010000:2.0:1746147737.690069:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051600/0xe64d3fbf12a7fbb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf5b expref: 25 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.690098:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf5b expref: 24 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.690104:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147737.690107:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147737.690108:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1050000, rc 0) 00000100:00100000:2.0:1746147737.690130:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:32670:x1830967794322816:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3737us (3824us total) trans 8589946224 rc 0/0 00000100:00100000:2.0:1746147737.690136:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12181 00000100:00100000:0.0:1746147737.694988:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.695046:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794323200 00000100:00100000:0.0:1746147737.695047:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.695054:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794323200 00000100:00100000:1.0:1746147737.695108:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794323328 00000100:00100000:1.0:1746147737.695110:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794323328 00000100:00100000:1.0:1746147737.695127:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17403 00000100:00100000:1.0:1746147737.695134:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794323200:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147737.695153:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147737.695170:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136575400/0xe64d3fbf12a7fbc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf62 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147737.695224:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796604544:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147737.695301:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.695363:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17404 00000100:00100000:2.0:1746147737.695370:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967794323328:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.695377:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.695388:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7fbcc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf69 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147737.695411:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796604672:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147737.695432:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.699959:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796604672:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147737.699959:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1830967796604544:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147737.699989:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7fbcc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf69 expref: 10 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.699989:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136575400/0xe64d3fbf12a7fbc5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf62 expref: 12 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.700002:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136575400/0xe64d3fbf12a7fbc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf62 expref: 12 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.700004:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1051800/0xe64d3fbf12a7fbcc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf69 expref: 10 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.700011:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1051800, rc 0) 00010000:00010000:1.0:1746147737.700025:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136575400, rc 0) 00000100:00100000:1.0:1746147737.700059:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794323200:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4924us (5085us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147737.700068:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17403 00000100:00100000:2.0:1746147737.700085:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967794323328:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4717us (5038us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147737.700090:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17404 00000100:00100000:0.0:1746147737.702397:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.706796:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794323584 00000100:00100000:3.0:1746147737.706812:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794323584 00002000:00100000:3.0:1746147737.706867:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800949d6680 x1830967794323584/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.706877:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d6680 with x1830967794323584 ext(2097152->3145727) 00002000:00010000:3.0:1746147737.706894:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d6680 00000100:00100000:3.0:1746147737.706935:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7852 00000100:00100000:3.0:1746147737.706942:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794323584:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147737.709330:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.710622:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.710663:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.710692:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.710727:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794323712 00000100:00100000:0.0:1746147737.710736:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794323712 00002000:00100000:0.0:1746147737.710784:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800949d5180 x1830967794323712/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147737.710794:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d5180 with x1830967794323712 ext(3145728->4194303) 00002000:00010000:0.0:1746147737.710800:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d5180 00000100:00100000:0.0:1746147737.710822:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794324096 00000100:00100000:0.0:1746147737.710826:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794324096 00002000:00100000:0.0:1746147737.710842:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800949d4a80 x1830967794324096/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147737.710849:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d4a80 with x1830967794324096 ext(2097152->3145727) 00002000:00010000:0.0:1746147737.710852:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d4a80 00000100:00100000:0.0:1746147737.710869:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7853 00000100:00100000:0.0:1746147737.710879:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794323712:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147737.712661:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794324224 00000100:00100000:2.0:1746147737.712668:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794324224 00000100:00100000:2.0:1746147737.712717:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17405 00000100:00100000:2.0:1746147737.712724:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32668:x1830967794324224:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.712737:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.712753:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf70 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.712780:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 24 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.712787:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.712789:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.712792:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.712820:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 24 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.712835:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 24 pid: 6715 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.712847:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796604800:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147737.712940:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.712960:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794324736 00000100:00100000:2.0:1746147737.712963:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794324736 00000100:00100000:2.0:1746147737.712987:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12182 00000100:00100000:2.0:1746147737.712992:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+334:32672:x1830967794324736:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147737.713004:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.713015:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7fbda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf77 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.713100:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050800/0xe64d3fbf12a7fbe1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713110:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050800/0xe64d3fbf12a7fbe1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713121:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050800/0xe64d3fbf12a7fbe1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713133:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7fbe8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713139:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7fbe8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713144:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7fbe8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713252:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a7fbef lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713261:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a7fbef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713268:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a7fbef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:2.0:1746147737.713278:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147737.713371:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050800/0xe64d3fbf12a7fbe1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713379:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050800/0xe64d3fbf12a7fbe1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713384:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050800/0xe64d3fbf12a7fbe1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713390:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a1050800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147737.713393:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050800/0xe64d3fbf12a7fbe1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713400:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050800/0xe64d3fbf12a7fbe1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713412:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147737.713415:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147737.713418:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050800/0xe64d3fbf12a7fbe1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713423:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050800/0xe64d3fbf12a7fbe1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713440:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7fbe8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713445:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7fbe8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713449:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7fbe8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713453:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a1050400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147737.713455:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7fbe8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713459:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7fbe8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713465:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a02f4500) 00010000:00010000:2.0:1746147737.713467:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147737.713469:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7fbe8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713473:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050400/0xe64d3fbf12a7fbe8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147737.713508:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050e00/0xe64d3fbf12a7fbda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf77 expref: 337 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.713518:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a7fbef lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf77 expref: 336 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.713524:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147737.713527:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147737.713529:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1051400, rc 0) 00000100:00100000:2.0:1746147737.713550:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+336:32672:x1830967794324736:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 558us (2934us total) trans 8589946225 rc 0/0 00000100:00100000:2.0:1746147737.713556:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12182 00000100:00100000:1.0:1746147737.713557:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7854 00000100:00100000:1.0:1746147737.713567:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1959:x1830967794324096:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147737.713683:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.713698:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794324480 00000100:00100000:2.0:1746147737.713701:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794324480 00002000:00100000:2.0:1746147737.713715:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4022271) req@ffff88009c9a8a80 x1830967794324480/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.713723:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a8a80 with x1830967794324480 ext(3145728->4022271) 00002000:00010000:2.0:1746147737.713726:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9a8a80 00000100:00100000:2.0:1746147737.713734:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7855 00000100:00100000:2.0:1746147737.713737:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794324480:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147737.731427:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794323584:12345-192.168.202.10@tcp:3:cat.0 Request processed in 24469us (29026us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147737.731441:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7852 00002000:00100000:3.0:1746147737.731453:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800949d6680 x1830967794323584/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.731463:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d6680 with x1830967794323584 ext(2097152->3145727) 00010000:00010000:3.0:1746147737.731474:0:31359:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 24 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.731496:0:31359:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 24 pid: 6715 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746147737.731502:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949d6680 00000100:00100000:2.0:1746147737.731745:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796604800:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.731775:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.731791:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1051c00, rc 0) 00000100:00100000:2.0:1746147737.731817:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32668:x1830967794324224:12345-192.168.202.10@tcp:101:cat.0 Request processed in 19092us (21154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.731824:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17405 00000100:00100000:0.0:1746147737.733859:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.734451:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1960:x1830967794324480:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20709us (20765us total) trans 0 rc 876544/876544 00000100:00100000:1.0:1746147737.734462:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7855 00002000:00100000:1.0:1746147737.734474:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4022271) req@ffff88009c9a8a80 x1830967794324480/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 876544/876544 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.734483:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a8a80 with x1830967794324480 ext(3145728->4022271) 00002000:00010000:1.0:1746147737.734488:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c9a8a80 00000100:00100000:3.0:1746147737.735648:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794324864 00000100:00100000:3.0:1746147737.735656:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794324864 00002000:00100000:3.0:1746147737.735694:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4587519) req@ffff8800949d7b80 x1830967794324864/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.735702:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d7b80 with x1830967794324864 ext(4194304->4587519) 00010000:00010000:3.0:1746147737.735708:0:31359:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 24 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.735723:0:31359:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 24 pid: 6715 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746147737.735728:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949d7b80 00000100:00100000:1.0:1746147737.735863:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1600 00000100:00100000:1.0:1746147737.735871:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794324864:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:1.0:1746147737.740657:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1959:x1830967794324096:12345-192.168.202.10@tcp:3:cat.0 Request processed in 27080us (29953us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147737.740670:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7854 00002000:00100000:1.0:1746147737.740681:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800949d4a80 x1830967794324096/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.740690:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d4a80 with x1830967794324096 ext(2097152->3145727) 00002000:00010000:1.0:1746147737.740696:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d4a80 00000100:00100000:1.0:1746147737.742411:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794323712:12345-192.168.202.10@tcp:3:cat.0 Request processed in 31528us (33086us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147737.742420:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7853 00002000:00100000:1.0:1746147737.742429:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800949d5180 x1830967794323712/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.742436:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d5180 with x1830967794323712 ext(3145728->4194303) 00010000:00010000:1.0:1746147737.742444:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 24 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.742460:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 24 pid: 6715 timeout: 916 lvb_type: 0 00002000:00010000:1.0:1746147737.742466:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949d5180 00000100:00100000:1.0:1746147737.743992:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794324864:12345-192.168.202.10@tcp:4:cat.0 Request processed in 8112us (10132us total) trans 17179874534 rc 0/0 00000100:00100000:1.0:1746147737.744004:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1600 00002000:00100000:1.0:1746147737.744014:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4587519) req@ffff8800949d7b80 x1830967794324864/t17179874534(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/448 e 0 to 0 dl 1746147748 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.744023:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d7b80 with x1830967794324864 ext(4194304->4587519) 00010000:00010000:1.0:1746147737.744035:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 24 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.744050:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 24 pid: 6715 timeout: 916 lvb_type: 0 00002000:00010000:1.0:1746147737.744056:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949d7b80 00000100:00100000:0.0:1746147737.744761:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.744806:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794324992 00000100:00100000:2.0:1746147737.744815:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794324992 00000100:00100000:2.0:1746147737.744855:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17406 00000100:00100000:2.0:1746147737.744860:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32665:x1830967794324992:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.744874:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.744915:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7fbfd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf7e expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.744938:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.744939:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.744942:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7fbfd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf7e expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.744951:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7fbfd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf7e expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.744958:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad2c2e00, rc 0) 00000100:00100000:2.0:1746147737.744992:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:32665:x1830967794324992:12345-192.168.202.10@tcp:101:cat.0 Request processed in 132us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.744996:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17406 00000100:00100000:0.0:1746147737.748990:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.749256:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794325120 00000100:00100000:2.0:1746147737.749266:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794325120 00000100:00100000:2.0:1746147737.749400:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17407 00000100:00100000:2.0:1746147737.749408:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32670:x1830967794325120:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147737.749427:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.749445:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf85 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.749473:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.749480:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.749490:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147737.749494:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.749530:0:4591:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.749542:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 13 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.749551:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad2c2c00, rc 0) 00000100:00100000:2.0:1746147737.749613:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32670:x1830967794325120:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 206us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.749619:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17407 00000100:00100000:0.0:1746147737.751454:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.751510:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794325248 00000100:00100000:3.0:1746147737.751515:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794325248 00010000:00010000:3.0:1746147737.751541:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 25 pid: 6715 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.751568:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8891 00000100:00100000:3.0:1746147737.751572:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794325248:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.751581:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147737.751612:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 25 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.751628:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 25 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.751652:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941bac00/0xe64d3fbf12a7fb71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4587519) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf1c expref: 25 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.751698:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.751701:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.751709:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.751719:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.751728:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.751729:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.751733:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7fbfd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf7e expref: 24 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.751740:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7fbfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf7e expref: 24 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.751773:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7fbfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf7e expref: 24 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147737.751788:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796605056:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147737.751959:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.751972:0:7312:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 12 pid: 4591 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.751981:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796605184:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147737.752866:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147737.756517:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.756609:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796605056:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147737.756666:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794325504 00000100:00100000:1.0:1746147737.756672:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794325504 00002000:00100000:1.0:1746147737.756712:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a21a0000 x1830967794325504/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.756721:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a0000 with x1830967794325504 ext(3145728->4194303) 00002000:00010000:1.0:1746147737.756725:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a21a0000 00000100:00100000:1.0:1746147737.756751:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7856 00000100:00100000:1.0:1746147737.756757:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794325504:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147737.760188:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.760259:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794325760 00000100:00100000:2.0:1746147737.760267:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794325760 00002000:00100000:2.0:1746147737.760309:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a21a0380 x1830967794325760/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.760318:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a0380 with x1830967794325760 ext(2097152->3145727) 00010000:00010000:2.0:1746147737.760328:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 13 pid: 4591 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746147737.760343:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 13 pid: 4591 timeout: 916 lvb_type: 0 00002000:00010000:2.0:1746147737.760354:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a21a0380 00000100:00100000:2.0:1746147737.760372:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1601 00000100:00100000:2.0:1746147737.760378:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794325760:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147737.760581:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796605184:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147737.760614:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147737.761307:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794325248:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 9730us (9854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.761318:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8891 00000100:00100000:1.0:1746147737.768378:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794325504:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11609us (11860us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147737.768389:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7856 00002000:00100000:1.0:1746147737.768400:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a21a0000 x1830967794325504/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.768410:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a0000 with x1830967794325504 ext(3145728->4194303) 00002000:00010000:1.0:1746147737.768416:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a21a0000 00000100:00100000:2.0:1746147737.769039:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794325760:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 8659us (8859us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147737.769046:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1601 00002000:00100000:2.0:1746147737.769052:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800a21a0380 x1830967794325760/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.769059:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a0380 with x1830967794325760 ext(2097152->3145727) 00010000:00010000:2.0:1746147737.769067:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 13 pid: 4591 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746147737.769082:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 13 pid: 4591 timeout: 916 lvb_type: 0 00002000:00010000:2.0:1746147737.769088:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a21a0380 00000100:00100000:0.0:1746147737.772104:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.772196:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794325888 00000100:00100000:1.0:1746147737.772204:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794325888 00000100:00100000:1.0:1746147737.772298:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17408 00000100:00100000:1.0:1746147737.772306:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32668:x1830967794325888:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147737.772325:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147737.772349:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf8c expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.772380:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4022272->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 17 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.772388:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147737.772390:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147737.772394:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 10 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.772422:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4022272->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 17 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.772433:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4022272->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 17 pid: 6715 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746147737.772444:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796605312:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147737.772688:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147737.772714:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.772787:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794326144 00000100:00100000:3.0:1746147737.772796:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794326144 00010000:00010000:3.0:1746147737.772830:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 13 pid: 4591 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746147737.772850:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.772867:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794326016 00000100:00100000:3.0:1746147737.772869:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8892 00000100:00100000:2.0:1746147737.772871:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794326016 00000100:00100000:3.0:1746147737.772876:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794326144:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.772913:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147737.772921:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17409 00000100:00100000:2.0:1746147737.772927:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794326016:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147737.772934:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 13 pid: 4591 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746147737.772935:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.772943:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2a00/0xe64d3fbf12a7fc12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf93 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.772950:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 13 pid: 4591 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746147737.772956:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.772970:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1051c00/0xe64d3fbf12a7fbd3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf70 expref: 13 pid: 4591 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746147737.772974:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2a00/0xe64d3fbf12a7fc12 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf93 expref: 25 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.772983:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2a00/0xe64d3fbf12a7fc12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf93 expref: 25 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.772986:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.772987:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.772992:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.772997:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.773018:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 12 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147737.773025:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796605440:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147737.773034:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad2c2a00, rc 0) 00000100:00100000:3.0:1746147737.773076:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.773177:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794326016:12345-192.168.202.10@tcp:101:cat.0 Request processed in 249us (326us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147737.773183:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17409 00000100:00100000:1.0:1746147737.774367:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f514a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796605312:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147737.774391:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 10 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.774402:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21de600, rc 0) 00000100:00100000:1.0:1746147737.774438:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32668:x1830967794325888:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2131us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147737.774444:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17408 00000100:00100000:3.0:1746147737.774484:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7312:1830967796605440:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147737.774496:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147737.774513:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1958:x1830967794326144:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1638us (1800us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.774521:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8892 00000100:00100000:0.0:1746147737.774759:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.774838:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.774947:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794326528 00000100:00100000:1.0:1746147737.774952:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794326528 00002000:00100000:1.0:1746147737.774981:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (2842624->2846719) req@ffff8800a21a0e00 x1830967794326528/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.774990:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a0e00 with x1830967794326528 ext(2842624->2846719) 00002000:00010000:1.0:1746147737.774994:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a21a0e00 00000100:00100000:1.0:1746147737.775006:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794326272 00000100:00100000:1.0:1746147737.775008:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794326272 00000100:00100000:3.0:1746147737.775012:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7857 00000100:00100000:3.0:1746147737.775019:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1957:x1830967794326528:12345-192.168.202.10@tcp:3:multiop.0 00002000:00100000:1.0:1746147737.775020:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (4022272->4194303) req@ffff8800a21a1180 x1830967794326272/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.775025:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a1180 with x1830967794326272 ext(4022272->4194303) 00010000:00010000:1.0:1746147737.775030:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4022272->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 18 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.775041:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4022272->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 18 pid: 6715 timeout: 916 lvb_type: 0 00002000:00010000:1.0:1746147737.775046:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a21a1180 00000100:00100000:1.0:1746147737.775055:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1602 00000100:00100000:1.0:1746147737.775058:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+18:1957:x1830967794326272:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147737.775149:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1957:x1830967794326528:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 131us (391us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147737.775155:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7857 00002000:00100000:3.0:1746147737.775159:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (2842624->2846719) req@ffff8800a21a0e00 x1830967794326528/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/4536 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.775166:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a0e00 with x1830967794326528 ext(2842624->2846719) 00002000:00010000:3.0:1746147737.775169:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a21a0e00 00000100:00100000:1.0:1746147737.778430:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1957:x1830967794326272:12345-192.168.202.10@tcp:4:cat.0 Request processed in 3360us (3581us total) trans 21474841759 rc 0/0 00000100:00100000:1.0:1746147737.778441:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1602 00002000:00100000:1.0:1746147737.778452:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (4022272->4194303) req@ffff8800a21a1180 x1830967794326272/t21474841759(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/448 e 0 to 0 dl 1746147748 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.778460:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a1180 with x1830967794326272 ext(4022272->4194303) 00010000:00010000:1.0:1746147737.778470:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4022272->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 20 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.778485:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4022272->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 20 pid: 6715 timeout: 916 lvb_type: 0 00002000:00010000:1.0:1746147737.778491:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a21a1180 00000100:00100000:0.0:1746147737.779915:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.779983:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794326656 00000100:00100000:1.0:1746147737.779991:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794326656 00000100:00100000:1.0:1746147737.780081:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17410 00000100:00100000:1.0:1746147737.780089:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32670:x1830967794326656:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147737.780105:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147737.780121:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcf9a expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.780146:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147737.780151:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 11 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.780156:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147737.780159:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->2338815] (req 2097152->2338815) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 11 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.780189:0:8468:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 11 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.780202:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->2338815] (req 2097152->2338815) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 11 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.780210:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093da8e00, rc 0) 00000100:00100000:1.0:1746147737.780731:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32670:x1830967794326656:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 642us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147737.780737:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17410 00000100:00100000:2.0:1746147737.781097:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.781152:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794326912 00000100:00100000:1.0:1746147737.781155:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794326912 00002000:00100000:1.0:1746147737.781187:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009c9a9500 x1830967794326912/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.781195:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a9500 with x1830967794326912 ext(4194304->5017599) 00002000:00010000:1.0:1746147737.781200:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9a9500 00000100:00100000:1.0:1746147737.781223:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7858 00000100:00100000:1.0:1746147737.781228:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794326912:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147737.783646:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.783729:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794327040 00000100:00100000:1.0:1746147737.783736:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794327040 00000100:00100000:1.0:1746147737.783865:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17411 00000100:00100000:1.0:1746147737.783872:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:32672:x1830967794327040:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147737.783934:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147737.783969:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcfa1 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147737.783996:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39400/0xe64d3fbf12a7f8e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdd3 expref: 21 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147737.784005:0:8468:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1dc00/0xe64d3fbf12a7f902 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdef expref: 10 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147737.784010:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147737.784012:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147737.784015:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1130496->1753087] (req 1130496->1753087) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147737.784046:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd1dc00/0xe64d3fbf12a7f902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdef expref: 10 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147737.784057:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bd1dc00/0xe64d3fbf12a7f902 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdef expref: 10 pid: 4591 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746147737.784069:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a21a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796605696:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147737.784262:0:8468:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb39400/0xe64d3fbf12a7f8e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdd3 expref: 21 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147737.784275:0:8468:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb39400/0xe64d3fbf12a7f8e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdd3 expref: 21 pid: 8470 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746147737.784283:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a21a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796605824:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147737.784301:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147737.786333:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.786418:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a21a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796605696:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147737.786581:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794327168 00000100:00100000:3.0:1746147737.786587:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794327168 00010000:00010000:3.0:1746147737.786625:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4022272->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 22 pid: 6715 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.786648:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8893 00000100:00100000:3.0:1746147737.786654:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967794327168:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.786666:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147737.786685:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4022272->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 22 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.786695:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4022272->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 22 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.786715:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941ba600/0xe64d3fbf12a7fb6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4022272->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf15 expref: 22 pid: 6715 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.786735:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.786737:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.786743:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 10 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.786750:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 10 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.786775:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 10 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.786783:0:7312:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 10 pid: 8468 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.786794:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796605952:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147737.786836:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147737.786971:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794326912:12345-192.168.202.10@tcp:3:cat.0 Request processed in 5742us (5873us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147737.786981:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7858 00002000:00100000:1.0:1746147737.786989:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff88009c9a9500 x1830967794326912/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.786997:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a9500 with x1830967794326912 ext(4194304->5017599) 00002000:00010000:1.0:1746147737.787001:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c9a9500 00000100:00100000:2.0:1746147737.787050:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a21a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796605824:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.787073:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [1130496->1753087] (req 1130496->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 21 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.787083:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135500800, rc 0) 00000100:00100000:2.0:1746147737.787100:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32672:x1830967794327040:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3229us (3463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.787106:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17411 00000100:00100000:0.0:1746147737.787378:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.787496:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794327296 00000100:00100000:1.0:1746147737.787500:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794327296 00010000:00010000:1.0:1746147737.787512:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd1dc00/0xe64d3fbf12a7f902 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdef expref: 11 pid: 4591 timeout: 916 lvb_type: 1 00000100:00100000:1.0:1746147737.787812:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8894 00000100:00100000:1.0:1746147737.787818:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1957:x1830967794327296:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147737.787825:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147737.787836:0:15900:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2075 -> 2081 00010000:00010000:1.0:1746147737.787840:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd1dc00/0xe64d3fbf12a7f902 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdef expref: 11 pid: 4591 timeout: 916 lvb_type: 1 00010000:00010000:1.0:1746147737.787847:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd1dc00/0xe64d3fbf12a7f902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdef expref: 11 pid: 4591 timeout: 916 lvb_type: 1 00010000:00010000:1.0:1746147737.787859:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd1dc00/0xe64d3fbf12a7f902 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdef expref: 11 pid: 4591 timeout: 916 lvb_type: 1 00010000:00010000:1.0:1746147737.788037:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147737.788057:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1957:x1830967794327296:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 240us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147737.788062:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8894 00000100:00100000:3.0:1746147737.788501:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796605952:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147737.788513:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147737.788532:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1958:x1830967794327168:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1877us (2205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.788538:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8893 00000100:00100000:0.0:1746147737.789189:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.789242:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794327424 00000100:00100000:3.0:1746147737.789245:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794327424 00010000:00010000:3.0:1746147737.789259:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb39400/0xe64d3fbf12a7f8e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdd3 expref: 20 pid: 8470 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.789298:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8895 00000100:00100000:3.0:1746147737.789302:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1959:x1830967794327424:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.789308:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147737.789315:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb39400/0xe64d3fbf12a7f8e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdd3 expref: 20 pid: 8470 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.789321:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb39400/0xe64d3fbf12a7f8e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdd3 expref: 20 pid: 8470 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.789330:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39400/0xe64d3fbf12a7f8e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcdd3 expref: 20 pid: 8470 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.789338:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.789340:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.789344:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1753087) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 19 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.789349:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1753087) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 19 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.789366:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 19 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147737.789374:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796606080:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147737.789662:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147737.791109:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.791293:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794327680 00000100:00100000:1.0:1746147737.791300:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794327680 00002000:00100000:1.0:1746147737.791338:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a21a2a00 x1830967794327680/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.791347:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a2a00 with x1830967794327680 ext(2097152->3145727) 00010000:00010000:1.0:1746147737.791355:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 10 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.791368:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 10 pid: 8468 timeout: 916 lvb_type: 0 00002000:00010000:1.0:1746147737.791379:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a21a2a00 00000100:00100000:1.0:1746147737.791408:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1603 00000100:00100000:1.0:1746147737.791419:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1957:x1830967794327680:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147737.791735:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.791776:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794327808 00000100:00100000:2.0:1746147737.791780:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794327808 00000100:00100000:0.0:1746147737.791788:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.791840:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796606080:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147737.791852:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147737.791861:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147737.791907:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794328064 00000100:00100000:3.0:1746147737.791909:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794328064 00000100:00100000:2.0:1746147737.791910:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794328192 00000100:00100000:2.0:1746147737.791913:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794328192 00000100:00100000:3.0:1746147737.791926:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17412 00000100:00100000:3.0:1746147737.791931:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794327808:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147737.791931:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17413 00000100:00100000:2.0:1746147737.791935:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794328064:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:0.0:1746147737.791937:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17414 00010000:00010000:3.0:1746147737.791939:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.791943:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147737.791945:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967794328192:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147737.791950:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e98400/0xe64d3fbf12a7fc27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcfa8 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.791952:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134b2fe00/0xe64d3fbf12a7fc2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcfaf expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147737.791952:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147737.791958:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2800/0xe64d3fbf12a7fc35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcfb6 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147737.791969:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.791970:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134b2fe00/0xe64d3fbf12a7fc2e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfaf expref: 25 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147737.791975:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2800/0xe64d3fbf12a7fc35 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfb6 expref: 23 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.791978:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134b2fe00/0xe64d3fbf12a7fc2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfaf expref: 25 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147737.791983:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c2800/0xe64d3fbf12a7fc35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfb6 expref: 23 pid: 9615 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147737.791986:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796606208:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147737.791995:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2fe00, rc 0) 00010000:00010000:0.0:1746147737.791995:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad2c2800, rc 0) 00000100:00100000:2.0:1746147737.792014:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794328064:12345-192.168.202.10@tcp:101:cat.0 Request processed in 78us (226us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147737.792019:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17413 00000100:00100000:3.0:1746147737.792022:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.792034:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794327424:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2731us (2846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.792039:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8895 00000100:00100000:0.0:1746147737.792069:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1958:x1830967794328192:12345-192.168.202.10@tcp:101:cat.0 Request processed in 125us (216us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147737.792075:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17414 00000100:00100000:0.0:1746147737.792116:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.792210:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794328320 00000100:00100000:2.0:1746147737.792213:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794328320 00002000:00100000:2.0:1746147737.792226:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1130496->1134591) req@ffff8800a21a3800 x1830967794328320/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.792233:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a3800 with x1830967794328320 ext(1130496->1134591) 00002000:00010000:2.0:1746147737.792236:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a21a3800 00000100:00100000:2.0:1746147737.792250:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7859 00000100:00100000:2.0:1746147737.792254:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794328320:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147737.792395:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794328320:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 139us (278us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147737.792405:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7859 00002000:00100000:2.0:1746147737.792409:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1130496->1134591) req@ffff8800a21a3800 x1830967794328320/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/4536 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147737.792416:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a3800 with x1830967794328320 ext(1130496->1134591) 00002000:00010000:2.0:1746147737.792418:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a21a3800 00002000:00010000:2.0:1746147737.793676:0:8470:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime: 1746147737 -> 1746147738 00002000:00010000:2.0:1746147737.793680:0:8470:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime: 1746147735 -> 1746147738 00002000:00010000:2.0:1746147737.793682:0:8470:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime: 1746147737 -> 1746147738 00000100:00100000:2.0:1746147737.793693:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796606208:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147737.793711:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e98400/0xe64d3fbf12a7fc27 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa8 expref: 20 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.793720:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e98400/0xe64d3fbf12a7fc27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa8 expref: 20 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.793728:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e98400, rc 0) 00000100:00100000:2.0:1746147737.793748:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1957:x1830967794327808:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1817us (2014us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147737.793753:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17412 00000100:00100000:1.0:1746147737.797145:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1957:x1830967794327680:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 5716us (6033us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147737.797157:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1603 00002000:00100000:1.0:1746147737.797168:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800a21a2a00 x1830967794327680/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.797178:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a2a00 with x1830967794327680 ext(2097152->3145727) 00010000:00010000:1.0:1746147737.797187:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 10 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746147737.797202:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 10 pid: 8468 timeout: 916 lvb_type: 0 00002000:00010000:1.0:1746147737.797209:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a21a2a00 00000100:00100000:0.0:1746147737.797425:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.797462:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794328448 00000100:00100000:2.0:1746147737.797470:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794328448 00000100:00100000:2.0:1746147737.797508:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17415 00000100:00100000:2.0:1746147737.797515:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794328448:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.797531:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.797548:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134b2f800/0xe64d3fbf12a7fc3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcfbd expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147737.797574:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147737.797577:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134b2f800/0xe64d3fbf12a7fc3c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfbd expref: 25 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.797587:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134b2f800/0xe64d3fbf12a7fc3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfbd expref: 25 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.797597:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2f800, rc 0) 00000100:00100000:2.0:1746147737.797641:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794328448:12345-192.168.202.10@tcp:101:cat.0 Request processed in 125us (215us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147737.797643:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794328576 00000100:00100000:2.0:1746147737.797646:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17415 00000100:00100000:1.0:1746147737.797646:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794328576 00000100:00100000:1.0:1746147737.797667:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17416 00000100:00100000:1.0:1746147737.797672:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794328576:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147737.797680:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147737.797688:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea200/0xe64d3fbf12a7fc43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcfc4 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147737.797703:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147737.797710:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea200/0xe64d3fbf12a7fc43 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfc4 expref: 20 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.797717:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ea200/0xe64d3fbf12a7fc43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfc4 expref: 20 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147737.797729:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8ea200, rc 0) 00000100:00100000:1.0:1746147737.797750:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794328576:12345-192.168.202.10@tcp:101:cat.0 Request processed in 77us (176us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147737.797754:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17416 00000100:00100000:0.0:1746147737.798326:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.798385:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794328832 00000100:00100000:1.0:1746147737.798389:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794328832 00002000:00100000:1.0:1746147737.798410:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x454:0x0] (1748992->1753087) req@ffff8800a21a2300 x1830967794328832/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.798418:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a2300 with x1830967794328832 ext(1748992->1753087) 00002000:00010000:1.0:1746147737.798422:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a21a2300 00000100:00100000:1.0:1746147737.798784:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7860 00000100:00100000:1.0:1746147737.798791:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1958:x1830967794328832:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147737.799163:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1958:x1830967794328832:12345-192.168.202.10@tcp:3:cat.0 Request processed in 371us (837us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147737.799169:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7860 00002000:00100000:1.0:1746147737.799174:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x454:0x0] (1748992->1753087) req@ffff8800a21a2300 x1830967794328832/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/4536 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.799187:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a2300 with x1830967794328832 ext(1748992->1753087) 00002000:00010000:1.0:1746147737.799190:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a21a2300 00000100:00100000:1.0:1746147737.803111:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.803138:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794328960 00000100:00100000:2.0:1746147737.803147:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794328960 00000100:00100000:1.0:1746147737.803223:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.803267:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.803293:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794329216 00000100:00100000:3.0:1746147737.803298:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794329216 00000100:00100000:2.0:1746147737.803316:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17417 00000100:00100000:3.0:1746147737.803324:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5100 00000100:00100000:2.0:1746147737.803324:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32668:x1830967794328960:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147737.803330:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+336:32672:x1830967794329216:12345-192.168.202.10@tcp:35:multiop.0 00010000:00010000:2.0:1746147737.803341:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.803358:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134b2ec00/0xe64d3fbf12a7fc4a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcfcb expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.803380:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.803382:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147737.803388:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134b2ec00/0xe64d3fbf12a7fc4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfcb expref: 13 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.803402:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134b2ec00/0xe64d3fbf12a7fc4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfcb expref: 13 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.803426:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2ec00, rc 0) 00000100:00100000:2.0:1746147737.803461:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32668:x1830967794328960:12345-192.168.202.10@tcp:101:cat.0 Request processed in 140us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.803465:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17417 00000100:00100000:3.0:1746147737.803634:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+337:32672:x1830967794329216:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 302us (409us total) trans 8589946226 rc 0/0 00000100:00100000:3.0:1746147737.803640:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5100 00000100:00100000:3.0:1746147737.803663:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794329344 00000100:00100000:3.0:1746147737.803666:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794329344 00010000:00010000:3.0:1746147737.803682:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 10 pid: 8468 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746147737.803717:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8896 00000100:00100000:3.0:1746147737.803723:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794329344:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.803738:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147737.803827:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 10 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.803838:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 10 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.803856:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a21de600/0xe64d3fbf12a7fc0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf8c expref: 10 pid: 8468 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746147737.803866:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.803868:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.803872:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.803879:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.803933:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147737.803944:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796606336:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147737.803996:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147737.806271:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.806365:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796606336:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147737.806386:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147737.806429:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967794329344:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2705us (3161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.806439:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8896 00000100:00100000:1.0:1746147737.806596:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794329600 00000100:00100000:1.0:1746147737.806611:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794329600 00002000:00100000:1.0:1746147737.806647:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a21a1f80 x1830967794329600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.806657:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a1f80 with x1830967794329600 ext(3145728->4194303) 00002000:00010000:1.0:1746147737.806661:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a21a1f80 00000100:00100000:1.0:1746147737.806678:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7861 00000100:00100000:1.0:1746147737.806683:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794329600:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147737.808247:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.808372:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794329856 00000100:00100000:3.0:1746147737.808378:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794329856 00002000:00100000:3.0:1746147737.808405:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2334720->2338815) req@ffff8800a21a1c00 x1830967794329856/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.808414:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a1c00 with x1830967794329856 ext(2334720->2338815) 00002000:00010000:3.0:1746147737.808418:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a21a1c00 00000100:00100000:3.0:1746147737.808438:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7862 00000100:00100000:3.0:1746147737.808444:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1957:x1830967794329856:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147737.808564:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1957:x1830967794329856:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 119us (322us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147737.808571:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7862 00002000:00100000:3.0:1746147737.808575:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2334720->2338815) req@ffff8800a21a1c00 x1830967794329856/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/4536 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.808582:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a1c00 with x1830967794329856 ext(2334720->2338815) 00002000:00010000:3.0:1746147737.808584:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a21a1c00 00010000:00010000:1.0:1746147737.811049:0:20300:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147737.814269:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794329600:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 7575us (7997us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147737.814281:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7861 00002000:00100000:1.0:1746147737.814294:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff8800a21a1f80 x1830967794329600/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.814303:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a21a1f80 with x1830967794329600 ext(3145728->4194303) 00002000:00010000:1.0:1746147737.814309:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a21a1f80 00000100:00100000:0.0:1746147737.817294:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.817361:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794330112 00000100:00100000:1.0:1746147737.817369:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794330112 00002000:00100000:1.0:1746147737.817406:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880091450000 x1830967794330112/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.817414:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091450000 with x1830967794330112 ext(3145728->4194303) 00002000:00010000:1.0:1746147737.817418:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091450000 00000100:00100000:1.0:1746147737.817441:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7863 00000100:00100000:1.0:1746147737.817446:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967794330112:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147737.823622:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967794330112:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 6144us (6305us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147737.823636:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7863 00002000:00100000:1.0:1746147737.823649:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff880091450000 x1830967794330112/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.823659:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091450000 with x1830967794330112 ext(3145728->4194303) 00002000:00010000:1.0:1746147737.823665:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091450000 00000100:00100000:0.0:1746147737.826506:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.826613:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.826645:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794330240 00000100:00100000:2.0:1746147737.826655:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794330240 00000100:00100000:2.0:1746147737.826706:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794330368 00000100:00100000:2.0:1746147737.826709:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794330368 00000100:00100000:2.0:1746147737.826739:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17418 00000100:00100000:2.0:1746147737.826747:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794330240:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:0.0:1746147737.826763:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17419 00010000:00010000:2.0:1746147737.826767:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147737.826770:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794330368:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147737.826778:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147737.826788:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c3000/0xe64d3fbf12a7fc58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcfd9 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.826789:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7fc51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcfd2 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147737.826816:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c3000/0xe64d3fbf12a7fc58 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfd9 expref: 14 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147737.826826:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c3000/0xe64d3fbf12a7fc58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfd9 expref: 14 pid: 9615 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147737.826837:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796606464:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147737.826840:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad2c3000, rc 0) 00000100:00100000:0.0:1746147737.826875:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794330368:12345-192.168.202.10@tcp:101:cat.0 Request processed in 106us (274us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147737.826879:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17419 00000100:00100000:2.0:1746147737.826913:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.828076:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796606464:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147737.828097:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7fc51 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfd2 expref: 10 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.828107:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7fc51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfd2 expref: 10 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.828131:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2e800, rc 0) 00000100:00100000:2.0:1746147737.828171:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794330240:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1424us (1675us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147737.828185:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17418 00000100:00100000:0.0:1746147737.830338:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.830453:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794330624 00000100:00100000:1.0:1746147737.830461:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794330624 00002000:00100000:1.0:1746147737.830504:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880091450a80 x1830967794330624/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.830514:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091450a80 with x1830967794330624 ext(4194304->5017599) 00002000:00010000:1.0:1746147737.830519:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091450a80 00000100:00100000:1.0:1746147737.830548:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7864 00000100:00100000:1.0:1746147737.830555:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794330624:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147737.836081:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794330624:12345-192.168.202.10@tcp:3:cat.0 Request processed in 5512us (5736us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147737.836094:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7864 00002000:00100000:1.0:1746147737.836106:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880091450a80 x1830967794330624/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:358/0 lens 488/440 e 0 to 0 dl 1746147748 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.836115:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091450a80 with x1830967794330624 ext(4194304->5017599) 00002000:00010000:1.0:1746147737.836121:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091450a80 00000100:00100000:0.0:1746147737.838362:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.838428:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794330880 00000100:00100000:2.0:1746147737.838438:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794330880 00000100:00100000:0.0:1746147737.838446:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.838487:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794330752 00000100:00100000:2.0:1746147737.838490:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794330752 00000100:00100000:2.0:1746147737.838512:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17420 00000100:00100000:2.0:1746147737.838519:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794330880:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147737.838531:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17421 00010000:00010000:2.0:1746147737.838538:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147737.838540:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967794330752:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147737.838548:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.838554:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134b2fc00/0xe64d3fbf12a7fc5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcfe7 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.838559:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e99400/0xe64d3fbf12a7fc66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcfe0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.838590:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134b2fc00/0xe64d3fbf12a7fc5f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfe7 expref: 14 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.838621:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134b2fc00/0xe64d3fbf12a7fc5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfe7 expref: 14 pid: 22183 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147737.838622:0:8468:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796606592:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147737.838636:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2fc00, rc 0) 00000100:00100000:2.0:1746147737.838676:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794330880:12345-192.168.202.10@tcp:101:cat.0 Request processed in 157us (323us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147737.838682:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17420 00000100:00100000:3.0:1746147737.839130:0:8468:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.839673:0:8468:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1830967796606592:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147737.839695:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e99400/0xe64d3fbf12a7fc66 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfe0 expref: 10 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.839705:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e99400/0xe64d3fbf12a7fc66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfe0 expref: 10 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.839729:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e99400, rc 0) 00000100:00100000:3.0:1746147737.839765:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1960:x1830967794330752:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1226us (1318us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147737.839771:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17421 00000100:00100000:2.0:1746147737.841319:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.841369:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147737.841436:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794331008 00000100:00100000:0.0:1746147737.841443:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794331008 00000100:00100000:3.0:1746147737.841464:0:8468:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794331136 00000100:00100000:3.0:1746147737.841475:0:8468:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794331136 00000100:00100000:0.0:1746147737.841492:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17422 00000100:00100000:0.0:1746147737.841499:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794331008:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147737.841512:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147737.841526:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6542000/0xe64d3fbf12a7fc6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcfee expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147737.841580:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091451500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796606720:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147737.841664:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c9809c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.841686:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17423 00000100:00100000:3.0:1746147737.841694:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794331136:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147737.841709:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147737.841724:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e99800/0xe64d3fbf12a7fc74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcff5 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.841752:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e99800/0xe64d3fbf12a7fc74 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcff5 expref: 14 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.841767:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e99800/0xe64d3fbf12a7fc74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcff5 expref: 14 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.841778:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e99800, rc 0) 00000100:00100000:3.0:1746147737.841817:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1959:x1830967794331136:12345-192.168.202.10@tcp:101:cat.0 Request processed in 125us (447us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147737.841823:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17423 00000100:00100000:2.0:1746147737.843044:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091451500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796606720:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147737.843067:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6542000/0xe64d3fbf12a7fc6d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfee expref: 10 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.843080:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6542000/0xe64d3fbf12a7fc6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfee expref: 10 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.843099:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6542000, rc 0) 00000100:00100000:2.0:1746147737.843166:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1959:x1830967794331008:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1666us (1850us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147737.843172:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17422 00000100:00100000:0.0:1746147737.962179:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.962365:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794331392 00000100:00100000:2.0:1746147737.962373:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794331392 00000100:00100000:2.0:1746147737.962418:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12183 00000100:00100000:2.0:1746147737.962425:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+24:32680:x1830967794331392:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.962451:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.962467:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e600/0xe64d3fbf12a7fc7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafcffc expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.962568:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f400/0xe64d3fbf12a7fc82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.962579:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f400/0xe64d3fbf12a7fc82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.962590:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f400/0xe64d3fbf12a7fc82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.962628:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fc89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.962634:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fc89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.962640:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fc89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.962731:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fc00/0xe64d3fbf12a7fc90 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.962738:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fc00/0xe64d3fbf12a7fc90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.962743:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fc00/0xe64d3fbf12a7fc90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:2.0:1746147737.962751:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147737.962824:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f400/0xe64d3fbf12a7fc82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.962830:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f400/0xe64d3fbf12a7fc82 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.962836:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f400/0xe64d3fbf12a7fc82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.963050:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134b2f400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147737.963054:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f400/0xe64d3fbf12a7fc82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.963061:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f400/0xe64d3fbf12a7fc82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.963072:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147737.963075:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147737.963079:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f400/0xe64d3fbf12a7fc82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.963088:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f400/0xe64d3fbf12a7fc82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.963680:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fc89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.963686:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fc89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.963690:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fc89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.963694:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134b2ea00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147737.963697:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fc89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.963701:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fc89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.963708:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a02f4d00) 00010000:00010000:2.0:1746147737.963711:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147737.963713:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fc89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.963717:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2ea00/0xe64d3fbf12a7fc89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147737.963757:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e600/0xe64d3fbf12a7fc7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcffc expref: 27 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.963767:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fc00/0xe64d3fbf12a7fc90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcffc expref: 26 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.963782:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147737.963784:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147737.963786:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2fc00, rc 0) 00000100:00100000:2.0:1746147737.963854:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32680:x1830967794331392:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1429us (1686us total) trans 8589946227 rc 0/0 00000100:00100000:2.0:1746147737.963862:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12183 00000100:00100000:0.0:1746147737.965722:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.965868:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794331648 00000100:00100000:3.0:1746147737.965876:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794331648 00000100:00100000:3.0:1746147737.965971:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5101 00000100:00100000:3.0:1746147737.965979:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+26:32680:x1830967794331648:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:3.0:1746147737.966372:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32680:x1830967794331648:12345-192.168.202.10@tcp:35:cat.0 Request processed in 382us (643us total) trans 8589946228 rc 0/0 00000100:00100000:3.0:1746147737.966383:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5101 00000100:00100000:0.0:1746147737.969662:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.969741:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794331776 00000100:00100000:2.0:1746147737.969753:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794331776 00000100:00100000:0.0:1746147737.969759:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.969808:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794331904 00000100:00100000:2.0:1746147737.969811:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794331904 00000100:00100000:2.0:1746147737.969832:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17424 00000100:00100000:2.0:1746147737.969838:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1957:x1830967794331776:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.969854:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.969868:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7fc9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd003 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147737.969945:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17425 00000100:00100000:3.0:1746147737.969960:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794331904:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:2.0:1746147737.969964:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796606848:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147737.969974:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147737.969989:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e98400/0xe64d3fbf12a7fca5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd00a expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.970012:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e98400/0xe64d3fbf12a7fca5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd00a expref: 14 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.970021:0:8468:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e98400/0xe64d3fbf12a7fca5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd00a expref: 14 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147737.970034:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e98400, rc 0) 00000100:00100000:2.0:1746147737.970038:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.970063:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1958:x1830967794331904:12345-192.168.202.10@tcp:101:cat.0 Request processed in 107us (305us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147737.970069:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17425 00000100:00100000:2.0:1746147737.971847:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796606848:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147737.971872:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7fc9e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd003 expref: 10 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.971910:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134b2f000/0xe64d3fbf12a7fc9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd003 expref: 10 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147737.971931:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2f000, rc 0) 00000100:00100000:2.0:1746147737.971960:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:1957:x1830967794331776:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2121us (2308us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147737.971967:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17424 00000100:00100000:0.0:1746147737.975456:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147737.975527:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794332032 00000100:00100000:2.0:1746147737.975538:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794332032 00000100:00100000:2.0:1746147737.975596:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17426 00000100:00100000:2.0:1746147737.975616:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+9:32680:x1830967794332032:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147737.975636:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147737.975655:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7fcac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd011 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.975684:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 18 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.975691:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.975693:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147737.975697:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7fcac lrc: 4/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd011 expref: 10 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.975726:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1753087) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 18 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.975739:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1753087) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 18 pid: 8468 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147737.975756:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796606976:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147737.975844:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147737.978811:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8470:1830967796606976:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147737.978839:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7fcac lrc: 3/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd011 expref: 10 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147737.978974:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2e800, rc 0) 00000100:00100000:2.0:1746147737.979071:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32680:x1830967794332032:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3452us (3620us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147737.979080:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17426 00000100:00100000:0.0:1746147737.980673:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147737.980770:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794332160 00000100:00100000:1.0:1746147737.980779:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794332160 00002000:00100000:1.0:1746147737.980821:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x454:0x0] (1130496->1753087) req@ffff880091452a00 x1830967794332160/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/0 e 0 to 0 dl 1746147748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147737.980832:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091452a00 with x1830967794332160 ext(1130496->1753087) 00010000:00010000:1.0:1746147737.980840:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 19 pid: 8468 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147737.980854:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 19 pid: 8468 timeout: 917 lvb_type: 0 00002000:00010000:1.0:1746147737.980861:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091452a00 00000100:00100000:3.0:1746147737.980924:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1604 00000100:00100000:3.0:1746147737.980934:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+19:1960:x1830967794332160:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147737.991748:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794332160:12345-192.168.202.10@tcp:4:cat.0 Request processed in 10806us (11070us total) trans 21474841760 rc 0/0 00000100:00100000:3.0:1746147737.991759:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1604 00002000:00100000:3.0:1746147737.991769:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1130496->1753087) req@ffff880091452a00 x1830967794332160/t21474841760(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:358/0 lens 488/448 e 0 to 0 dl 1746147748 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147737.991777:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091452a00 with x1830967794332160 ext(1130496->1753087) 00010000:00010000:3.0:1746147737.991785:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 21 pid: 8468 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147737.991798:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 21 pid: 8468 timeout: 917 lvb_type: 0 00002000:00010000:3.0:1746147737.991805:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091452a00 00000100:00100000:0.0:1746147737.996482:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147737.996539:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794332288 00000100:00100000:3.0:1746147737.996548:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794332288 00010000:00010000:3.0:1746147737.996579:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 21 pid: 8468 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147737.996626:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8897 00000100:00100000:3.0:1746147737.996633:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091452d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1957:x1830967794332288:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147737.996645:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147737.996665:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 21 pid: 8468 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147737.996676:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1753087) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 21 pid: 8468 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147737.996696:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135500800/0xe64d3fbf12a7fc20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1753087) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfa1 expref: 21 pid: 8468 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147737.996721:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.996724:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147737.996730:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7fcac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd011 expref: 9 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.996738:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7fcac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd011 expref: 9 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147737.996766:0:7312:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7fcac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd011 expref: 9 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147737.996777:0:7312:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796607104:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147737.999441:0:7312:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147737.999729:0:7312:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7312:1830967796607104:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147737.999751:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147737.999785:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091452d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+20:1957:x1830967794332288:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3151us (3307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147737.999794:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8897 00000100:00100000:0.0:1746147738.009370:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.009480:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794332544 00000100:00100000:3.0:1746147738.009488:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794332544 00002000:00100000:3.0:1746147738.009534:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880091453100 x1830967794332544/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.009543:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091453100 with x1830967794332544 ext(1048576->2097151) 00002000:00010000:3.0:1746147738.009548:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091453100 00000100:00100000:3.0:1746147738.009577:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7865 00000100:00100000:3.0:1746147738.009586:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794332544:12345-192.168.202.10@tcp:3:cat.0 00000100:00080000:0.0:1746147738.011103:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147738.024141:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794332544:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14548us (14769us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147738.024152:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7865 00002000:00100000:3.0:1746147738.024162:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880091453100 x1830967794332544/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.024172:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091453100 with x1830967794332544 ext(1048576->2097151) 00002000:00010000:3.0:1746147738.024177:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091453100 00000100:00100000:0.0:1746147738.032871:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.032932:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.032966:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.032987:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794332800 00000100:00100000:0.0:1746147738.032994:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794332800 00000100:00100000:0.0:1746147738.033031:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794333056 00000100:00100000:0.0:1746147738.033033:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794333056 00000100:00100000:0.0:1746147738.033046:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12184 00000100:00100000:0.0:1746147738.033052:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+337:32686:x1830967794332800:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147738.033071:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147738.033086:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2c800/0xe64d3fbf12a7fcb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd018 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.033168:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d189400/0xe64d3fbf12a7fcba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033179:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d189400/0xe64d3fbf12a7fcba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033188:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d189400/0xe64d3fbf12a7fcba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033197:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d188000/0xe64d3fbf12a7fcc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033203:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d188000/0xe64d3fbf12a7fcc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033208:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d188000/0xe64d3fbf12a7fcc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033287:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095537400/0xe64d3fbf12a7fcc8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033293:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095537400/0xe64d3fbf12a7fcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033298:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095537400/0xe64d3fbf12a7fcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:0.0:1746147738.033306:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147738.033365:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d189400/0xe64d3fbf12a7fcba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033371:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d189400/0xe64d3fbf12a7fcba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033377:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d189400/0xe64d3fbf12a7fcba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033382:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d189400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147738.033385:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d189400/0xe64d3fbf12a7fcba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033390:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d189400/0xe64d3fbf12a7fcba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033398:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147738.033400:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147738.033403:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d189400/0xe64d3fbf12a7fcba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033408:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d189400/0xe64d3fbf12a7fcba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033420:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d188000/0xe64d3fbf12a7fcc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033424:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d188000/0xe64d3fbf12a7fcc1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033429:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d188000/0xe64d3fbf12a7fcc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033433:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d188000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147738.033435:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d188000/0xe64d3fbf12a7fcc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033439:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d188000/0xe64d3fbf12a7fcc1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033448:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130b32e00) 00010000:00010000:0.0:1746147738.033449:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147738.033451:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d188000/0xe64d3fbf12a7fcc1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033455:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d188000/0xe64d3fbf12a7fcc1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033484:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b2c800/0xe64d3fbf12a7fcb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd018 expref: 340 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.033493:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095537400/0xe64d3fbf12a7fcc8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd018 expref: 339 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.033499:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147738.033501:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147738.033503:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095537400, rc 0) 00000100:00100000:0.0:1746147738.033534:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:32686:x1830967794332800:12345-192.168.202.10@tcp:101:cat.0 Request processed in 482us (673us total) trans 8589946229 rc 0/0 00000100:00100000:0.0:1746147738.033540:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12184 00000100:00100000:0.0:1746147738.033553:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12185 00000100:00100000:0.0:1746147738.033557:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+27:32687:x1830967794333056:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147738.033565:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147738.033570:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095537200/0xe64d3fbf12a7fcd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd01f expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.033611:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095536800/0xe64d3fbf12a7fcdd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033618:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095536800/0xe64d3fbf12a7fcdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033624:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095536800/0xe64d3fbf12a7fcdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033631:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095536000/0xe64d3fbf12a7fce4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033636:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095536000/0xe64d3fbf12a7fce4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033641:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095536000/0xe64d3fbf12a7fce4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033679:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093da9c00/0xe64d3fbf12a7fceb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033684:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093da9c00/0xe64d3fbf12a7fceb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033689:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093da9c00/0xe64d3fbf12a7fceb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00200000:0.0:1746147738.033694:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147738.033719:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095536800/0xe64d3fbf12a7fcdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033724:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095536800/0xe64d3fbf12a7fcdd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033729:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095536800/0xe64d3fbf12a7fcdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033736:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095536800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147738.033739:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095536800/0xe64d3fbf12a7fcdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033743:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095536800/0xe64d3fbf12a7fcdd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033749:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147738.033750:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147738.033752:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095536800/0xe64d3fbf12a7fcdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033756:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095536800/0xe64d3fbf12a7fcdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033762:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095536000/0xe64d3fbf12a7fce4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033767:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095536000/0xe64d3fbf12a7fce4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033772:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095536000/0xe64d3fbf12a7fce4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033775:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095536000 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147738.033777:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095536000/0xe64d3fbf12a7fce4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033781:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095536000/0xe64d3fbf12a7fce4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033785:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130b32400) 00010000:00010000:0.0:1746147738.033787:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147738.033789:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095536000/0xe64d3fbf12a7fce4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033794:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095536000/0xe64d3fbf12a7fce4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.033813:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095537200/0xe64d3fbf12a7fcd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd01f expref: 30 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.033820:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093da9c00/0xe64d3fbf12a7fceb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd01f expref: 29 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.033826:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147738.033827:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147738.033829:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093da9c00, rc 0) 00000100:00100000:0.0:1746147738.033843:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:32687:x1830967794333056:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 285us (876us total) trans 8589946230 rc 0/0 00000100:00100000:0.0:1746147738.033847:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12185 00000100:00080000:0.0:1746147738.033862:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147738.034001:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794333184 00000100:00100000:3.0:1746147738.034006:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794333184 00000100:00100000:3.0:1746147738.034031:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17427 00000100:00100000:3.0:1746147738.034036:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32680:x1830967794333184:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.034043:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.034052:0:8470:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8b17a00/0xe64d3fbf12a7fcf9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd026 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.034068:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 14 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.034075:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147738.034076:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147738.034080:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8b17a00/0xe64d3fbf12a7fcf9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd026 expref: 14 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.034102:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 14 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.034112:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 14 pid: 4591 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.034123:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796607232:192.168.202.10@tcp:104: 00000100:00080000:0.0:1746147738.034680:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147738.035283:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147738.036013:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.036086:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.036141:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794333312 00000100:00100000:3.0:1746147738.036145:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794333312 00000100:00100000:3.0:1746147738.036183:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 913 00000100:00100000:3.0:1746147738.036189:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091451500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:1960:x1830967794333312:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147738.036197:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147738.036212:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095537400/0xe64d3fbf12a7fcc8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd018 expref: 339 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.036231:0:7312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147738.036236:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.036258:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091451500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+338:1960:x1830967794333312:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 69us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.036264:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 913 00000100:00100000:2.0:1746147738.036670:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794333696 00000100:00100000:2.0:1746147738.036674:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794333696 00000100:00100000:1.0:1746147738.037992:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5102 00000100:00100000:1.0:1746147738.038001:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+338:32686:x1830967794333696:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:1.0:1746147738.038160:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:32686:x1830967794333696:12345-192.168.202.10@tcp:35:cat.0 Request processed in 160us (2073us total) trans 8589946231 rc 0/0 00000100:00100000:1.0:1746147738.038166:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5102 00000100:00100000:3.0:1746147738.039951:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796607232:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.039977:0:8470:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8b17a00/0xe64d3fbf12a7fcf9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd026 expref: 14 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.039991:0:8470:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8b17a00, rc 0) 00000100:00100000:3.0:1746147738.040021:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32680:x1830967794333184:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5985us (7088us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.040028:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17427 00000100:00100000:0.0:1746147738.040333:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.040558:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.040573:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.040910:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794334080 00000100:00100000:2.0:1746147738.040917:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794334080 00000100:00100000:3.0:1746147738.040971:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794333824 00000100:00100000:3.0:1746147738.040974:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794333824 00002000:00100000:3.0:1746147738.040992:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x458:0x0] (2842624->3145727) req@ffff880134eb0380 x1830967794333824/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.041000:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb0380 with x1830967794333824 ext(2842624->3145727) 00010000:00010000:3.0:1746147738.041006:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 14 pid: 4591 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.041016:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 14 pid: 4591 timeout: 917 lvb_type: 0 00002000:00010000:3.0:1746147738.041022:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134eb0380 00000100:00100000:0.0:1746147738.041092:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.041113:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.041142:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.041191:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794333568 00000100:00100000:1.0:1746147738.041195:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794333568 00000100:00100000:1.0:1746147738.041220:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 914 00000100:00100000:1.0:1746147738.041226:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1959:x1830967794333568:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147738.041243:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147738.041263:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093da9c00/0xe64d3fbf12a7fceb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd01f expref: 30 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.041275:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147738.041279:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147738.041298:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1959:x1830967794333568:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 73us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.041303:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 914 00000100:00100000:2.0:1746147738.041518:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5103 00000100:00100000:2.0:1746147738.041525:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+28:32687:x1830967794334080:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:2.0:1746147738.041759:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:32687:x1830967794334080:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 234us (1200us total) trans 8589946232 rc 0/0 00000100:00100000:2.0:1746147738.041765:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5103 00000100:00100000:2.0:1746147738.041793:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.041807:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794334336 00000100:00100000:2.0:1746147738.041810:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794334336 00000100:00100000:2.0:1746147738.041832:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12186 00000100:00100000:2.0:1746147738.041836:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+339:32684:x1830967794334336:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147738.041846:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.041856:0:14545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e200/0xe64d3fbf12a7fd00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd02d expref: -99 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.041933:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7fd07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.041943:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7fd07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.041951:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7fd07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.041960:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f200/0xe64d3fbf12a7fd0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.041965:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f200/0xe64d3fbf12a7fd0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.041970:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f200/0xe64d3fbf12a7fd0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042036:0:14545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7fd15 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042043:0:14545:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7fd15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042048:0:14545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7fd15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14545 initiator: MDT0 00000004:00200000:2.0:1746147738.042054:0:14545:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147738.042086:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7fd07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042096:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7fd07 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042101:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7fd07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042106:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134b2f800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147738.042108:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7fd07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042113:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7fd07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042119:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147738.042121:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147738.042124:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7fd07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042128:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f800/0xe64d3fbf12a7fd07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042135:0:14545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f200/0xe64d3fbf12a7fd0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042139:0:14545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f200/0xe64d3fbf12a7fd0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042143:0:14545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f200/0xe64d3fbf12a7fd0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042147:0:14545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134b2f200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147738.042149:0:14545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f200/0xe64d3fbf12a7fd0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042157:0:14545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f200/0xe64d3fbf12a7fd0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042162:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a02f4500) 00010000:00010000:2.0:1746147738.042163:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147738.042165:0:14545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f200/0xe64d3fbf12a7fd0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042169:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2f200/0xe64d3fbf12a7fd0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14545 initiator: MDT0 00010000:00010000:2.0:1746147738.042189:0:14545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2e200/0xe64d3fbf12a7fd00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd02d expref: 342 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.042197:0:14545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7fd15 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd02d expref: 341 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.042202:0:14545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147738.042203:0:14545:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147738.042205:0:14545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2fa00, rc 0) 00000100:00100000:2.0:1746147738.042220:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+341:32684:x1830967794334336:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 383us (427us total) trans 8589946233 rc 0/0 00000100:00100000:2.0:1746147738.042226:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12186 00000100:00100000:3.0:1746147738.043613:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794334464 00000100:00100000:3.0:1746147738.043621:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794334464 00000100:00100000:3.0:1746147738.043648:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794334720 00000100:00100000:3.0:1746147738.043650:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794334720 00000100:00100000:3.0:1746147738.043670:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794334592 00000100:00100000:3.0:1746147738.043671:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794334592 00000100:00100000:3.0:1746147738.043690:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17428 00000100:00100000:3.0:1746147738.043695:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794334464:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.043704:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.043715:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8b16800/0xe64d3fbf12a7fd23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd034 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.043728:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.043730:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.043735:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8b16800/0xe64d3fbf12a7fd23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd034 expref: 22 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.043753:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8b16800/0xe64d3fbf12a7fd23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd034 expref: 22 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.043761:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8b16800, rc 0) 00000100:00100000:3.0:1746147738.043787:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794334464:12345-192.168.202.10@tcp:101:cat.0 Request processed in 91us (2694us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.043792:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17428 00000100:00100000:3.0:1746147738.043802:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17429 00000100:00100000:3.0:1746147738.043807:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794334720:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.043812:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.043823:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8b16c00/0xe64d3fbf12a7fd2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd042 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.043852:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796607360:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147738.043911:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.043925:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17430 00000100:00100000:3.0:1746147738.043930:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794334592:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.043936:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.043946:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7fd31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd03b expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.043960:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7fd31 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd03b expref: 25 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.043968:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02a1600/0xe64d3fbf12a7fd31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd03b expref: 25 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.043976:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02a1600, rc 0) 00000100:00100000:3.0:1746147738.043989:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794334592:12345-192.168.202.10@tcp:101:cat.0 Request processed in 59us (2846us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147738.043993:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17430 00000100:00100000:3.0:1746147738.044026:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1605 00000100:00100000:3.0:1746147738.044031:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1957:x1830967794333824:12345-192.168.202.10@tcp:4:cat.0 00002000:00010000:2.0:1746147738.047146:0:9615:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime: 1746147738 -> 1746147739 00000100:00100000:2.0:1746147738.047171:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796607360:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147738.047197:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8b16c00/0xe64d3fbf12a7fd2a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd042 expref: 22 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147738.047213:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8b16c00/0xe64d3fbf12a7fd2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd042 expref: 22 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147738.047220:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8b16c00, rc 0) 00000100:00100000:2.0:1746147738.047253:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794334720:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3445us (6138us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147738.047259:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17429 00000100:00100000:0.0:1746147738.051569:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.054361:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794334848 00000100:00100000:1.0:1746147738.054374:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794334848 00000100:00100000:1.0:1746147738.054434:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 915 00000100:00100000:1.0:1746147738.054443:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+341:1960:x1830967794334848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147738.054456:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147738.054478:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fa00/0xe64d3fbf12a7fd15 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd02d expref: 341 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.054493:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147738.054497:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.056104:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1957:x1830967794333824:12345-192.168.202.10@tcp:4:cat.0 Request processed in 12067us (15766us total) trans 17179874535 rc 0/0 00000100:00100000:3.0:1746147738.056114:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1605 00002000:00100000:3.0:1746147738.056123:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (2842624->3145727) req@ffff880134eb0380 x1830967794333824/t17179874535(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/448 e 0 to 0 dl 1746147749 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.056131:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb0380 with x1830967794333824 ext(2842624->3145727) 00010000:00010000:3.0:1746147738.056140:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 16 pid: 4591 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.056151:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 16 pid: 4591 timeout: 917 lvb_type: 0 00002000:00010000:3.0:1746147738.056157:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134eb0380 00000100:00100000:1.0:1746147738.056718:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+340:1960:x1830967794334848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2274us (5157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.056725:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 915 00000100:00100000:0.0:1746147738.058343:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.058416:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794335104 00000100:00100000:3.0:1746147738.058425:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794335104 00002000:00100000:3.0:1746147738.058461:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880134eb1c00 x1830967794335104/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.058469:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb1c00 with x1830967794335104 ext(1048576->2097151) 00002000:00010000:3.0:1746147738.058473:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134eb1c00 00000100:00100000:3.0:1746147738.058518:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7866 00000100:00100000:3.0:1746147738.058527:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794335104:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147738.064005:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.066040:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794335232 00000100:00100000:1.0:1746147738.066050:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794335232 00010000:00010000:1.0:1746147738.066083:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 16 pid: 4591 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.066127:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8898 00000100:00100000:1.0:1746147738.066133:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1957:x1830967794335232:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147738.066146:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147738.066165:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 16 pid: 4591 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.066174:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 16 pid: 4591 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.066194:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2c00/0xe64d3fbf12a7fc04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf85 expref: 16 pid: 4591 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.066206:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.066208:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.066213:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8b17a00/0xe64d3fbf12a7fcf9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd026 expref: 15 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.066219:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8b17a00/0xe64d3fbf12a7fcf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd026 expref: 15 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.066247:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8b17a00/0xe64d3fbf12a7fcf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd026 expref: 15 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147738.066256:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd18e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796607488:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147738.066337:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.069365:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1959:x1830967794335104:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10833us (11018us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147738.069376:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7866 00002000:00100000:3.0:1746147738.069386:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x454:0x0] (1048576->2097151) req@ffff880134eb1c00 x1830967794335104/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.069394:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb1c00 with x1830967794335104 ext(1048576->2097151) 00002000:00010000:3.0:1746147738.069398:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134eb1c00 00000100:00100000:1.0:1746147738.071193:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd18e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796607488:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147738.071216:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147738.071249:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1957:x1830967794335232:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5115us (7251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.071259:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8898 00000100:00100000:0.0:1746147738.076334:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.076386:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794335360 00000100:00100000:2.0:1746147738.076393:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794335360 00000100:00100000:2.0:1746147738.076440:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17431 00000100:00100000:2.0:1746147738.076447:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32686:x1830967794335360:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147738.076461:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.076475:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134b2f600/0xe64d3fbf12a7fd38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd049 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.076496:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.076498:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.076504:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134b2f600/0xe64d3fbf12a7fd38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd049 expref: 25 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.076516:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134b2f600/0xe64d3fbf12a7fd38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd049 expref: 25 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.076526:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b2f600, rc 0) 00000100:00100000:2.0:1746147738.076577:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:32686:x1830967794335360:12345-192.168.202.10@tcp:101:cat.0 Request processed in 129us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.076583:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17431 00000100:00100000:0.0:1746147738.079296:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.079342:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.079369:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794335744 00000100:00100000:3.0:1746147738.079378:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794335744 00002000:00100000:3.0:1746147738.079416:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880134eb2300 x1830967794335744/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.079424:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb2300 with x1830967794335744 ext(2097152->3145727) 00000100:00100000:2.0:1746147738.079426:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794335872 00002000:00010000:3.0:1746147738.079428:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134eb2300 00000100:00100000:2.0:1746147738.079430:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794335872 00002000:00100000:2.0:1746147738.079448:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2338816->3145727) req@ffff880134eb2680 x1830967794335872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.079454:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb2680 with x1830967794335872 ext(2338816->3145727) 00002000:00010000:2.0:1746147738.079457:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134eb2680 00000100:00100000:3.0:1746147738.079459:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7867 00000100:00100000:3.0:1746147738.079474:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794335744:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147738.081455:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7868 00000100:00100000:2.0:1746147738.081463:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794335872:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:0.0:1746147738.087781:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.088025:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794336128 00000100:00100000:1.0:1746147738.088034:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794336128 00002000:00100000:1.0:1746147738.088070:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880134eb2a00 x1830967794336128/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.088078:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb2a00 with x1830967794336128 ext(2097152->3145727) 00002000:00010000:1.0:1746147738.088083:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134eb2a00 00000100:00100000:1.0:1746147738.088112:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7869 00000100:00100000:1.0:1746147738.088119:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794336128:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147738.092212:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.093198:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794335744:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 13729us (13906us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147738.093209:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7867 00002000:00100000:3.0:1746147738.093218:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880134eb2300 x1830967794335744/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.093226:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb2300 with x1830967794335744 ext(2097152->3145727) 00002000:00010000:3.0:1746147738.093231:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134eb2300 00000100:00100000:2.0:1746147738.093317:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794336256 00000100:00100000:2.0:1746147738.093323:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794336256 00000100:00100000:2.0:1746147738.093388:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12187 00000100:00100000:2.0:1746147738.093393:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+8:32689:x1830967794336256:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147738.093410:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.093423:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667b000/0xe64d3fbf12a7fd3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd050 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.093474:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7fd46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.093484:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7fd46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.093492:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7fd46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.093502:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.093508:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.093513:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.093616:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.093625:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf5b expref: 28 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.093631:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.093658:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf5b expref: 28 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.093668:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf5b expref: 28 pid: 14546 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.093678:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796607616:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147738.093731:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617900 going to sleep for 11 seconds 00000100:00080000:1.0:1746147738.093791:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147738.100779:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.101001:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794335872:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 19537us (21655us total) trans 0 rc 806912/806912 00000100:00100000:2.0:1746147738.101011:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7868 00002000:00100000:2.0:1746147738.101020:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2338816->3145727) req@ffff880134eb2680 x1830967794335872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 806912/806912 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.101033:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb2680 with x1830967794335872 ext(2338816->3145727) 00002000:00010000:2.0:1746147738.101037:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134eb2680 00000100:00100000:3.0:1746147738.101347:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796607616:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.101366:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147738.102483:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794336512 00000100:00100000:1.0:1746147738.102490:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794336512 00000100:00100000:1.0:1746147738.102533:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5104 00000100:00100000:1.0:1746147738.102540:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:27451:x1830967794336512:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147738.102743:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:27451:x1830967794336512:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 204us (1971us total) trans 8589946234 rc 0/0 00000100:00100000:1.0:1746147738.102748:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5104 00000100:00100000:2.0:1746147738.103643:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794336128:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15522us (15866us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147738.103651:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7869 00002000:00100000:2.0:1746147738.103658:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff880134eb2a00 x1830967794336128/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.103666:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb2a00 with x1830967794336128 ext(2097152->3145727) 00002000:00010000:2.0:1746147738.103670:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134eb2a00 00000100:00100000:0.0:1746147738.106157:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.106219:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794336640 00000100:00100000:1.0:1746147738.106227:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794336640 00010000:00010000:1.0:1746147738.106255:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf5b expref: 30 pid: 14546 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.106293:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8899 00000100:00100000:1.0:1746147738.106300:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+30:1957:x1830967794336640:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147738.106312:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147738.106316:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf5b expref: 30 pid: 14546 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.106334:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf5b expref: 30 pid: 14546 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.106352:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1050000/0xe64d3fbf12a7fbb7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf5b expref: 30 pid: 14546 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.106367:0:15900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147738.106371:0:15900:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147738.106379:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147738.106385:0:15900:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147738.106422:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147738.106462:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:1957:x1830967794336640:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 163us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.106468:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8899 00010000:00010000:2.0:1746147738.107011:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107018:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:2.0:1746147738.107055:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147738.107060:0:5744:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147738.107073:0:5744:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107081:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107089:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7fd46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107094:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7fd46 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107103:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7fd46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107107:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013179e800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147738.107110:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7fd46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107116:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7fd46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107124:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147738.107126:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147738.107129:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7fd46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107133:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e800/0xe64d3fbf12a7fd46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107146:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107150:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107158:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107162:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013179f400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147738.107164:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107169:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107178:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a02f4d00) 00010000:00010000:2.0:1746147738.107180:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147738.107182:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107186:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.107214:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a667b000/0xe64d3fbf12a7fd3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd050 expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.107224:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd050 expref: 9 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.107228:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147738.107230:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147738.107232:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179e200, rc 0) 00000100:00100000:2.0:1746147738.107266:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+9:32689:x1830967794336256:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 13873us (15060us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.107272:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12187 00000100:00100000:0.0:1746147738.110691:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.110740:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.111286:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.111319:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.111345:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794336768 00000100:00100000:3.0:1746147738.111356:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794336768 00000100:00100000:0.0:1746147738.111373:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.111979:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794336896 00000100:00100000:3.0:1746147738.111982:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794336896 00000100:00100000:2.0:1746147738.111986:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794337024 00000100:00100000:2.0:1746147738.111990:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794337024 00000100:00100000:3.0:1746147738.111996:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794337152 00000100:00100000:3.0:1746147738.111998:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794337152 00000100:00100000:3.0:1746147738.112008:0:6715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794337280 00000100:00100000:3.0:1746147738.112010:0:6715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794337280 00000100:00080000:0.0:1746147738.112068:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147738.112073:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147738.112153:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17432 00000100:00100000:2.0:1746147738.112162:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794336768:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:3.0:1746147738.112163:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17433 00000100:00100000:3.0:1746147738.112170:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794336896:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147738.112178:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.112178:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.112191:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7fd62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd05e expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.112191:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013179f800/0xe64d3fbf12a7fd5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd057 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.112210:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.112210:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.112211:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.112211:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.112218:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7fd62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd05e expref: 10 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147738.112218:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013179f800/0xe64d3fbf12a7fd5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd057 expref: 10 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.112229:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7fd62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd05e expref: 10 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147738.112229:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013179f800/0xe64d3fbf12a7fd5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd057 expref: 10 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.112237:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0db600, rc 0) 00010000:00010000:2.0:1746147738.112237:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179f800, rc 0) 00000100:00100000:3.0:1746147738.112274:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+10:1958:x1830967794336896:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 105us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.112280:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17433 00000100:00100000:3.0:1746147738.112294:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17434 00000100:00100000:3.0:1746147738.112298:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+7:1958:x1830967794337152:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147738.112305:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.112314:0:6715:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7fd69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd06c expref: -99 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.112324:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.112325:0:6715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.112329:0:6715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7fd69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd06c expref: 8 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.112338:0:6715:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7fd69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd06c expref: 8 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.112344:0:6715:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c0da000, rc 0) 00000100:00100000:1.0:1746147738.112536:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17435 00000100:00100000:1.0:1746147738.112543:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794337024:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147738.112551:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147738.112558:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130eeaa00/0xe64d3fbf12a7fd70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd065 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.112567:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.112568:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.112573:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130eeaa00/0xe64d3fbf12a7fd70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd065 expref: 9 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147738.112581:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130eeaa00/0xe64d3fbf12a7fd70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd065 expref: 9 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147738.112586:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130eeaa00, rc 0) 00000100:00100000:2.0:1746147738.112741:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794336768:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 579us (2058us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.112742:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:41587371-240a-4781-aecb-638f17200fbd+9:1958:x1830967794337152:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 441us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.112747:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17432 00000100:00100000:3.0:1746147738.112750:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17434 00000100:00100000:2.0:1746147738.112761:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17436 00000100:00100000:2.0:1746147738.112767:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794337280:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147738.112774:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.112782:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7fd77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd073 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147738.112821:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c9a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796607744:192.168.202.10@tcp:106: 00000100:00100000:1.0:1746147738.113151:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794337024:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 608us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.113156:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17435 00000100:00100000:0.0:1746147738.113203:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.113372:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794337408 00000100:00100000:1.0:1746147738.113376:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794337408 00000100:00100000:1.0:1746147738.113402:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17437 00000100:00100000:1.0:1746147738.113407:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:32686:x1830967794337408:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1746147738.113413:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147738.113419:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130eeae00/0xe64d3fbf12a7fd7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd07a expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147738.113719:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617900 going to sleep for 11 seconds 00010000:00010000:1.0:1746147738.113970:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.113981:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147738.113983:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147738.113985:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130eeae00/0xe64d3fbf12a7fd7e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd07a expref: 22 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.114003:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 9 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.114013:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 9 pid: 8468 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.114023:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796607872:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147738.114058:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201540 going to sleep for 11 seconds 00002000:00010000:0.0:1746147738.118146:0:9615:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime: 1746147738 -> 1746147739 00002000:00010000:0.0:1746147738.118153:0:9615:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime: 1746147738 -> 1746147739 00000100:00100000:0.0:1746147738.118174:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c9a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796607744:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147738.118199:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7fd77 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd073 expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147738.118209:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013179f200/0xe64d3fbf12a7fd77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd073 expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147738.119172:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.119230:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796607872:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.119236:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794337536 00000100:00100000:3.0:1746147738.119243:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794337536 00010000:00010000:2.0:1746147738.119249:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130eeae00/0xe64d3fbf12a7fd7e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd07a expref: 22 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.119265:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130eeae00, rc 0) 00002000:00100000:3.0:1746147738.119278:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3715071) req@ffff88009c9a8e00 x1830967794337536/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 504/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.119286:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a8e00 with x1830967794337536 ext(2097152->3715071) 00010000:00010000:3.0:1746147738.119292:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 10 pid: 8468 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.119303:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:32686:x1830967794337408:12345-192.168.202.10@tcp:101:cat.0 Request processed in 5894us (6098us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147738.119304:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 10 pid: 8468 timeout: 917 lvb_type: 0 00002000:00010000:3.0:1746147738.119310:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c9a8e00 00000100:00100000:2.0:1746147738.119310:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17437 00000100:00100000:3.0:1746147738.119327:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1606 00000100:00100000:3.0:1746147738.119334:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1960:x1830967794337536:12345-192.168.202.10@tcp:4:cat.0 00010000:00010000:0.0:1746147738.119691:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179f200, rc 0) 00000100:00100000:0.0:1746147738.119714:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794337280:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 6947us (8340us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147738.119722:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17436 00000100:00100000:2.0:1746147738.125160:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.125210:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794337664 00000100:00100000:1.0:1746147738.125218:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794337664 00000100:00100000:1.0:1746147738.125257:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17438 00000100:00100000:1.0:1746147738.125264:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:32684:x1830967794337664:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147738.125285:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147738.125299:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130eea600/0xe64d3fbf12a7fd85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd081 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.125327:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7fb86 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf31 expref: 23 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.125336:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7fd62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd05e expref: 7 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147738.125344:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a542e200/0xe64d3fbf12a7fb9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf38 expref: 11 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147738.125350:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.125351:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.125354:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130eea600/0xe64d3fbf12a7fd85 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1556480->2097151] (req 1556480->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd081 expref: 23 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.125378:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a542e200/0xe64d3fbf12a7fb9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf38 expref: 11 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147738.125387:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a542e200/0xe64d3fbf12a7fb9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf38 expref: 11 pid: 4591 timeout: 917 lvb_type: 1 00000100:00100000:1.0:1746147738.125397:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796608000:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147738.125470:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7fd62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd05e expref: 7 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147738.125478:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7fd62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd05e expref: 7 pid: 6715 timeout: 917 lvb_type: 1 00000100:00100000:1.0:1746147738.125486:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796608128:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147738.125514:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7fb86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf31 expref: 23 pid: 6715 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.125526:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7fb86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf31 expref: 23 pid: 6715 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.125534:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796608256:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147738.125553:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147738.127509:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.127593:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794337920 00000100:00100000:2.0:1746147738.127610:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794337920 00000100:00100000:2.0:1746147738.127659:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12188 00000100:00100000:2.0:1746147738.127665:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+9:32689:x1830967794337920:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147738.127684:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.127701:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e000/0xe64d3fbf12a7fd8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd088 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.127795:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.127811:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd050 expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.127818:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.127849:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd050 expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.127859:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd050 expref: 10 pid: 5744 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.127875:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796608384:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147738.127975:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147738.128353:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796608000:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.130299:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1960:x1830967794337536:12345-192.168.202.10@tcp:4:cat.0 Request processed in 10961us (11124us total) trans 21474841761 rc 0/0 00000100:00100000:3.0:1746147738.130311:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1606 00002000:00100000:3.0:1746147738.130325:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3715071) req@ffff88009c9a8e00 x1830967794337536/t21474841761(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 504/448 e 0 to 0 dl 1746147749 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.130340:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c9a8e00 with x1830967794337536 ext(2097152->3715071) 00010000:00010000:3.0:1746147738.130348:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 12 pid: 8468 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.130360:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 12 pid: 8468 timeout: 917 lvb_type: 0 00002000:00010000:3.0:1746147738.130366:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c9a8e00 00000100:00100000:0.0:1746147738.130541:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.130589:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796608128:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147738.130608:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796608256:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147738.130634:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130eea600/0xe64d3fbf12a7fd85 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1556480->2097151] (req 1556480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd081 expref: 23 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.130646:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130eea600, rc 0) 00000100:00100000:1.0:1746147738.130668:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32684:x1830967794337664:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5405us (5515us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.130674:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17438 00000100:00100000:3.0:1746147738.130908:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794338048 00000100:00100000:3.0:1746147738.130913:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794338048 00010000:00010000:3.0:1746147738.130935:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7fd62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd05e expref: 8 pid: 6715 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746147738.130963:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8900 00000100:00100000:3.0:1746147738.130969:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093644a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794338048:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147738.130979:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147738.130991:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7fd62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd05e expref: 8 pid: 6715 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746147738.131000:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7fd62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd05e expref: 8 pid: 6715 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746147738.131018:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c0db600/0xe64d3fbf12a7fd62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd05e expref: 8 pid: 6715 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746147738.131030:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.131061:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093644a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967794338048:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 92us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.131067:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8900 00000100:00100000:2.0:1746147738.132049:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.132061:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.132082:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.132094:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794338176 00000100:00100000:2.0:1746147738.132097:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794338176 00010000:00010000:2.0:1746147738.132110:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a542e200/0xe64d3fbf12a7fb9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf38 expref: 12 pid: 4591 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746147738.132112:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796608384:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147738.132123:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794338304 00000100:00100000:2.0:1746147738.132125:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794338304 00010000:00010000:3.0:1746147738.132128:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.132138:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd050 expref: 11 pid: 5744 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.132143:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794338432 00000100:00100000:3.0:1746147738.132146:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794338432 00000100:00100000:2.0:1746147738.132149:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8901 00000100:00100000:2.0:1746147738.132154:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1959:x1830967794338176:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147738.132159:0:7312:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7fb86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf31 expref: 23 pid: 6715 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.132160:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147738.132169:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a542e200/0xe64d3fbf12a7fb9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf38 expref: 12 pid: 4591 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746147738.132175:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a542e200/0xe64d3fbf12a7fb9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf38 expref: 12 pid: 4591 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746147738.132180:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8902 00000100:00100000:3.0:1746147738.132185:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794338304:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147738.132186:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a542e200/0xe64d3fbf12a7fb9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf38 expref: 12 pid: 4591 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746147738.132193:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147738.132198:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd050 expref: 11 pid: 5744 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.132201:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147738.132206:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd050 expref: 11 pid: 5744 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.132217:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794338176:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 63us (170us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147738.132218:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e200/0xe64d3fbf12a7fd54 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd050 expref: 11 pid: 5744 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.132222:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8901 00010000:00010000:3.0:1746147738.132227:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00000100:00100000:2.0:1746147738.132230:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8903 00010000:00010000:3.0:1746147738.132231:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147738.132234:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794338432:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147738.132238:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147738.132239:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.132242:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7fb86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf31 expref: 23 pid: 6715 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.132246:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.132248:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7fb86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf31 expref: 23 pid: 6715 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.132257:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941bb600/0xe64d3fbf12a7fb86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf31 expref: 23 pid: 6715 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.132259:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147738.132265:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.132266:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.132270:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130eea600/0xe64d3fbf12a7fd85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd081 expref: 22 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.132274:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41587371-240a-4781-aecb-638f17200fbd+10:1959:x1830967794338304:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 89us (212us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147738.132276:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130eea600/0xe64d3fbf12a7fd85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd081 expref: 22 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.132280:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8902 00010000:00010000:3.0:1746147738.132293:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.132294:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130eea600/0xe64d3fbf12a7fd85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd081 expref: 22 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.132298:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147738.132303:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796608512:192.168.202.10@tcp:105: 00000004:00200000:3.0:1746147738.132312:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147738.132503:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179e000/0xe64d3fbf12a7fd8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd088 expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.132514:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd088 expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.132519:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147738.132522:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147738.132524:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013179f400, rc 0) 00000100:00100000:3.0:1746147738.132543:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32689:x1830967794337920:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 4878us (5042us total) trans 8589946235 rc 0/0 00000100:00100000:3.0:1746147738.132549:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12188 00000100:00100000:2.0:1746147738.132800:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147738.134535:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.134751:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796608512:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147738.134765:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147738.134789:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794338432:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2553us (2706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.134796:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8903 00000100:00100000:2.0:1746147738.135253:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794338560 00000100:00100000:2.0:1746147738.135258:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794338560 00010000:00010000:2.0:1746147738.135277:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 11 pid: 8468 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.135307:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8904 00000100:00100000:2.0:1746147738.135313:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1959:x1830967794338560:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147738.135322:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147738.135339:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 11 pid: 8468 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.135348:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 11 pid: 8468 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.135365:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093da8e00/0xe64d3fbf12a7fc19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf9a expref: 11 pid: 8468 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.135379:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.135381:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.135386:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130eeae00/0xe64d3fbf12a7fd7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd07a expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.135393:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130eeae00/0xe64d3fbf12a7fd7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd07a expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.135416:0:7095:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130eeae00/0xe64d3fbf12a7fd7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd07a expref: 21 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147738.135426:0:7095:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796608640:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147738.135476:0:7095:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147738.135614:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.135700:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794338816 00000100:00100000:3.0:1746147738.135703:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794338816 00002000:00100000:3.0:1746147738.135728:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1556480->1560575) req@ffff880093645180 x1830967794338816/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.135737:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093645180 with x1830967794338816 ext(1556480->1560575) 00002000:00010000:3.0:1746147738.135740:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093645180 00000100:00100000:3.0:1746147738.135763:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7870 00000100:00100000:3.0:1746147738.135768:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794338816:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147738.136089:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794338816:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 318us (473us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147738.136095:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7870 00002000:00100000:3.0:1746147738.136099:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1556480->1560575) req@ffff880093645180 x1830967794338816/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/4536 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.136105:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093645180 with x1830967794338816 ext(1556480->1560575) 00002000:00010000:3.0:1746147738.136107:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093645180 00000100:00100000:0.0:1746147738.136547:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.136664:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794338944 00000100:00100000:3.0:1746147738.136667:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794338944 00000100:00100000:2.0:1746147738.136753:0:7095:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7095:1830967796608640:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147738.136765:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147738.136784:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1959:x1830967794338560:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1471us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.136790:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8904 00000100:00100000:3.0:1746147738.137456:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12189 00000100:00100000:3.0:1746147738.137464:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32689:x1830967794338944:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147738.137479:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.137492:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7fda1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd08f expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.137550:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.137563:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd088 expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.137573:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.137591:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd088 expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.137615:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd088 expref: 11 pid: 5744 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.137624:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796608768:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.137672:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.142432:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.142491:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.142510:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794339200 00000100:00100000:2.0:1746147738.142517:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794339200 00002000:00100000:2.0:1746147738.142551:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800951d4000 x1830967794339200/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.142560:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d4000 with x1830967794339200 ext(2097152->3145727) 00000100:00100000:0.0:1746147738.142560:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796608768:192.168.202.10@tcp:104: 00002000:00010000:2.0:1746147738.142565:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d4000 00000100:00100000:2.0:1746147738.142579:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794339456 00000100:00100000:2.0:1746147738.142581:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794339456 00010000:00010000:0.0:1746147738.142587:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00002000:00100000:2.0:1746147738.142591:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800951d6680 x1830967794339456/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.142606:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d6680 with x1830967794339456 ext(3145728->4194303) 00002000:00010000:2.0:1746147738.142608:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d6680 00000100:00100000:3.0:1746147738.143018:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7871 00000100:00100000:3.0:1746147738.143026:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794339200:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147738.143175:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7872 00000100:00100000:2.0:1746147738.143180:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794339456:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147738.144401:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.144421:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794339584 00000100:00100000:2.0:1746147738.144425:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794339584 00010000:00010000:2.0:1746147738.144442:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd088 expref: 12 pid: 5744 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.144469:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8905 00000100:00100000:2.0:1746147738.144475:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+12:1959:x1830967794339584:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147738.144483:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147738.144488:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd088 expref: 12 pid: 5744 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.144498:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd088 expref: 12 pid: 5744 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.144516:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013179f400/0xe64d3fbf12a7fd93 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd088 expref: 12 pid: 5744 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.144531:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147738.144536:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.144544:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.144550:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.144567:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147738.144588:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+11:1959:x1830967794339584:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 113us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.144594:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8905 00010000:00010000:0.0:1746147738.146076:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147738.146087:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:0.0:1746147738.146122:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:0.0:1746147738.146126:0:5744:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746147738.146140:0:5744:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147738.146168:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7fda1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd08f expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.146184:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd08f expref: 10 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.146191:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147738.146195:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147738.146197:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8400, rc 0) 00000100:00100000:0.0:1746147738.146220:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32689:x1830967794338944:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 8757us (9674us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147738.146226:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12189 00000100:00100000:0.0:1746147738.147135:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.147175:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794339712 00000100:00100000:1.0:1746147738.147182:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794339712 00000100:00100000:1.0:1746147738.147226:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17439 00000100:00100000:1.0:1746147738.147232:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:32684:x1830967794339712:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:1.0:1746147738.147244:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147738.147257:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd096 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.147279:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fba2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf4d expref: 26 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.147291:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130eeaa00/0xe64d3fbf12a7fd70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd065 expref: 7 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147738.147299:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7fba9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf54 expref: 14 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.147305:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.147307:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.147310:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 6/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [1048576->1150975] (req 1048576->1150975) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.147335:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7fba9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf54 expref: 14 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.147347:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7fba9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf54 expref: 14 pid: 8470 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.147358:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796608896:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147738.147430:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130eeaa00/0xe64d3fbf12a7fd70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd065 expref: 7 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147738.147437:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130eeaa00/0xe64d3fbf12a7fd70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd065 expref: 7 pid: 22183 timeout: 917 lvb_type: 1 00000100:00100000:1.0:1746147738.147444:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796609024:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147738.147470:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fba2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf4d expref: 26 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.147477:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fba2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf4d expref: 26 pid: 8470 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.147484:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796609152:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147738.147502:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.152304:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794339456:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 9115us (9805us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147738.152316:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7872 00002000:00100000:2.0:1746147738.152326:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800951d6680 x1830967794339456/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.152335:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d6680 with x1830967794339456 ext(3145728->4194303) 00002000:00010000:2.0:1746147738.152340:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d6680 00000100:00100000:3.0:1746147738.153518:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794339200:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 10489us (11089us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147738.153525:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7871 00002000:00100000:3.0:1746147738.153530:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff8800951d4000 x1830967794339200/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.153537:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d4000 with x1830967794339200 ext(2097152->3145727) 00002000:00010000:3.0:1746147738.153540:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d4000 00000100:00100000:0.0:1746147738.154458:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.154488:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.154515:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.154562:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.154652:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796608896:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.154654:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794339840 00000100:00100000:3.0:1746147738.154660:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794339840 00000100:00100000:1.0:1746147738.154662:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796609024:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147738.154668:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:9615:1830967796609152:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.154692:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794339968 00000100:00100000:3.0:1746147738.154694:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794339968 00010000:00010000:1.0:1746147738.154694:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [1048576->1150975] (req 1048576->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.154708:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17440 00010000:00010000:1.0:1746147738.154709:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8ac6e00, rc 0) 00000100:00100000:3.0:1746147738.154714:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794339840:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147738.154725:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147738.154732:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32684:x1830967794339712:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 7500us (7600us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147738.154738:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7fdb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd09d expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147738.154738:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17439 00000100:00100000:1.0:1746147738.154751:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17441 00000100:00100000:1.0:1746147738.154757:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+9:1957:x1830967794339968:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147738.154763:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147738.154770:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8ac7c00/0xe64d3fbf12a7fdbd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd0a4 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.154777:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796609280:192.168.202.10@tcp:106: 00010000:00010000:1.0:1746147738.154785:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.154787:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.154793:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8ac7c00/0xe64d3fbf12a7fdbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0a4 expref: 10 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147738.154804:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8ac7c00/0xe64d3fbf12a7fdbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0a4 expref: 10 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147738.154811:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8ac7c00, rc 0) 00000100:00100000:3.0:1746147738.154822:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147738.154827:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+10:1957:x1830967794339968:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 70us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.154831:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17441 00000100:00100000:2.0:1746147738.154928:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794340096 00000100:00100000:2.0:1746147738.154932:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794340096 00010000:00010000:2.0:1746147738.154949:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130eeaa00/0xe64d3fbf12a7fd70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd065 expref: 8 pid: 22183 timeout: 917 lvb_type: 1 00000100:00100000:2.0:1746147738.154966:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794340224 00000100:00100000:2.0:1746147738.154969:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794340224 00010000:00010000:2.0:1746147738.154977:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7fba9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf54 expref: 15 pid: 8470 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.155001:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8906 00000100:00100000:2.0:1746147738.155007:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093645f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794340096:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147738.155015:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147738.155031:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8907 00010000:00010000:2.0:1746147738.155032:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130eeaa00/0xe64d3fbf12a7fd70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd065 expref: 8 pid: 22183 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746147738.155038:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093646680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794340224:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147738.155041:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130eeaa00/0xe64d3fbf12a7fd70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd065 expref: 8 pid: 22183 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746147738.155046:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147738.155057:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130eeaa00/0xe64d3fbf12a7fd70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd065 expref: 8 pid: 22183 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746147738.155063:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7fba9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf54 expref: 15 pid: 8470 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.155070:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147738.155073:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7fba9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf54 expref: 15 pid: 8470 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.155084:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095092400/0xe64d3fbf12a7fba9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf54 expref: 15 pid: 8470 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.155090:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093645f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+7:1957:x1830967794340096:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 83us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.155095:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8906 00010000:00010000:3.0:1746147738.155099:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.155114:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093646680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794340224:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 77us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.155120:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8907 00000100:00100000:0.0:1746147738.156750:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:3.0:1746147738.157539:0:22183:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime: 1746147738 -> 1746147739 00002000:00010000:3.0:1746147738.157544:0:22183:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime: 1746147738 -> 1746147739 00002000:00010000:3.0:1746147738.157546:0:22183:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime: 1746147738 -> 1746147739 00000100:00100000:3.0:1746147738.157562:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796609280:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147738.157585:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7fdb6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd09d expref: 9 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.157610:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8a00/0xe64d3fbf12a7fdb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd09d expref: 9 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.157620:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8a00, rc 0) 00000100:00100000:3.0:1746147738.157656:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+8:1957:x1830967794339840:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 2942us (3199us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147738.157663:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17440 00000100:00100000:1.0:1746147738.157746:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794340352 00000100:00100000:1.0:1746147738.157753:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794340352 00010000:00010000:1.0:1746147738.157773:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fba2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf4d expref: 26 pid: 8470 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.157792:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8908 00000100:00100000:1.0:1746147738.157798:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093646a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967794340352:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147738.157808:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147738.157821:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fba2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf4d expref: 26 pid: 8470 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.157830:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fba2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf4d expref: 26 pid: 8470 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.157848:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fba2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf4d expref: 26 pid: 8470 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.157862:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.157864:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.157869:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 25 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.157875:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 25 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.157926:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 25 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147738.157937:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796609408:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147738.157993:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147738.159565:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15900:1830967796609408:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147738.159581:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147738.159615:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093646a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794340352:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1818us (2871us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.159623:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8908 00000100:00100000:0.0:1746147738.160958:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.161198:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794340608 00000100:00100000:2.0:1746147738.161206:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794340608 00000100:00100000:2.0:1746147738.161254:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12190 00000100:00100000:2.0:1746147738.161261:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32689:x1830967794340608:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147738.161275:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.161290:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5000/0xe64d3fbf12a7fdc4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd0ab expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.161372:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5e00/0xe64d3fbf12a7fdcb lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.161383:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5e00/0xe64d3fbf12a7fdcb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.161391:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5e00/0xe64d3fbf12a7fdcb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.161401:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5e00/0xe64d3fbf12a7fdcb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.161405:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5e00/0xe64d3fbf12a7fdcb lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.161411:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5e00/0xe64d3fbf12a7fdcb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.161415:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800956d5e00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147738.161417:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5e00/0xe64d3fbf12a7fdcb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.161422:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5e00/0xe64d3fbf12a7fdcb lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.161430:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147738.161432:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147738.161435:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5e00/0xe64d3fbf12a7fdcb lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.161439:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5e00/0xe64d3fbf12a7fdcb lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.161474:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5000/0xe64d3fbf12a7fdc4 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ab expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.161480:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5000/0xe64d3fbf12a7fdc4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ab expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.161487:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800956d5000, rc 0) 00000100:00100000:2.0:1746147738.161515:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32689:x1830967794340608:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 256us (560us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147738.161521:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12190 00000100:00100000:0.0:1746147738.161667:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.161787:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794340864 00000100:00100000:3.0:1746147738.161792:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794340864 00002000:00100000:3.0:1746147738.161814:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1146880->1150975) req@ffff880093647100 x1830967794340864/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.161822:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093647100 with x1830967794340864 ext(1146880->1150975) 00002000:00010000:3.0:1746147738.161825:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093647100 00000100:00100000:3.0:1746147738.161878:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7873 00000100:00100000:3.0:1746147738.161898:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794340864:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147738.162014:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1958:x1830967794340864:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 131us (347us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147738.162018:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7873 00002000:00100000:3.0:1746147738.162021:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1146880->1150975) req@ffff880093647100 x1830967794340864/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/4536 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.162026:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093647100 with x1830967794340864 ext(1146880->1150975) 00002000:00010000:3.0:1746147738.162028:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093647100 00000100:00100000:0.0:1746147738.163522:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.163710:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794341120 00000100:00100000:3.0:1746147738.163715:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794341120 00000100:00100000:3.0:1746147738.163752:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5105 00000100:00100000:3.0:1746147738.163758:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130ebf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41587371-240a-4781-aecb-638f17200fbd+10:32689:x1830967794341120:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:3.0:1746147738.163927:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130ebf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:41587371-240a-4781-aecb-638f17200fbd+11:32689:x1830967794341120:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 168us (405us total) trans 8589946236 rc 0/0 00000100:00100000:3.0:1746147738.163933:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5105 00000100:00100000:0.0:1746147738.164122:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.164251:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794341376 00000100:00100000:1.0:1746147738.164255:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794341376 00000100:00100000:1.0:1746147738.164286:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5106 00000100:00100000:1.0:1746147738.164291:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+340:32684:x1830967794341376:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:1.0:1746147738.164508:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+341:32684:x1830967794341376:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 216us (386us total) trans 8589946237 rc 0/0 00000100:00100000:1.0:1746147738.164514:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5106 00000100:00100000:0.0:1746147738.281217:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.281281:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.281316:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794341504 00000100:00100000:3.0:1746147738.281324:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794341504 00000100:00100000:2.0:1746147738.281333:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794341632 00000100:00100000:2.0:1746147738.281337:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794341632 00002000:00100000:2.0:1746147738.281361:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1150975) req@ffff880093647b80 x1830967794341632/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.281362:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1556480->2097151) req@ffff880093647800 x1830967794341504/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.281370:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093647800 with x1830967794341504 ext(1556480->2097151) 00002000:00100000:2.0:1746147738.281370:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093647b80 with x1830967794341632 ext(1048576->1150975) 00002000:00010000:3.0:1746147738.281374:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093647800 00002000:00010000:2.0:1746147738.281374:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093647b80 00000100:00100000:3.0:1746147738.281403:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7874 00000100:00100000:2.0:1746147738.281407:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7875 00000100:00100000:3.0:1746147738.281409:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1957:x1830967794341504:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147738.281411:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1957:x1830967794341632:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147738.288750:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967794341632:12345-192.168.202.10@tcp:4:cat.0 Request processed in 7328us (7459us total) trans 17179874536 rc 0/0 00000100:00100000:2.0:1746147738.288761:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7875 00002000:00100000:2.0:1746147738.288774:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1150975) req@ffff880093647b80 x1830967794341632/t17179874536(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/448 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.288783:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093647b80 with x1830967794341632 ext(1048576->1150975) 00002000:00010000:2.0:1746147738.288789:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093647b80 00000100:00100000:0.0:1746147738.296351:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.296399:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.296525:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794341888 00000100:00100000:2.0:1746147738.296532:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794341888 00000100:00100000:2.0:1746147738.296579:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794342144 00000100:00100000:2.0:1746147738.296582:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794342144 00000100:00100000:2.0:1746147738.296610:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12191 00000100:00100000:2.0:1746147738.296618:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+341:32695:x1830967794341888:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:2.0:1746147738.296640:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.296654:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7fdd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd0b2 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.296741:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4400/0xe64d3fbf12a7fdd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.296752:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4400/0xe64d3fbf12a7fdd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147738.296951:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12192 00000100:00100000:0.0:1746147738.296966:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+29:32697:x1830967794342144:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147738.296987:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147738.297002:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c3c00/0xe64d3fbf12a7fde0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd0b9 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.297096:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2800/0xe64d3fbf12a7fde7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147738.297851:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4400/0xe64d3fbf12a7fdd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.297869:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4600/0xe64d3fbf12a7fdee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.297876:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4600/0xe64d3fbf12a7fdee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.297894:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4600/0xe64d3fbf12a7fdee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.297984:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fdf5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.297991:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.297997:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:2.0:1746147738.298005:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:0.0:1746147738.298084:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2800/0xe64d3fbf12a7fde7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147738.298096:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4400/0xe64d3fbf12a7fdd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147738.298097:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2800/0xe64d3fbf12a7fde7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147738.298102:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4400/0xe64d3fbf12a7fdd9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.298107:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4400/0xe64d3fbf12a7fdd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147738.298107:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2400/0xe64d3fbf12a7fe03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147738.298111:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800956d4400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147738.298114:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2400/0xe64d3fbf12a7fe03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147738.298115:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4400/0xe64d3fbf12a7fdd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.298119:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4400/0xe64d3fbf12a7fdd9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147738.298119:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2400/0xe64d3fbf12a7fe03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147738.298127:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147738.298130:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147738.298133:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4400/0xe64d3fbf12a7fdd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.298137:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4400/0xe64d3fbf12a7fdd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.298197:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4600/0xe64d3fbf12a7fdee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.298202:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4600/0xe64d3fbf12a7fdee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147738.298205:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c3400/0xe64d3fbf12a7fe0a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147738.298209:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4600/0xe64d3fbf12a7fdee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147738.298212:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c3400/0xe64d3fbf12a7fe0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147738.298213:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800956d4600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147738.298215:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4600/0xe64d3fbf12a7fdee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.298218:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4600/0xe64d3fbf12a7fdee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:0.0:1746147738.298218:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c3400/0xe64d3fbf12a7fe0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746147738.298224:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a02f4b00) 00000004:00200000:0.0:1746147738.298224:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:2.0:1746147738.298225:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147738.298227:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4600/0xe64d3fbf12a7fdee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.298231:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d4600/0xe64d3fbf12a7fdee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147738.298259:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7fdd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b2 expref: 344 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.298268:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fdf5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b2 expref: 343 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.298274:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147738.298275:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147738.298277:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3ca00, rc 0) 00010000:00010000:0.0:1746147738.298284:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2800/0xe64d3fbf12a7fde7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147738.298289:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2800/0xe64d3fbf12a7fde7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147738.298294:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2800/0xe64d3fbf12a7fde7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147738.298303:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ad2c2800 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147738.298306:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2800/0xe64d3fbf12a7fde7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147738.298312:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2800/0xe64d3fbf12a7fde7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147738.298320:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:0.0:1746147738.298323:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147738.298326:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2800/0xe64d3fbf12a7fde7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147738.298330:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2800/0xe64d3fbf12a7fde7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147738.298351:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2400/0xe64d3fbf12a7fe03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147738.298356:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2400/0xe64d3fbf12a7fe03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147738.298360:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2400/0xe64d3fbf12a7fe03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147738.298365:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ad2c2400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:0.0:1746147738.298367:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2400/0xe64d3fbf12a7fe03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147738.298371:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2400/0xe64d3fbf12a7fe03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147738.298377:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a02f4b00) 00010000:00010000:0.0:1746147738.298379:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147738.298382:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2400/0xe64d3fbf12a7fe03 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147738.298385:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c2400/0xe64d3fbf12a7fe03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746147738.298418:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c3c00/0xe64d3fbf12a7fde0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b9 expref: 32 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.298428:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c3400/0xe64d3fbf12a7fe0a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b9 expref: 31 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.298433:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147738.298434:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147738.298436:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad2c3400, rc 0) 00000100:00100000:2.0:1746147738.298821:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+343:32695:x1830967794341888:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2202us (2475us total) trans 8589946238 rc 0/0 00000100:00100000:0.0:1746147738.298822:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:32697:x1830967794342144:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1860us (2420us total) trans 8589946239 rc 0/0 00000100:00100000:2.0:1746147738.298828:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12191 00000100:00100000:0.0:1746147738.298834:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12192 00000100:00100000:3.0:1746147738.300908:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794341504:12345-192.168.202.10@tcp:4:cat.0 Request processed in 19492us (19691us total) trans 21474841762 rc 0/0 00000100:00100000:3.0:1746147738.300921:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7874 00002000:00100000:3.0:1746147738.300930:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1556480->2097151) req@ffff880093647800 x1830967794341504/t21474841762(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/448 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.300940:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093647800 with x1830967794341504 ext(1556480->2097151) 00002000:00010000:3.0:1746147738.300944:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093647800 00000100:00100000:0.0:1746147738.316048:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.316133:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794342272 00000100:00100000:3.0:1746147738.316145:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794342272 00000100:00100000:3.0:1746147738.316213:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17442 00000100:00100000:3.0:1746147738.316222:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:32697:x1830967794342272:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147738.316241:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.316261:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd0c0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.316291:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130eeae00/0xe64d3fbf12a7fd7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd07a expref: 23 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.316298:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8ac7c00/0xe64d3fbf12a7fdbd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0a4 expref: 7 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.316304:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.316305:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.316308:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4034560->4194303] (req 4034560->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 11 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.316338:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8ac7c00/0xe64d3fbf12a7fdbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0a4 expref: 7 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.316350:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8ac7c00/0xe64d3fbf12a7fdbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0a4 expref: 7 pid: 9615 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746147738.316361:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796609536:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.317117:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130eeae00/0xe64d3fbf12a7fd7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd07a expref: 23 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.317131:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130eeae00/0xe64d3fbf12a7fd7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd07a expref: 23 pid: 22183 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.317139:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796609664:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.317179:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147738.320430:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.320465:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796609536:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.320581:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:22183:1830967796609664:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147738.320589:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794342400 00000100:00100000:1.0:1746147738.320606:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794342400 00010000:00010000:3.0:1746147738.320621:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [4034560->4194303] (req 4034560->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 11 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.320637:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8ac7c00/0xe64d3fbf12a7fdbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0a4 expref: 8 pid: 9615 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746147738.320638:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8800, rc 0) 00000100:00100000:1.0:1746147738.320678:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8909 00000100:00100000:3.0:1746147738.320681:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32697:x1830967794342272:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4459us (4640us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.320685:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794342400:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147738.320687:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17442 00010000:00010000:1.0:1746147738.320697:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147738.320718:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8ac7c00/0xe64d3fbf12a7fdbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0a4 expref: 8 pid: 9615 timeout: 917 lvb_type: 1 00010000:00010000:1.0:1746147738.320734:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8ac7c00/0xe64d3fbf12a7fdbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0a4 expref: 8 pid: 9615 timeout: 917 lvb_type: 1 00010000:00010000:1.0:1746147738.320760:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8ac7c00/0xe64d3fbf12a7fdbd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0a4 expref: 8 pid: 9615 timeout: 917 lvb_type: 1 00010000:00010000:1.0:1746147738.321635:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147738.322097:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794342400:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1409us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.322105:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8909 00000100:00100000:0.0:1746147738.322804:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.322964:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794342528 00000100:00100000:1.0:1746147738.322969:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794342528 00010000:00010000:1.0:1746147738.323152:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130eeae00/0xe64d3fbf12a7fd7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd07a expref: 24 pid: 22183 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.323268:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8910 00000100:00100000:1.0:1746147738.323275:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794342528:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147738.323287:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147738.323303:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130eeae00/0xe64d3fbf12a7fd7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd07a expref: 24 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.323315:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130eeae00/0xe64d3fbf12a7fd7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd07a expref: 24 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.323334:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130eeae00/0xe64d3fbf12a7fd7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd07a expref: 24 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.323345:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.323347:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.323354:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 10 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.323362:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 10 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.323391:0:15900:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 10 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147738.323403:0:15900:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796609792:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147738.323825:0:15900:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147738.327026:0:15900:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15900:1830967796609792:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147738.327049:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147738.327336:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794342528:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4059us (4532us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.327351:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8910 00000100:00100000:0.0:1746147738.328144:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.328250:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794342784 00000100:00100000:3.0:1746147738.328257:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794342784 00002000:00100000:3.0:1746147738.328292:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (4034560->4038655) req@ffff8800a0024a80 x1830967794342784/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.328300:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0024a80 with x1830967794342784 ext(4034560->4038655) 00002000:00010000:3.0:1746147738.328304:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0024a80 00000100:00100000:3.0:1746147738.328332:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7876 00000100:00100000:3.0:1746147738.328339:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794342784:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147738.328661:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1960:x1830967794342784:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 318us (513us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147738.328667:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7876 00002000:00100000:3.0:1746147738.328672:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x456:0x0] (4034560->4038655) req@ffff8800a0024a80 x1830967794342784/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/4536 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.328678:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0024a80 with x1830967794342784 ext(4034560->4038655) 00002000:00010000:3.0:1746147738.328682:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0024a80 00000100:00100000:0.0:1746147738.332864:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.333073:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794342912 00000100:00100000:3.0:1746147738.333082:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794342912 00000100:00100000:3.0:1746147738.333131:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17443 00000100:00100000:3.0:1746147738.333138:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32697:x1830967794342912:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147738.333153:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.333168:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd0c7 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.333194:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8b17a00/0xe64d3fbf12a7fcf9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd026 expref: 15 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.333202:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7fd69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd06c expref: 6 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.333210:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134b2f600/0xe64d3fbf12a7fd38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd049 expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.333216:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7fbfd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf7e expref: 26 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.333222:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134b2ec00/0xe64d3fbf12a7fc4a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfcb expref: 15 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.333228:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147738.333230:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147738.333232:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 8/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [4194304->4349951] (req 4194304->4349951) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 15 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.333258:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134b2ec00/0xe64d3fbf12a7fc4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfcb expref: 15 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.333269:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134b2ec00/0xe64d3fbf12a7fc4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfcb expref: 15 pid: 22183 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.333278:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796609920:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.334277:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7fbfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf7e expref: 26 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.334286:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7fbfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf7e expref: 26 pid: 4591 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.334295:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796610048:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.334327:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134b2f600/0xe64d3fbf12a7fd38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd049 expref: 26 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.334339:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134b2f600/0xe64d3fbf12a7fd38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd049 expref: 26 pid: 9615 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.334346:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796610176:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.334379:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7fd69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd06c expref: 6 pid: 6715 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.334388:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7fd69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd06c expref: 6 pid: 6715 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746147738.334396:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135848380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796610304:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.334429:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8b17a00/0xe64d3fbf12a7fcf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd026 expref: 15 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.334438:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8b17a00/0xe64d3fbf12a7fcf9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd026 expref: 15 pid: 8470 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.334446:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796610432:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.334463:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.337048:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796609920:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.337058:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796610048:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.337064:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796610176:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.337072:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135848380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796610304:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.337078:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796610432:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.337108:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [4194304->4349951] (req 4194304->4349951) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 15 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.337122:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8600, rc 0) 00000100:00100000:3.0:1746147738.337779:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32697:x1830967794342912:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 4639us (4918us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.337787:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17443 00000100:00100000:0.0:1746147738.342316:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.342357:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.342414:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794343424 00000100:00100000:2.0:1746147738.342422:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794343424 00000100:00100000:0.0:1746147738.342438:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.342497:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794343552 00000100:00100000:2.0:1746147738.342499:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794343552 00000100:00100000:2.0:1746147738.342513:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794343680 00000100:00100000:2.0:1746147738.342515:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794343680 00000100:00100000:2.0:1746147738.342526:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17444 00000100:00100000:2.0:1746147738.342532:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967794343424:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147738.342548:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.342563:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800956d4600/0xe64d3fbf12a7fe26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd0ce expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147738.342618:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796610560:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147738.342686:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.342703:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17445 00000100:00100000:2.0:1746147738.342708:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794343552:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147738.342715:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.342724:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9323c00/0xe64d3fbf12a7fe2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd0d5 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147738.342747:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796610688:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147738.342766:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6170c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.342789:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17446 00000100:00100000:3.0:1746147738.342796:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794343680:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.342802:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.342809:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7fe34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd0dc expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.342819:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.342827:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7fe34 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0dc expref: 18 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.342835:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a736ac00/0xe64d3fbf12a7fe34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0dc expref: 18 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.342849:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a736ac00, rc 0) 00000100:00100000:3.0:1746147738.342872:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794343680:12345-192.168.202.10@tcp:101:cat.0 Request processed in 77us (433us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147738.344042:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.344074:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.344086:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794343168 00000100:00100000:0.0:1746147738.344088:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.344091:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794343168 00010000:00010000:1.0:1746147738.344108:0:15900:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134b2ec00/0xe64d3fbf12a7fc4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfcb expref: 18 pid: 22183 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.344129:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794343040 00000100:00100000:0.0:1746147738.344130:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.344131:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794343040 00010000:00010000:1.0:1746147738.344140:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7fbfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf7e expref: 27 pid: 4591 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.344160:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794343296 00000100:00100000:1.0:1746147738.344329:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794343296 00010000:00010000:1.0:1746147738.344342:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7fd69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd06c expref: 7 pid: 6715 timeout: 917 lvb_type: 1 00000100:00100000:1.0:1746147738.344352:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794343936 00000100:00100000:1.0:1746147738.344354:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794343936 00010000:00010000:1.0:1746147738.344361:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134b2f600/0xe64d3fbf12a7fd38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd049 expref: 28 pid: 9615 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.344370:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8911 00000100:00100000:1.0:1746147738.344376:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0025880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1960:x1830967794343168:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147738.344385:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147738.344403:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134b2ec00/0xe64d3fbf12a7fc4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfcb expref: 18 pid: 22183 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.344406:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17446 00010000:00010000:1.0:1746147738.344411:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134b2ec00/0xe64d3fbf12a7fc4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfcb expref: 18 pid: 22183 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.344425:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8912 00010000:00010000:1.0:1746147738.344426:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134b2ec00/0xe64d3fbf12a7fc4a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcfcb expref: 17 pid: 22183 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.344431:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794343040:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147738.344438:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147738.344439:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147738.344446:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7fbfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf7e expref: 28 pid: 4591 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.344454:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7fbfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf7e expref: 28 pid: 4591 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.344461:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0025880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794343168:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 86us (421us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147738.344464:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ad2c2e00/0xe64d3fbf12a7fbfd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf7e expref: 28 pid: 4591 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.344466:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8911 00010000:00010000:3.0:1746147738.344472:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147738.344475:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8913 00000100:00100000:1.0:1746147738.344479:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0025c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794343296:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147738.344483:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794343040:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 54us (410us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147738.344485:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147738.344488:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8912 00010000:00010000:1.0:1746147738.344490:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7fd69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd06c expref: 7 pid: 6715 timeout: 917 lvb_type: 1 00010000:00010000:1.0:1746147738.344496:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7fd69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd06c expref: 7 pid: 6715 timeout: 917 lvb_type: 1 00010000:00010000:1.0:1746147738.344505:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7fd69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd06c expref: 7 pid: 6715 timeout: 917 lvb_type: 1 00010000:00010000:1.0:1746147738.344516:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.344523:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8914 00000100:00100000:1.0:1746147738.344526:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0025c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794343296:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 47us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.344528:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0025f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794343936:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147738.344530:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8913 00010000:00010000:3.0:1746147738.344533:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147738.344539:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134b2f600/0xe64d3fbf12a7fd38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd049 expref: 26 pid: 9615 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.344546:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134b2f600/0xe64d3fbf12a7fd38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd049 expref: 26 pid: 9615 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.344555:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134b2f600/0xe64d3fbf12a7fd38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd049 expref: 26 pid: 9615 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.344563:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.344574:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0025f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794343936:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 46us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.344578:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8914 00000100:00100000:0.0:1746147738.345393:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.345466:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794343808 00000100:00100000:3.0:1746147738.345470:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794343808 00010000:00010000:3.0:1746147738.345484:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8b17a00/0xe64d3fbf12a7fcf9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd026 expref: 16 pid: 8470 timeout: 917 lvb_type: 0 00002000:00010000:2.0:1746147738.345874:0:7050:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime: 1746147738 -> 1746147739 00002000:00010000:2.0:1746147738.345878:0:7050:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime: 1746147738 -> 1746147739 00002000:00010000:2.0:1746147738.345880:0:7050:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime: 1746147738 -> 1746147739 00000100:00100000:3.0:1746147738.345967:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8915 00000100:00100000:3.0:1746147738.345974:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794343808:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147738.345981:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147738.345991:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8b17a00/0xe64d3fbf12a7fcf9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd026 expref: 16 pid: 8470 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.345999:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8b17a00/0xe64d3fbf12a7fcf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd026 expref: 16 pid: 8470 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.346012:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8b17a00/0xe64d3fbf12a7fcf9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd026 expref: 16 pid: 8470 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.346022:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.346024:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.346029:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 15 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.346037:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 15 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.346061:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 15 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.346069:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796610816:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147738.346118:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.346157:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796610560:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147738.346179:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800956d4600/0xe64d3fbf12a7fe26 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ce expref: 12 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.346188:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800956d4600/0xe64d3fbf12a7fe26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ce expref: 12 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.346196:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800956d4600, rc 0) 00000100:00100000:3.0:1746147738.346213:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:1958:x1830967794343424:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3681us (3904us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147738.346219:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17444 00000100:00100000:2.0:1746147738.346516:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7050:1830967796610688:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147738.346533:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9323c00/0xe64d3fbf12a7fe2d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0d5 expref: 15 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147738.346542:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9323c00/0xe64d3fbf12a7fe2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0d5 expref: 15 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147738.346553:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9323c00, rc 0) 00000100:00100000:2.0:1746147738.346582:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794343552:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3874us (4225us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147738.346587:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17445 00000100:00100000:3.0:1746147738.349495:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796610816:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147738.349513:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.349544:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1960:x1830967794343808:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3570us (4151us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.349554:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8915 00000100:00100000:0.0:1746147738.350823:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.350908:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794344192 00000100:00100000:3.0:1746147738.350914:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794344192 00002000:00100000:3.0:1746147738.350945:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4345856->4349951) req@ffff8800a0026680 x1830967794344192/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.350954:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0026680 with x1830967794344192 ext(4345856->4349951) 00002000:00010000:3.0:1746147738.350958:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0026680 00000100:00100000:3.0:1746147738.351215:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7877 00000100:00100000:3.0:1746147738.351221:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967794344192:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147738.351361:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967794344192:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 140us (541us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147738.351367:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7877 00002000:00100000:3.0:1746147738.351373:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4345856->4349951) req@ffff8800a0026680 x1830967794344192/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/4536 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.351379:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0026680 with x1830967794344192 ext(4345856->4349951) 00002000:00010000:3.0:1746147738.351382:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0026680 00000100:00100000:0.0:1746147738.355701:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.355920:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794344448 00000100:00100000:1.0:1746147738.355927:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794344448 00000100:00100000:1.0:1746147738.355973:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5107 00000100:00100000:1.0:1746147738.355981:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+31:32697:x1830967794344448:12345-192.168.202.10@tcp:35:multiop.0 00000100:00100000:1.0:1746147738.356184:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:32697:x1830967794344448:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 203us (489us total) trans 8589946240 rc 0/0 00000100:00100000:1.0:1746147738.356191:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5107 00000100:00100000:0.0:1746147738.357965:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.358067:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794344576 00000100:00100000:2.0:1746147738.358073:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794344576 00000100:00100000:2.0:1746147738.358215:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17447 00000100:00100000:2.0:1746147738.358222:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+11:32700:x1830967794344576:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147738.358235:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.358249:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9322400/0xe64d3fbf12a7fe3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd0e3 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.358269:0:7050:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130eea600/0xe64d3fbf12a7fd85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd081 expref: 22 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.358274:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147738.358275:0:7050:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147738.358278:0:7050:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9322400/0xe64d3fbf12a7fe3b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0e3 expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.358299:0:7050:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130eea600/0xe64d3fbf12a7fd85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd081 expref: 22 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.358309:0:7050:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130eea600/0xe64d3fbf12a7fd85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd081 expref: 22 pid: 9615 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.358317:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796610944:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147738.358382:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6170c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147738.362506:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.362748:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796610944:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147738.362776:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a9322400/0xe64d3fbf12a7fe3b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0e3 expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.362828:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794344704 00000100:00100000:3.0:1746147738.362834:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794344704 00010000:00010000:3.0:1746147738.362858:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130eea600/0xe64d3fbf12a7fd85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd081 expref: 23 pid: 9615 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.362915:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9322400, rc 0) 00000100:00100000:3.0:1746147738.362949:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8916 00000100:00100000:3.0:1746147738.362956:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1958:x1830967794344704:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147738.362967:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147738.362986:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130eea600/0xe64d3fbf12a7fd85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd081 expref: 23 pid: 9615 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.362995:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130eea600/0xe64d3fbf12a7fd85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd081 expref: 23 pid: 9615 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.363014:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130eea600/0xe64d3fbf12a7fd85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd081 expref: 23 pid: 9615 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.363029:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.363031:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.363037:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9322400/0xe64d3fbf12a7fe3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0e3 expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.363044:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9322400/0xe64d3fbf12a7fe3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0e3 expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.363070:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a9322400/0xe64d3fbf12a7fe3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0e3 expref: 12 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.363080:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796611072:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147738.363150:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.363220:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:32700:x1830967794344576:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4995us (5255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.363227:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17447 00000100:00100000:3.0:1746147738.368255:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796611072:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147738.368275:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.368841:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1958:x1830967794344704:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5884us (6340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.368852:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8916 00000100:00100000:0.0:1746147738.371926:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.372453:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794344960 00000100:00100000:2.0:1746147738.372462:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794344960 00002000:00100000:2.0:1746147738.372506:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a0027480 x1830967794344960/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.372516:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0027480 with x1830967794344960 ext(1048576->2097151) 00002000:00010000:2.0:1746147738.372521:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0027480 00000100:00100000:2.0:1746147738.372562:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7878 00000100:00100000:2.0:1746147738.372572:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1957:x1830967794344960:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147738.382403:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.382443:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.382467:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.382521:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794345088 00000100:00100000:3.0:1746147738.382533:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794345088 00000100:00100000:3.0:1746147738.382579:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794345216 00000100:00100000:3.0:1746147738.382582:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794345216 00000100:00100000:3.0:1746147738.382612:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794345344 00000100:00100000:3.0:1746147738.382614:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794345344 00000100:00100000:0.0:1746147738.382633:0:8468:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17448 00000100:00100000:0.0:1746147738.382646:0:8468:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794345088:12345-192.168.202.10@tcp:101:cat.0 00000100:00100000:3.0:1746147738.382651:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17449 00000100:00100000:3.0:1746147738.382659:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794345216:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147738.382667:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.382675:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147738.382685:0:8468:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c3a00/0xe64d3fbf12a7fe42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd0ea expref: -99 pid: 8468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.382690:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff8800/0xe64d3fbf12a7fe49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd0f1 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.382710:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147738.382712:0:8468:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147738.382721:0:8468:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c3a00/0xe64d3fbf12a7fe42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ea expref: 24 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147738.382737:0:8468:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c3a00/0xe64d3fbf12a7fe42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ea expref: 24 pid: 8468 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147738.382748:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796611200:192.168.202.10@tcp:106: 00010000:00010000:0.0:1746147738.382749:0:8468:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad2c3a00, rc 0) 00000100:00100000:2.0:1746147738.382817:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17450 00000100:00100000:2.0:1746147738.382826:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794345344:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147738.382834:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.382842:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe50 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd0f8 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147738.382875:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796611328:192.168.202.10@tcp:106: 00000100:00100000:0.0:1746147738.383452:0:8468:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794345088:12345-192.168.202.10@tcp:101:cat.0 Request processed in 808us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147738.383458:0:8468:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17448 00000100:00100000:3.0:1746147738.383501:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.383618:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6170c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.383936:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1957:x1830967794344960:12345-192.168.202.10@tcp:3:cat.0 Request processed in 11365us (12016us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147738.383945:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7878 00002000:00100000:3.0:1746147738.383954:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a0027480 x1830967794344960/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.383962:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0027480 with x1830967794344960 ext(1048576->2097151) 00002000:00010000:3.0:1746147738.383966:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0027480 00002000:00010000:3.0:1746147738.385711:0:21480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime: 1746147738 -> 1746147739 00002000:00010000:3.0:1746147738.385716:0:21480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime: 1746147738 -> 1746147739 00002000:00010000:3.0:1746147738.385718:0:21480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime: 1746147738 -> 1746147739 00000100:00100000:2.0:1746147738.385720:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796611328:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147738.385731:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796611200:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147738.385751:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe50 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0f8 expref: 24 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.385752:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8800/0xe64d3fbf12a7fe49 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0f1 expref: 26 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.385763:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8800/0xe64d3fbf12a7fe49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0f1 expref: 26 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147738.385763:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0f8 expref: 24 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.385777:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8800, rc 0) 00010000:00010000:2.0:1746147738.385778:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9323e00, rc 0) 00000100:00100000:2.0:1746147738.385822:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794345344:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2996us (3353us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147738.385828:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17450 00000100:00100000:3.0:1746147738.386011:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794345216:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3352us (3566us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147738.386016:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17449 00000100:00100000:0.0:1746147738.390474:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.390673:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794345472 00000100:00100000:3.0:1746147738.390681:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794345472 00000100:00100000:3.0:1746147738.390727:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17451 00000100:00100000:3.0:1746147738.390734:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:32700:x1830967794345472:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.390750:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.390767:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7fe57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd0ff expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.390793:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 24 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.390799:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147738.390801:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147738.390803:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7fe57 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ff expref: 14 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.390829:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 24 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.390844:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 24 pid: 9615 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.390854:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796611456:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.390963:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147738.393325:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.393418:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.393526:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796611456:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.393550:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7fe57 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ff expref: 14 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.393565:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8e00, rc 0) 00000100:00100000:3.0:1746147738.393625:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32700:x1830967794345472:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2890us (3157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.393633:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17451 00000100:00100000:2.0:1746147738.393759:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794345856 00000100:00100000:2.0:1746147738.393765:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794345856 00002000:00100000:2.0:1746147738.393794:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a0025180 x1830967794345856/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.393802:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0025180 with x1830967794345856 ext(1048576->2097151) 00002000:00010000:2.0:1746147738.393806:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0025180 00000100:00100000:2.0:1746147738.393817:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794345984 00000100:00100000:2.0:1746147738.393819:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794345984 00002000:00100000:2.0:1746147738.393829:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1150976->2097151) req@ffff8800a0024380 x1830967794345984/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.393835:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0024380 with x1830967794345984 ext(1150976->2097151) 00010000:00010000:2.0:1746147738.393840:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 25 pid: 9615 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.393851:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 25 pid: 9615 timeout: 917 lvb_type: 0 00002000:00010000:2.0:1746147738.393857:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0024380 00000100:00100000:2.0:1746147738.393868:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1607 00000100:00100000:2.0:1746147738.393873:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794345984:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147738.394315:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7879 00000100:00100000:3.0:1746147738.394321:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794345856:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147738.400669:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.400735:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794346112 00000100:00100000:3.0:1746147738.400742:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794346112 00000100:00100000:3.0:1746147738.400785:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17452 00000100:00100000:3.0:1746147738.400792:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:32695:x1830967794346112:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147738.400806:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.400824:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd106 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.400851:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 13 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.400857:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147738.400858:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147738.400861:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3162112->3952639] (req 3162112->3952639) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 28 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.400911:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 13 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.400919:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 13 pid: 22183 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.400928:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796611584:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.401552:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.402221:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794345984:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8345us (8801us total) trans 0 rc 946176/946176 00000100:00100000:2.0:1746147738.402231:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1607 00002000:00100000:2.0:1746147738.402239:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1150976->2097151) req@ffff8800a0024380 x1830967794345984/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:H/200/0 rc 946176/946176 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.402247:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0024380 with x1830967794345984 ext(1150976->2097151) 00010000:00010000:2.0:1746147738.402253:0:31355:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 27 pid: 9615 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.402264:0:31355:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 27 pid: 9615 timeout: 917 lvb_type: 0 00002000:00010000:2.0:1746147738.402270:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0024380 00000100:00100000:3.0:1746147738.403034:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794345856:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8707us (9708us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147738.403043:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7879 00002000:00100000:3.0:1746147738.403051:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff8800a0025180 x1830967794345856/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.403060:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0025180 with x1830967794345856 ext(1048576->2097151) 00002000:00010000:3.0:1746147738.403065:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0025180 00000100:00100000:0.0:1746147738.403788:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.403851:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794346240 00000100:00100000:2.0:1746147738.403859:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794346240 00000100:00100000:3.0:1746147738.403868:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796611584:192.168.202.10@tcp:104: 00002000:00100000:2.0:1746147738.403912:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4349951) req@ffff8800a0025880 x1830967794346240/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.403920:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0025880 with x1830967794346240 ext(4194304->4349951) 00010000:00010000:2.0:1746147738.403926:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 14 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.403936:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 14 pid: 22183 timeout: 917 lvb_type: 0 00002000:00010000:2.0:1746147738.403943:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0025880 00000100:00100000:2.0:1746147738.403959:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1608 00000100:00100000:2.0:1746147738.403965:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967794346240:12345-192.168.202.10@tcp:4:cat.0 00010000:00010000:3.0:1746147738.403970:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3162112->3952639] (req 3162112->3952639) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 26 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.403985:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff9200, rc 0) 00000100:00100000:3.0:1746147738.404017:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32695:x1830967794346112:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3225us (3354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.404025:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17452 00000100:00100000:2.0:1746147738.407269:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.407322:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794346368 00000100:00100000:3.0:1746147738.407330:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794346368 00010000:00010000:3.0:1746147738.407361:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 26 pid: 9615 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.407400:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8917 00000100:00100000:3.0:1746147738.407407:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967794346368:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147738.407418:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147738.407440:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 26 pid: 9615 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.407451:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 26 pid: 9615 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.407473:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8ac6e00/0xe64d3fbf12a7fdaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1150975) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd096 expref: 26 pid: 9615 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.407490:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.407492:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.407500:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7fe57 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ff expref: 15 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.407508:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7fe57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ff expref: 15 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.407538:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7fe57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ff expref: 15 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.407549:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796611712:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147738.407864:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.408369:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794346240:12345-192.168.202.10@tcp:4:cat.0 Request processed in 4400us (4579us total) trans 17179874537 rc 0/0 00000100:00100000:2.0:1746147738.408378:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1608 00002000:00100000:2.0:1746147738.408387:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->4349951) req@ffff8800a0025880 x1830967794346240/t17179874537(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/448 e 0 to 0 dl 1746147749 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.408397:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0025880 with x1830967794346240 ext(4194304->4349951) 00010000:00010000:2.0:1746147738.408405:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 16 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.408416:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 16 pid: 22183 timeout: 917 lvb_type: 0 00002000:00010000:2.0:1746147738.408426:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0025880 00000100:00100000:0.0:1746147738.408652:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.408747:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794346496 00000100:00100000:3.0:1746147738.408755:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794346496 00000100:00100000:3.0:1746147738.408796:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17453 00000100:00100000:3.0:1746147738.408803:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32704:x1830967794346496:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.408818:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.408831:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7fe65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd10d expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.408851:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.408853:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.408860:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7fe65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd10d expref: 27 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.408872:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7fe65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd10d expref: 27 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.408881:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8a00, rc 0) 00000100:00100000:3.0:1746147738.408950:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:32704:x1830967794346496:12345-192.168.202.10@tcp:101:cat.0 Request processed in 148us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.408955:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17453 00000100:00100000:3.0:1746147738.409518:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796611712:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147738.409533:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.409552:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1957:x1830967794346368:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2146us (2293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.409559:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8917 00000100:00100000:1.0:1746147738.411591:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.411686:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794346624 00000100:00100000:3.0:1746147738.411694:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794346624 00010000:00010000:3.0:1746147738.411720:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 16 pid: 22183 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.411952:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8918 00000100:00100000:3.0:1746147738.411960:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794346624:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147738.411971:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147738.411989:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 16 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.411999:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 16 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.412017:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fe1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c7 expref: 16 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.412036:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.412039:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.412044:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3952639) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 25 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.412051:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3952639) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 25 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.412078:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3952639) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 25 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.412088:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796611840:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147738.412150:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147738.413161:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.413203:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.413587:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794346880 00000100:00100000:2.0:1746147738.413611:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794346880 00002000:00100000:2.0:1746147738.413655:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800954c3100 x1830967794346880/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147738.413660:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794347136 00000100:00100000:1.0:1746147738.413665:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794347136 00002000:00100000:2.0:1746147738.413666:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c3100 with x1830967794346880 ext(1048576->2097151) 00002000:00010000:2.0:1746147738.413671:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c3100 00002000:00100000:1.0:1746147738.413692:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800954c2a00 x1830967794347136/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.413700:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c2a00 with x1830967794347136 ext(1048576->2097151) 00002000:00010000:1.0:1746147738.413704:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c2a00 00000100:00100000:2.0:1746147738.413709:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7880 00000100:00100000:2.0:1746147738.413723:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794346880:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147738.414713:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796611840:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147738.414731:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.414777:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794346624:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2817us (3189us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147738.414779:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.414787:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8918 00000100:00100000:3.0:1746147738.414868:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794347392 00000100:00100000:3.0:1746147738.414872:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794347392 00002000:00100000:3.0:1746147738.414925:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (3162112->3166207) req@ffff8800949d6300 x1830967794347392/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.414933:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d6300 with x1830967794347392 ext(3162112->3166207) 00002000:00010000:3.0:1746147738.414937:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d6300 00000100:00100000:3.0:1746147738.415131:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7881 00000100:00100000:3.0:1746147738.415139:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794347136:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147738.415139:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7882 00000100:00100000:1.0:1746147738.415150:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794347392:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147738.415292:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794347392:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 144us (516us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147738.415298:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7882 00002000:00100000:1.0:1746147738.415304:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (3162112->3166207) req@ffff8800949d6300 x1830967794347392/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/4536 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.415310:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d6300 with x1830967794347392 ext(3162112->3166207) 00002000:00010000:1.0:1746147738.415314:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d6300 00000100:00100000:2.0:1746147738.424341:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794346880:12345-192.168.202.10@tcp:3:cat.0 Request processed in 10614us (11170us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147738.424353:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7880 00002000:00100000:2.0:1746147738.424363:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800954c3100 x1830967794346880/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.424371:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c3100 with x1830967794346880 ext(1048576->2097151) 00002000:00010000:2.0:1746147738.424378:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c3100 00000100:00100000:3.0:1746147738.425734:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794347136:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 10590us (12524us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147738.425745:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7881 00002000:00100000:3.0:1746147738.425752:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff8800954c2a00 x1830967794347136/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.425760:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954c2a00 with x1830967794347136 ext(1048576->2097151) 00002000:00010000:3.0:1746147738.425765:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954c2a00 00000100:00100000:0.0:1746147738.428369:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.428462:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794347648 00000100:00100000:3.0:1746147738.428470:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794347648 00002000:00100000:3.0:1746147738.428517:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (3948544->3952639) req@ffff8800949d5c00 x1830967794347648/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.428526:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d5c00 with x1830967794347648 ext(3948544->3952639) 00002000:00010000:3.0:1746147738.428531:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d5c00 00000100:00100000:3.0:1746147738.428564:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7883 00000100:00100000:3.0:1746147738.428571:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794347648:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:3.0:1746147738.428748:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794347648:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 177us (389us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147738.428754:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7883 00002000:00100000:3.0:1746147738.428759:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (3948544->3952639) req@ffff8800949d5c00 x1830967794347648/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/4536 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.428766:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d5c00 with x1830967794347648 ext(3948544->3952639) 00002000:00010000:3.0:1746147738.428769:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d5c00 00000100:00100000:0.0:1746147738.429401:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.429509:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794347776 00000100:00100000:2.0:1746147738.429513:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794347776 00000100:00100000:2.0:1746147738.429540:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17454 00000100:00100000:2.0:1746147738.429544:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32700:x1830967794347776:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147738.429552:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.429566:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9322800/0xe64d3fbf12a7fe6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd114 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.429589:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3952639) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 25 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.429608:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147738.429609:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147738.429613:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9322800/0xe64d3fbf12a7fe6c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd114 expref: 16 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.429645:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3952639) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 25 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.429656:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3952639) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 25 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.429667:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796611968:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147738.429738:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6170c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.430810:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796611968:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147738.430833:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9322800/0xe64d3fbf12a7fe6c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd114 expref: 16 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.430845:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9322800, rc 0) 00000100:00100000:2.0:1746147738.430878:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32700:x1830967794347776:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1333us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.430908:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17454 00000100:00100000:0.0:1746147738.431227:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.431312:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794348032 00000100:00100000:2.0:1746147738.431318:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794348032 00000100:00100000:2.0:1746147738.431355:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17455 00000100:00100000:2.0:1746147738.431360:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:32704:x1830967794348032:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147738.431369:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.431380:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe73 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd11b expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.431395:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147738.431398:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe73 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd11b expref: 27 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.431406:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe73 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd11b expref: 27 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.431412:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9323e00, rc 0) 00000100:00100000:2.0:1746147738.431444:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:32704:x1830967794348032:12345-192.168.202.10@tcp:101:cat.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.431449:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17455 00000100:00100000:0.0:1746147738.432432:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.432524:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.432693:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794348416 00000100:00100000:2.0:1746147738.432697:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794348160 00000100:00100000:3.0:1746147738.432698:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794348416 00000100:00100000:2.0:1746147738.432700:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794348160 00002000:00100000:2.0:1746147738.432726:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (3162112->3952639) req@ffff8800949d6a00 x1830967794348160/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.432736:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d6a00 with x1830967794348160 ext(3162112->3952639) 00000100:00100000:3.0:1746147738.432738:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5108 00010000:00010000:2.0:1746147738.432743:0:21458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 27 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.432745:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+343:32695:x1830967794348416:12345-192.168.202.10@tcp:35:multiop.0 00010000:00010000:2.0:1746147738.432756:0:21458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 27 pid: 21480 timeout: 917 lvb_type: 0 00002000:00010000:2.0:1746147738.432764:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949d6a00 00000100:00100000:2.0:1746147738.432781:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1609 00000100:00100000:2.0:1746147738.432786:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967794348160:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147738.432972:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+344:32695:x1830967794348416:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 226us (540us total) trans 8589946241 rc 0/0 00000100:00100000:3.0:1746147738.432978:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5108 00000100:00100000:2.0:1746147738.443725:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1958:x1830967794348160:12345-192.168.202.10@tcp:4:cat.0 Request processed in 10930us (11193us total) trans 17179874538 rc 0/0 00000100:00100000:2.0:1746147738.443737:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1609 00002000:00100000:2.0:1746147738.443748:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3162112->3952639) req@ffff8800949d6a00 x1830967794348160/t17179874538(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/448 e 0 to 0 dl 1746147749 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.443757:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d6a00 with x1830967794348160 ext(3162112->3952639) 00010000:00010000:2.0:1746147738.443765:0:2402:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 29 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.443781:0:2402:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 29 pid: 21480 timeout: 917 lvb_type: 0 00002000:00010000:2.0:1746147738.443787:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949d6a00 00000100:00100000:0.0:1746147738.445863:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.445929:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794348544 00000100:00100000:3.0:1746147738.445939:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794348544 00010000:00010000:3.0:1746147738.445971:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 29 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.446007:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8919 00000100:00100000:3.0:1746147738.446014:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794348544:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147738.446027:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147738.446047:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3162112->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 29 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.446059:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3162112->3952639) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 29 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.446082:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff9200/0xe64d3fbf12a7fe5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3162112->3952639) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd106 expref: 29 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.446110:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.446112:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.446119:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9322800/0xe64d3fbf12a7fe6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd114 expref: 15 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.446128:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9322800/0xe64d3fbf12a7fe6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd114 expref: 15 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.446137:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.446138:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.446141:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe73 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd11b expref: 28 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.446148:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd11b expref: 28 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.446178:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd11b expref: 28 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.446190:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796612096:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147738.446268:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9322800/0xe64d3fbf12a7fe6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd114 expref: 15 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.446276:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135848380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796612224:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147738.446291:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ad1a4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.448101:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796612096:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147738.448113:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135848380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796612224:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147738.448130:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.448171:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794348544:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2156us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.448181:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8919 00000100:00100000:0.0:1746147738.451295:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.451516:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794348800 00000100:00100000:2.0:1746147738.451525:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794348800 00002000:00100000:2.0:1746147738.451577:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800949d4e00 x1830967794348800/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.451590:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d4e00 with x1830967794348800 ext(2097152->3145727) 00002000:00010000:2.0:1746147738.451608:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d4e00 00000100:00100000:2.0:1746147738.451640:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7884 00000100:00100000:2.0:1746147738.451647:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794348800:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147738.456860:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.456929:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.456930:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794349056 00000100:00100000:3.0:1746147738.456940:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794349056 00002000:00100000:3.0:1746147738.456987:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800949d7480 x1830967794349056/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.456997:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d7480 with x1830967794349056 ext(2097152->3145727) 00002000:00010000:3.0:1746147738.457002:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d7480 00000100:00100000:2.0:1746147738.457003:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794349312 00000100:00100000:2.0:1746147738.457007:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794349312 00002000:00100000:2.0:1746147738.457024:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fce6d80 x1830967794349312/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147738.457029:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7885 00002000:00100000:2.0:1746147738.457031:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce6d80 with x1830967794349312 ext(3145728->4194303) 00002000:00010000:2.0:1746147738.457034:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fce6d80 00000100:00100000:3.0:1746147738.457036:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967794349056:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147738.457048:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7886 00000100:00100000:2.0:1746147738.457053:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967794349312:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147738.457292:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.457349:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.457367:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794349696 00000100:00100000:0.0:1746147738.457370:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794349696 00002000:00100000:0.0:1746147738.457386:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4034559) req@ffff88009fd18380 x1830967794349696/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147738.457392:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18380 with x1830967794349696 ext(3145728->4034559) 00002000:00010000:0.0:1746147738.457395:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd18380 00000100:00100000:0.0:1746147738.457406:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794349568 00000100:00100000:0.0:1746147738.457407:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794349568 00002000:00100000:0.0:1746147738.457414:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fd19180 x1830967794349568/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147738.457424:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19180 with x1830967794349568 ext(2097152->3145727) 00002000:00010000:0.0:1746147738.457427:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd19180 00000100:00100000:0.0:1746147738.457435:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7887 00000100:00100000:0.0:1746147738.457439:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967794349696:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147738.457498:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7888 00000100:00100000:0.0:1746147738.457502:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+13:1957:x1830967794349568:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147738.457772:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794348800:12345-192.168.202.10@tcp:3:cat.0 Request processed in 6124us (6481us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147738.457782:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7884 00002000:00100000:1.0:1746147738.457791:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800949d4e00 x1830967794348800/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.457799:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d4e00 with x1830967794348800 ext(2097152->3145727) 00002000:00010000:1.0:1746147738.457803:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d4e00 00000100:00100000:0.0:1746147738.462123:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.462208:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794349952 00000100:00100000:2.0:1746147738.462220:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794349952 00000100:00100000:2.0:1746147738.462282:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17456 00000100:00100000:2.0:1746147738.462290:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32704:x1830967794349952:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147738.462308:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.462328:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7fe7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd122 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.462355:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 15 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.462363:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147738.462365:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147738.462368:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7fe7a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd122 expref: 24 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.462399:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 15 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.462411:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 15 pid: 22183 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.462423:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796612352:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147738.462510:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6170c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.466094:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1957:x1830967794349312:12345-192.168.202.10@tcp:3:cat.0 Request processed in 9029us (9154us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147738.466107:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7886 00002000:00100000:3.0:1746147738.466118:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff88009fce6d80 x1830967794349312/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.466128:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce6d80 with x1830967794349312 ext(3145728->4194303) 00002000:00010000:3.0:1746147738.466134:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fce6d80 00000100:00100000:3.0:1746147738.470826:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20619:1830967796612352:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.470856:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7fe7a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd122 expref: 24 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.470871:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9323200, rc 0) 00000100:00100000:3.0:1746147738.470958:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32704:x1830967794349952:12345-192.168.202.10@tcp:101:cat.0 Request processed in 8668us (8842us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.470965:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17456 00000100:00100000:2.0:1746147738.471061:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1957:x1830967794349568:12345-192.168.202.10@tcp:3:cat.0 Request processed in 13556us (13709us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147738.471070:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7888 00002000:00100000:2.0:1746147738.471078:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fd19180 x1830967794349568/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.471086:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd19180 with x1830967794349568 ext(2097152->3145727) 00010000:00010000:2.0:1746147738.471092:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 14 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.471103:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 14 pid: 22183 timeout: 917 lvb_type: 0 00002000:00010000:2.0:1746147738.471109:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd19180 00000100:00100000:0.0:1746147738.474337:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.474472:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794350080 00000100:00100000:2.0:1746147738.474483:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794350080 00002000:00100000:2.0:1746147738.474523:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (4034560->4194303) req@ffff88009fce5180 x1830967794350080/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.474535:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce5180 with x1830967794350080 ext(4034560->4194303) 00010000:00010000:2.0:1746147738.474543:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 14 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.474557:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 14 pid: 22183 timeout: 917 lvb_type: 0 00002000:00010000:2.0:1746147738.474563:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fce5180 00000100:00100000:2.0:1746147738.474608:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1610 00000100:00100000:2.0:1746147738.474615:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1957:x1830967794350080:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:3.0:1746147738.477750:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1957:x1830967794349056:12345-192.168.202.10@tcp:3:cat.0 Request processed in 20707us (20890us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147738.477763:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7885 00002000:00100000:3.0:1746147738.477771:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x458:0x0] (2097152->3145727) req@ffff8800949d7480 x1830967794349056/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.477779:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d7480 with x1830967794349056 ext(2097152->3145727) 00002000:00010000:3.0:1746147738.477784:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d7480 00000100:00100000:0.0:1746147738.479118:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1957:x1830967794349696:12345-192.168.202.10@tcp:3:cat.0 Request processed in 21675us (21829us total) trans 0 rc 888832/888832 00000100:00100000:0.0:1746147738.479125:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7887 00002000:00100000:0.0:1746147738.479131:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4034559) req@ffff88009fd18380 x1830967794349696/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147738.479138:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd18380 with x1830967794349696 ext(3145728->4034559) 00010000:00010000:0.0:1746147738.479145:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 14 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746147738.479158:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 14 pid: 22183 timeout: 917 lvb_type: 0 00002000:00010000:0.0:1746147738.479163:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd18380 00000100:00100000:2.0:1746147738.479470:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1957:x1830967794350080:12345-192.168.202.10@tcp:4:cat.0 Request processed in 4854us (5140us total) trans 21474841763 rc 0/0 00000100:00100000:2.0:1746147738.479478:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1610 00002000:00100000:2.0:1746147738.479484:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (4034560->4194303) req@ffff88009fce5180 x1830967794350080/t21474841763(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/448 e 0 to 0 dl 1746147749 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.479492:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fce5180 with x1830967794350080 ext(4034560->4194303) 00010000:00010000:2.0:1746147738.479497:0:8474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 14 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.479507:0:8474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 14 pid: 22183 timeout: 917 lvb_type: 0 00002000:00010000:2.0:1746147738.479514:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fce5180 00000100:00100000:0.0:1746147738.481058:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.481469:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.481530:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794350208 00000100:00100000:1.0:1746147738.481537:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794350208 00000100:00100000:1.0:1746147738.481570:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794350464 00000100:00100000:1.0:1746147738.481573:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794350464 00000100:00100000:1.0:1746147738.481588:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12193 00000100:00100000:1.0:1746147738.481605:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+11:32708:x1830967794350208:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147738.481625:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147738.481640:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eaa00/0xe64d3fbf12a7fe81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd129 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.481695:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eac00/0xe64d3fbf12a7fe88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481706:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eac00/0xe64d3fbf12a7fe88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481716:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eac00/0xe64d3fbf12a7fe88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481728:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eae00/0xe64d3fbf12a7fe8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481734:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eae00/0xe64d3fbf12a7fe8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481738:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eae00/0xe64d3fbf12a7fe8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481830:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ebe00/0xe64d3fbf12a7fe96 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481839:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ebe00/0xe64d3fbf12a7fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481844:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ebe00/0xe64d3fbf12a7fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:1.0:1746147738.481870:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:1.0:1746147738.481874:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746147738.481906:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ebe00/0xe64d3fbf12a7fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481914:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ebe00/0xe64d3fbf12a7fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481920:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eac00/0xe64d3fbf12a7fe88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481925:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eac00/0xe64d3fbf12a7fe88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481934:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eac00/0xe64d3fbf12a7fe88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481939:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801350eac00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147738.481943:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eac00/0xe64d3fbf12a7fe88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481949:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eac00/0xe64d3fbf12a7fe88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481959:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147738.481961:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147738.481964:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eac00/0xe64d3fbf12a7fe88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481969:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eac00/0xe64d3fbf12a7fe88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.481997:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eae00/0xe64d3fbf12a7fe8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.482002:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eae00/0xe64d3fbf12a7fe8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.482006:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eae00/0xe64d3fbf12a7fe8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.482010:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801350eae00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147738.482012:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eae00/0xe64d3fbf12a7fe8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.482016:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eae00/0xe64d3fbf12a7fe8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.482025:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fed9100) 00010000:00010000:1.0:1746147738.482027:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147738.482030:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eae00/0xe64d3fbf12a7fe8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.482034:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eae00/0xe64d3fbf12a7fe8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746147738.482058:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801350eaa00/0xe64d3fbf12a7fe81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd129 expref: 13 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.482068:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ebe00/0xe64d3fbf12a7fe96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd129 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.482073:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147738.482074:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147738.482076:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350ebe00, rc 0) 00000100:00100000:1.0:1746147738.482115:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41587371-240a-4781-aecb-638f17200fbd+12:32708:x1830967794350208:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 520us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.482120:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12193 00000100:00100000:0.0:1746147738.482130:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12194 00000100:00100000:0.0:1746147738.482138:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:32707:x1830967794350464:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:0.0:1746147738.482147:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147738.482155:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130eeb400/0xe64d3fbf12a7fe9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd130 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.482197:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.482206:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd08f expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.482213:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fdf5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b2 expref: 343 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.482219:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c3400/0xe64d3fbf12a7fe0a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b9 expref: 33 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.482225:0:14546:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ebe00/0xe64d3fbf12a7fe96 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd129 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.482230:0:14546:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 7/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.482255:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ebe00/0xe64d3fbf12a7fe96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd129 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.482264:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ebe00/0xe64d3fbf12a7fe96 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd129 expref: 11 pid: 14547 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746147738.482275:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fce6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796612480:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147738.482340:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c3400/0xe64d3fbf12a7fe0a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b9 expref: 33 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.482347:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c3400/0xe64d3fbf12a7fe0a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b9 expref: 33 pid: 14547 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746147738.482354:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093056300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796612608:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147738.482378:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fdf5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b2 expref: 343 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.482385:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fdf5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b2 expref: 343 pid: 5744 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746147738.482392:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093056680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796612736:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147738.482411:0:14546:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd08f expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.482418:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd08f expref: 11 pid: 5744 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746147738.482424:0:14546:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093057800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796612864:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147738.482437:0:14546:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147738.486086:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.486117:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.486152:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794350720 00000100:00100000:2.0:1746147738.486160:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794350720 00000100:00100000:0.0:1746147738.486166:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.486176:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1746147738.486189:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 14 pid: 22183 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746147738.486195:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.486209:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.486216:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794350848 00000100:00100000:2.0:1746147738.486218:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794350848 00000100:00100000:0.0:1746147738.486223:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794350976 00000100:00100000:0.0:1746147738.486226:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794350976 00010000:00010000:2.0:1746147738.486227:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ebe00/0xe64d3fbf12a7fe96 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd129 expref: 12 pid: 14547 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.486235:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794351104 00000100:00100000:2.0:1746147738.486237:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794351104 00010000:00010000:0.0:1746147738.486241:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c3400/0xe64d3fbf12a7fe0a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b9 expref: 34 pid: 14547 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.486245:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fdf5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b2 expref: 344 pid: 5744 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746147738.486253:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794351232 00000100:00100000:0.0:1746147738.486255:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794351232 00000100:00100000:2.0:1746147738.486256:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8920 00000100:00100000:2.0:1746147738.486262:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c267100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794350720:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147738.486264:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd08f expref: 13 pid: 5744 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.486273:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147738.486274:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8921 00000100:00100000:0.0:1746147738.486279:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c267800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794350848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147738.486286:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147738.486291:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 14 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746147738.486291:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ebe00/0xe64d3fbf12a7fe96 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd129 expref: 13 pid: 14547 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746147738.486299:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ebe00/0xe64d3fbf12a7fe96 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd129 expref: 13 pid: 14547 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.486300:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 14 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.486316:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a09a8800/0xe64d3fbf12a7fe18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0c0 expref: 14 pid: 22183 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746147738.486316:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147738.486321:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.486328:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147738.486331:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.486332:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147738.486332:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147738.486338:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7fe7a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd122 expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.486350:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7fe7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd122 expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147738.486364:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c267800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794350848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 85us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147738.486372:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8921 00010000:00010000:2.0:1746147738.486377:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7fe7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd122 expref: 23 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147738.486386:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800951d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796612992:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147738.486386:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8922 00000100:00100000:0.0:1746147738.486390:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c265180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1960:x1830967794350976:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147738.486395:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147738.486398:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c3400/0xe64d3fbf12a7fe0a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b9 expref: 34 pid: 14547 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746147738.486405:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c3400/0xe64d3fbf12a7fe0a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b9 expref: 34 pid: 14547 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746147738.486415:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147738.486418:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.486423:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.486426:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147738.486430:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b617b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147738.486440:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c265180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1960:x1830967794350976:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 50us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147738.486444:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8922 00000100:00100000:2.0:1746147738.486448:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8923 00000100:00100000:2.0:1746147738.486453:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+344:1960:x1830967794351104:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147738.486454:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8924 00000100:00100000:0.0:1746147738.486458:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794351232:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147738.486459:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147738.486463:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fdf5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b2 expref: 344 pid: 5744 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746147738.486463:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147738.486466:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd08f expref: 12 pid: 5744 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.486471:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fdf5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b2 expref: 344 pid: 5744 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746147738.486479:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd08f expref: 12 pid: 5744 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.486538:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801350ebe00/0xe64d3fbf12a7fe96 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd129 expref: 12 pid: 14547 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.486554:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fce6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796612480:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147738.486563:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad2c3400/0xe64d3fbf12a7fe0a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b9 expref: 33 pid: 14547 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.486571:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093056300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796612608:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147738.486579:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093056680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796612736:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147738.486586:0:14546:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093057800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14546:1830967796612864:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.486632:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794350592 00000100:00100000:3.0:1746147738.486636:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794350592 00000100:00100000:3.0:1746147738.486657:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17457 00000100:00100000:3.0:1746147738.486661:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32700:x1830967794350592:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.486671:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.486680:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fff8000/0xe64d3fbf12a7feab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd137 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.486693:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.486694:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.486698:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fff8000/0xe64d3fbf12a7feab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd137 expref: 15 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.486707:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fff8000/0xe64d3fbf12a7feab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd137 expref: 15 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.486714:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8000, rc 0) 00000100:00100000:3.0:1746147738.486730:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32700:x1830967794350592:12345-192.168.202.10@tcp:101:cat.0 Request processed in 68us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.486735:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17457 00010000:00010000:2.0:1746147738.486786:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ca00/0xe64d3fbf12a7fdf5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0b2 expref: 344 pid: 5744 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.486795:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147738.486798:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147738.486803:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147738.486808:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147738.486821:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+343:1960:x1830967794351104:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 368us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.486827:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8923 00000100:00100000:2.0:1746147738.486872:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1746147738.487088:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7fda8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd08f expref: 11 pid: 5744 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.487102:0:14546:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.487102:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:0.0:1746147738.487106:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.487112:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.487118:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14546 initiator: MDT0 00010000:00010000:0.0:1746147738.487132:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147738.487137:0:14546:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147738.487141:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147738.487152:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+10:1960:x1830967794351232:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 693us (941us total) trans 0 rc 0/0 00000004:00200000:1.0:1746147738.487158:0:14546:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:0.0:1746147738.487158:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8924 00000100:00100000:3.0:1746147738.487210:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794351360 00000100:00100000:3.0:1746147738.487213:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794351360 00000100:00100000:3.0:1746147738.487233:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12195 00000100:00100000:3.0:1746147738.487237:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+10:32708:x1830967794351360:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147738.487246:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.487253:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7feb9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd13e expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.487298:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.487304:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 2/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147738.487309:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.487318:0:5744:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14546 initiator: MDT0 00010000:00010000:3.0:1746147738.487326:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147738.487531:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130eeb400/0xe64d3fbf12a7fe9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd130 expref: 34 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.487543:0:14546:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd130 expref: 33 pid: 14546 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.487550:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd130 expref: 33 pid: 14546 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.487554:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130eea800, rc 0) 00000100:00100000:1.0:1746147738.487588:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:32707:x1830967794350464:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 5452us (6119us total) trans 8589946242 rc 0/0 00000100:00100000:1.0:1746147738.487602:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12194 00000100:00100000:2.0:1746147738.489255:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800951d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796612992:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147738.489279:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147738.490726:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c267100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794350720:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4457us (4601us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.490737:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8920 00000100:00100000:0.0:1746147738.492728:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.492778:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.492835:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794351616 00000100:00100000:1.0:1746147738.492843:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794351616 00000100:00100000:2.0:1746147738.492852:0:8474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794351872 00000100:00100000:2.0:1746147738.492856:0:8474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794351872 00002000:00100000:2.0:1746147738.492881:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fe43100 x1830967794351872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.492881:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fe41f80 x1830967794351616/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.492910:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe43100 with x1830967794351872 ext(3145728->4194303) 00002000:00100000:1.0:1746147738.492910:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41f80 with x1830967794351616 ext(2097152->3145727) 00002000:00010000:1.0:1746147738.492914:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe41f80 00002000:00010000:2.0:1746147738.492915:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe43100 00000100:00100000:2.0:1746147738.492934:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7889 00000100:00100000:1.0:1746147738.492939:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7890 00000100:00100000:2.0:1746147738.492940:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1958:x1830967794351872:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147738.492945:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1958:x1830967794351616:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147738.494043:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.494132:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794352128 00000100:00100000:3.0:1746147738.494137:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794352128 00002000:00100000:3.0:1746147738.494157:0:21458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fe42d80 x1830967794352128/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.494164:0:21458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe42d80 with x1830967794352128 ext(2097152->3145727) 00002000:00010000:3.0:1746147738.494168:0:21458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe42d80 00000100:00100000:3.0:1746147738.494184:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7891 00000100:00100000:3.0:1746147738.494190:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794352128:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147738.498711:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.498751:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.498777:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794352256 00000100:00100000:2.0:1746147738.498780:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.498785:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794352256 00000100:00100000:2.0:1746147738.498797:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794352512 00000100:00100000:2.0:1746147738.498800:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794352512 00010000:00010000:3.0:1746147738.498816:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd130 expref: 33 pid: 14546 timeout: 917 lvb_type: 0 00002000:00100000:2.0:1746147738.498822:0:31355:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800951d4a80 x1830967794352512/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.498834:0:31355:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d4a80 with x1830967794352512 ext(3145728->4194303) 00002000:00010000:2.0:1746147738.498838:0:31355:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d4a80 00000100:00100000:3.0:1746147738.498851:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8925 00000100:00100000:3.0:1746147738.498857:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:1960:x1830967794352256:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147738.498868:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147738.498874:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd130 expref: 33 pid: 14546 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.498898:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd130 expref: 33 pid: 14546 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.498916:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130eea800/0xe64d3fbf12a7fea4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd130 expref: 33 pid: 14546 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.498930:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147738.498934:0:7096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.498942:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.498946:0:7096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.498963:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.498999:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:1960:x1830967794352256:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 142us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.499009:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8925 00010000:00010000:3.0:1746147738.499028:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.499034:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147738.499070:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:3.0:1746147738.499074:0:5744:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746147738.499086:0:5744:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.499111:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7feb9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd13e expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.499122:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd13e expref: 11 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.499127:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147738.499129:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147738.499131:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff9c00, rc 0) 00000100:00100000:3.0:1746147738.499153:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+11:32708:x1830967794351360:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 11914us (12280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.499158:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12195 00000100:00100000:2.0:1746147738.499162:0:21459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794352768 00000100:00100000:2.0:1746147738.499165:0:21459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794352768 00002000:00100000:2.0:1746147738.499179:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880091119f80 x1830967794352768/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.499186:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091119f80 with x1830967794352768 ext(3145728->4194303) 00002000:00010000:2.0:1746147738.499188:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091119f80 00000100:00100000:2.0:1746147738.499239:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7892 00000100:00100000:2.0:1746147738.499245:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794352512:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147738.499391:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7893 00000100:00100000:1.0:1746147738.499398:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794352768:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147738.506993:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794351872:12345-192.168.202.10@tcp:3:cat.0 Request processed in 14043us (14205us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147738.507005:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7889 00002000:00100000:2.0:1746147738.507016:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff88009fe43100 x1830967794351872/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.507024:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe43100 with x1830967794351872 ext(3145728->4194303) 00002000:00010000:2.0:1746147738.507029:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe43100 00000100:00100000:1.0:1746147738.514244:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794351616:12345-192.168.202.10@tcp:3:cat.0 Request processed in 21289us (21510us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147738.514256:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7890 00002000:00100000:1.0:1746147738.514266:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fe41f80 x1830967794351616/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.514274:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe41f80 with x1830967794351616 ext(2097152->3145727) 00002000:00010000:1.0:1746147738.514279:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe41f80 00000100:00100000:3.0:1746147738.517539:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794352128:12345-192.168.202.10@tcp:3:cat.0 Request processed in 23340us (23491us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147738.517549:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7891 00002000:00100000:3.0:1746147738.517560:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x456:0x0] (2097152->3145727) req@ffff88009fe42d80 x1830967794352128/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.517574:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe42d80 with x1830967794352128 ext(2097152->3145727) 00002000:00010000:3.0:1746147738.517579:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe42d80 00000100:00100000:0.0:1746147738.518365:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.518400:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.518415:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.518586:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.518670:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794353024 00000100:00100000:3.0:1746147738.518677:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794353024 00000100:00100000:3.0:1746147738.518705:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794353280 00000100:00100000:3.0:1746147738.518707:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794353280 00000100:00100000:3.0:1746147738.518726:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794352896 00000100:00100000:3.0:1746147738.518728:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794352896 00000100:00100000:3.0:1746147738.518738:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794353152 00000100:00100000:3.0:1746147738.518739:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794353152 00000100:00100000:3.0:1746147738.518751:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17458 00000100:00100000:3.0:1746147738.518757:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+7:1960:x1830967794353024:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:1.0:1746147738.518762:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17459 00010000:00010000:3.0:1746147738.518769:0:20619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147738.518771:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794353280:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147738.518779:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.518783:0:20619:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fec7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd14c expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.518789:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800949c1a00/0xe64d3fbf12a7fece lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd15a expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.518801:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.518801:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.518803:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.518803:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.518810:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd14c expref: 8 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147738.518811:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800949c1a00/0xe64d3fbf12a7fece lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd15a expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.518823:0:20619:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd14c expref: 8 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147738.518825:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800949c1a00/0xe64d3fbf12a7fece lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd15a expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.518832:0:20619:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8600, rc 0) 00010000:00010000:1.0:1746147738.518833:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800949c1a00, rc 0) 00000100:00100000:1.0:1746147738.518865:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794353280:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 96us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.518870:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17459 00000100:00100000:1.0:1746147738.518899:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17460 00000100:00100000:1.0:1746147738.518905:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794352896:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147738.518910:0:9615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147738.518917:0:9615:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800949c0a00/0xe64d3fbf12a7fed5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd145 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147738.518926:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.518927:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147738.518932:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800949c0a00/0xe64d3fbf12a7fed5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd145 expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147738.518951:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17461 00000100:00100000:0.0:1746147738.518958:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794353152:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1746147738.518965:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147738.518972:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a002c600/0xe64d3fbf12a7fedc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd153 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147738.518982:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147738.518983:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147738.518988:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a002c600/0xe64d3fbf12a7fedc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd153 expref: 9 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147738.518997:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a002c600/0xe64d3fbf12a7fedc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd153 expref: 9 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147738.518998:0:9615:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800949c0a00/0xe64d3fbf12a7fed5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd145 expref: 9 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147738.519004:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a002c600, rc 0) 00010000:00010000:1.0:1746147738.519005:0:9615:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800949c0a00, rc 0) 00000100:00100000:0.0:1746147738.519019:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794353152:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 62us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.519022:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:41587371-240a-4781-aecb-638f17200fbd+9:1960:x1830967794352896:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 118us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147738.519024:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17461 00000100:00100000:1.0:1746147738.519027:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17460 00000100:00100000:3.0:1746147738.519207:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41587371-240a-4781-aecb-638f17200fbd+8:1960:x1830967794353024:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 450us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.519216:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17458 00000100:00100000:0.0:1746147738.526376:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.526650:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.527215:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794353536 00000100:00100000:3.0:1746147738.527223:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794353536 00000100:00100000:3.0:1746147738.527268:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12196 00000100:00100000:3.0:1746147738.527275:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+11:32708:x1830967794353536:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147738.527290:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.527304:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7fee3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd161 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.527390:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7feea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527401:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7feea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527410:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7feea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527422:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7fef1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527427:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7fef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527431:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7fef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147738.527518:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794352768:12345-192.168.202.10@tcp:3:cat.0 Request processed in 28119us (28735us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147738.527526:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7893 00010000:00010000:3.0:1746147738.527531:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7fef8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00002000:00100000:1.0:1746147738.527534:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (3145728->4194303) req@ffff880091119f80 x1830967794352768/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147738.527539:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7fef8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00002000:00100000:1.0:1746147738.527542:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091119f80 with x1830967794352768 ext(3145728->4194303) 00010000:00010000:3.0:1746147738.527545:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7fef8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00002000:00010000:1.0:1746147738.527546:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091119f80 00000004:00200000:3.0:1746147738.527553:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000100:00100000:1.0:1746147738.527565:0:2402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794353792 00000100:00100000:1.0:1746147738.527568:0:2402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794353792 00002000:00100000:1.0:1746147738.527585:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880130d24700 x1830967794353792/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.527591:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d24700 with x1830967794353792 ext(4194304->5017599) 00002000:00010000:1.0:1746147738.527605:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d24700 00000100:00100000:1.0:1746147738.527622:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7894 00000100:00100000:1.0:1746147738.527627:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1957:x1830967794353792:12345-192.168.202.10@tcp:3:cat.0 00010000:00010000:3.0:1746147738.527633:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7feea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527639:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7feea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527644:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7feea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527649:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fff9200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147738.527653:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7feea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527659:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7feea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527667:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00000100:00100000:2.0:1746147738.527722:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794352512:12345-192.168.202.10@tcp:3:cat.0 Request processed in 27920us (28414us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147738.527730:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7892 00002000:00100000:2.0:1746147738.527735:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x456:0x0] (3145728->4194303) req@ffff8800951d4a80 x1830967794352512/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.527742:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800951d4a80 with x1830967794352512 ext(3145728->4194303) 00002000:00010000:2.0:1746147738.527746:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800951d4a80 00010000:00010000:3.0:1746147738.527853:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147738.527857:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7feea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527862:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7feea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527881:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7fef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527904:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7fef1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527910:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7fef1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527912:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fff9600 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147738.527913:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7fef1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527916:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7fef1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527920:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a05d0100) 00010000:00010000:3.0:1746147738.527921:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147738.527922:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7fef1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527925:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7fef1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.527949:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7fee3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd161 expref: 14 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.527955:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7fef8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd161 expref: 13 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.527959:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147738.527960:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147738.527961:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8c00, rc 0) 00000100:00100000:3.0:1746147738.528136:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+13:32708:x1830967794353536:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 861us (1768us total) trans 8589946243 rc 0/0 00000100:00100000:3.0:1746147738.528140:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12196 00000100:00100000:0.0:1746147738.532672:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.532806:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.533008:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794354048 00000100:00100000:3.0:1746147738.533016:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794354048 00000100:00100000:2.0:1746147738.533017:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794354176 00000100:00100000:2.0:1746147738.533021:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794354176 00000100:00100000:2.0:1746147738.533054:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 916 00000100:00100000:3.0:1746147738.533061:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12197 00000100:00100000:2.0:1746147738.533061:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+14:1957:x1830967794354176:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147738.533067:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+14:32708:x1830967794354048:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147738.533074:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147738.533083:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.533093:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7fef8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd161 expref: 14 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.533094:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff06 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd168 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.533112:0:7096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147738.533116:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147738.533161:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+14:1957:x1830967794354176:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 100us (355us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147738.533165:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7ff0d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00000100:00100000:2.0:1746147738.533167:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 916 00010000:00010000:3.0:1746147738.533175:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7ff0d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.533182:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7ff0d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.533191:0:5744:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7ff0d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.533195:0:5744:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7ff0d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.533201:0:5744:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7ff0d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.533205:0:5744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fff9400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147738.533208:0:5744:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7ff0d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.533212:0:5744:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7ff0d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.533222:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147738.533224:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147738.533227:0:5744:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7ff0d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.533231:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7ff0d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.533313:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff06 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd168 expref: 13 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.533320:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff06 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd168 expref: 13 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.533327:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8800, rc 0) 00000100:00100000:3.0:1746147738.534126:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+12:32708:x1830967794354048:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1058us (1460us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147738.534132:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12197 00000100:00100000:1.0:1746147738.534531:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1957:x1830967794353792:12345-192.168.202.10@tcp:3:cat.0 Request processed in 6903us (7881us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147738.534537:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7894 00002000:00100000:1.0:1746147738.534543:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880130d24700 x1830967794353792/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.534548:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d24700 with x1830967794353792 ext(4194304->5017599) 00002000:00010000:1.0:1746147738.534552:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d24700 00000100:00100000:0.0:1746147738.542172:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.542261:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794354432 00000100:00100000:1.0:1746147738.542270:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794354432 00000100:00100000:1.0:1746147738.542319:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5109 00000100:00100000:1.0:1746147738.542327:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+12:32708:x1830967794354432:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:1.0:1746147738.542510:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41587371-240a-4781-aecb-638f17200fbd+13:32708:x1830967794354432:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 184us (344us total) trans 8589946244 rc 0/0 00000100:00100000:1.0:1746147738.542516:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5109 00000100:00100000:0.0:1746147738.553798:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.554788:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794354688 00000100:00100000:1.0:1746147738.554797:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794354688 00002000:00100000:1.0:1746147738.554840:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880130d26300 x1830967794354688/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.554849:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d26300 with x1830967794354688 ext(4194304->5017599) 00002000:00010000:1.0:1746147738.554854:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d26300 00000100:00100000:1.0:1746147738.554879:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7895 00000100:00100000:1.0:1746147738.555098:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794354688:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147738.566241:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.566324:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794354944 00000100:00100000:3.0:1746147738.566334:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794354944 00000100:00100000:3.0:1746147738.566395:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12198 00000100:00100000:3.0:1746147738.566401:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+343:32712:x1830967794354944:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147738.566420:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.566438:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7ff14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd16f expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.566524:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7ff1b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.566541:0:5744:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd13e expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.566547:0:5744:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7ff1b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147738.566574:0:5744:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd13e expref: 12 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.566584:0:5744:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd13e expref: 12 pid: 5744 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.566606:0:5744:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796613120:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.566695:0:5744:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147738.567137:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794354688:12345-192.168.202.10@tcp:3:cat.0 Request processed in 12040us (13344us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746147738.567148:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7895 00002000:00100000:1.0:1746147738.567157:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x458:0x0] (4194304->5017599) req@ffff880130d26300 x1830967794354688/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.567165:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d26300 with x1830967794354688 ext(4194304->5017599) 00002000:00010000:1.0:1746147738.567169:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d26300 00000100:00100000:0.0:1746147738.569436:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.569521:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794355072 00000100:00100000:1.0:1746147738.569528:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794355072 00000100:00100000:3.0:1746147738.569546:0:5744:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:5744:1830967796613120:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.569566:0:5744:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7ff1b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147738.569568:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd13e expref: 13 pid: 5744 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.569881:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8926 00000100:00100000:1.0:1746147738.569921:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+13:1960:x1830967794355072:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147738.569933:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147738.569939:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd13e expref: 13 pid: 5744 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.569950:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd13e expref: 13 pid: 5744 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.569968:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7fec0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd13e expref: 13 pid: 5744 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.569989:0:7095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147738.569994:0:7095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7ff1b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147738.570002:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7ff1b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147738.570009:0:7095:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7ff1b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 5744 initiator: MDT0 00010000:00010000:1.0:1746147738.570029:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147738.570059:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+12:1960:x1830967794355072:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 140us (629us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147738.570061:0:5744:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7ff1b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:1.0:1746147738.570064:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8926 00010000:00010000:3.0:1746147738.570068:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7ff1b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147738.570083:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147738.570219:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9600/0xe64d3fbf12a7ff14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd16f expref: 346 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.570241:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7ff1b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd16f expref: 345 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.570248:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147738.570250:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147738.570252:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff9200, rc 0) 00000100:00100000:3.0:1746147738.570275:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+345:32712:x1830967794354944:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3874us (4043us total) trans 8589946245 rc 0/0 00000100:00100000:3.0:1746147738.570282:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12198 00000100:00100000:0.0:1746147738.620348:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.620826:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794355200 00000100:00100000:3.0:1746147738.620837:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794355200 00000100:00100000:3.0:1746147738.620928:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17462 00000100:00100000:3.0:1746147738.620935:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:32707:x1830967794355200:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147738.620953:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.620969:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd176 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.620993:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9322400/0xe64d3fbf12a7fe3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0e3 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.621001:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800949c0a00/0xe64d3fbf12a7fed5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd145 expref: 8 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.621008:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c3a00/0xe64d3fbf12a7fe42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ea expref: 23 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.621013:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.621015:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.621018:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1556480->2097151] (req 1556480->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 15 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.621045:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c3a00/0xe64d3fbf12a7fe42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ea expref: 23 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.621057:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c3a00/0xe64d3fbf12a7fe42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ea expref: 23 pid: 8468 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746147738.621068:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796613248:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.621179:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800949c0a00/0xe64d3fbf12a7fed5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd145 expref: 8 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.621186:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800949c0a00/0xe64d3fbf12a7fed5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd145 expref: 8 pid: 9615 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746147738.621195:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796613376:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.621219:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a9322400/0xe64d3fbf12a7fe3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0e3 expref: 15 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.621226:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a9322400/0xe64d3fbf12a7fe3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0e3 expref: 15 pid: 7050 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.621234:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796613504:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.621250:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.623129:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013584bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796613248:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.623139:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796613376:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.623146:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796613504:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.623169:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [1556480->2097151] (req 1556480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 15 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.623180:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8800, rc 0) 00000100:00100000:3.0:1746147738.623208:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32707:x1830967794355200:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 2273us (2874us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.623215:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17462 00000100:00100000:0.0:1746147738.624771:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.625054:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794355328 00000100:00100000:2.0:1746147738.625060:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794355328 00010000:00010000:2.0:1746147738.625083:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800949c0a00/0xe64d3fbf12a7fed5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd145 expref: 9 pid: 9615 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746147738.625163:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.625208:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794355456 00000100:00100000:2.0:1746147738.625210:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794355456 00010000:00010000:2.0:1746147738.625220:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c3a00/0xe64d3fbf12a7fe42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ea expref: 24 pid: 8468 timeout: 917 lvb_type: 1 00000100:00100000:2.0:1746147738.625234:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8927 00000100:00100000:2.0:1746147738.625240:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+9:1959:x1830967794355328:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147738.625251:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147738.625268:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800949c0a00/0xe64d3fbf12a7fed5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd145 expref: 9 pid: 9615 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746147738.625277:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800949c0a00/0xe64d3fbf12a7fed5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd145 expref: 9 pid: 9615 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746147738.625293:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800949c0a00/0xe64d3fbf12a7fed5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd145 expref: 9 pid: 9615 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746147738.625311:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147738.625333:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41587371-240a-4781-aecb-638f17200fbd+8:1959:x1830967794355328:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 94us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.625339:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8927 00000100:00100000:2.0:1746147738.625348:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8928 00000100:00100000:2.0:1746147738.625353:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1957:x1830967794355456:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147738.625357:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147738.625362:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c3a00/0xe64d3fbf12a7fe42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ea expref: 24 pid: 8468 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746147738.625369:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c3a00/0xe64d3fbf12a7fe42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ea expref: 24 pid: 8468 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746147738.625379:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800ad2c3a00/0xe64d3fbf12a7fe42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ea expref: 24 pid: 8468 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746147738.625390:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147738.625400:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1957:x1830967794355456:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 47us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.625404:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8928 00000100:00100000:0.0:1746147738.625430:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.625563:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794355584 00000100:00100000:3.0:1746147738.625566:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794355584 00010000:00010000:3.0:1746147738.625579:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9322400/0xe64d3fbf12a7fe3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0e3 expref: 15 pid: 7050 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.625606:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8929 00000100:00100000:3.0:1746147738.625610:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794355584:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147738.625617:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147738.625625:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a9322400/0xe64d3fbf12a7fe3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0e3 expref: 15 pid: 7050 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.625633:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a9322400/0xe64d3fbf12a7fe3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0e3 expref: 15 pid: 7050 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.625645:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9322400/0xe64d3fbf12a7fe3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0e3 expref: 15 pid: 7050 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746147738.625662:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.625664:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.625669:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 14 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.625676:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 14 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.625700:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 14 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.625709:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796613632:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147738.626019:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.629332:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796613632:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147738.629352:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.629398:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794355584:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3785us (3967us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.629410:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8929 00000100:00100000:0.0:1746147738.635589:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.635662:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794355840 00000100:00100000:1.0:1746147738.635670:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794355840 00002000:00100000:1.0:1746147738.635709:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1556480->1560575) req@ffff8800a5d7c000 x1830967794355840/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.635718:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c000 with x1830967794355840 ext(1556480->1560575) 00002000:00010000:1.0:1746147738.635723:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7c000 00000100:00100000:1.0:1746147738.635749:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7896 00000100:00100000:1.0:1746147738.635756:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794355840:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147738.635942:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1960:x1830967794355840:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 185us (360us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147738.635947:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7896 00002000:00100000:1.0:1746147738.635952:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1556480->1560575) req@ffff8800a5d7c000 x1830967794355840/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/4536 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.635959:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c000 with x1830967794355840 ext(1556480->1560575) 00002000:00010000:1.0:1746147738.635962:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7c000 00000100:00100000:0.0:1746147738.643833:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.643924:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794355968 00000100:00100000:3.0:1746147738.643933:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794355968 00000100:00100000:3.0:1746147738.643980:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17463 00000100:00100000:3.0:1746147738.643988:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32707:x1830967794355968:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147738.644004:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.644018:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd17d expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.644048:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7fe57 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ff expref: 17 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.644056:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fec7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd14c expref: 7 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.644063:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7fe65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd10d expref: 27 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.644068:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.644070:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.644074:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [1048576->1429503] (req 1048576->1429503) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 17 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.644099:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7fe65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd10d expref: 27 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.644110:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7fe65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd10d expref: 27 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.644120:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796613760:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.644209:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd14c expref: 7 pid: 20619 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.644217:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fec7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd14c expref: 7 pid: 20619 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746147738.644225:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796613888:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.644309:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7fe57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ff expref: 17 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.644316:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7fe57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ff expref: 17 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.644324:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0026300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796614016:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.644344:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.645347:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796613760:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147738.645606:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.645661:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794356096 00000100:00100000:2.0:1746147738.645667:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794356096 00010000:00010000:2.0:1746147738.645691:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fec7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd14c expref: 8 pid: 20619 timeout: 917 lvb_type: 1 00000100:00100000:2.0:1746147738.645713:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8930 00000100:00100000:2.0:1746147738.645718:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794356096:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147738.645726:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147738.645743:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fec7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd14c expref: 8 pid: 20619 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746147738.645751:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fec7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd14c expref: 8 pid: 20619 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746147738.645767:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147738.645799:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8600/0xe64d3fbf12a7fec7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd14c expref: 8 pid: 20619 timeout: 917 lvb_type: 1 00000100:00100000:2.0:1746147738.645805:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41587371-240a-4781-aecb-638f17200fbd+8:1958:x1830967794356096:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 86us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.645811:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8930 00000100:00100000:3.0:1746147738.645814:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796613888:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.645823:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0026300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796614016:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.645844:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [1048576->1429503] (req 1048576->1429503) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 17 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.645853:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a09a8400, rc 0) 00000100:00100000:3.0:1746147738.645871:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:32707:x1830967794355968:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 1885us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.645876:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17463 00000100:00100000:0.0:1746147738.647180:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.647493:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.647534:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794356224 00000100:00100000:1.0:1746147738.647539:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794356224 00010000:00010000:1.0:1746147738.647559:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7fe65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd10d expref: 28 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.647566:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794356352 00000100:00100000:2.0:1746147738.647570:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794356352 00000100:00100000:1.0:1746147738.647578:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8931 00010000:00010000:2.0:1746147738.647584:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7fe57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ff expref: 17 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.647584:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794356224:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147738.647601:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147738.647616:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7fe65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd10d expref: 28 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.647626:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7fe65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd10d expref: 28 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.647633:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8932 00000100:00100000:2.0:1746147738.647639:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1960:x1830967794356352:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147738.647642:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7fe65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd10d expref: 28 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.647645:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147738.647653:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7fe57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ff expref: 17 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.647657:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147738.647662:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7fe57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ff expref: 17 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.647676:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7fe57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd0ff expref: 17 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746147738.647683:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794356224:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 99us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.647688:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8931 00010000:00010000:2.0:1746147738.647689:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.647691:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.647696:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 16 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.647705:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 16 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.647733:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 16 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147738.647743:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009111b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796614144:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147738.647794:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b6170c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.649168:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009111b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796614144:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147738.649182:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147738.649213:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1960:x1830967794356352:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1574us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.649221:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8932 00000100:00100000:0.0:1746147738.652273:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.652513:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794356608 00000100:00100000:1.0:1746147738.652519:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794356608 00002000:00100000:1.0:1746147738.652555:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1425408->1429503) req@ffff8800a2138380 x1830967794356608/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.652564:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2138380 with x1830967794356608 ext(1425408->1429503) 00002000:00010000:1.0:1746147738.652568:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2138380 00000100:00100000:1.0:1746147738.652603:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7897 00000100:00100000:1.0:1746147738.652609:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794356608:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147738.652764:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794356608:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 155us (497us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147738.652769:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7897 00002000:00100000:1.0:1746147738.652774:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x457:0x0] (1425408->1429503) req@ffff8800a2138380 x1830967794356608/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/4536 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.652780:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2138380 with x1830967794356608 ext(1425408->1429503) 00002000:00010000:1.0:1746147738.652782:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2138380 00000100:00100000:0.0:1746147738.653653:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.653737:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794356736 00000100:00100000:3.0:1746147738.653741:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794356736 00000100:00100000:3.0:1746147738.653763:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17464 00000100:00100000:3.0:1746147738.653767:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a213b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:32712:x1830967794356736:12345-192.168.202.10@tcp:101:multiop.0 00010000:00010000:3.0:1746147738.653774:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.653787:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd184 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.653809:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800986f7600/0xe64d3fbf12a7f79d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccfa expref: 6 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.653816:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b10a600/0xe64d3fbf12a7f88b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd6a expref: 28 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.653823:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b10b400/0xe64d3fbf12a7f7ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd24 expref: 15 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.653828:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.653830:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147738.653833:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [274432->966655] (req 274432->966655) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 28 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.653859:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b10b400/0xe64d3fbf12a7f7ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd24 expref: 15 pid: 8468 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.653869:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b10b400/0xe64d3fbf12a7f7ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd24 expref: 15 pid: 8468 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746147738.653904:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0026300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796614272:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147738.654175:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.654232:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794356992 00000100:00100000:0.0:1746147738.654236:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794356992 00000100:00100000:0.0:1746147738.654261:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5110 00000100:00100000:0.0:1746147738.654266:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+32:32707:x1830967794356992:12345-192.168.202.10@tcp:35:multiop.0 00010000:00010000:3.0:1746147738.654329:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b10a600/0xe64d3fbf12a7f88b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd6a expref: 28 pid: 8469 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.654336:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b10a600/0xe64d3fbf12a7f88b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd6a expref: 28 pid: 8469 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746147738.654343:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796614400:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.654374:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800986f7600/0xe64d3fbf12a7f79d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccfa expref: 6 pid: 8470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.654381:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800986f7600/0xe64d3fbf12a7f79d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccfa expref: 6 pid: 8470 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746147738.654387:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796614528:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.654398:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147738.654537:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:32707:x1830967794356992:12345-192.168.202.10@tcp:35:multiop.0 Request processed in 270us (362us total) trans 8589946246 rc 0/0 00000100:00100000:0.0:1746147738.654543:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5110 00000100:00100000:3.0:1746147738.655299:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0026300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796614272:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147738.657050:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.657209:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796614400:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.657220:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796614528:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.657247:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [274432->966655] (req 274432->966655) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 28 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.657268:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8c00, rc 0) 00000100:00100000:3.0:1746147738.657314:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a213b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:32712:x1830967794356736:12345-192.168.202.10@tcp:101:multiop.0 Request processed in 3545us (3659us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.657321:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17464 00000100:00100000:0.0:1746147738.657376:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.657432:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794357248 00000100:00100000:3.0:1746147738.657439:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794357248 00010000:00010000:3.0:1746147738.657461:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800986f7600/0xe64d3fbf12a7f79d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccfa expref: 7 pid: 8470 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746147738.657481:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794357120 00000100:00100000:3.0:1746147738.657483:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794357120 00000100:00100000:1.0:1746147738.657490:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8933 00010000:00010000:3.0:1746147738.657493:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b10b400/0xe64d3fbf12a7f7ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd24 expref: 16 pid: 8468 timeout: 917 lvb_type: 1 00000100:00100000:1.0:1746147738.657499:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+7:1959:x1830967794357248:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147738.657509:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147738.657526:0:7095:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 2045 -> 2047 00010000:00010000:1.0:1746147738.657532:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800986f7600/0xe64d3fbf12a7f79d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccfa expref: 7 pid: 8470 timeout: 917 lvb_type: 1 00010000:00010000:1.0:1746147738.657542:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800986f7600/0xe64d3fbf12a7f79d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccfa expref: 7 pid: 8470 timeout: 917 lvb_type: 1 00010000:00010000:1.0:1746147738.657560:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800986f7600/0xe64d3fbf12a7f79d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafccfa expref: 7 pid: 8470 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746147738.658075:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8934 00000100:00100000:3.0:1746147738.658082:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794357120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147738.658089:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147738.658098:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b10b400/0xe64d3fbf12a7f7ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd24 expref: 16 pid: 8468 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746147738.658108:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b10b400/0xe64d3fbf12a7f7ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd24 expref: 16 pid: 8468 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746147738.658121:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b10b400/0xe64d3fbf12a7f7ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd24 expref: 16 pid: 8468 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746147738.658148:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147738.658154:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.658172:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1959:x1830967794357120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 90us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147738.658173:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41587371-240a-4781-aecb-638f17200fbd+6:1959:x1830967794357248:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 676us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.658178:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8934 00000100:00100000:1.0:1746147738.658188:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8933 00000100:00100000:0.0:1746147738.658791:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.658840:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794357376 00000100:00100000:2.0:1746147738.658845:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794357376 00010000:00010000:2.0:1746147738.658861:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b10a600/0xe64d3fbf12a7f88b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd6a expref: 28 pid: 8469 timeout: 917 lvb_type: 1 00000100:00100000:2.0:1746147738.658915:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8935 00000100:00100000:2.0:1746147738.658921:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794357376:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147738.658928:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147738.658937:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b10a600/0xe64d3fbf12a7f88b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd6a expref: 28 pid: 8469 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746147738.658945:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b10a600/0xe64d3fbf12a7f88b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd6a expref: 28 pid: 8469 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746147738.658957:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b10a600/0xe64d3fbf12a7f88b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd6a expref: 28 pid: 8469 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746147738.658975:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.658977:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.658983:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->966655) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 27 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.658990:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->966655) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 27 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.659019:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->966655) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 27 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147738.659028:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009111b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796614656:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147738.659098:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4cf6000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.662116:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009111b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796614656:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147738.662137:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147738.662159:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.662179:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794357376:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3256us (3390us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.662190:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8935 00000100:00100000:1.0:1746147738.662264:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794357632 00000100:00100000:1.0:1746147738.662271:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794357632 00002000:00100000:1.0:1746147738.662301:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (274432->278527) req@ffff88009fe96300 x1830967794357632/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.662310:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96300 with x1830967794357632 ext(274432->278527) 00002000:00010000:1.0:1746147738.662313:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe96300 00000100:00100000:1.0:1746147738.662339:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7898 00000100:00100000:1.0:1746147738.662345:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967794357632:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:1.0:1746147738.662604:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967794357632:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 246us (433us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147738.662612:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7898 00002000:00100000:1.0:1746147738.662617:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (274432->278527) req@ffff88009fe96300 x1830967794357632/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/4536 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.662623:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96300 with x1830967794357632 ext(274432->278527) 00002000:00010000:1.0:1746147738.662626:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe96300 00000100:00100000:0.0:1746147738.668629:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.668719:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794357888 00000100:00100000:1.0:1746147738.668727:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794357888 00002000:00100000:1.0:1746147738.668762:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (962560->966655) req@ffff88009fe95880 x1830967794357888/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.668772:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe95880 with x1830967794357888 ext(962560->966655) 00002000:00010000:1.0:1746147738.668776:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe95880 00000100:00100000:2.0:1746147738.669130:0:2402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7899 00000100:00100000:2.0:1746147738.669138:0:2402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967794357888:12345-192.168.202.10@tcp:3:multiop.0 00000100:00100000:2.0:1746147738.669297:0:2402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1958:x1830967794357888:12345-192.168.202.10@tcp:3:multiop.0 Request processed in 159us (675us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147738.669303:0:2402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7899 00002000:00100000:2.0:1746147738.669308:0:2402:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x455:0x0] (962560->966655) req@ffff88009fe95880 x1830967794357888/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/4536 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.669313:0:2402:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe95880 with x1830967794357888 ext(962560->966655) 00002000:00010000:2.0:1746147738.669316:0:2402:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe95880 00000100:00100000:0.0:1746147738.670191:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.670458:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794358016 00000100:00100000:3.0:1746147738.670463:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794358016 00000100:00100000:3.0:1746147738.670489:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17465 00000100:00100000:3.0:1746147738.670494:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794358016:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.670505:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.670518:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7ff3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd18b expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.670557:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796614784:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147738.670633:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8b300 going to sleep for 11 seconds 00002000:00010000:3.0:1746147738.674332:0:21480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime: 1746147736 -> 1746147739 00002000:00010000:3.0:1746147738.674341:0:21480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime: 1746147735 -> 1746147739 00002000:00010000:3.0:1746147738.674343:0:21480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime: 1746147736 -> 1746147739 00000100:00100000:3.0:1746147738.674368:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796614784:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147738.674401:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7ff3e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd18b expref: 16 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.674415:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff9e00/0xe64d3fbf12a7ff3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd18b expref: 16 pid: 21480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.674487:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff9e00, rc 0) 00000100:00100000:3.0:1746147738.674716:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1960:x1830967794358016:12345-192.168.202.10@tcp:101:cat.0 Request processed in 4219us (4523us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147738.674724:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17465 00000100:00100000:0.0:1746147738.676951:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.677059:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794358144 00000100:00100000:3.0:1746147738.677068:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794358144 00000100:00100000:3.0:1746147738.677110:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17466 00000100:00100000:3.0:1746147738.677118:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:32717:x1830967794358144:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.677136:0:21480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.677154:0:21480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7ff45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd192 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.677433:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->966655) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 26 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.677442:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147738.677445:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147738.677449:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7ff45 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd192 expref: 16 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.677479:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->966655) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 26 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.677491:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->966655) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 26 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.677504:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796614912:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.677912:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147738.680536:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.680552:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21480:1830967796614912:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.680580:0:21480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7ff45 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd192 expref: 16 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.680611:0:21480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8a00, rc 0) 00000100:00100000:3.0:1746147738.680656:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:32717:x1830967794358144:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3538us (3718us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.680664:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17466 00000100:00100000:1.0:1746147738.680811:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794358272 00000100:00100000:1.0:1746147738.680818:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794358272 00002000:00100000:1.0:1746147738.680857:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (274432->966655) req@ffff88009fe96d80 x1830967794358272/t0(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.680867:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96d80 with x1830967794358272 ext(274432->966655) 00010000:00010000:1.0:1746147738.680873:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->966655) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 27 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.680911:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->966655) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 27 pid: 21480 timeout: 917 lvb_type: 0 00002000:00010000:1.0:1746147738.680918:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe96d80 00000100:00100000:1.0:1746147738.680947:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1611 00000100:00100000:1.0:1746147738.680955:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967794358272:12345-192.168.202.10@tcp:4:multiop.0 00000100:00100000:0.0:1746147738.689026:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.689092:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794358400 00000100:00100000:3.0:1746147738.689102:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794358400 00000100:00100000:1.0:1746147738.689137:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.689162:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794358528 00000100:00100000:3.0:1746147738.689164:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794358528 00000100:00100000:3.0:1746147738.689180:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17467 00000100:00100000:3.0:1746147738.689188:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794358400:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.689209:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.689227:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff9600/0xe64d3fbf12a7ff4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd199 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.689281:0:10613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796615040:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147738.689358:0:10613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.689392:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17468 00000100:00100000:3.0:1746147738.689397:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794358528:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.689404:0:7050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.689425:0:7050:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7ff53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd1a0 expref: -99 pid: 7050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.689449:0:7050:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796615168:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147738.689477:0:7050:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.690205:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.690372:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794358656 00000100:00100000:0.0:1746147738.690377:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794358656 00000100:00100000:0.0:1746147738.690457:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17469 00000100:00100000:0.0:1746147738.690788:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967794358656:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1746147738.690800:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147738.690813:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5481400/0xe64d3fbf12a7ff5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd1a7 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.690913:0:10613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10613:1830967796615040:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147738.690937:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff9600/0xe64d3fbf12a7ff4c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd199 expref: 32 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.690946:0:10613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff9600/0xe64d3fbf12a7ff4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd199 expref: 32 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.690963:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff9600, rc 0) 00000100:00100000:0.0:1746147738.691030:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aee9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796615296:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147738.691044:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794358400:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1857us (2029us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147738.691050:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17467 00000100:00100000:0.0:1746147738.691075:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.691918:0:7050:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7050:1830967796615168:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147738.691943:0:7050:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7ff53 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1a0 expref: 24 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.691954:0:7050:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fff9400/0xe64d3fbf12a7ff53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1a0 expref: 24 pid: 7050 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.691965:0:7050:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff9400, rc 0) 00000100:00100000:3.0:1746147738.692102:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794358528:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2703us (2964us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147738.692110:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17468 00000100:00100000:2.0:1746147738.693252:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aee9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796615296:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147738.693278:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5481400/0xe64d3fbf12a7ff5a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1a7 expref: 30 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147738.693290:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5481400/0xe64d3fbf12a7ff5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1a7 expref: 30 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147738.693313:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5481400, rc 0) 00000100:00100000:2.0:1746147738.693344:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967794358656:12345-192.168.202.10@tcp:101:cat.0 Request processed in 2880us (3145us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147738.693352:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17469 00000100:00100000:1.0:1746147738.694318:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1957:x1830967794358272:12345-192.168.202.10@tcp:4:multiop.0 Request processed in 13359us (13789us total) trans 17179874539 rc 0/0 00000100:00100000:1.0:1746147738.694431:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1611 00002000:00100000:1.0:1746147738.694440:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (274432->966655) req@ffff88009fe96d80 x1830967794358272/t17179874539(0) o4->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/448 e 0 to 0 dl 1746147749 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.694448:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe96d80 with x1830967794358272 ext(274432->966655) 00010000:00010000:1.0:1746147738.694455:0:31358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->966655) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 29 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.694466:0:31358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->966655) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 29 pid: 21480 timeout: 917 lvb_type: 0 00002000:00010000:1.0:1746147738.694472:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe96d80 00000100:00100000:0.0:1746147738.695875:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.695936:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794358784 00000100:00100000:2.0:1746147738.695944:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794358784 00000100:00100000:2.0:1746147738.695987:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17470 00000100:00100000:2.0:1746147738.695993:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32721:x1830967794358784:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147738.696006:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.696019:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0265a00/0xe64d3fbf12a7ff61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd1ae expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.696041:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147738.696046:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0265a00/0xe64d3fbf12a7ff61 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ae expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.696056:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0265a00/0xe64d3fbf12a7ff61 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ae expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.696065:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0265a00, rc 0) 00000100:00100000:2.0:1746147738.696179:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32721:x1830967794358784:12345-192.168.202.10@tcp:101:cat.0 Request processed in 185us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.696188:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17470 00000100:00100000:0.0:1746147738.697477:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.697580:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794358912 00000100:00100000:2.0:1746147738.697587:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794358912 00010000:00010000:2.0:1746147738.697622:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 274432->966655) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 30 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.697655:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8936 00000100:00100000:2.0:1746147738.697661:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aee9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794358912:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147738.697672:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147738.697691:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 274432->966655) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 30 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.697700:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 274432->966655) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 30 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.697718:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 274432->966655) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd184 expref: 30 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.697735:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.697737:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.697743:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7ff45 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd192 expref: 15 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.697751:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7ff45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd192 expref: 15 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.697758:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.697760:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.697762:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0265a00/0xe64d3fbf12a7ff61 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ae expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.697768:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0265a00/0xe64d3fbf12a7ff61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ae expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.697793:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0265a00/0xe64d3fbf12a7ff61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ae expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147738.697803:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091119500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796615424:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147738.697922:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7ff45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd192 expref: 15 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147738.697930:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796615552:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147738.697973:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4cf6000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.700513:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091119500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796615424:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147738.700526:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796615552:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147738.700545:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147738.700586:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aee9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967794358912:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2924us (3115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.700609:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8936 00000100:00100000:0.0:1746147738.704729:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.704774:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.704808:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.704857:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.704922:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794359168 00000100:00100000:3.0:1746147738.704928:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794359552 00000100:00100000:1.0:1746147738.704931:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794359168 00000100:00100000:3.0:1746147738.704933:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794359552 00002000:00100000:3.0:1746147738.704969:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c265180 x1830967794359552/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.704969:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c267800 x1830967794359168/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.704975:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c267800 with x1830967794359168 ext(0->1048575) 00002000:00100000:3.0:1746147738.704976:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c265180 with x1830967794359552 ext(0->1048575) 00002000:00010000:1.0:1746147738.704980:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c267800 00002000:00010000:3.0:1746147738.704981:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c265180 00000100:00100000:3.0:1746147738.704997:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794359680 00000100:00100000:3.0:1746147738.704999:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794359680 00000100:00100000:1.0:1746147738.705002:0:31358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794359936 00000100:00100000:1.0:1746147738.705003:0:31358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794359936 00002000:00100000:3.0:1746147738.705008:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x457:0x0] (1429504->2097151) req@ffff88009c264380 x1830967794359680/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.705011:0:31358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1556479) req@ffff88009c266680 x1830967794359936/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.705014:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c264380 with x1830967794359680 ext(1429504->2097151) 00002000:00100000:1.0:1746147738.705016:0:31358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c266680 with x1830967794359936 ext(1048576->1556479) 00002000:00010000:3.0:1746147738.705017:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c264380 00002000:00010000:1.0:1746147738.705018:0:31358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c266680 00000100:00100000:3.0:1746147738.705028:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7900 00000100:00100000:3.0:1746147738.705035:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794359552:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1746147738.705035:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7901 00000100:00100000:1.0:1746147738.705039:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794359168:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147738.705044:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7902 00000100:00100000:2.0:1746147738.705054:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794359680:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1746147738.705095:0:8474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7903 00000100:00100000:3.0:1746147738.705100:0:8474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794359936:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147738.720288:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794359680:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15223us (15466us total) trans 0 rc 667648/667648 00000100:00100000:2.0:1746147738.720303:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7902 00002000:00100000:2.0:1746147738.720317:0:21459:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x457:0x0] (1429504->2097151) req@ffff88009c264380 x1830967794359680/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.720327:0:21459:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c264380 with x1830967794359680 ext(1429504->2097151) 00002000:00010000:2.0:1746147738.720332:0:21459:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c264380 00000100:00100000:3.0:1746147738.720652:0:8474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1958:x1830967794359936:12345-192.168.202.10@tcp:3:cat.0 Request processed in 15550us (15793us total) trans 0 rc 507904/507904 00000100:00100000:3.0:1746147738.720660:0:8474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7903 00002000:00100000:3.0:1746147738.720665:0:8474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x455:0x0] (1048576->1556479) req@ffff88009c266680 x1830967794359936/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 507904/507904 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147738.720670:0:8474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c266680 with x1830967794359936 ext(1048576->1556479) 00002000:00010000:3.0:1746147738.720674:0:8474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c266680 00000100:00100000:2.0:1746147738.722836:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1958:x1830967794359552:12345-192.168.202.10@tcp:3:cat.0 Request processed in 17793us (18052us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147738.722848:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7900 00002000:00100000:2.0:1746147738.722858:0:31359:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c265180 x1830967794359552/t0(0) o3->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.722867:0:31359:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c265180 with x1830967794359552 ext(0->1048575) 00002000:00010000:2.0:1746147738.723362:0:31359:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c265180 00000100:00100000:1.0:1746147738.723766:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794359168:12345-192.168.202.10@tcp:3:cat.0 Request processed in 18724us (19048us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147738.723775:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7901 00002000:00100000:1.0:1746147738.723781:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x455:0x0] (0->1048575) req@ffff88009c267800 x1830967794359168/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.723788:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c267800 with x1830967794359168 ext(0->1048575) 00002000:00010000:1.0:1746147738.723792:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c267800 00000100:00100000:0.0:1746147738.730218:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.730328:0:14542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794360064 00000100:00100000:2.0:1746147738.730341:0:14542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794360064 00000100:00100000:2.0:1746147738.730398:0:14542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 224 00000100:00100000:2.0:1746147738.730405:0:14542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febf1b7c-e040-48da-83a3-5da159ba5e63+15:1957:x1830967794360064:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1746147738.730478:0:14542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febf1b7c-e040-48da-83a3-5da159ba5e63+15:1957:x1830967794360064:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 74us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.730485:0:14542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 224 00000100:00100000:0.0:1746147738.732288:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.732395:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794360192 00000100:00100000:2.0:1746147738.732403:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794360192 00000100:00100000:2.0:1746147738.732458:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17471 00000100:00100000:2.0:1746147738.732465:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:32721:x1830967794360192:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147738.732483:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.732501:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0265000/0xe64d3fbf12a7ff68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd1b5 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.732531:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 13 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.732538:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147738.732539:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147738.732543:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0265000/0xe64d3fbf12a7ff68 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1b5 expref: 24 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.732571:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 13 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.732582:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 13 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.732670:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796615680:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147738.733255:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.735856:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796615680:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147738.735911:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0265000/0xe64d3fbf12a7ff68 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1b5 expref: 24 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.735931:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0265000, rc 0) 00000100:00100000:2.0:1746147738.735988:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32721:x1830967794360192:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3521us (3707us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.735997:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17471 00000100:00100000:0.0:1746147738.738182:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.738253:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.738348:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794360320 00000100:00100000:1.0:1746147738.738358:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794360320 00002000:00100000:1.0:1746147738.738404:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1556480->2097151) req@ffff8800a5d7ce00 x1830967794360320/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.738414:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ce00 with x1830967794360320 ext(1556480->2097151) 00010000:00010000:1.0:1746147738.738423:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 14 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.738437:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 14 pid: 21480 timeout: 917 lvb_type: 0 00002000:00010000:1.0:1746147738.738445:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7ce00 00000100:00100000:1.0:1746147738.738477:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1612 00000100:00100000:1.0:1746147738.738484:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+14:1959:x1830967794360320:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147738.738559:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794360448 00000100:00100000:2.0:1746147738.738563:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794360448 00000100:00100000:2.0:1746147738.738582:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17472 00000100:00100000:2.0:1746147738.738586:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1957:x1830967794360448:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1746147738.738602:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147738.738615:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0265400/0xe64d3fbf12a7ff6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd1bc expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147738.739147:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796615808:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147738.739209:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.742319:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a02ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796615808:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147738.742357:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0265400/0xe64d3fbf12a7ff6f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1bc expref: 17 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.742376:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0265400/0xe64d3fbf12a7ff6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1bc expref: 17 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.742399:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0265400, rc 0) 00000100:00100000:3.0:1746147738.742446:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1957:x1830967794360448:12345-192.168.202.10@tcp:101:cat.0 Request processed in 3858us (4191us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147738.742455:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17472 00000100:00100000:2.0:1746147738.745346:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.745410:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794360576 00000100:00100000:3.0:1746147738.745424:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794360576 00000100:00100000:3.0:1746147738.745471:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17473 00000100:00100000:3.0:1746147738.745480:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1957:x1830967794360576:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.745499:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.745518:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7ff76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd1c3 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147738.745569:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796615936:192.168.202.10@tcp:106: 00000100:00100000:3.0:1746147738.745657:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147738.747150:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794360320:12345-192.168.202.10@tcp:4:cat.0 Request processed in 8660us (8972us total) trans 21474841764 rc 0/0 00000100:00100000:1.0:1746147738.747162:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1612 00002000:00100000:1.0:1746147738.747173:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1556480->2097151) req@ffff8800a5d7ce00 x1830967794360320/t21474841764(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/448 e 0 to 0 dl 1746147749 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.747182:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ce00 with x1830967794360320 ext(1556480->2097151) 00010000:00010000:1.0:1746147738.747190:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 18 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746147738.747203:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 18 pid: 21480 timeout: 917 lvb_type: 0 00002000:00010000:1.0:1746147738.747209:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7ce00 00000100:00100000:3.0:1746147738.747285:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796615936:192.168.202.10@tcp:106: 00010000:00010000:3.0:1746147738.747315:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7ff76 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1c3 expref: 17 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.747332:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fff8e00/0xe64d3fbf12a7ff76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1c3 expref: 17 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.747348:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8e00, rc 0) 00000100:00100000:3.0:1746147738.747369:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1957:x1830967794360576:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1891us (2035us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147738.747375:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17473 00000100:00100000:0.0:1746147738.750655:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147738.750731:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.750789:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794360832 00000100:00100000:3.0:1746147738.750795:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794360704 00000100:00100000:3.0:1746147738.750799:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794360704 00000100:00100000:2.0:1746147738.750799:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794360832 00010000:00010000:2.0:1746147738.750835:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 17 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.750841:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17474 00000100:00100000:3.0:1746147738.750849:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1957:x1830967794360704:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.750864:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147738.750866:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8937 00000100:00100000:2.0:1746147738.750870:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794360832:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147738.750878:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7ff7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd1ca expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.750901:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147738.750924:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 18 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.750935:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 18 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.750943:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796616064:192.168.202.10@tcp:106: 00010000:00010000:2.0:1746147738.750954:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.750955:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.750963:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0265000/0xe64d3fbf12a7ff68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1b5 expref: 23 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.750970:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0265000/0xe64d3fbf12a7ff68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1b5 expref: 23 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.750990:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0265000/0xe64d3fbf12a7ff68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1b5 expref: 23 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147738.750997:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091119500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796616192:192.168.202.10@tcp:105: 00000100:00100000:3.0:1746147738.751017:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.751017:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20feb40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147738.752124:0:4591:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.10@tcp) returned -22 from glimpse AST (req@ffff8800a0025c00 x1830967796616064) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 18 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.752134:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091119500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7096:1830967796616192:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147738.752151:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fff8800/0xe64d3fbf12a7ff29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd176 expref: 18 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.752151:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147738.752165:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796616064:192.168.202.10@tcp:106: 00000100:00100000:2.0:1746147738.752183:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800951d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1959:x1830967794360832:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1310us (1450us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147738.752184:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7ff7d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ca expref: 17 pid: 4591 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147738.752191:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8937 00010000:00010000:3.0:1746147738.752198:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fff9c00/0xe64d3fbf12a7ff7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ca expref: 17 pid: 4591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147738.752205:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff9c00, rc 0) 00000100:00100000:3.0:1746147738.752225:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1957:x1830967794360704:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1377us (1582us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147738.752231:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17474 00000100:00100000:0.0:1746147738.753831:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147738.753949:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794361088 00000100:00100000:1.0:1746147738.753959:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794361088 00002000:00100000:1.0:1746147738.754002:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880134eb0e00 x1830967794361088/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147738.754012:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb0e00 with x1830967794361088 ext(1048576->2097151) 00002000:00010000:1.0:1746147738.754018:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134eb0e00 00000100:00100000:1.0:1746147738.754093:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7904 00000100:00100000:1.0:1746147738.754102:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794361088:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:0.0:1746147738.762298:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794361088:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8187us (8465us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147738.762308:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7904 00002000:00100000:0.0:1746147738.762319:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x455:0x0] (1048576->2097151) req@ffff880134eb0e00 x1830967794361088/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147738.762326:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb0e00 with x1830967794361088 ext(1048576->2097151) 00002000:00010000:0.0:1746147738.762332:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134eb0e00 00000100:00100000:0.0:1746147738.767665:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147738.767770:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794361216 00000100:00100000:3.0:1746147738.767781:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794361216 00000100:00100000:3.0:1746147738.767840:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17475 00000100:00100000:3.0:1746147738.767846:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:32721:x1830967794361216:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1746147738.767870:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147738.767915:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd1d1 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.767948:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 15 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.767956:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147738.767958:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147738.767962:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff84 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d1 expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.767991:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 15 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.768006:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 15 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746147738.768019:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796616320:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147738.768105:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013024b900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147738.769350:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796616320:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147738.769378:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff84 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d1 expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147738.769394:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8c00, rc 0) 00000100:00100000:3.0:1746147738.769443:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32721:x1830967794361216:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1596us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147738.769452:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17475 00000100:00100000:0.0:1746147738.770397:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.770503:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794361344 00000100:00100000:2.0:1746147738.770512:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794361344 00002000:00100000:2.0:1746147738.770558:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1429503) req@ffff880134eb1180 x1830967794361344/t0(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.770568:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb1180 with x1830967794361344 ext(1048576->1429503) 00010000:00010000:2.0:1746147738.770575:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 16 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.770600:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 16 pid: 21480 timeout: 917 lvb_type: 0 00002000:00010000:2.0:1746147738.770612:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134eb1180 00000100:00100000:2.0:1746147738.770642:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1613 00000100:00100000:2.0:1746147738.770649:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+16:1959:x1830967794361344:12345-192.168.202.10@tcp:4:cat.0 00000100:00100000:2.0:1746147738.777616:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1959:x1830967794361344:12345-192.168.202.10@tcp:4:cat.0 Request processed in 6941us (7194us total) trans 17179874540 rc 0/0 00000100:00100000:2.0:1746147738.777634:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1613 00002000:00100000:2.0:1746147738.777650:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1048576->1429503) req@ffff880134eb1180 x1830967794361344/t17179874540(0) o4->ddca4d47-3f3f-485c-b881-26ef94728fb1@192.168.202.10@tcp:359/0 lens 488/448 e 0 to 0 dl 1746147749 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.777662:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb1180 with x1830967794361344 ext(1048576->1429503) 00010000:00010000:2.0:1746147738.777674:0:8473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 18 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.777692:0:8473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 18 pid: 21480 timeout: 917 lvb_type: 0 00002000:00010000:2.0:1746147738.777700:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134eb1180 00000100:00100000:0.0:1746147738.781119:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.781295:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794361472 00000100:00100000:2.0:1746147738.781305:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794361472 00010000:00010000:2.0:1746147738.781346:0:7096:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 18 pid: 21480 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746147738.781392:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8938 00000100:00100000:2.0:1746147738.781399:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+18:1958:x1830967794361472:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147738.781416:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147738.781439:0:7096:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 18 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.781451:0:7096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 18 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.781473:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd17d expref: 18 pid: 21480 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746147738.781502:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.781504:0:7096:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147738.781511:0:7096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d1 expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.781525:0:7096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d1 expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147738.781560:0:7096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d1 expref: 29 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147738.781572:0:7096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091119500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796616448:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147738.781667:0:7096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20fe840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147738.783487:0:7096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091119500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7096:1830967796616448:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147738.783510:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147738.783562:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1958:x1830967794361472:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2162us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147738.783574:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8938 00000100:00100000:0.0:1746147738.791208:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147738.792159:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794361728 00000100:00100000:2.0:1746147738.792171:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794361728 00002000:00100000:2.0:1746147738.792216:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880134eb3b80 x1830967794361728/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/0 e 0 to 0 dl 1746147749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.792226:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb3b80 with x1830967794361728 ext(1048576->2097151) 00002000:00010000:2.0:1746147738.792231:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134eb3b80 00000100:00100000:2.0:1746147738.792391:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7905 00000100:00100000:2.0:1746147738.792399:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794361728:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:2.0:1746147738.801331:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794361728:12345-192.168.202.10@tcp:3:cat.0 Request processed in 8924us (10126us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147738.801342:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7905 00002000:00100000:2.0:1746147738.801353:0:8473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x457:0x0] (1048576->2097151) req@ffff880134eb3b80 x1830967794361728/t0(0) o3->729e0a2b-9977-4fe3-8060-6fd2b07f1e5a@192.168.202.10@tcp:359/0 lens 488/440 e 0 to 0 dl 1746147749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147738.801361:0:8473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134eb3b80 with x1830967794361728 ext(1048576->2097151) 00002000:00010000:2.0:1746147738.801366:0:8473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134eb3b80 00010000:00010000:1.0:1746147738.814324:0:7099:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147739.589300:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147739.589482:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794361984 00000100:00100000:2.0:1746147739.589491:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794361984 00000100:00100000:2.0:1746147739.589550:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5111 00000100:00100000:2.0:1746147739.589559:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:32744:x1830967794361984:12345-192.168.202.10@tcp:35:umount.0 00000100:00100000:2.0:1746147739.589959:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:32744:x1830967794361984:12345-192.168.202.10@tcp:35:umount.0 Request processed in 399us (672us total) trans 8589946247 rc 0/0 00000100:00100000:2.0:1746147739.589966:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5111 00000100:00100000:0.0:1746147739.593209:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147739.593804:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147739.593837:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147739.593879:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794362112 00000100:00100000:3.0:1746147739.593901:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794362112 00000100:00100000:0.0:1746147739.593944:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147739.593950:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794362240 00000100:00100000:3.0:1746147739.593952:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794362240 00000100:00100000:3.0:1746147739.593975:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794362368 00000100:00100000:3.0:1746147739.593978:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794362368 00000100:00100000:3.0:1746147739.594578:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 917 00000100:00100000:3.0:1746147739.594594:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:febf1b7c-e040-48da-83a3-5da159ba5e63+17:1959:x1830967794362112:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147739.594608:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147739.594633:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a0279600/0xe64d3fbf12a7583a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf6ee3 expref: 17 pid: 14542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147739.594656:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147739.594700:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:febf1b7c-e040-48da-83a3-5da159ba5e63+16:1959:x1830967794362112:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 107us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147739.594707:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 917 00000100:00100000:0.0:1746147739.594730:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 918 00000100:00100000:0.0:1746147739.594737:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:febf1b7c-e040-48da-83a3-5da159ba5e63+15:1960:x1830967794362240:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147739.594743:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147739.594752:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012e13be00/0xe64d3fbf12a75841 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf6f0d expref: 15 pid: 14541 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147739.594754:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 919 00000100:00100000:3.0:1746147739.594758:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:febf1b7c-e040-48da-83a3-5da159ba5e63+14:1960:x1830967794362368:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147739.594763:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147739.594764:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147739.594770:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012e13a600/0xe64d3fbf12a75848 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf6f14 expref: 14 pid: 14542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147739.594776:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:febf1b7c-e040-48da-83a3-5da159ba5e63+13:1960:x1830967794362240:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 41us (974us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147739.594777:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147739.594781:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 918 00000100:00100000:3.0:1746147739.594787:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:febf1b7c-e040-48da-83a3-5da159ba5e63+12:1960:x1830967794362368:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 28us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147739.594791:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 919 00000100:00100000:3.0:1746147739.594804:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794362752 00000100:00100000:3.0:1746147739.594807:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794362752 00000100:00100000:3.0:1746147739.594826:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17476 00000100:00100000:3.0:1746147739.594831:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+17:1956:x1830967794362752:12345-192.168.202.10@tcp:9:umount.0 00000020:00000080:3.0:1746147739.594857:0:4591:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe64d3fbf12a75856 00000020:00010000:3.0:1746147739.594864:0:4591:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88008c7e4800: total 0 00000100:00080000:3.0:1746147739.594868:0:4591:0:(import.c:66:import_set_state_nolock()) ffff88008c7e2800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1746147739.594913:0:7098:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88008c7e4800: total 0 00000001:00000004:3.0:1746147739.594916:0:4591:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874540 00010000:00010000:0.0:1746147739.594916:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147739.594948:0:7098:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88008c7e4800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1746147739.594986:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9322800/0xe64d3fbf12a7fe6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd114 expref: 16 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147739.595005:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8a00/0xe64d3fbf12a7ff45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd192 expref: 15 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147739.595019:0:7098:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88008c7e4800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1746147739.595027:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147739.595028:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147739.595029:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147739.595328:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+12:1956:x1830967794362752:12345-192.168.202.10@tcp:9:umount.0 Request processed in 495us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147739.595334:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17476 00000100:00100000:0.0:1746147739.607321:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147739.607432:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794363136 00000100:00100000:3.0:1746147739.607442:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794363136 00000100:00100000:3.0:1746147739.607484:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17477 00000100:00100000:3.0:1746147739.607492:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+15:1956:x1830967794363136:12345-192.168.202.10@tcp:9:umount.0 00000020:00000080:3.0:1746147739.607524:0:4591:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe64d3fbf12a7585d 00000020:00010000:3.0:1746147739.607530:0:4591:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012d5bc800: total 0 00000100:00080000:3.0:1746147739.607535:0:4591:0:(import.c:66:import_set_state_nolock()) ffff88012d5b9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147739.607579:0:4591:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841764 00000020:00010000:2.0:1746147739.608012:0:8483:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012d5bc800: total 0 00010000:00010000:2.0:1746147739.608045:0:8483:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012d5bc800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1746147739.608096:0:8483:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134b2e800/0xe64d3fbf12a7fcac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd011 expref: 15 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147739.608120:0:8483:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fff8000/0xe64d3fbf12a7feab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd137 expref: 14 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147739.608130:0:8483:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012d5bc800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1746147739.608136:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147739.608138:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147739.608139:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147739.608715:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+10:1956:x1830967794363136:12345-192.168.202.10@tcp:9:umount.0 Request processed in 1222us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147739.608724:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17477 00000100:00100000:0.0:1746147739.615843:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147739.616007:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794363520 00000100:00100000:3.0:1746147739.616017:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794363520 00000100:00100000:3.0:1746147739.616080:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12199 00000100:00100000:3.0:1746147739.616089:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+34:1956:x1830967794363520:12345-192.168.202.10@tcp:39:umount.0 00000020:00000080:3.0:1746147739.616123:0:5744:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe64d3fbf12a7584f 00000020:00010000:3.0:1746147739.616131:0:5744:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88008c7e1800: total 0 00000100:00080000:3.0:1746147739.616136:0:5744:0:(import.c:66:import_set_state_nolock()) ffff88008c7e7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147739.616162:0:5744:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589946247 00000020:00010000:1.0:1746147739.616170:0:20300:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88008c7e1800: total 0 00000100:00100000:3.0:1746147739.616470:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ddca4d47-3f3f-485c-b881-26ef94728fb1+33:1956:x1830967794363520:12345-192.168.202.10@tcp:39:umount.0 Request processed in 381us (638us total) trans 8589946248 rc 0/0 00000100:00100000:3.0:1746147739.616477:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12199 00010000:00010000:1.0:1746147739.616519:0:20300:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88008c7e1800, canceled 0 locks, left on hash table 5. 00010000:00010000:1.0:1746147739.616554:0:20300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147739.616558:0:20300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147739.616566:0:20300:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d78a00/0xe64d3fbf12a7f8b5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda2 expref: 32 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147739.616615:0:20300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147739.616618:0:20300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147739.616622:0:20300:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134b2fc00/0xe64d3fbf12a7fc90 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcffc expref: 31 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147739.616635:0:20300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147739.616637:0:20300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147739.616639:0:20300:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dae9200/0xe64d3fbf12a7d8ef lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafb86a expref: 30 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147739.616651:0:20300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:1.0:1746147739.616652:0:20300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746147739.616655:0:20300:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc31a00/0xe64d3fbf12a758db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf6fae expref: 29 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147739.616665:0:20300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147739.616667:0:20300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746147739.616670:0:20300:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79200/0xe64d3fbf12a7f8ae lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcd9b expref: 28 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147739.616678:0:20300:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88008c7e1800, canceled 5 locks, left on hash table 0. 00010000:00010000:1.0:1746147739.616688:0:20300:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746147739.616689:0:20300:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746147739.616691:0:20300:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746147739.817119:0:7099:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147739.997561:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147739.997743:0:15900:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794363776 00000100:00100000:1.0:1746147739.997752:0:15900:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794363776 00000100:00100000:1.0:1746147739.998001:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 920 00000100:00100000:0.0:1746147739.998360:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147739.998375:0:7312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794363648 00000100:00100000:0.0:1746147739.998378:0:7312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794363648 00000100:00100000:1.0:1746147739.998422:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:febf1b7c-e040-48da-83a3-5da159ba5e63+13:1957:x1830967794363776:12345-192.168.202.10@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147739.998425:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 921 00000100:00100000:0.0:1746147739.998431:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:febf1b7c-e040-48da-83a3-5da159ba5e63+13:1960:x1830967794363648:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147739.998435:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147739.998438:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147739.998454:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a5897200/0xe64d3fbf12a7586b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf6f68 expref: 13 pid: 14542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147739.998489:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147739.998533:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:febf1b7c-e040-48da-83a3-5da159ba5e63+12:1957:x1830967794363776:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 116us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147739.998540:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 920 00010000:00010000:0.0:1746147739.998547:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a6694a00/0xe64d3fbf12a75864 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf6f3e expref: 12 pid: 14542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147739.998568:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147739.998596:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:febf1b7c-e040-48da-83a3-5da159ba5e63+10:1960:x1830967794363648:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 166us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147739.998602:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 921 00000100:00100000:0.0:1746147739.998638:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147739.998654:0:7096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794363904 00000100:00100000:3.0:1746147739.998658:0:7096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794363904 00000100:00100000:3.0:1746147739.998682:0:7096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 922 00000100:00100000:3.0:1746147739.998687:0:7096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:febf1b7c-e040-48da-83a3-5da159ba5e63+10:1960:x1830967794363904:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147739.998693:0:7096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147739.998701:0:7096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800914f3200/0xe64d3fbf12a75872 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf6f6f expref: 10 pid: 14542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147739.998711:0:7096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147739.998726:0:7096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:febf1b7c-e040-48da-83a3-5da159ba5e63+9:1960:x1830967794363904:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 39us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147739.998731:0:7096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 922 00000100:00100000:0.0:1746147739.998827:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147739.999672:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794364160 00000100:00100000:3.0:1746147739.999677:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794364160 00000100:00100000:3.0:1746147739.999712:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17478 00000100:00100000:3.0:1746147739.999717:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+6:1956:x1830967794364160:12345-192.168.202.10@tcp:9:umount.0 00000020:00000080:3.0:1746147739.999740:0:4591:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe64d3fbf12a75887 00000020:00010000:3.0:1746147739.999748:0:4591:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a1196800: total 0 00000100:00080000:3.0:1746147739.999752:0:4591:0:(import.c:66:import_set_state_nolock()) ffff8800a1195800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1746147739.999769:0:7098:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a1196800: total 0 00000001:00000004:3.0:1746147739.999783:0:4591:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874540 00010000:00010000:0.0:1746147739.999802:0:7098:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a1196800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1746147739.999846:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a002c600/0xe64d3fbf12a7fedc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd153 expref: 5 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147739.999863:0:7098:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a1196800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1746147739.999874:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147739.999876:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147739.999877:0:7098:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147739.999944:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+2:1956:x1830967794364160:12345-192.168.202.10@tcp:9:umount.0 Request processed in 226us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147739.999949:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17478 00000100:00100000:0.0:1746147740.002305:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147740.002390:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794364672 00000100:00100000:3.0:1746147740.002403:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794364672 00000100:00080000:0.0:1746147740.002466:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147740.002528:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17479 00000100:00100000:3.0:1746147740.002540:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+8:1956:x1830967794364672:12345-192.168.202.10@tcp:9:umount.0 00000020:00000080:3.0:1746147740.002572:0:4591:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe64d3fbf12a75880 00000020:00010000:3.0:1746147740.002594:0:4591:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a8a72000: total 0 00000100:00080000:3.0:1746147740.002600:0:4591:0:(import.c:66:import_set_state_nolock()) ffff8800a8a74800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147740.003003:0:4591:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841764 00000020:00010000:2.0:1746147740.003314:0:8483:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a8a72000: total 0 00010000:00010000:2.0:1746147740.003319:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147740.003355:0:8483:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a8a72000, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1746147740.003413:0:8483:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7622e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf7493 expref: 6 pid: 7050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.003474:0:8483:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800949c1a00/0xe64d3fbf12a7fece lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd15a expref: 5 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147740.003629:0:8483:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013179f800/0xe64d3fbf12a7fd5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd057 expref: 4 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147740.003642:0:8483:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a8a72000, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1746147740.003656:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147740.003658:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147740.003660:0:8483:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147740.003718:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41587371-240a-4781-aecb-638f17200fbd+2:1956:x1830967794364672:12345-192.168.202.10@tcp:9:umount.0 Request processed in 1178us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147740.003731:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17479 00000100:00100000:0.0:1746147740.009758:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147740.009948:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794364928 00000100:00100000:3.0:1746147740.009960:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794364928 00000100:00100000:3.0:1746147740.010040:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12200 00000100:00100000:3.0:1746147740.010051:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+12:1956:x1830967794364928:12345-192.168.202.10@tcp:39:umount.0 00000020:00000080:3.0:1746147740.010087:0:5744:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe64d3fbf12a75879 00000020:00010000:3.0:1746147740.010095:0:5744:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a8a71000: total 0 00000100:00080000:3.0:1746147740.010101:0:5744:0:(import.c:66:import_set_state_nolock()) ffff8800a8a74000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147740.010140:0:5744:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589946248 00000100:00080000:1.0:1746147740.010183:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1746147740.010325:0:20300:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a8a71000: total 0 00010000:00010000:2.0:1746147740.010543:0:20300:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a8a71000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1746147740.010595:0:20300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ca65000) 00010000:00010000:2.0:1746147740.010599:0:20300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746147740.010608:0:20300:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc30400/0xe64d3fbf12a75895 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf6f99 expref: 11 pid: 15085 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.010625:0:20300:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a8a71000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1746147740.010640:0:20300:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147740.010642:0:20300:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746147740.010644:0:20300:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147740.011073:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:41587371-240a-4781-aecb-638f17200fbd+9:1956:x1830967794364928:12345-192.168.202.10@tcp:39:umount.0 Request processed in 1022us (1324us total) trans 8589946249 rc 0/0 00000100:00100000:3.0:1746147740.011083:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12200 00000100:00100000:0.0:1746147740.038494:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.039485:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794365184 00000100:00100000:2.0:1746147740.039497:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794365184 00000100:00100000:2.0:1746147740.039591:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5112 00000100:00100000:2.0:1746147740.039599:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+345:32766:x1830967794365184:12345-192.168.202.10@tcp:35:lfs.0 00000100:00080000:1.0:1746147740.039872:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147740.040192:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+346:32766:x1830967794365184:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 592us (1709us total) trans 8589946250 rc 0/0 00000100:00100000:2.0:1746147740.040199:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5112 00000100:00100000:0.0:1746147740.042932:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147740.043027:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794365440 00000100:00100000:3.0:1746147740.043035:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794365440 00000100:00100000:3.0:1746147740.043082:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12201 00000100:00100000:3.0:1746147740.043089:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+346:32766:x1830967794365440:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147740.043109:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147740.043112:0:5744:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1746147740.043134:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fff9200/0xe64d3fbf12a7ff1b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd16f expref: 346 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.043152:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013553d000/0xe64d3fbf12a77e3c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aaf8422 expref: 345 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.043160:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147740.043164:0:5744:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147740.044551:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff8b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd1d8 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.044667:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0234a00/0xe64d3fbf12a7ff92 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147740.044678:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0234a00/0xe64d3fbf12a7ff92 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147740.044687:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0234a00/0xe64d3fbf12a7ff92 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:3.0:1746147740.044700:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00010000:00010000:3.0:1746147740.044799:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a09a8400/0xe64d3fbf12a7ff8b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d8 expref: 347 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.044810:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0234a00/0xe64d3fbf12a7ff92 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d8 expref: 346 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.044816:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147740.044818:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147740.044821:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0234a00, rc 0) 00000100:00100000:3.0:1746147740.045019:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+346:32766:x1830967794365440:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1929us (2092us total) trans 8589946251 rc 0/0 00000100:00100000:3.0:1746147740.045026:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12201 00000100:00100000:0.0:1746147740.048472:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.048504:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.048532:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.048558:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.048574:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.048609:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794365568 00000100:00100000:0.0:1746147740.048618:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794365568 00000100:00100000:0.0:1746147740.048663:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794365824 00000100:00100000:0.0:1746147740.048665:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794365824 00000100:00100000:0.0:1746147740.048676:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794366080 00000100:00100000:0.0:1746147740.048678:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794366080 00000100:00100000:0.0:1746147740.048687:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794365696 00000100:00100000:0.0:1746147740.048689:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794365696 00000100:00100000:0.0:1746147740.048697:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794365952 00000100:00100000:0.0:1746147740.048698:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794365952 00000100:00100000:0.0:1746147740.048710:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17480 00000100:00100000:0.0:1746147740.048717:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794365568:12345-192.168.202.10@tcp:1:lfs.0 00000100:00100000:3.0:1746147740.048760:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17481 00010000:00010000:0.0:1746147740.048760:0:20619:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7ffa0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147740.048776:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1960:x1830967794365824:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:0.0:1746147740.048784:0:20619:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0265a00/0xe64d3fbf12a7ff61 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ae expref: 32 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.048792:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.048794:0:20619:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.048797:0:20619:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7ffa0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.048814:0:21480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0234800/0xe64d3fbf12a7ffa7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.048826:0:20619:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0265a00/0xe64d3fbf12a7ff61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ae expref: 32 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.048833:0:21480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0265000/0xe64d3fbf12a7ff68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1b5 expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.048839:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.048840:0:20619:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0265a00/0xe64d3fbf12a7ff61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ae expref: 32 pid: 4591 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746147740.048841:0:21480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.048844:0:21480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0234800/0xe64d3fbf12a7ffa7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147740.048854:0:20619:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135810380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796616576:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147740.048871:0:21480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0265000/0xe64d3fbf12a7ff68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1b5 expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.048881:0:21480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0265000/0xe64d3fbf12a7ff68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1b5 expref: 25 pid: 4591 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746147740.048957:0:20619:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147740.048977:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17482 00000100:00100000:0.0:1746147740.048982:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794366080:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:0.0:1746147740.049000:0:22183:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7ffae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.049010:0:22183:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe73 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd11b expref: 32 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.049015:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.049017:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.049020:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7ffae lrc: 4/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.049033:0:22183:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd11b expref: 32 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.049041:0:22183:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd11b expref: 32 pid: 20619 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746147740.049048:0:22183:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135813100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796616832:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147740.049065:0:22183:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147740.049111:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147740.049279:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794366208 00000100:00100000:1.0:1746147740.049283:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794366208 00000100:00100000:3.0:1746147740.049297:0:21480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796616704:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147740.049304:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17483 00000100:00100000:1.0:1746147740.049308:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794365696:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:1.0:1746147740.049325:0:9615:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0475600/0xe64d3fbf12a7ffb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.049334:0:9615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8b16800/0xe64d3fbf12a7fd23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd034 expref: 26 pid: 9615 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147740.049340:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147740.049341:0:9615:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147740.049343:0:9615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0475600/0xe64d3fbf12a7ffb5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.049357:0:9615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8b16800/0xe64d3fbf12a7fd23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd034 expref: 26 pid: 9615 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147740.049365:0:21480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c8ba80 going to sleep for 11 seconds 00010000:00010000:1.0:1746147740.049365:0:9615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8b16800/0xe64d3fbf12a7fd23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd034 expref: 26 pid: 9615 timeout: 919 lvb_type: 1 00000100:00100000:1.0:1746147740.049374:0:9615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796616960:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147740.049385:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17484 00000100:00100000:3.0:1746147740.049392:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794365952:12345-192.168.202.10@tcp:1:lfs.0 00000100:00100000:1.0:1746147740.049397:0:9615:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746147740.049411:0:8470:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7ffbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147740.049411:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17485 00000100:00100000:1.0:1746147740.049416:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794366208:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:3.0:1746147740.049421:0:8470:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d1 expref: 32 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.049427:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.049428:0:8470:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147740.049430:0:4592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7ffc3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.049432:0:8470:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7ffbc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.049439:0:4592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7fe7a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd122 expref: 26 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.049444:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147740.049445:0:4592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147740.049447:0:4592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7ffc3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.049448:0:8470:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d1 expref: 32 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.049457:0:8470:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d1 expref: 32 pid: 4591 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746147740.049460:0:4592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7fe7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd122 expref: 26 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147740.049466:0:8470:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796617088:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147740.049469:0:4592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7fe7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd122 expref: 26 pid: 20619 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746147740.049476:0:4592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796617216:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147740.049484:0:8470:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa5db840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147740.049493:0:4592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201540 going to sleep for 11 seconds 00000100:00080000:1.0:1746147740.049508:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147740.049511:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147740.051268:0:20619:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135810380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20619:1830967796616576:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147740.051318:0:20619:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7ffa0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147740.052651:0:4592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4592:1830967796617216:192.168.202.10@tcp:104: 00010000:00010000:0.0:1746147740.052676:0:4592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7ffc3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147740.052774:0:21480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21480:1830967796616704:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147740.052787:0:21480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0234800/0xe64d3fbf12a7ffa7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147740.052807:0:8470:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8470:1830967796617088:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147740.052817:0:8470:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7ffbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147740.052847:0:9615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:9615:1830967796616960:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147740.053209:0:22183:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135813100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:22183:1830967796616832:192.168.202.10@tcp:104: 00010000:00010000:1.0:1746147740.053223:0:22183:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7ffae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.053271:0:9615:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0475600/0xe64d3fbf12a7ffb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147740.054207:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.054245:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.054302:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.054325:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794366592 00000100:00100000:0.0:1746147740.054331:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794366592 00010000:00010000:0.0:1746147740.054364:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8b16800/0xe64d3fbf12a7fd23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd034 expref: 27 pid: 9615 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746147740.054386:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794366336 00000100:00100000:0.0:1746147740.054388:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794366336 00010000:00010000:0.0:1746147740.054397:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0265000/0xe64d3fbf12a7ff68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1b5 expref: 28 pid: 4591 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746147740.054427:0:7095:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794366720 00000100:00100000:0.0:1746147740.054429:0:7095:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794366720 00010000:00010000:0.0:1746147740.054439:0:7095:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d1 expref: 33 pid: 4591 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746147740.054452:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8939 00000100:00100000:0.0:1746147740.054459:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1957:x1830967794366592:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147740.054472:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147740.054492:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8b16800/0xe64d3fbf12a7fd23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd034 expref: 28 pid: 9615 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746147740.054501:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8b16800/0xe64d3fbf12a7fd23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd034 expref: 28 pid: 9615 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746147740.054523:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8b16800/0xe64d3fbf12a7fd23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd034 expref: 28 pid: 9615 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746147740.054541:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.054543:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.054547:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0475600/0xe64d3fbf12a7ffb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.054554:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0475600/0xe64d3fbf12a7ffb5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.054572:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147740.054623:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1957:x1830967794366592:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 163us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147740.054630:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8939 00000100:00100000:0.0:1746147740.054645:0:7095:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8940 00000100:00100000:0.0:1746147740.054650:0:7095:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a22d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1958:x1830967794366336:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147740.054656:0:7095:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147740.054700:0:15900:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8941 00000100:00100000:1.0:1746147740.054707:0:15900:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1958:x1830967794366720:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147740.054714:0:15900:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147740.054729:0:15900:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d1 expref: 33 pid: 4591 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746147740.054737:0:15900:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d1 expref: 33 pid: 4591 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746147740.054750:0:15900:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a7ff84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d1 expref: 33 pid: 4591 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746147740.054767:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147740.054769:0:15900:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147740.054771:0:15900:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7ffbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.054778:0:15900:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7ffbc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.054806:0:15900:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147740.054818:0:8470:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7ffbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.054825:0:8470:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7ffbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.054843:0:8470:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7ffbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.054850:0:8470:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7ffbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.054857:0:8470:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7ffbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.054864:0:8470:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c0da000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147740.054867:0:8470:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7ffbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.054875:0:8470:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7ffbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.054912:0:8470:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7ffbc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.054918:0:8470:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c0da000/0xe64d3fbf12a7ffbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147740.054959:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794365952:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 5567us (6383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147740.054966:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17484 00010000:00010000:3.0:1746147740.054981:0:9615:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0475600/0xe64d3fbf12a7ffb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147740.054993:0:15900:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1958:x1830967794366720:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 287us (690us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147740.054994:0:9615:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0475600/0xe64d3fbf12a7ffb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147740.054998:0:15900:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8941 00010000:00010000:3.0:1746147740.055009:0:9615:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0475600/0xe64d3fbf12a7ffb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.055014:0:9615:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0475600/0xe64d3fbf12a7ffb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.055020:0:9615:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0475600/0xe64d3fbf12a7ffb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.055026:0:9615:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0475600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147740.055029:0:9615:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0475600/0xe64d3fbf12a7ffb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.055035:0:9615:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0475600/0xe64d3fbf12a7ffb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.055044:0:9615:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0475600/0xe64d3fbf12a7ffb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.055049:0:9615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0475600/0xe64d3fbf12a7ffb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9615 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147740.055092:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794365696:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 5783us (6532us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147740.055098:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17483 00010000:00010000:0.0:1746147740.055333:0:7095:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0265000/0xe64d3fbf12a7ff68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1b5 expref: 25 pid: 4591 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746147740.055343:0:7095:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0265000/0xe64d3fbf12a7ff68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1b5 expref: 25 pid: 4591 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746147740.055355:0:7095:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0265000/0xe64d3fbf12a7ff68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1b5 expref: 25 pid: 4591 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746147740.055363:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.055364:0:7095:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.055367:0:7095:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0234800/0xe64d3fbf12a7ffa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.055372:0:7095:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0234800/0xe64d3fbf12a7ffa7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.055396:0:7095:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147740.055427:0:7095:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a22d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1958:x1830967794366336:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 776us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147740.055433:0:7095:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8940 00010000:00010000:3.0:1746147740.055508:0:21480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0234800/0xe64d3fbf12a7ffa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.055515:0:21480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0234800/0xe64d3fbf12a7ffa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.055528:0:21480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0234800/0xe64d3fbf12a7ffa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.055534:0:21480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0234800/0xe64d3fbf12a7ffa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.055540:0:21480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0234800/0xe64d3fbf12a7ffa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.055545:0:21480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0234800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147740.055548:0:21480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0234800/0xe64d3fbf12a7ffa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.055553:0:21480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0234800/0xe64d3fbf12a7ffa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.055562:0:21480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0234800/0xe64d3fbf12a7ffa7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.055567:0:21480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0234800/0xe64d3fbf12a7ffa7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147740.055627:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1960:x1830967794365824:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 6858us (7121us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147740.055633:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17481 00000100:00100000:0.0:1746147740.057054:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.057095:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.057141:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.057212:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794366976 00000100:00100000:2.0:1746147740.057221:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794366976 00010000:00010000:2.0:1746147740.057253:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd11b expref: 31 pid: 20619 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746147740.057289:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794366464 00000100:00100000:2.0:1746147740.057293:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794366464 00010000:00010000:2.0:1746147740.057303:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0265a00/0xe64d3fbf12a7ff61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ae expref: 32 pid: 4591 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746147740.057317:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794366848 00000100:00100000:2.0:1746147740.057319:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794366848 00010000:00010000:2.0:1746147740.057330:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7fe7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd122 expref: 23 pid: 20619 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746147740.057344:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8942 00000100:00100000:2.0:1746147740.057350:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1959:x1830967794366976:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147740.057363:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147740.057383:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd11b expref: 32 pid: 20619 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746147740.057394:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd11b expref: 32 pid: 20619 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746147740.057419:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9323e00/0xe64d3fbf12a7fe73 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd11b expref: 32 pid: 20619 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746147740.057423:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8943 00000100:00100000:0.0:1746147740.057430:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967794366464:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147740.057437:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147740.057439:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.057441:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.057445:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7ffae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057447:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0265a00/0xe64d3fbf12a7ff61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ae expref: 31 pid: 4591 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746147740.057453:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7ffae lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057454:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0265a00/0xe64d3fbf12a7ff61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ae expref: 31 pid: 4591 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746147740.057465:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0265a00/0xe64d3fbf12a7ff61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ae expref: 31 pid: 4591 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746147740.057473:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.057474:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.057476:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7ffa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.057478:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147740.057481:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7ffa0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057494:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147740.057518:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794366464:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 89us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147740.057524:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8943 00000100:00100000:0.0:1746147740.057538:0:7312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8944 00000100:00100000:0.0:1746147740.057543:0:7312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135810380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794366848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147740.057550:0:7312:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147740.057563:0:7312:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7fe7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd122 expref: 23 pid: 20619 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746147740.057571:0:7312:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7fe7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd122 expref: 23 pid: 20619 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746147740.057598:0:22183:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7ffae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057598:0:7312:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9323200/0xe64d3fbf12a7fe7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd122 expref: 23 pid: 20619 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746147740.057606:0:22183:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7ffae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057606:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.057608:0:7312:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.057611:0:7312:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7ffc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057616:0:7312:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7ffc3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.057624:0:22183:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7ffae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057627:0:7312:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147740.057631:0:22183:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7ffae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.057637:0:22183:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7ffae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147740.057638:0:7312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135810380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1959:x1830967794366848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 95us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147740.057643:0:7312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8944 00010000:00010000:3.0:1746147740.057644:0:22183:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02e5e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147740.057647:0:22183:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7ffae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.057654:0:22183:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7ffae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057657:0:4592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7ffc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.057663:0:22183:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7ffae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057663:0:4592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7ffc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.057670:0:22183:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e5e00/0xe64d3fbf12a7ffae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057679:0:4592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7ffc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057685:0:4592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7ffc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057689:0:4592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7ffc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057694:0:4592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e38c400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147740.057696:0:4592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7ffc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057701:0:4592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7ffc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147740.057705:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1960:x1830967794366080:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 8723us (9172us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147740.057709:0:4592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7ffc3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147740.057711:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17482 00010000:00010000:0.0:1746147740.057714:0:4592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e38c400/0xe64d3fbf12a7ffc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147740.057748:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794366208:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 8331us (8637us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147740.057753:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17485 00010000:00010000:0.0:1746147740.057771:0:20619:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7ffa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057777:0:20619:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7ffa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057795:0:20619:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7ffa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057801:0:20619:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7ffa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057810:0:20619:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7ffa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057816:0:20619:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02e4600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746147740.057818:0:20619:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7ffa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057824:0:20619:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7ffa0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057832:0:20619:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7ffa0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.057837:0:20619:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02e4600/0xe64d3fbf12a7ffa0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20619 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147740.057880:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794365568:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 9164us (9417us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147740.057911:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17480 00000100:00100000:2.0:1746147740.057971:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135813480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794366976:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 161us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147740.057979:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8942 00000100:00100000:0.0:1746147740.060468:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147740.060592:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794367232 00000100:00100000:3.0:1746147740.060602:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794367232 00000100:00100000:3.0:1746147740.060691:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12202 00000100:00100000:3.0:1746147740.060697:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+346:32766:x1830967794367232:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:3.0:1746147740.061027:0:5744:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746147740.061057:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a7fbef lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcf77 expref: 346 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.061078:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0d79c00/0xe64d3fbf12a7f8bc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafcda9 expref: 345 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.061087:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147740.061090:0:5744:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147740.061120:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7ffca lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147740.061130:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7ffca lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147740.061138:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7ffca lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000040:00080000:3.0:1746147740.061919:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3776, 88 off316664 00000004:00080000:3.0:1746147740.061929:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819236043444ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.061980:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3773, 88 off316048 00000004:00080000:3.0:1746147740.061985:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819236100183ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147740.062040:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3774, 88 off316136 00000004:00080000:3.0:1746147740.062043:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819236158743ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147740.062051:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3777, 88 off316752 00000004:00080000:3.0:1746147740.062053:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819236168741ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.062060:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3778, 88 off316840 00000004:00080000:3.0:1746147740.062062:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819236177949ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.062068:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3775, 88 off316224 00000004:00080000:3.0:1746147740.062070:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819236185864ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147740.062076:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3776, 88 off316312 00000004:00080000:3.0:1746147740.062078:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819236193909ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147740.062084:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3777, 88 off316400 00000004:00080000:3.0:1746147740.062086:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819236201751ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147740.062092:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3779, 88 off316928 00000004:00080000:3.0:1746147740.062094:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819236209686ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.062110:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3778, 88 off316488 00000004:00080000:3.0:1746147740.062112:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819236227931ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147740.062119:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3780, 88 off317016 00000004:00080000:3.0:1746147740.062250:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819236236353ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.062276:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3779, 88 off316576 00000004:00080000:3.0:1746147740.062279:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819236394774ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147740.062288:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3781, 88 off317104 00000004:00080000:3.0:1746147740.062290:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819236405666ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.062296:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3782, 88 off317192 00000004:00080000:3.0:1746147740.062298:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819236413911ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.062304:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3783, 88 off317280 00000004:00080000:3.0:1746147740.062306:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819236421628ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.062311:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3784, 88 off317368 00000004:00080000:3.0:1746147740.062313:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819236429031ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.062319:0:5744:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3780, 88 off316664 00000004:00080000:3.0:1746147740.062321:0:5744:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819236436734ns, next at 756024029964ns, rc = 0 00000001:00080000:1.0:1746147740.090244:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946246 is committed 00000001:00080000:1.0:1746147740.090263:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946229 is committed 00000001:00080000:1.0:1746147740.090273:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946244 is committed 00000001:00080000:1.0:1746147740.090280:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946237 is committed 00000004:00010000:3.0:1746147740.090328:0:5744:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880134eb3800 reply state ffff8800a666a800 transno 8589946252 ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7ffca lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000100:00100000:3.0:1746147740.090341:0:5744:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1746147740.090457:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946250 is committed 00000001:00080000:1.0:1746147740.090461:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946247 is committed 00000001:00080000:1.0:1746147740.090541:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946252 is committed 00000004:00080000:1.0:1746147740.090545:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2847 committed 00000004:00080000:1.0:1746147740.090552:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2851 committed 00000004:00080000:1.0:1746147740.090565:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2850 committed 00000004:00080000:1.0:1746147740.090567:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2849 committed 00000004:00080000:1.0:1746147740.090568:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2848 committed 00000004:00080000:1.0:1746147740.090569:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2846 committed 00000004:00080000:1.0:1746147740.090571:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2847 committed 00000004:00080000:1.0:1746147740.090572:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2845 committed 00000004:00080000:1.0:1746147740.090573:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2846 committed 00000004:00080000:1.0:1746147740.090575:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2844 committed 00000004:00080000:1.0:1746147740.090576:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2843 committed 00000004:00080000:1.0:1746147740.090588:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2842 committed 00000004:00080000:1.0:1746147740.090589:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2845 committed 00000004:00080000:1.0:1746147740.090590:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2844 committed 00000004:00080000:1.0:1746147740.090593:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2841 committed 00000004:00080000:1.0:1746147740.090594:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2840 committed 00000004:00080000:1.0:1746147740.090596:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2843 committed 00000001:00100000:1.0:1746147740.090602:0:14610:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 41587371-240a-4781-aecb-638f17200fbd 00000001:00080000:1.0:1746147740.090607:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946249 is committed 00000001:00100000:1.0:1746147740.090610:0:14610:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ddca4d47-3f3f-485c-b881-26ef94728fb1 00000001:00080000:1.0:1746147740.090614:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946248 is committed 00000020:00000080:1.0:1746147740.090627:0:14610:0:(genops.c:904:class_export_put()) final put ffff8800a8a71000/41587371-240a-4781-aecb-638f17200fbd 00000020:00000080:1.0:1746147740.090654:0:14610:0:(genops.c:904:class_export_put()) final put ffff88008c7e1800/ddca4d47-3f3f-485c-b881-26ef94728fb1 00000100:00100000:1.0:1746147740.090674:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796617344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147740.090700:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796617728:0@lo:2:osp-syn-0-0.0 00010000:00080000:3.0:1746147740.090734:0:5744:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147740.090748:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:32766:x1830967794367232:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 30047us (30287us total) trans 8589946252 rc 0/0 00000100:00100000:3.0:1746147740.090755:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12202 00000020:00000080:2.0:1746147740.090793:0:281:0:(genops.c:863:class_export_destroy()) destroying export ffff8800a8a71000/41587371-240a-4781-aecb-638f17200fbd for lustre-MDT0000 00000020:00000080:2.0:1746147740.090840:0:281:0:(genops.c:863:class_export_destroy()) destroying export ffff88008c7e1800/ddca4d47-3f3f-485c-b881-26ef94728fb1 for lustre-MDT0000 00000020:00000080:2.0:1746147740.090867:0:281:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800a8a74000 for lustre-MDT0000 00000020:00000080:2.0:1746147740.090872:0:281:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88008c7e7000 for lustre-MDT0000 00000100:00100000:1.0:1746147740.091650:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.091711:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796617856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.091740:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.091760:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091119500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796618368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.091774:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.091786:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796618880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.091799:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.091811:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746147740.091815:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796618752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.091832:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.091843:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796619264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.091855:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.091877:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796617472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.091908:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.091920:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796617984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.091934:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.091945:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796618496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.091960:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.091969:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796619008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.091980:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.091994:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746147740.091999:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796617600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.092013:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.092029:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796618112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.092042:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.092053:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796618624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.092065:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.092076:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796619136:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.092089:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.092108:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796617344 00000100:00100000:1.0:1746147740.092114:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796617344 00000100:00100000:2.0:1746147740.092147:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796617856 00000100:00100000:1.0:1746147740.092150:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796618368 00000100:00100000:1.0:1746147740.092153:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796618368 00000100:00100000:2.0:1746147740.092154:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796617856 00000100:00100000:1.0:1746147740.092164:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796618880 00000100:00100000:1.0:1746147740.092165:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796618880 00000100:00100000:1.0:1746147740.092174:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796618752 00000100:00100000:1.0:1746147740.092175:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796618752 00000100:00100000:2.0:1746147740.092177:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796619264 00000100:00100000:2.0:1746147740.092179:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796619264 00000100:00100000:1.0:1746147740.092181:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796617472 00000100:00100000:1.0:1746147740.092183:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796617472 00000100:00100000:2.0:1746147740.092188:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796617984 00000100:00100000:2.0:1746147740.092190:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796617984 00000100:00100000:1.0:1746147740.092191:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796618496 00000100:00100000:1.0:1746147740.092193:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796618496 00000100:00100000:2.0:1746147740.092197:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796619008 00000100:00100000:2.0:1746147740.092199:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796619008 00000100:00100000:1.0:1746147740.092199:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796617600 00000100:00100000:1.0:1746147740.092201:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796617600 00000100:00100000:2.0:1746147740.092206:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796618112 00000100:00100000:2.0:1746147740.092208:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796618112 00000100:00100000:1.0:1746147740.092209:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796618624 00000100:00100000:1.0:1746147740.092211:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796618624 00000100:00100000:2.0:1746147740.092215:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796619136 00000100:00100000:2.0:1746147740.092216:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796619136 00000100:00100000:1.0:1746147740.092220:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17486 00000100:00100000:1.0:1746147740.092226:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3302:x1830967796617344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147740.092229:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17487 00000100:00100000:2.0:1746147740.092234:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3302:x1830967796618368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.092414:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3302:x1830967796617344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 188us (768us total) trans 21474841765 rc 0/0 00000100:00100000:1.0:1746147740.092420:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17486 00000100:00100000:2.0:1746147740.092426:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3302:x1830967796618368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (651us total) trans 17179874541 rc 0/0 00000100:00100000:1.0:1746147740.092431:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17488 00000100:00100000:1.0:1746147740.092435:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3302:x1830967796618880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147740.092439:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17487 00000100:00100000:2.0:1746147740.092450:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17489 00000100:00100000:2.0:1746147740.092454:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3302:x1830967796617856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.092528:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3302:x1830967796618880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (728us total) trans 17179874542 rc 0/0 00000100:00100000:1.0:1746147740.092533:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17488 00000100:00100000:1.0:1746147740.092541:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17490 00000100:00100000:1.0:1746147740.092544:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3302:x1830967796618752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147740.092611:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3302:x1830967796617856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 154us (869us total) trans 21474841766 rc 0/0 00000100:00100000:2.0:1746147740.092616:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17489 00000100:00100000:1.0:1746147740.092626:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3302:x1830967796618752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (792us total) trans 17179874543 rc 0/0 00000100:00100000:2.0:1746147740.092630:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17491 00000100:00100000:2.0:1746147740.092634:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3302:x1830967796619264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147740.092720:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3302:x1830967796619264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (863us total) trans 17179874544 rc 0/0 00010000:00010000:3.0:1746147740.092747:0:3288:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7ffca lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147740.092758:0:3288:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7ffca lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147740.092759:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147740.092764:0:3288:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7ffca lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147740.092771:0:3288:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800956d5c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147740.092775:0:3288:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7ffca lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147740.092780:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796618240:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746147740.092781:0:3288:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7ffca lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147740.092799:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147740.092800:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147740.092803:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147740.092807:0:3288:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7ffca lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00010000:00010000:3.0:1746147740.092811:0:3288:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800956d5c00/0xe64d3fbf12a7ffca lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5744 initiator: MDT0 00000100:00100000:0.0:1746147740.092826:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796617728 00000100:00100000:0.0:1746147740.092829:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796617728 00000100:00100000:3.0:1746147740.092831:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796618240 00000100:00100000:3.0:1746147740.092833:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796618240 00000100:00100000:1.0:1746147740.093325:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17490 00000100:00100000:2.0:1746147740.093331:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17491 00000100:00100000:2.0:1746147740.093349:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17492 00000100:00100000:2.0:1746147740.093354:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3303:x1830967796617472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147740.093446:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796617472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (1537us total) trans 21474841767 rc 0/0 00000100:00100000:1.0:1746147740.093450:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17493 00000100:00100000:2.0:1746147740.093454:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17492 00000100:00100000:1.0:1746147740.093456:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796617984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147740.093464:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17494 00000100:00100000:2.0:1746147740.093468:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3303:x1830967796618496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147740.093538:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796618496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (1577us total) trans 17179874545 rc 0/0 00000100:00100000:2.0:1746147740.093542:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17494 00000100:00100000:2.0:1746147740.093550:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17495 00000100:00100000:1.0:1746147740.093552:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796617984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (1616us total) trans 21474841768 rc 0/0 00000100:00100000:2.0:1746147740.093554:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3303:x1830967796619008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.093558:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17493 00000100:00100000:1.0:1746147740.093569:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17496 00000100:00100000:1.0:1746147740.093574:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3303:x1830967796617600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147740.093659:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796619008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (1677us total) trans 17179874546 rc 0/0 00000100:00100000:2.0:1746147740.093664:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17495 00000100:00100000:1.0:1746147740.093666:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796617600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (1651us total) trans 21474841769 rc 0/0 00000100:00100000:1.0:1746147740.093672:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17496 00000100:00100000:2.0:1746147740.093676:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17497 00000100:00100000:2.0:1746147740.093682:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3303:x1830967796618112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.093684:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17498 00000100:00100000:1.0:1746147740.093689:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3303:x1830967796618624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147740.093766:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796618112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (1723us total) trans 21474841770 rc 0/0 00000100:00100000:2.0:1746147740.093772:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17497 00000100:00100000:1.0:1746147740.093776:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796618624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (1709us total) trans 17179874547 rc 0/0 00000100:00100000:2.0:1746147740.093781:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17499 00000100:00100000:2.0:1746147740.093786:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796619136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.093788:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17498 00000100:00080000:1.0:1746147740.093817:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746147740.093820:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147740.093843:0:3302:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874528 gen 2 00000004:00080000:1.0:1746147740.093847:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0434e00, transno 17179874412 00000004:00080000:1.0:1746147740.093855:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0434000, transno 17179874413 00000004:00080000:1.0:1746147740.093857:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0435180, transno 17179874414 00000004:00080000:1.0:1746147740.093859:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0437100, transno 17179874415 00000004:00080000:1.0:1746147740.093861:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0437800, transno 17179874416 00000004:00080000:1.0:1746147740.093863:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0436300, transno 17179874417 00000004:00080000:1.0:1746147740.093865:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0436d80, transno 17179874418 00000004:00080000:1.0:1746147740.093867:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0437480, transno 17179874419 00000004:00080000:1.0:1746147740.093869:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7ed80, transno 17179874420 00000100:00100000:2.0:1746147740.093871:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3303:x1830967796619136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (1780us total) trans 17179874548 rc 0/0 00000004:00080000:1.0:1746147740.093871:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091631180, transno 17179874424 00000004:00080000:1.0:1746147740.093873:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0227b80, transno 17179874425 00000004:00080000:1.0:1746147740.093875:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091630a80, transno 17179874426 00000100:00100000:2.0:1746147740.093876:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17499 00000004:00080000:1.0:1746147740.093877:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0227480, transno 17179874427 00000004:00080000:1.0:1746147740.093880:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0224000, transno 17179874428 00000004:00080000:1.0:1746147740.093881:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091630380, transno 17179874429 00000004:00080000:1.0:1746147740.093897:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0224380, transno 17179874430 00000004:00080000:1.0:1746147740.093898:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091631f80, transno 17179874431 00000004:00080000:1.0:1746147740.093900:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0226d80, transno 17179874432 00000004:00080000:1.0:1746147740.093903:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093cd7800, transno 17179874433 00000004:00080000:1.0:1746147740.093905:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093cd4000, transno 17179874434 00000004:00080000:1.0:1746147740.093907:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093cd6680, transno 17179874435 00000004:00080000:1.0:1746147740.093909:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093cd6d80, transno 17179874436 00000004:00080000:1.0:1746147740.093911:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093cd5c00, transno 17179874437 00000004:00080000:1.0:1746147740.093912:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093cd5880, transno 17179874438 00000004:00080000:1.0:1746147740.093915:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135810700, transno 17179874439 00000004:00080000:1.0:1746147740.093917:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093cd7480, transno 17179874440 00000004:00080000:1.0:1746147740.093919:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093cd6a00, transno 17179874441 00000004:00080000:1.0:1746147740.093921:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2138a80, transno 17179874445 00000004:00080000:1.0:1746147740.093923:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800943c7100, transno 17179874446 00000004:00080000:1.0:1746147740.093924:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2138000, transno 17179874447 00000004:00080000:1.0:1746147740.093926:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a548bb80, transno 17179874448 00000100:00100000:2.0:1746147740.093927:0:3303:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841752 gen 2 00000004:00080000:1.0:1746147740.093928:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a213a300, transno 17179874449 00000004:00080000:1.0:1746147740.093930:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7d880, transno 17179874450 00000004:00080000:2.0:1746147740.093931:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02ae300, transno 21474841650 00000004:00080000:1.0:1746147740.093932:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a213ad80, transno 17179874451 00000004:00080000:1.0:1746147740.093934:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7f100, transno 17179874452 00000004:00080000:1.0:1746147740.093937:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5e37100, transno 17179874453 00000004:00080000:2.0:1746147740.093938:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02ac380, transno 21474841651 00000004:00080000:1.0:1746147740.093939:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5e34e00, transno 17179874454 00000004:00080000:2.0:1746147740.093941:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02aea00, transno 21474841652 00000004:00080000:1.0:1746147740.093941:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5e35880, transno 17179874455 00000004:00080000:2.0:1746147740.093943:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02ad880, transno 21474841653 00000004:00080000:1.0:1746147740.093944:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8acc380, transno 17179874456 00000004:00080000:2.0:1746147740.093945:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02adc00, transno 21474841654 00000004:00080000:1.0:1746147740.093946:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2139500, transno 17179874457 00000004:00080000:2.0:1746147740.093948:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02aed80, transno 21474841655 00000004:00080000:1.0:1746147740.093948:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8acc700, transno 17179874458 00000004:00080000:2.0:1746147740.093950:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02af480, transno 21474841656 00000004:00080000:1.0:1746147740.093950:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8acce00, transno 17179874459 00000004:00080000:2.0:1746147740.093952:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02af100, transno 21474841657 00000004:00080000:1.0:1746147740.093952:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5e37480, transno 17179874460 00000004:00080000:2.0:1746147740.093954:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02ad180, transno 21474841661 00000004:00080000:1.0:1746147740.093954:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8ace300, transno 17179874461 00000004:00080000:2.0:1746147740.093956:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02af800, transno 21474841662 00000004:00080000:1.0:1746147740.093957:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8acca80, transno 17179874462 00000004:00080000:2.0:1746147740.093958:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02ae680, transno 21474841663 00000004:00080000:1.0:1746147740.093959:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d26d80, transno 17179874467 00000004:00080000:2.0:1746147740.093960:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02afb80, transno 21474841664 00000004:00080000:1.0:1746147740.093961:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d25c00, transno 17179874468 00000004:00080000:2.0:1746147740.093962:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02aca80, transno 21474841665 00000004:00080000:1.0:1746147740.093963:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d24e00, transno 17179874469 00000004:00080000:2.0:1746147740.093964:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02adf80, transno 21474841666 00000004:00080000:2.0:1746147740.093965:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02ad500, transno 21474841667 00000004:00080000:2.0:1746147740.093967:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a02ace00, transno 21474841668 00000004:00080000:1.0:1746147740.093967:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800941b0e00, transno 17179874470 00000004:00080000:2.0:1746147740.093969:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5488e00, transno 21474841669 00000004:00080000:1.0:1746147740.093969:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800943c6300, transno 17179874471 00000004:00080000:2.0:1746147740.093972:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a548b800, transno 21474841670 00000004:00080000:1.0:1746147740.093972:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800943c7800, transno 17179874472 00000004:00080000:1.0:1746147740.093974:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135811f80, transno 17179874473 00000004:00080000:2.0:1746147740.093975:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5488a80, transno 21474841671 00000004:00080000:2.0:1746147740.093977:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5489f80, transno 21474841672 00000004:00080000:1.0:1746147740.093977:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d26680, transno 17179874474 00000004:00080000:1.0:1746147740.093979:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800941b1500, transno 17179874475 00000004:00080000:2.0:1746147740.093980:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5489500, transno 21474841673 00000004:00080000:1.0:1746147740.093982:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f515f80, transno 17179874479 00000004:00080000:2.0:1746147740.093983:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5489180, transno 21474841674 00000004:00080000:1.0:1746147740.093984:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f517800, transno 17179874480 00000004:00080000:2.0:1746147740.093985:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5489880, transno 21474841675 00000004:00080000:2.0:1746147740.093987:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5488380, transno 21474841676 00000004:00080000:1.0:1746147740.093987:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f516a00, transno 17179874481 00000004:00080000:2.0:1746147740.093989:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a213bb80, transno 21474841678 00000004:00080000:1.0:1746147740.093990:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f517480, transno 17179874482 00000004:00080000:2.0:1746147740.093992:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2138700, transno 21474841679 00000004:00080000:1.0:1746147740.093993:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f515c00, transno 17179874483 00000004:00080000:2.0:1746147740.093994:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2139f80, transno 21474841680 00000004:00080000:1.0:1746147740.093995:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f516300, transno 17179874484 00000004:00080000:2.0:1746147740.093996:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a213b800, transno 21474841681 00000004:00080000:1.0:1746147740.093997:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f514380, transno 17179874485 00000004:00080000:2.0:1746147740.093999:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a213b100, transno 21474841682 00000004:00080000:1.0:1746147740.094000:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f515180, transno 17179874486 00000004:00080000:2.0:1746147740.094001:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2139c00, transno 21474841683 00000004:00080000:2.0:1746147740.094003:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2139880, transno 21474841684 00000004:00080000:1.0:1746147740.094003:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c9aad80, transno 17179874487 00000004:00080000:1.0:1746147740.094005:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d25f80, transno 17179874488 00000004:00080000:2.0:1746147740.094006:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2139180, transno 21474841685 00000004:00080000:1.0:1746147740.094007:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d25880, transno 17179874489 00000004:00080000:2.0:1746147740.094008:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013584b800, transno 21474841686 00000004:00080000:2.0:1746147740.094010:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013584a680, transno 21474841687 00000004:00080000:2.0:1746147740.094013:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ce62300, transno 21474841688 00000004:00080000:1.0:1746147740.094014:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d25500, transno 17179874490 00000004:00080000:2.0:1746147740.094015:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135849500, transno 21474841689 00000004:00080000:1.0:1746147740.094016:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d5880, transno 17179874491 00000004:00080000:2.0:1746147740.094018:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0435f80, transno 21474841690 00000004:00080000:1.0:1746147740.094019:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d24a80, transno 17179874492 00000004:00080000:2.0:1746147740.094020:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135848a80, transno 21474841691 00000004:00080000:1.0:1746147740.094021:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d25180, transno 17179874493 00000004:00080000:2.0:1746147740.094023:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0434380, transno 21474841692 00000004:00080000:1.0:1746147740.094023:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d27480, transno 17179874494 00000004:00080000:2.0:1746147740.094025:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013584aa00, transno 21474841693 00000004:00080000:1.0:1746147740.094026:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d24380, transno 17179874495 00000004:00080000:2.0:1746147740.094028:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800951d5880, transno 21474841697 00000004:00080000:1.0:1746147740.094028:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d6d80, transno 17179874496 00000004:00080000:2.0:1746147740.094030:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800951d5c00, transno 21474841698 00000004:00080000:1.0:1746147740.094030:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe43480, transno 17179874502 00000004:00080000:1.0:1746147740.094032:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe40700, transno 17179874503 00000004:00080000:2.0:1746147740.094033:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800951d4380, transno 21474841699 00000004:00080000:1.0:1746147740.094034:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe41180, transno 17179874504 00000004:00080000:2.0:1746147740.094035:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d0ddc00, transno 21474841700 00000004:00080000:1.0:1746147740.094036:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c0380, transno 17179874505 00000004:00080000:2.0:1746147740.094038:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d0df800, transno 21474841701 00000004:00080000:1.0:1746147740.094038:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe40a80, transno 17179874506 00000004:00080000:2.0:1746147740.094040:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a08ab100, transno 21474841702 00000004:00080000:1.0:1746147740.094040:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe40380, transno 17179874507 00000004:00080000:2.0:1746147740.094042:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800951d5180, transno 21474841703 00000004:00080000:1.0:1746147740.094043:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe43b80, transno 17179874508 00000004:00080000:2.0:1746147740.094045:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d0dd880, transno 21474841704 00000004:00080000:1.0:1746147740.094046:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe40e00, transno 17179874509 00000004:00080000:2.0:1746147740.094047:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c2a9f80, transno 21474841708 00000004:00080000:1.0:1746147740.094048:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172d180, transno 17179874510 00000004:00080000:2.0:1746147740.094049:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c2a9c00, transno 21474841709 00000004:00080000:1.0:1746147740.094050:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172c700, transno 17179874511 00000004:00080000:2.0:1746147740.094051:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c2a8e00, transno 21474841710 00000004:00080000:1.0:1746147740.094053:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172ea00, transno 17179874512 00000004:00080000:2.0:1746147740.094054:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c2a8000, transno 21474841711 00000004:00080000:1.0:1746147740.094055:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5e34700, transno 17179874513 00000004:00080000:2.0:1746147740.094056:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c2abb80, transno 21474841712 00000004:00080000:1.0:1746147740.094057:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172d880, transno 17179874514 00000004:00080000:2.0:1746147740.094059:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c2aaa00, transno 21474841713 00000004:00080000:1.0:1746147740.094059:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172fb80, transno 17179874515 00000004:00080000:2.0:1746147740.094061:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c2ab800, transno 21474841714 00000004:00080000:1.0:1746147740.094061:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172f100, transno 17179874516 00000004:00080000:1.0:1746147740.094063:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172d500, transno 17179874517 00000004:00080000:2.0:1746147740.094064:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c2a9500, transno 21474841715 00000004:00080000:1.0:1746147740.094066:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5e35180, transno 17179874518 00000004:00080000:2.0:1746147740.094068:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe94380, transno 21474841716 00000004:00080000:1.0:1746147740.094068:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009172e680, transno 17179874519 00000004:00080000:2.0:1746147740.094070:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe95c00, transno 21474841717 00000004:00080000:1.0:1746147740.094070:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5e36300, transno 17179874520 00000004:00080000:1.0:1746147740.094072:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0436680, transno 17179874521 00000004:00080000:2.0:1746147740.094073:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aeea680, transno 21474841718 00000004:00080000:1.0:1746147740.094075:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0437b80, transno 17179874522 00000004:00080000:2.0:1746147740.094076:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe97480, transno 21474841719 00000004:00080000:1.0:1746147740.094077:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5e34000, transno 17179874523 00000004:00080000:2.0:1746147740.094078:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135849180, transno 21474841720 00000004:00080000:2.0:1746147740.094080:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aee9180, transno 21474841721 00000004:00080000:1.0:1746147740.094080:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0435880, transno 17179874524 00000004:00080000:1.0:1746147740.094082:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0435c00, transno 17179874525 00000004:00080000:2.0:1746147740.094083:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe94a80, transno 21474841722 00000004:00080000:1.0:1746147740.094084:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5e36a00, transno 17179874526 00000004:00080000:2.0:1746147740.094085:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aeeb100, transno 21474841723 00000004:00080000:2.0:1746147740.094087:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800956b7b80, transno 21474841729 00000004:00080000:1.0:1746147740.094087:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5e36d80, transno 17179874527 00000004:00080000:1.0:1746147740.094088:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0434a80, transno 17179874528 00000004:00080000:2.0:1746147740.094090:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800956b6a00, transno 21474841730 00000004:00080000:2.0:1746147740.094092:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800956b5f80, transno 21474841731 00000100:00100000:1.0:1746147740.094094:0:3302:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012ee5b800 x1830967796618752/t17179874543(17179874543) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147756 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746147740.094096:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe42680, transno 21474841732 00000004:00080000:2.0:1746147740.094098:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800956b7100, transno 21474841733 00000004:00080000:2.0:1746147740.094100:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800956b5500, transno 21474841734 00000004:00080000:2.0:1746147740.094102:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800956b4000, transno 21474841735 00000004:00080000:1.0:1746147740.094103:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ee5b800/2, rc 0, transno 17179874543 00000004:00080000:2.0:1746147740.094105:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800956b7480, transno 21474841736 00000004:00080000:2.0:1746147740.094107:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c3b80, transno 21474841737 00000100:00100000:1.0:1746147740.094108:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796618752:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147740.094110:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c3480, transno 21474841738 00000004:00080000:2.0:1746147740.094112:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c0700, transno 21474841739 00000004:00080000:2.0:1746147740.094115:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c3800, transno 21474841740 00000004:00080000:2.0:1746147740.094117:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c1180, transno 21474841741 00000004:00080000:2.0:1746147740.094120:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093054000, transno 21474841742 00000004:00080000:1.0:1746147740.094121:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ee58a80/2, rc 0, transno 17179874544 00000004:00080000:2.0:1746147740.094122:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c2d80, transno 21474841743 00000004:00080000:2.0:1746147740.094124:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954c0a80, transno 21474841744 00000100:00100000:1.0:1746147740.094124:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796619264:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147740.094127:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093054700, transno 21474841745 00000004:00080000:2.0:1746147740.094129:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093055500, transno 21474841746 00000004:00080000:2.0:1746147740.094131:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093054a80, transno 21474841747 00000004:00080000:2.0:1746147740.094133:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093055880, transno 21474841748 00000004:00080000:1.0:1746147740.094133:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091119500/2, rc 0, transno 17179874541 00000004:00080000:2.0:1746147740.094135:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093054e00, transno 21474841749 00000100:00100000:1.0:1746147740.094136:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091119500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796618368:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147740.094138:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093055180, transno 21474841750 00000004:00080000:2.0:1746147740.094141:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093054380, transno 21474841751 00000004:00080000:1.0:1746147740.094142:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ee5aa00/2, rc 0, transno 17179874542 00000004:00080000:2.0:1746147740.094143:0:3303:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093055c00, transno 21474841752 00000100:00100000:1.0:1746147740.094144:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796618880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147740.094148:0:3303:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880134eb3480 x1830967796617600/t21474841769(21474841769) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147756 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:2.0:1746147740.094157:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134eb3480/2, rc 0, transno 21474841769 00000004:00080000:1.0:1746147740.094157:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134eb1880/2, rc 0, transno 21474841765 00000100:00100000:2.0:1746147740.094161:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796617600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.094161:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796617344:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147740.094168:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2a9180/2, rc 0, transno 21474841766 00000100:00100000:1.0:1746147740.094171:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796617856:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147740.094173:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2ab100/2, rc 0, transno 21474841770 00000100:00100000:2.0:1746147740.094176:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796618112:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147740.094187:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d24000/2, rc 0, transno 17179874547 00000100:00100000:2.0:1746147740.094190:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796618624:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147740.094197:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ee5ad80/2, rc 0, transno 17179874548 00000100:00100000:2.0:1746147740.094199:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796619136:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147740.094207:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134eb3100/2, rc 0, transno 21474841767 00000100:00100000:2.0:1746147740.094209:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796617472:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147740.094217:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2aad80/2, rc 0, transno 21474841768 00000100:00100000:2.0:1746147740.094220:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796617984:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147740.094226:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d4700/2, rc 0, transno 17179874545 00000100:00100000:2.0:1746147740.094229:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796618496:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147740.094235:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ee59500/2, rc 0, transno 17179874546 00000100:00100000:2.0:1746147740.094238:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796619008:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147740.094704:0:14588:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 2 in flight, 88 done 00000004:00080000:1.0:1746147740.094786:0:14594:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 99 done 00000100:00100000:1.0:1746147740.094828:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a21a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796619392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.094852:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147740.095013:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796619392 00000100:00100000:0.0:1746147740.095019:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796619392 00000100:00100000:0.0:1746147740.095042:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17500 00000100:00100000:0.0:1746147740.095048:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3301:x1830967796617728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.095081:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147740.095105:0:6715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17501 00000100:00100000:1.0:1746147740.095112:0:6715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+13:3302:x1830967796619392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147740.095203:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3301:x1830967796617728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 155us (2443us total) trans 21474841771 rc 0/0 00000100:00100000:0.0:1746147740.095208:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17500 00000100:00100000:1.0:1746147740.095214:0:6715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+14:3302:x1830967796619392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (360us total) trans 17179874549 rc 0/0 00000100:00100000:1.0:1746147740.095220:0:6715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17501 00000100:00100000:1.0:1746147740.095237:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794367360 00000100:00100000:1.0:1746147740.095242:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794367360 00000004:00080000:0.0:1746147740.095246:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134eb1f80/2, rc 0, transno 21474841771 00000100:00100000:0.0:1746147740.095249:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796617728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.095266:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12203 00000100:00100000:1.0:1746147740.095271:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:32766:x1830967794367360:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1746147740.095282:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147740.095296:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0267a00/0xe64d3fbf12a7ffd1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd1df expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.095337:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0267a00/0xe64d3fbf12a7ffd1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1df expref: 323 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.095349:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0267a00/0xe64d3fbf12a7ffd1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1df expref: 323 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.095364:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147740.095367:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147740.095370:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0267a00, rc 0) 00000100:00100000:1.0:1746147740.095396:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:32766:x1830967794367360:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 125us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147740.095401:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12203 00000004:00080000:1.0:1746147740.095423:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a21a3b80/2, rc 0, transno 17179874549 00000100:00100000:1.0:1746147740.095426:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a21a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796619392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147740.095690:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17502 00000100:00100000:3.0:1746147740.095698:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3301:x1830967796618240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147740.095835:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3301:x1830967796618240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (3033us total) trans 21474841772 rc 0/0 00000100:00100000:3.0:1746147740.095841:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17502 00000004:00080000:1.0:1746147740.095849:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c2aa300/2, rc 0, transno 21474841772 00000100:00100000:1.0:1746147740.095855:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796618240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147740.098550:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.098667:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794367488 00000100:00100000:2.0:1746147740.098676:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794367488 00000100:00100000:2.0:1746147740.098719:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12204 00000100:00100000:2.0:1746147740.098727:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:32766:x1830967794367488:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147740.098744:0:5744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147740.098763:0:5744:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095465000/0xe64d3fbf12a7ffd8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd1e6 expref: -99 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.098841:0:5744:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095465400/0xe64d3fbf12a7ffdf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147740.098853:0:5744:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095465400/0xe64d3fbf12a7ffdf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147740.098863:0:5744:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095465400/0xe64d3fbf12a7ffdf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00000004:00200000:2.0:1746147740.102682:0:5744:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x3bf:0x0]: returning size 9208000 00000004:00200000:2.0:1746147740.102691:0:5744:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746147740.102721:0:5744:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095465400/0xe64d3fbf12a7ffdf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5744 initiator: MDT0 00010000:00010000:2.0:1746147740.102766:0:5744:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095465000/0xe64d3fbf12a7ffd8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1e6 expref: 325 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.102783:0:5744:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095465400/0xe64d3fbf12a7ffdf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1e6 expref: 324 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.102792:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147740.102795:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147740.102798:0:5744:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095465400, rc 0) 00000100:00100000:2.0:1746147740.102863:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32766:x1830967794367488:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 4135us (4321us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147740.102870:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12204 00000100:00100000:0.0:1746147740.106396:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.106479:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794367616 00000100:00100000:2.0:1746147740.106492:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794367616 00000100:00100000:2.0:1746147740.106570:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17503 00000100:00100000:2.0:1746147740.106590:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1959:x1830967794367616:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147740.106610:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147740.106632:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a22a7000/0xe64d3fbf12a7ffe6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd1ed expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147740.106657:0:22183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 1048576, mtime: 0x6814199b, atime: 0x68141997, ctime: 0x6814199b, blocks: 0x7ff 00010000:00010000:2.0:1746147740.106677:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.106679:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.106690:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a22a7000/0xe64d3fbf12a7ffe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ed expref: 28 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147740.106706:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a22a7000/0xe64d3fbf12a7ffe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ed expref: 28 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147740.106716:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a22a7000, rc 0) 00000100:00100000:2.0:1746147740.106779:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1959:x1830967794367616:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 201us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147740.106789:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17503 00000100:00100000:0.0:1746147740.107843:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.107929:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794367744 00000100:00100000:2.0:1746147740.107936:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794367744 00000100:00100000:2.0:1746147740.107966:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17504 00000100:00100000:2.0:1746147740.107972:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+21:1960:x1830967794367744:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147740.107984:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147740.108000:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a22a7800/0xe64d3fbf12a7ffed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd1f4 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147740.108018:0:22183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 2097152, mtime: 0x6814199a, atime: 0x6814199a, ctime: 0x6814199a, blocks: 0x821 00010000:00010000:2.0:1746147740.108032:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.108033:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.108039:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a22a7800/0xe64d3fbf12a7ffed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1f4 expref: 22 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147740.108051:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a22a7800/0xe64d3fbf12a7ffed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1f4 expref: 22 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147740.108060:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a22a7800, rc 0) 00000100:00100000:2.0:1746147740.108104:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+22:1960:x1830967794367744:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 131us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147740.108110:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17504 00000100:00100000:0.0:1746147740.108951:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.108976:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.109000:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.109019:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794367872 00000100:00100000:1.0:1746147740.109022:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794368128 00000100:00100000:2.0:1746147740.109025:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794367872 00000100:00100000:1.0:1746147740.109029:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794368128 00000100:00100000:0.0:1746147740.109031:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.109052:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794368000 00000100:00100000:2.0:1746147740.109054:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794368000 00000100:00100000:1.0:1746147740.109060:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794368256 00000100:00100000:1.0:1746147740.109063:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794368256 00000100:00100000:2.0:1746147740.109085:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17505 00000100:00100000:1.0:1746147740.109093:0:10613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17506 00000100:00100000:2.0:1746147740.109094:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794367872:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:1.0:1746147740.109100:0:10613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967794368128:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147740.109104:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147740.109115:0:10613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147740.109119:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090abae00/0xe64d3fbf12a7fff4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd1fb expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147740.109129:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17507 00010000:00010000:1.0:1746147740.109132:0:10613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0266800/0xe64d3fbf12a7fffb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd209 expref: -99 pid: 10613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147740.109135:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+29:1959:x1830967794368000:12345-192.168.202.10@tcp:101:lfs.0 00002000:00010000:2.0:1746147740.109139:0:22183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 2097152, mtime: 0x6814199b, atime: 0x6814199b, ctime: 0x6814199b, blocks: 0x81f 00010000:00010000:0.0:1746147740.109142:0:8184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147740.109148:0:8184:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a80002 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd202 expref: -99 pid: 8184 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.109150:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.109152:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746147740.109152:0:10613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x458:0x0] initial LVB size: 5013696, mtime: 0x6814199b, atime: 0x6814199b, ctime: 0x6814199b, blocks: 0x168b 00010000:00010000:2.0:1746147740.109157:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090abae00/0xe64d3fbf12a7fff4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1fb expref: 24 pid: 22183 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746147740.109157:0:8184:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 2097152, mtime: 0x6814199b, atime: 0x6814199b, ctime: 0x6814199b, blocks: 0x821 00010000:00010000:2.0:1746147740.109167:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090abae00/0xe64d3fbf12a7fff4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1fb expref: 24 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147740.109167:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.109167:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.109168:0:8184:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147740.109169:0:10613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.109174:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090abae00, rc 0) 00010000:00010000:1.0:1746147740.109175:0:10613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0266800/0xe64d3fbf12a7fffb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd209 expref: 31 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147740.109187:0:10613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0266800/0xe64d3fbf12a7fffb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd209 expref: 31 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147740.109195:0:10613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0266800, rc 0) 00000100:00100000:2.0:1746147740.109205:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794367872:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 113us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147740.109210:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17505 00000100:00100000:2.0:1746147740.109222:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17508 00000100:00100000:2.0:1746147740.109227:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+23:1959:x1830967794368256:12345-192.168.202.10@tcp:101:lfs.0 00000100:00100000:1.0:1746147740.109227:0:10613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967794368128:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 128us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147740.109233:0:10613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17506 00010000:00010000:2.0:1746147740.109234:0:22183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147740.109243:0:22183:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090abb400/0xe64d3fbf12a80009 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd210 expref: -99 pid: 22183 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147740.109253:0:22183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x456:0x0] initial LVB size: 4194304, mtime: 0x6814199b, atime: 0x6814199b, ctime: 0x6814199b, blocks: 0x1029 00010000:00010000:2.0:1746147740.109260:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.109263:0:22183:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.109267:0:22183:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090abb400/0xe64d3fbf12a80009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd210 expref: 24 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147740.109275:0:22183:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090abb400/0xe64d3fbf12a80009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd210 expref: 24 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147740.109283:0:22183:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090abb400, rc 0) 00000100:00100000:2.0:1746147740.109298:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794368256:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 72us (267us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147740.109298:0:8184:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a80002 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd202 expref: 30 pid: 8184 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147740.109303:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17508 00010000:00010000:0.0:1746147740.109310:0:8184:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a80002 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd202 expref: 30 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147740.109317:0:8184:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fff8c00, rc 0) 00000100:00100000:0.0:1746147740.109334:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794368000:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 200us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147740.109340:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17507 00000100:00100000:0.0:1746147740.117035:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.117139:0:8473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794368512 00000100:00100000:2.0:1746147740.117151:0:8473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794368512 00000100:00100000:2.0:1746147740.117227:0:8473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7906 00000100:00100000:2.0:1746147740.117235:0:8473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794368512:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:2.0:1746147740.117273:0:8473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a80010 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.117287:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.117289:0:8473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.117294:0:8473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a80010 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.117306:0:8473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a80010 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147740.129287:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.132653:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147740.132847:0:31359:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794369024 00000100:00100000:3.0:1746147740.132859:0:31359:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794369024 00000100:00100000:3.0:1746147740.132953:0:31359:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7907 00000100:00100000:3.0:1746147740.132962:0:31359:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794369024:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:3.0:1746147740.132999:0:31359:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0487000/0xe64d3fbf12a80017 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.133013:0:31359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.133015:0:31359:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.133020:0:31359:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0487000/0xe64d3fbf12a80017 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.133033:0:31359:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0487000/0xe64d3fbf12a80017 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147740.136624:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.136644:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.136660:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.136685:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147740.136733:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794368896 00000100:00100000:0.0:1746147740.136739:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147740.136746:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794368896 00000100:00100000:0.0:1746147740.136761:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794369152 00000100:00100000:0.0:1746147740.136768:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794369152 00000100:00100000:1.0:1746147740.136804:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794369536 00000100:00100000:1.0:1746147740.136807:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794369536 00000100:00100000:0.0:1746147740.136810:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794369792 00000100:00100000:0.0:1746147740.136812:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794369792 00000100:00100000:1.0:1746147740.136827:0:21458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794369408 00000100:00100000:1.0:1746147740.136829:0:21458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794369408 00000100:00100000:0.0:1746147740.136830:0:31355:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794369664 00000100:00100000:0.0:1746147740.136832:0:31355:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794369664 00000100:00100000:1.0:1746147740.136852:0:21458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7908 00000100:00100000:1.0:1746147740.136859:0:21458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967794368896:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:1.0:1746147740.136916:0:21458:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0266000/0xe64d3fbf12a8001e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147740.136925:0:31355:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7909 00010000:00010000:1.0:1746147740.136928:0:21458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147740.136930:0:21458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147740.136932:0:31355:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+35:1960:x1830967794369152:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:1.0:1746147740.136934:0:21458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0266000/0xe64d3fbf12a8001e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.136945:0:21458:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0266000/0xe64d3fbf12a8001e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.136960:0:31355:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5897000/0xe64d3fbf12a80025 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.136970:0:31355:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.136972:0:31355:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.136977:0:31355:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5897000/0xe64d3fbf12a80025 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.136988:0:31355:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5897000/0xe64d3fbf12a80025 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147740.137481:0:31358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7910 00000100:00100000:1.0:1746147740.137488:0:31358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794369536:12345-192.168.202.10@tcp:3:lfs.0 00000100:00100000:2.0:1746147740.137507:0:21459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7911 00010000:00010000:1.0:1746147740.137507:0:31358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a8002c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.137514:0:31358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147740.137515:0:21459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794369792:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:1.0:1746147740.137515:0:31358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147740.137518:0:31358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a8002c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.137526:0:31358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a8002c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.137536:0:21459:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090abb800/0xe64d3fbf12a80033 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.137544:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.137545:0:21459:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.137547:0:21459:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090abb800/0xe64d3fbf12a80033 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.137555:0:21459:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090abb800/0xe64d3fbf12a80033 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147740.137629:0:31357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7912 00000100:00100000:2.0:1746147740.137636:0:31357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794369408:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:2.0:1746147740.137655:0:31357:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090abb200/0xe64d3fbf12a8003a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.137662:0:31357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.137663:0:31357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.137666:0:31357:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090abb200/0xe64d3fbf12a8003a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.137673:0:31357:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090abb200/0xe64d3fbf12a8003a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147740.137715:0:8475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7913 00000100:00100000:2.0:1746147740.137720:0:8475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794369664:12345-192.168.202.10@tcp:3:lfs.0 00010000:00010000:2.0:1746147740.137731:0:8475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a80041 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.137738:0:8475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.137739:0:8475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.137741:0:8475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a80041 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.137748:0:8475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a80041 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.158472:0:8473:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a80010 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.158486:0:8473:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a80010 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.158493:0:8473:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a80010 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.158499:0:8473:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090aba400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147740.158502:0:8473:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a80010 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.158509:0:8473:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a80010 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.158524:0:8473:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a80010 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.158529:0:8473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090aba400/0xe64d3fbf12a80010 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147740.158604:0:8473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+36:1959:x1830967794368512:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 41365us (41571us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147740.158613:0:8473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7906 00010000:00010000:3.0:1746147740.163179:0:31359:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0487000/0xe64d3fbf12a80017 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.163194:0:31359:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0487000/0xe64d3fbf12a80017 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.163199:0:31359:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0487000/0xe64d3fbf12a80017 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.163205:0:31359:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0487000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147740.163208:0:31359:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0487000/0xe64d3fbf12a80017 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.163214:0:31359:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0487000/0xe64d3fbf12a80017 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.163229:0:31359:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0487000/0xe64d3fbf12a80017 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.163234:0:31359:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0487000/0xe64d3fbf12a80017 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31359 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147740.163451:0:31359:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+34:1960:x1830967794369024:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 30446us (34153us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147740.163461:0:31359:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7907 00010000:00010000:2.0:1746147740.168037:0:31355:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5897000/0xe64d3fbf12a80025 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.168048:0:31355:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5897000/0xe64d3fbf12a80025 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.168052:0:31355:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5897000/0xe64d3fbf12a80025 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.168056:0:31355:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5897000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147740.168058:0:31355:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5897000/0xe64d3fbf12a80025 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.168062:0:31355:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5897000/0xe64d3fbf12a80025 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.168074:0:31355:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5897000/0xe64d3fbf12a80025 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.168077:0:31355:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5897000/0xe64d3fbf12a80025 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31355 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147740.168158:0:31355:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+32:1960:x1830967794369152:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 31223us (31542us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147740.168168:0:31355:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7909 00010000:00010000:1.0:1746147740.176434:0:21458:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0266000/0xe64d3fbf12a8001e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.176446:0:21458:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0266000/0xe64d3fbf12a8001e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.176453:0:21458:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0266000/0xe64d3fbf12a8001e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.176458:0:21458:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0266000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147740.176461:0:21458:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0266000/0xe64d3fbf12a8001e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.176467:0:21458:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0266000/0xe64d3fbf12a8001e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.176483:0:21458:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0266000/0xe64d3fbf12a8001e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.176489:0:21458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0266000/0xe64d3fbf12a8001e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147740.176570:0:21458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794368896:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 39707us (43923us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147740.176591:0:21458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7908 00010000:00010000:3.0:1746147740.176916:0:21459:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090abb800/0xe64d3fbf12a80033 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.176924:0:21459:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090abb800/0xe64d3fbf12a80033 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.176933:0:21459:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090abb800/0xe64d3fbf12a80033 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.176938:0:21459:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090abb800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746147740.176940:0:21459:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090abb800/0xe64d3fbf12a80033 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.176945:0:21459:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090abb800/0xe64d3fbf12a80033 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.176955:0:21459:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090abb800/0xe64d3fbf12a80033 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.176959:0:21459:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090abb800/0xe64d3fbf12a80033 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21459 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147740.177435:0:21459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794369792:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 39920us (40771us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147740.177442:0:21459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7911 00010000:00010000:1.0:1746147740.184469:0:31358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a8002c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.184483:0:31358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a8002c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.184491:0:31358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a8002c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.184497:0:31358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0267400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746147740.184501:0:31358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a8002c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.184508:0:31358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a8002c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.184525:0:31358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a8002c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.184535:0:31358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0267400/0xe64d3fbf12a8002c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31358 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147740.184771:0:31358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+28:1960:x1830967794369536:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 47278us (48120us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147740.184783:0:31358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7910 00010000:00010000:2.0:1746147740.194018:0:31357:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090abb200/0xe64d3fbf12a8003a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.194034:0:31357:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090abb200/0xe64d3fbf12a8003a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.194042:0:31357:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090abb200/0xe64d3fbf12a8003a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.194048:0:31357:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090abb200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147740.194051:0:31357:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090abb200/0xe64d3fbf12a8003a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.194057:0:31357:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090abb200/0xe64d3fbf12a8003a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.194072:0:31357:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090abb200/0xe64d3fbf12a8003a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.194077:0:31357:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090abb200/0xe64d3fbf12a8003a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31357 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147740.194175:0:31357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794369408:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 56534us (57484us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147740.194186:0:31357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7912 00010000:00010000:2.0:1746147740.195041:0:8475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a80041 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.195049:0:8475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a80041 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.195055:0:8475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a80041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.195059:0:8475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090abb600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746147740.195062:0:8475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a80041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.195067:0:8475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a80041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.195076:0:8475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a80041 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.195081:0:8475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090abb600/0xe64d3fbf12a80041 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147740.195730:0:8475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1960:x1830967794369664:12345-192.168.202.10@tcp:3:lfs.0 Request processed in 58006us (58987us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147740.195738:0:8475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7913 00000100:00100000:0.0:1746147740.203648:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.203739:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794370176 00000100:00100000:2.0:1746147740.203747:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794370176 00000100:00100000:2.0:1746147740.204082:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12205 00000100:00100000:2.0:1746147740.204091:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32766:x1830967794370176:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:2.0:1746147740.204479:0:14546:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147740.204503:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095465400/0xe64d3fbf12a7ffdf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1e6 expref: 324 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.204810:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147740.204815:0:14546:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147740.204846:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051200/0xe64d3fbf12a80048 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147740.204855:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051200/0xe64d3fbf12a80048 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147740.204863:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051200/0xe64d3fbf12a80048 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000004:00010000:2.0:1746147740.205614:0:14546:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094691c00 reply state ffff8800a00eb000 transno 8589946253 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051200/0xe64d3fbf12a80048 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00000100:00100000:2.0:1746147740.205620:0:14546:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147740.205689:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:32766:x1830967794370176:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 1598us (2049us total) trans 8589946253 rc 0/0 00000100:00100000:2.0:1746147740.205694:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12205 00010000:00010000:1.0:1746147740.207927:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051200/0xe64d3fbf12a80048 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147740.207938:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051200/0xe64d3fbf12a80048 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147740.207944:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051200/0xe64d3fbf12a80048 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147740.207949:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a1051200 already unused, calling callback (ffffffffa1369690) 00010000:00010000:1.0:1746147740.207952:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051200/0xe64d3fbf12a80048 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147740.207959:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051200/0xe64d3fbf12a80048 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147740.207972:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:1.0:1746147740.207975:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147740.207978:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051200/0xe64d3fbf12a80048 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:1.0:1746147740.207983:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051200/0xe64d3fbf12a80048 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00000100:00100000:0.0:1746147740.210381:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147740.210589:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794370304 00000100:00100000:3.0:1746147740.210597:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794370304 00000100:00100000:3.0:1746147740.210634:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17509 00000100:00100000:3.0:1746147740.210640:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32766:x1830967794370304:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147740.210654:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147740.210668:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00ffc00/0xe64d3fbf12a8004f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd217 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.210698:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a22a7000/0xe64d3fbf12a7ffe6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ed expref: 31 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147740.210704:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.210706:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.210709:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00ffc00/0xe64d3fbf12a8004f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd217 expref: 31 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.210735:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a22a7000/0xe64d3fbf12a7ffe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ed expref: 31 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147740.210745:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a22a7000/0xe64d3fbf12a7ffe6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ed expref: 31 pid: 22183 timeout: 919 lvb_type: 1 00000100:00100000:3.0:1746147740.210754:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796619520:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147740.210880:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147740.212304:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796619520:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147740.212325:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00ffc00/0xe64d3fbf12a8004f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd217 expref: 31 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.212337:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00ffc00, rc 0) 00000100:00100000:3.0:1746147740.212364:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:32766:x1830967794370304:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1724us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147740.212370:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17509 00000100:00100000:0.0:1746147740.213180:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.213253:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794370432 00000100:00100000:2.0:1746147740.213259:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794370432 00010000:00010000:2.0:1746147740.213280:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a22a7000/0xe64d3fbf12a7ffe6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ed expref: 31 pid: 22183 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746147740.213308:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8945 00000100:00100000:2.0:1746147740.213313:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967794370432:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147740.213322:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147740.213340:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a22a7000/0xe64d3fbf12a7ffe6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ed expref: 31 pid: 22183 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746147740.213349:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a22a7000/0xe64d3fbf12a7ffe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ed expref: 31 pid: 22183 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746147740.213373:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a22a7000/0xe64d3fbf12a7ffe6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1ed expref: 31 pid: 22183 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746147740.213388:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.213389:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.213395:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00ffc00/0xe64d3fbf12a8004f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd217 expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.213402:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00ffc00/0xe64d3fbf12a8004f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd217 expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.213426:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00ffc00/0xe64d3fbf12a8004f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd217 expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147740.213436:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796619648:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147740.213488:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca90240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147740.215152:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796619648:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147740.215168:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147740.215195:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794370432:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1881us (2016us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147740.215204:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8945 00000100:00100000:0.0:1746147740.216235:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147740.217721:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794370560 00000100:00100000:3.0:1746147740.217729:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794370560 00000100:00100000:3.0:1746147740.217764:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17510 00000100:00100000:3.0:1746147740.217770:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32766:x1830967794370560:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147740.217784:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147740.217799:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffa00/0xe64d3fbf12a80056 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd21e expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.217822:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a22a7800/0xe64d3fbf12a7ffed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1f4 expref: 25 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147740.217828:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.217829:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.217832:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffa00/0xe64d3fbf12a80056 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd21e expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.217857:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a22a7800/0xe64d3fbf12a7ffed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1f4 expref: 25 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147740.217867:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a22a7800/0xe64d3fbf12a7ffed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1f4 expref: 25 pid: 22183 timeout: 919 lvb_type: 1 00000100:00100000:3.0:1746147740.217878:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796619776:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147740.217970:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147740.220829:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147740.220939:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796619776:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147740.220966:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffa00/0xe64d3fbf12a80056 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd21e expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.220985:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00ffa00, rc 0) 00000100:00100000:3.0:1746147740.221021:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:32766:x1830967794370560:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 3251us (4787us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147740.221029:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17510 00000100:00100000:2.0:1746147740.221312:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794370688 00000100:00100000:2.0:1746147740.221318:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794370688 00010000:00010000:2.0:1746147740.221340:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a22a7800/0xe64d3fbf12a7ffed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1f4 expref: 25 pid: 22183 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746147740.221369:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8946 00000100:00100000:2.0:1746147740.221375:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794370688:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147740.221385:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147740.221404:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a22a7800/0xe64d3fbf12a7ffed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1f4 expref: 25 pid: 22183 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746147740.221413:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a22a7800/0xe64d3fbf12a7ffed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1f4 expref: 25 pid: 22183 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746147740.221429:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a22a7800/0xe64d3fbf12a7ffed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x454:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1f4 expref: 25 pid: 22183 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746147740.221441:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.221443:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.221448:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffa00/0xe64d3fbf12a80056 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd21e expref: 24 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.221455:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffa00/0xe64d3fbf12a80056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd21e expref: 24 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.221482:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00ffa00/0xe64d3fbf12a80056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd21e expref: 24 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147740.221493:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796619904:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147740.221538:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca90240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147740.224962:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.225028:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796619904:192.168.202.10@tcp:105: 00010000:00010000:0.0:1746147740.225050:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147740.225124:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794370688:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3747us (4299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147740.225134:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8946 00000100:00100000:3.0:1746147740.225157:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794370816 00000100:00100000:3.0:1746147740.225163:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794370816 00000100:00100000:3.0:1746147740.225192:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17511 00000100:00100000:3.0:1746147740.225198:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32766:x1830967794370816:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147740.225212:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147740.225262:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe400/0xe64d3fbf12a8005d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd225 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.225287:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090abae00/0xe64d3fbf12a7fff4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1fb expref: 25 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147740.225294:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.225296:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.225298:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe400/0xe64d3fbf12a8005d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd225 expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.225320:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090abae00/0xe64d3fbf12a7fff4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1fb expref: 25 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147740.225329:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090abae00/0xe64d3fbf12a7fff4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1fb expref: 25 pid: 22183 timeout: 919 lvb_type: 1 00000100:00100000:3.0:1746147740.225343:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796620032:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147740.225537:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147740.226981:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147740.227046:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794370944 00000100:00100000:1.0:1746147740.227051:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794370944 00010000:00010000:1.0:1746147740.227070:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090abae00/0xe64d3fbf12a7fff4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1fb expref: 26 pid: 22183 timeout: 919 lvb_type: 1 00000100:00100000:1.0:1746147740.227089:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8947 00000100:00100000:1.0:1746147740.227095:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a237bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794370944:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147740.227104:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147740.227124:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090abae00/0xe64d3fbf12a7fff4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1fb expref: 26 pid: 22183 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746147740.227132:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090abae00/0xe64d3fbf12a7fff4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1fb expref: 26 pid: 22183 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746147740.227147:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147740.227149:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147740.227153:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe400/0xe64d3fbf12a8005d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd225 expref: 26 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.227159:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe400/0xe64d3fbf12a8005d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd225 expref: 26 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.227170:0:4591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090abae00/0xe64d3fbf12a7fff4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x455:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1fb expref: 26 pid: 22183 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746147740.227180:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe400/0xe64d3fbf12a8005d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd225 expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147740.227184:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796620032:192.168.202.10@tcp:104: 00000100:00100000:1.0:1746147740.227188:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796620160:192.168.202.10@tcp:105: 00010000:00010000:3.0:1746147740.227199:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00fe400/0xe64d3fbf12a8005d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd225 expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.227207:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00fe400, rc 0) 00000100:00100000:3.0:1746147740.227234:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:32766:x1830967794370816:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 2037us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147740.227240:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17511 00000100:00100000:1.0:1746147740.227242:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147740.228281:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796620160:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147740.228293:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147740.228314:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1746147740.228321:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a237bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794370944:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1226us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147740.228328:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8947 00000100:00100000:3.0:1746147740.228525:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794371072 00000100:00100000:3.0:1746147740.228529:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794371072 00000100:00100000:3.0:1746147740.228560:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17512 00000100:00100000:3.0:1746147740.228565:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32766:x1830967794371072:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147740.228574:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147740.228594:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00ff600/0xe64d3fbf12a80064 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd22c expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.228611:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a80002 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd202 expref: 31 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147740.228621:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.228623:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.228625:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00ff600/0xe64d3fbf12a80064 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd22c expref: 31 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.228639:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a80002 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd202 expref: 31 pid: 8184 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147740.228649:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a80002 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd202 expref: 31 pid: 8184 timeout: 919 lvb_type: 1 00000100:00100000:3.0:1746147740.228657:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796620288:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147740.228710:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147740.230006:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796620288:192.168.202.10@tcp:104: 00000100:00100000:0.0:1746147740.230012:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:3.0:1746147740.230022:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00ff600/0xe64d3fbf12a80064 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd22c expref: 31 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.230032:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00ff600, rc 0) 00000100:00100000:3.0:1746147740.230054:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:32766:x1830967794371072:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1489us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147740.230064:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17512 00000100:00100000:1.0:1746147740.230079:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794371200 00000100:00100000:1.0:1746147740.230083:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794371200 00010000:00010000:1.0:1746147740.230097:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a80002 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd202 expref: 31 pid: 8184 timeout: 919 lvb_type: 1 00000100:00100000:1.0:1746147740.230124:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8948 00000100:00100000:1.0:1746147740.230170:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794371200:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147740.230178:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147740.230195:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a80002 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd202 expref: 31 pid: 8184 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746147740.230203:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a80002 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd202 expref: 31 pid: 8184 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746147740.230218:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fff8c00/0xe64d3fbf12a80002 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x457:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd202 expref: 31 pid: 8184 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746147740.230231:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147740.230233:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147740.230238:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00ff600/0xe64d3fbf12a80064 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd22c expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.230248:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00ff600/0xe64d3fbf12a80064 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd22c expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147740.230267:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00ff600/0xe64d3fbf12a80064 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd22c expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147740.230276:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cd7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796620416:192.168.202.10@tcp:105: 00000100:00100000:1.0:1746147740.230316:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2201cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147740.233819:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cd7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796620416:192.168.202.10@tcp:105: 00010000:00010000:1.0:1746147740.233847:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147740.233911:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1960:x1830967794371200:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3780us (3897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147740.233920:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8948 00000100:00100000:0.0:1746147740.234869:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147740.234980:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794371328 00000100:00100000:3.0:1746147740.234987:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794371328 00000100:00100000:3.0:1746147740.235016:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17513 00000100:00100000:3.0:1746147740.235021:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:32766:x1830967794371328:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147740.235034:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147740.235048:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a8006b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd233 expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.235070:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0266800/0xe64d3fbf12a7fffb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd209 expref: 31 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147740.235077:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.235078:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.235081:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a8006b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd233 expref: 31 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.235105:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0266800/0xe64d3fbf12a7fffb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd209 expref: 31 pid: 10613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147740.235115:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0266800/0xe64d3fbf12a7fffb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd209 expref: 31 pid: 10613 timeout: 919 lvb_type: 1 00000100:00100000:3.0:1746147740.235124:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796620544:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147740.235821:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147740.238712:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4591:1830967796620544:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147740.238738:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a8006b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd233 expref: 31 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.238753:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00fe000, rc 0) 00000100:00100000:3.0:1746147740.238829:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:32766:x1830967794371328:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 3806us (3961us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147740.238838:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17513 00000100:00100000:1.0:1746147740.239677:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.239747:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794371456 00000100:00100000:0.0:1746147740.239755:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794371456 00010000:00010000:0.0:1746147740.239779:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0266800/0xe64d3fbf12a7fffb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd209 expref: 31 pid: 10613 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746147740.239827:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8949 00000100:00100000:0.0:1746147740.239833:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967794371456:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147740.239843:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147740.239864:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0266800/0xe64d3fbf12a7fffb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd209 expref: 31 pid: 10613 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746147740.239874:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0266800/0xe64d3fbf12a7fffb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd209 expref: 31 pid: 10613 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746147740.239910:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0266800/0xe64d3fbf12a7fffb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x458:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd209 expref: 31 pid: 10613 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746147740.239923:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.239925:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147740.239929:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a8006b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd233 expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.239936:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a8006b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd233 expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147740.239962:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00fe000/0xe64d3fbf12a8006b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd233 expref: 30 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147740.240266:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009433a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796620672:192.168.202.10@tcp:105: 00000100:00100000:0.0:1746147740.240389:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c980e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147740.242671:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009433a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20557:1830967796620672:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147740.242689:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147740.242735:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794371456:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2901us (3057us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147740.242744:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8949 00000100:00100000:0.0:1746147740.243595:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147740.243730:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794371584 00000100:00100000:3.0:1746147740.243737:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794371584 00000100:00100000:3.0:1746147740.243782:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17514 00000100:00100000:3.0:1746147740.243788:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:32766:x1830967794371584:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1746147740.243802:0:4591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147740.243816:0:4591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00fec00/0xe64d3fbf12a80072 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd23a expref: -99 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.243840:0:4591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090abb400/0xe64d3fbf12a80009 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd210 expref: 25 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147740.243846:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.243848:0:4591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147740.243850:0:4591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00fec00/0xe64d3fbf12a80072 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd23a expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.243873:0:4591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090abb400/0xe64d3fbf12a80009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd210 expref: 25 pid: 22183 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147740.243897:0:4591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090abb400/0xe64d3fbf12a80009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd210 expref: 25 pid: 22183 timeout: 919 lvb_type: 1 00000100:00100000:3.0:1746147740.243908:0:4591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796620800:192.168.202.10@tcp:104: 00000100:00100000:3.0:1746147740.244025:0:4591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a70f780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147740.245597:0:4591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4591:1830967796620800:192.168.202.10@tcp:104: 00010000:00010000:3.0:1746147740.245617:0:4591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00fec00/0xe64d3fbf12a80072 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd23a expref: 25 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147740.245627:0:4591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00fec00, rc 0) 00000100:00100000:3.0:1746147740.245656:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:32766:x1830967794371584:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1868us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147740.245663:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17514 00000100:00100000:0.0:1746147740.247706:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.247869:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794371712 00000100:00100000:2.0:1746147740.247876:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794371712 00010000:00010000:2.0:1746147740.247924:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090abb400/0xe64d3fbf12a80009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd210 expref: 25 pid: 22183 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746147740.247946:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8950 00000100:00100000:2.0:1746147740.247953:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794371712:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147740.247965:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147740.247983:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090abb400/0xe64d3fbf12a80009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd210 expref: 25 pid: 22183 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746147740.247995:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090abb400/0xe64d3fbf12a80009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd210 expref: 25 pid: 22183 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746147740.248019:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090abb400/0xe64d3fbf12a80009 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x456:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd210 expref: 25 pid: 22183 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746147740.248048:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.248050:0:20557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147740.248055:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00fec00/0xe64d3fbf12a80072 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd23a expref: 24 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.248062:0:20557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00fec00/0xe64d3fbf12a80072 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd23a expref: 24 pid: 4591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.248090:0:20557:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00fec00/0xe64d3fbf12a80072 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd23a expref: 24 pid: 4591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147740.248099:0:20557:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796620928:192.168.202.10@tcp:105: 00000100:00100000:2.0:1746147740.248149:0:20557:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca90240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147740.252472:0:20557:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20557:1830967796620928:192.168.202.10@tcp:105: 00010000:00010000:2.0:1746147740.252496:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147740.252548:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+24:1959:x1830967794371712:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4594us (4851us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147740.252559:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8950 00000100:00100000:0.0:1746147740.253940:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.254167:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147740.254168:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794371840 00000100:00100000:3.0:1746147740.254178:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794371840 00000100:00100000:0.0:1746147740.254198:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1746147740.254231:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794372096 00000100:00100000:0.0:1746147740.254231:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794371968 00000100:00100000:3.0:1746147740.254234:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794372096 00000100:00100000:0.0:1746147740.254234:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794371968 00000100:00100000:3.0:1746147740.254250:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17515 00000100:00100000:0.0:1746147740.254254:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17516 00000100:00100000:3.0:1746147740.254256:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+30:1959:x1830967794371840:12345-192.168.202.10@tcp:2:lfs.0 00000100:00100000:0.0:1746147740.254259:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+25:1959:x1830967794372096:12345-192.168.202.10@tcp:2:lfs.0 00000100:00100000:2.0:1746147740.254397:0:8184:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17517 00000100:00100000:2.0:1746147740.254409:0:8184:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794371968:12345-192.168.202.10@tcp:2:lfs.0 00002000:00010000:3.0:1746147740.254424:0:4591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147740.254424:0:21480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147740.254427:0:4591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147739 -> 1746147739 00002000:00010000:0.0:1746147740.254427:0:21480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147739 -> 1746147739 00002000:00010000:3.0:1746147740.254429:0:4591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147735 -> 1746147739 00002000:00010000:0.0:1746147740.254429:0:21480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147739 -> 1746147739 00002000:00010000:3.0:1746147740.254431:0:4591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147739 -> 1746147741 00002000:00010000:0.0:1746147740.254431:0:21480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147739 -> 1746147741 00002000:00010000:3.0:1746147740.254432:0:4591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 2047 -> 2047 00002000:00010000:0.0:1746147740.254432:0:21480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746147740.254462:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1959:x1830967794371840:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 207us (526us total) trans 17179874550 rc 0/0 00000100:00100000:0.0:1746147740.254462:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794372096:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 203us (263us total) trans 21474841773 rc 0/0 00000100:00100000:0.0:1746147740.254468:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17516 00000100:00100000:3.0:1746147740.254470:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17515 00002000:00010000:2.0:1746147740.254489:0:8184:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147740.254492:0:8184:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147738 -> 1746147739 00002000:00010000:2.0:1746147740.254494:0:8184:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147738 -> 1746147739 00000100:00100000:0.0:1746147740.254494:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00002000:00010000:2.0:1746147740.254496:0:8184:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147738 -> 1746147741 00002000:00010000:2.0:1746147740.254498:0:8184:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147740.254511:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794372352 00000100:00100000:3.0:1746147740.254514:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794372352 00000100:00100000:2.0:1746147740.254516:0:8184:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1959:x1830967794371968:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 108us (349us total) trans 21474841774 rc 0/0 00000100:00100000:2.0:1746147740.254522:0:8184:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17517 00000100:00100000:3.0:1746147740.254529:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17518 00000100:00100000:3.0:1746147740.254533:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+31:1960:x1830967794372352:12345-192.168.202.10@tcp:2:lfs.0 00000100:00100000:0.0:1746147740.254540:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.254559:0:22183:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794372224 00000100:00100000:2.0:1746147740.254562:0:22183:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794372224 00000100:00100000:0.0:1746147740.254589:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.254593:0:22183:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17519 00000100:00100000:2.0:1746147740.254601:0:22183:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009433a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794372224:12345-192.168.202.10@tcp:2:lfs.0 00002000:00010000:3.0:1746147740.254611:0:21480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:3.0:1746147740.254614:0:21480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147739 -> 1746147739 00002000:00010000:3.0:1746147740.254615:0:21480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147739 -> 1746147739 00002000:00010000:3.0:1746147740.254617:0:21480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147739 -> 1746147741 00002000:00010000:3.0:1746147740.254619:0:21480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5771 -> 5771 00000100:00100000:3.0:1746147740.254637:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794372352:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 104us (143us total) trans 17179874551 rc 0/0 00000100:00100000:3.0:1746147740.254643:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17518 00000100:00100000:3.0:1746147740.254650:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794372480 00000100:00100000:3.0:1746147740.254652:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794372480 00002000:00010000:2.0:1746147740.254665:0:22183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746147740.254666:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17520 00002000:00010000:2.0:1746147740.254668:0:22183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147739 -> 1746147739 00000100:00100000:3.0:1746147740.254670:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+26:1960:x1830967794372480:12345-192.168.202.10@tcp:2:lfs.0 00002000:00010000:2.0:1746147740.254670:0:22183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147739 -> 1746147739 00002000:00010000:2.0:1746147740.254672:0:22183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147739 -> 1746147741 00002000:00010000:2.0:1746147740.254673:0:22183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746147740.254689:0:22183:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009433a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+33:1960:x1830967794372224:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 91us (148us total) trans 17179874552 rc 0/0 00000100:00100000:2.0:1746147740.254694:0:22183:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17519 00002000:00010000:3.0:1746147740.254727:0:21480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147740.254729:0:21480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147739 -> 1746147739 00002000:00010000:3.0:1746147740.254731:0:21480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147739 -> 1746147739 00002000:00010000:3.0:1746147740.254733:0:21480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147739 -> 1746147741 00002000:00010000:3.0:1746147740.254734:0:21480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746147740.254751:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+27:1960:x1830967794372480:12345-192.168.202.10@tcp:2:lfs.0 Request processed in 80us (173us total) trans 21474841775 rc 0/0 00000100:00100000:3.0:1746147740.254756:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17520 00000100:00100000:0.0:1746147740.257604:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.257969:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794372736 00000100:00100000:2.0:1746147740.257977:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794372736 00000100:00100000:2.0:1746147740.258035:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12206 00000100:00100000:2.0:1746147740.258042:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32766:x1830967794372736:12345-192.168.202.10@tcp:55:lfs.0 00010000:00010000:2.0:1746147740.258109:0:14546:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051c00/0xe64d3fbf12a80079 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147740.258122:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051c00/0xe64d3fbf12a80079 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147740.258133:0:14546:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051c00/0xe64d3fbf12a80079 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147740.258157:0:14546:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051c00/0xe64d3fbf12a80079 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147740.258162:0:14546:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051c00/0xe64d3fbf12a80079 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147740.258168:0:14546:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051c00/0xe64d3fbf12a80079 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147740.258173:0:14546:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a1051c00 already unused, calling callback (ffffffffa1369690) 00010000:00010000:2.0:1746147740.258176:0:14546:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051c00/0xe64d3fbf12a80079 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147740.258181:0:14546:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051c00/0xe64d3fbf12a80079 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147740.258190:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147740.258193:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1746147740.258197:0:14546:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051c00/0xe64d3fbf12a80079 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00010000:00010000:2.0:1746147740.258201:0:14546:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051c00/0xe64d3fbf12a80079 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14546 initiator: MDT0 00000100:00100000:2.0:1746147740.259502:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32766:x1830967794372736:12345-192.168.202.10@tcp:55:lfs.0 Request processed in 1457us (1900us total) trans 0 rc -22/-22 00000100:00100000:2.0:1746147740.259510:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12206 00000100:00100000:0.0:1746147740.261771:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.261865:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794372992 00000100:00100000:2.0:1746147740.261873:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794372992 00000100:00100000:2.0:1746147740.261938:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5113 00000100:00100000:2.0:1746147740.261945:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:32766:x1830967794372992:12345-192.168.202.10@tcp:35:lfs.0 00000004:00010000:2.0:1746147740.261990:0:21583:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x3bf:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0234a00/0xe64d3fbf12a7ff92 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d8 expref: 324 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.262028:0:21583:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21583 initiator: MDT0 00010000:00010000:2.0:1746147740.262038:0:21583:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0267a00/0xe64d3fbf12a7ffd1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1df expref: 324 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.262044:0:21583:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21583 initiator: MDT0 00010000:00010000:2.0:1746147740.262070:0:21583:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0267a00/0xe64d3fbf12a7ffd1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1df expref: 324 pid: 5744 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.262080:0:21583:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0267a00/0xe64d3fbf12a7ffd1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1df expref: 324 pid: 5744 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746147740.262090:0:21583:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:21583:1830967796621056:192.168.202.10@tcp:104: 00000100:00100000:2.0:1746147740.263684:0:21583:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca90240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147740.264817:0:21583:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:21583:1830967796621056:192.168.202.10@tcp:104: 00010000:00010000:2.0:1746147740.264838:0:21583:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21583 initiator: MDT0 00000100:00100000:0.0:1746147740.265787:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.266167:0:20557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794373120 00000100:00100000:2.0:1746147740.266176:0:20557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794373120 00010000:00010000:2.0:1746147740.266202:0:20557:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0267a00/0xe64d3fbf12a7ffd1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1df expref: 325 pid: 5744 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746147740.266406:0:20557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8951 00000100:00100000:2.0:1746147740.266414:0:20557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0224380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+325:1960:x1830967794373120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147740.266426:0:20557:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147740.266431:0:20557:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0267a00/0xe64d3fbf12a7ffd1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1df expref: 325 pid: 5744 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746147740.266440:0:20557:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0267a00/0xe64d3fbf12a7ffd1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1df expref: 325 pid: 5744 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746147740.266457:0:20557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0267a00/0xe64d3fbf12a7ffd1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1df expref: 325 pid: 5744 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746147740.267055:0:20557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:2.0:1746147740.267062:0:20557:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21583 initiator: MDT0 00010000:00010000:2.0:1746147740.267069:0:20557:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21583 initiator: MDT0 00010000:00010000:2.0:1746147740.267075:0:20557:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21583 initiator: MDT0 00010000:00010000:2.0:1746147740.267389:0:20557:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147740.267436:0:20557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+324:1960:x1830967794373120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1022us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147740.267443:0:20557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8951 00010000:00010000:3.0:1746147740.267712:0:21583:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21583 initiator: MDT0 00010000:00010000:3.0:1746147740.267723:0:21583:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21583 initiator: MDT0 00000040:00080000:3.0:1746147740.268265:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3785, 88 off317456 00000004:00080000:3.0:1746147740.268271:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819442385896ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.268312:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3781, 88 off316752 00000004:00080000:3.0:1746147740.268317:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819442432540ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147740.268327:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3782, 88 off316840 00000004:00080000:3.0:1746147740.268330:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819442445555ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147740.268345:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3786, 88 off317544 00000004:00080000:3.0:1746147740.268348:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819442463467ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.268355:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3787, 88 off317632 00000004:00080000:3.0:1746147740.268358:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819442473654ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.268365:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3783, 88 off316928 00000004:00080000:3.0:1746147740.268368:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819442483380ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147740.268374:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3784, 88 off317016 00000004:00080000:3.0:1746147740.268376:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819442491339ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147740.269504:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3785, 88 off317104 00000004:00080000:3.0:1746147740.269509:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819443624279ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147740.269520:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3788, 88 off317720 00000004:00080000:3.0:1746147740.269522:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819443637504ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.269598:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3786, 88 off317192 00000004:00080000:3.0:1746147740.269602:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819443717893ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147740.269610:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3789, 88 off317808 00000004:00080000:3.0:1746147740.269613:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819443728113ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.269619:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3787, 88 off317280 00000004:00080000:3.0:1746147740.269621:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819443736803ns, next at 756024029964ns, rc = 0 00000040:00080000:3.0:1746147740.269626:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3790, 88 off317896 00000004:00080000:3.0:1746147740.269628:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819443744029ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.269635:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3791, 88 off317984 00000004:00080000:3.0:1746147740.269637:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819443752764ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.269643:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3792, 88 off318072 00000004:00080000:3.0:1746147740.269646:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819443761158ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.269652:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3793, 88 off318160 00000004:00080000:3.0:1746147740.269655:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 819443770349ns, next at 756039729591ns, rc = 0 00000040:00080000:3.0:1746147740.269661:0:21583:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3788, 88 off317368 00000004:00080000:3.0:1746147740.269663:0:21583:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819443778668ns, next at 756024029964ns, rc = 0 00000001:00080000:1.0:1746147740.303318:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946253 is committed 00000001:00080000:1.0:1746147740.303328:0:14610:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589946254 is committed 00000004:00080000:1.0:1746147740.303332:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2855 committed 00000004:00080000:1.0:1746147740.303338:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2860 committed 00000004:00080000:1.0:1746147740.303344:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2859 committed 00000004:00080000:1.0:1746147740.303345:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2858 committed 00000004:00080000:1.0:1746147740.303347:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2857 committed 00000004:00080000:1.0:1746147740.303348:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2854 committed 00000004:00080000:1.0:1746147740.303350:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2856 committed 00000004:00080000:1.0:1746147740.303351:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2853 committed 00000004:00080000:1.0:1746147740.303353:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2855 committed 00000004:00080000:1.0:1746147740.303354:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2852 committed 00000004:00080000:1.0:1746147740.303356:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2851 committed 00000004:00080000:1.0:1746147740.303358:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2850 committed 00000004:00080000:1.0:1746147740.303359:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2854 committed 00000004:00080000:1.0:1746147740.303360:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2853 committed 00000004:00080000:1.0:1746147740.303362:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2849 committed 00000004:00080000:1.0:1746147740.303363:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2848 committed 00000004:00080000:1.0:1746147740.303365:0:14610:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2852 committed 00000100:00100000:2.0:1746147740.303530:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796621184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147740.303598:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147740.303635:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a548bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796621696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147740.303650:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147740.303664:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746147740.303668:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796621312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147740.303679:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.303712:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796621440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.303732:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796621568:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746147740.303912:0:21583:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a0224000 reply state ffff880129e83000 transno 8589946254 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21583 initiator: MDT0 00000100:00100000:3.0:1746147740.303922:0:21583:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746147740.303929:0:21583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147740.303932:0:21583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147740.303938:0:21583:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0234a00/0xe64d3fbf12a7ff92 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3bf:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd1d8 expref: 322 pid: 5744 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746147740.304007:0:21583:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147740.304017:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:32766:x1830967794372992:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 42072us (42251us total) trans 8589946254 rc 0/0 00000100:00100000:3.0:1746147740.304025:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5113 00010000:00010000:3.0:1746147740.304048:0:3288:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21583 initiator: MDT0 00010000:00010000:3.0:1746147740.304055:0:3288:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21583 initiator: MDT0 00010000:00010000:3.0:1746147740.304061:0:3288:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21583 initiator: MDT0 00010000:00010000:3.0:1746147740.304065:0:3288:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a1051400 already unused, calling callback (ffffffffa1369690) 00010000:00010000:3.0:1746147740.304069:0:3288:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21583 initiator: MDT0 00010000:00010000:3.0:1746147740.304075:0:3288:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21583 initiator: MDT0 00010000:00010000:3.0:1746147740.304086:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880093790e00) 00010000:00010000:3.0:1746147740.304089:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147740.304091:0:3288:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21583 initiator: MDT0 00010000:00010000:3.0:1746147740.304095:0:3288:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a1051400/0xe64d3fbf12a80080 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21583 initiator: MDT0 00000100:00100000:1.0:1746147740.304154:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796622336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147740.304711:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796621824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147740.304730:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147740.304986:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796622208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147740.305005:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147740.305230:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0224e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796622720:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147740.305247:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.305278:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147740.305291:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796621184 00000100:00100000:3.0:1746147740.305297:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796621184 00000100:00100000:3.0:1746147740.305324:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796621696 00000100:00100000:3.0:1746147740.305326:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796621696 00000100:00100000:3.0:1746147740.305336:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796621312 00000100:00100000:3.0:1746147740.305338:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796621312 00000100:00100000:3.0:1746147740.305347:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796621824 00000100:00100000:3.0:1746147740.305348:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796621824 00000100:00100000:3.0:1746147740.305356:0:4591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796622208 00000100:00100000:3.0:1746147740.305357:0:4591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796622208 00000100:00100000:3.0:1746147740.305369:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17521 00000100:00100000:3.0:1746147740.305374:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3303:x1830967796621184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147740.305535:0:4591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147740.305538:0:4591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb mtime from disk: 1746147739 -> 1746147739 00002000:00010000:3.0:1746147740.305540:0:4591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb atime from disk: 1746147739 -> 1746147739 00002000:00010000:3.0:1746147740.305541:0:4591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb ctime from disk: 1746147741 -> 1746147741 00002000:00010000:3.0:1746147740.305543:0:4591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x454:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746147740.305566:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3303:x1830967796621184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (1968us total) trans 21474841776 rc 0/0 00000100:00100000:3.0:1746147740.305571:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17521 00000100:00100000:3.0:1746147740.305594:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17522 00000100:00100000:3.0:1746147740.305599:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3303:x1830967796621696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147740.305676:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3303:x1830967796621696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (2024us total) trans 21474841777 rc 0/0 00000100:00100000:3.0:1746147740.305680:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17522 00000100:00100000:3.0:1746147740.305688:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17523 00000100:00100000:3.0:1746147740.305692:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3303:x1830967796621312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147740.305753:0:4591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147740.305755:0:4591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb mtime from disk: 1746147739 -> 1746147739 00002000:00010000:3.0:1746147740.305757:0:4591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb atime from disk: 1746147739 -> 1746147739 00002000:00010000:3.0:1746147740.305758:0:4591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb ctime from disk: 1746147741 -> 1746147741 00002000:00010000:3.0:1746147740.305760:0:4591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x455:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746147740.305777:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3303:x1830967796621312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (2097us total) trans 21474841778 rc 0/0 00000100:00100000:3.0:1746147740.305782:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17523 00000100:00100000:3.0:1746147740.305793:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17524 00000100:00100000:3.0:1746147740.305797:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3303:x1830967796621824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147740.305862:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3303:x1830967796621824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (1131us total) trans 21474841779 rc 0/0 00000100:00100000:3.0:1746147740.305866:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17524 00000100:00100000:3.0:1746147740.305874:0:4591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17525 00000100:00100000:3.0:1746147740.305878:0:4591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3303:x1830967796622208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147740.305967:0:4591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147740.305969:0:4591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb mtime from disk: 1746147739 -> 1746147739 00002000:00010000:3.0:1746147740.305971:0:4591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb atime from disk: 1746147739 -> 1746147739 00002000:00010000:3.0:1746147740.305972:0:4591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb ctime from disk: 1746147741 -> 1746147741 00002000:00010000:3.0:1746147740.305975:0:4591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x455:0x0] updating lvb blocks from disk: 2047 -> 2047 00000100:00100000:3.0:1746147740.305992:0:4591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3303:x1830967796622208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (986us total) trans 17179874553 rc 0/0 00000100:00100000:3.0:1746147740.305997:0:4591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17525 00000004:00080000:2.0:1746147740.306748:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ee59180/2, rc 0, transno 21474841778 00000100:00100000:2.0:1746147740.306754:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796621312:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147740.306761:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5488e00/2, rc 0, transno 21474841779 00000100:00100000:2.0:1746147740.306764:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796621824:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147740.306771:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ee5b100/2, rc 0, transno 21474841776 00000100:00100000:2.0:1746147740.306773:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796621184:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147740.306779:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a548bb80/2, rc 0, transno 21474841777 00000100:00100000:2.0:1746147740.306781:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a548bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796621696:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147740.306792:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0226d80/2, rc 0, transno 17179874553 00000100:00100000:2.0:1746147740.306800:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796622208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147740.306816:0:8469:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796622720 00000100:00100000:2.0:1746147740.306822:0:8469:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796622720 00000100:00100000:2.0:1746147740.306843:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17526 00000100:00100000:2.0:1746147740.306847:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3303:x1830967796622720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147740.306974:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3303:x1830967796622720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 126us (1726us total) trans 17179874554 rc 0/0 00000100:00100000:2.0:1746147740.306980:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17526 00000004:00080000:2.0:1746147740.307007:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0224e00/2, rc 0, transno 17179874554 00000100:00100000:2.0:1746147740.307010:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0224e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796622720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147740.307293:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1746147740.307384:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794373248 00000100:00100000:2.0:1746147740.307387:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794373248 00000100:00100000:2.0:1746147740.307409:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12207 00000100:00100000:2.0:1746147740.307414:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+321:32766:x1830967794373248:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1746147740.307427:0:14546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147740.307442:0:14546:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528000/0xe64d3fbf12a80087 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b6b410c7aafd241 expref: -99 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.307484:0:14546:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528000/0xe64d3fbf12a80087 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd241 expref: 322 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.307496:0:14546:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528000/0xe64d3fbf12a80087 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x3bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x5b6b410c7aafd241 expref: 322 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147740.307509:0:14546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3bf:0x0].0x0 (ffff880091544500) 00010000:00010000:2.0:1746147740.307512:0:14546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147740.307515:0:14546:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5528000, rc 0) 00000100:00100000:2.0:1746147740.307538:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:32766:x1830967794373248:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 124us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147740.307546:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12207 00000100:00100000:2.0:1746147740.307561:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796623232:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147740.307593:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147740.307616:0:20619:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796623232 00000100:00100000:2.0:1746147740.307619:0:20619:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796623232 00000100:00100000:2.0:1746147740.307632:0:20619:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17527 00000100:00100000:2.0:1746147740.307636:0:20619:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3303:x1830967796623232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147740.307720:0:20619:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3303:x1830967796623232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (126us total) trans 17179874555 rc 0/0 00000100:00100000:2.0:1746147740.307724:0:20619:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17527 00000004:00080000:2.0:1746147740.307742:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ef8700/2, rc 0, transno 17179874555 00000100:00100000:2.0:1746147740.307746:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796623232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.308271:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796622080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.308294:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.308310:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796622592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.308323:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.308331:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796623104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.308343:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.308353:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746147740.308357:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796622464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.308368:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.308377:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796622976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.308386:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.308403:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796621568 00000100:00100000:1.0:1746147740.308406:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796621568 00000100:00100000:1.0:1746147740.308423:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796622080 00000100:00100000:1.0:1746147740.308425:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796622080 00000100:00100000:1.0:1746147740.309284:0:10613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796622592 00000100:00100000:1.0:1746147740.309287:0:10613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796622592 00000100:00100000:3.0:1746147740.309327:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796623104 00000100:00100000:3.0:1746147740.309330:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796623104 00000100:00100000:3.0:1746147740.309344:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796622464 00000100:00100000:3.0:1746147740.309346:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796622464 00000100:00100000:3.0:1746147740.309353:0:21480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796622976 00000100:00100000:3.0:1746147740.309354:0:21480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796622976 00000100:00100000:3.0:1746147740.309364:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17528 00000100:00100000:3.0:1746147740.309369:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3302:x1830967796621568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147740.309521:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3302:x1830967796621568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 151us (4242us total) trans 21474841780 rc 0/0 00000100:00100000:3.0:1746147740.309527:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17528 00000100:00100000:3.0:1746147740.309538:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17529 00000100:00100000:3.0:1746147740.309541:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3302:x1830967796622080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147740.309628:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3302:x1830967796622080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1333us total) trans 21474841781 rc 0/0 00000100:00100000:3.0:1746147740.309633:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17529 00000100:00100000:3.0:1746147740.309641:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17530 00000100:00100000:3.0:1746147740.309645:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3302:x1830967796622592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147740.309723:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3302:x1830967796622592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (1398us total) trans 17179874556 rc 0/0 00000100:00100000:3.0:1746147740.309727:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17530 00000100:00100000:3.0:1746147740.309736:0:21480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17531 00000100:00100000:3.0:1746147740.309740:0:21480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3302:x1830967796623104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147740.310495:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17532 00000100:00100000:0.0:1746147740.310503:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3302:x1830967796622464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147740.310605:0:8469:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb size from disk: 5013696 -> 5013696 00002000:00010000:0.0:1746147740.310608:0:8469:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb mtime from disk: 1746147739 -> 1746147739 00002000:00010000:0.0:1746147740.310610:0:8469:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb atime from disk: 1746147739 -> 1746147739 00002000:00010000:0.0:1746147740.310612:0:8469:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb ctime from disk: 1746147741 -> 1746147741 00002000:00010000:0.0:1746147740.310613:0:8469:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x458:0x0] updating lvb blocks from disk: 5771 -> 5771 00000100:00100000:0.0:1746147740.310639:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3302:x1830967796622464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 138us (2270us total) trans 17179874557 rc 0/0 00000100:00100000:0.0:1746147740.310645:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17532 00000100:00100000:0.0:1746147740.310658:0:8469:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17533 00000100:00100000:0.0:1746147740.310662:0:8469:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3302:x1830967796622976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147740.310739:0:8469:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3302:x1830967796622976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (2351us total) trans 17179874558 rc 0/0 00000100:00100000:0.0:1746147740.310744:0:8469:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17533 00000100:00100000:0.0:1746147740.310796:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1746147740.310816:0:21583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967794373504 00000100:00100000:0.0:1746147740.310821:0:21583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967794373504 00000100:00100000:0.0:1746147740.310844:0:21583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5114 00000100:00100000:0.0:1746147740.310848:0:21583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+322:32766:x1830967794373504:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:3.0:1746147740.311456:0:21480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3302:x1830967796623104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1715us (3111us total) trans 17179874559 rc 0/0 00000100:00100000:3.0:1746147740.311462:0:21480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17531 00000004:00080000:3.0:1746147740.311502:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0227800/2, rc 0, transno 17179874557 00000100:00100000:3.0:1746147740.311507:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796622464:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147740.311514:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0226680/2, rc 0, transno 17179874558 00000100:00100000:3.0:1746147740.311517:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796622976:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147740.311523:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0226a00/2, rc 0, transno 17179874556 00000100:00100000:3.0:1746147740.311526:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796622592:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147740.311532:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0225c00/2, rc 0, transno 17179874559 00000100:00100000:3.0:1746147740.311534:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796623104:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147740.311542:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ee59c00/2, rc 0, transno 21474841780 00000100:00100000:3.0:1746147740.311545:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796621568:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147740.311553:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5488a80/2, rc 0, transno 21474841781 00000100:00100000:3.0:1746147740.311556:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796622080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.311646:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.311676:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796622848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.311699:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.311719:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796622336 00000100:00100000:1.0:1746147740.311722:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796622336 00000100:00100000:1.0:1746147740.311737:0:4592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796622848 00000100:00100000:1.0:1746147740.311738:0:4592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796622848 00000100:00100000:1.0:1746147740.311749:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17534 00000100:00100000:1.0:1746147740.311753:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3304:x1830967796622336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147740.311831:0:4592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147740.311833:0:4592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb mtime from disk: 1746147739 -> 1746147739 00002000:00010000:1.0:1746147740.311835:0:4592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb atime from disk: 1746147739 -> 1746147739 00002000:00010000:1.0:1746147740.311837:0:4592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb ctime from disk: 1746147741 -> 1746147741 00002000:00010000:1.0:1746147740.311839:0:4592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x457:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746147740.311861:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3304:x1830967796622336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (215us total) trans 17179874560 rc 0/0 00000100:00100000:1.0:1746147740.311867:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17534 00000100:00100000:1.0:1746147740.311876:0:4592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17535 00000100:00100000:1.0:1746147740.311879:0:4592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3304:x1830967796622848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.311961:0:4592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3304:x1830967796622848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (261us total) trans 17179874561 rc 0/0 00000100:00100000:1.0:1746147740.311966:0:4592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17535 00000004:00080000:1.0:1746147740.311984:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0224a80/2, rc 0, transno 17179874560 00000100:00100000:1.0:1746147740.311987:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796622336:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147740.311992:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0225f80/2, rc 0, transno 17179874561 00000100:00100000:1.0:1746147740.311995:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796622848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147740.312005:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.312024:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a548b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796621952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.312041:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147740.312058:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796621440 00000100:00100000:1.0:1746147740.312060:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796621440 00000100:00100000:1.0:1746147740.312072:0:7050:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796621952 00000100:00100000:1.0:1746147740.312074:0:7050:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796621952 00000100:00100000:1.0:1746147740.312082:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17536 00000100:00100000:1.0:1746147740.312086:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3301:x1830967796621440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147740.312169:0:7050:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147740.312171:0:7050:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb mtime from disk: 1746147739 -> 1746147739 00002000:00010000:1.0:1746147740.312173:0:7050:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb atime from disk: 1746147739 -> 1746147739 00002000:00010000:1.0:1746147740.312175:0:7050:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb ctime from disk: 1746147741 -> 1746147741 00002000:00010000:1.0:1746147740.312176:0:7050:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x456:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746147740.312196:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3301:x1830967796621440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (190us total) trans 21474841782 rc 0/0 00000100:00100000:1.0:1746147740.312201:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17536 00000100:00100000:1.0:1746147740.312295:0:7050:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17537 00000100:00100000:1.0:1746147740.312298:0:7050:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3301:x1830967796621952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147740.312358:0:7050:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3301:x1830967796621952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (316us total) trans 21474841783 rc 0/0 00000100:00100000:1.0:1746147740.312362:0:7050:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17537 00000004:00080000:1.0:1746147740.312377:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ee5bb80/2, rc 0, transno 21474841782 00000100:00100000:1.0:1746147740.312380:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796621440:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147740.312384:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a548b800/2, rc 0, transno 21474841783 00000100:00100000:1.0:1746147740.312387:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a548b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1830967796621952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147740.312678:0:21583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:729e0a2b-9977-4fe3-8060-6fd2b07f1e5a+323:32766:x1830967794373504:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 1827us (1882us total) trans 8589946255 rc 0/0 00000100:00100000:0.0:1746147740.312685:0:21583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5114 00010000:00010000:0.0:1746147740.819831:0:7099:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147740.969060:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a634195-95c6-4e3b-860d-2cf2df4961a5:3304:1830967796623360:0@lo:400:kworker.0 00000100:00100000:2.0:1746147740.969074:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796623744:0@lo:400:kworker.0 00000100:00100000:3.0:1746147740.969092:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1830967796623616:0@lo:400:kworker.0 00000100:00100000:2.0:1746147740.969118:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147740.969119:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147740.969124:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147740.969148:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796623744 00000100:00100000:2.0:1746147740.969153:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796623744 00000100:00100000:0.0:1746147740.969165:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796623872:0@lo:400:kworker.0 00000100:00100000:3.0:1746147740.969169:0:14542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796623360 00000100:00100000:3.0:1746147740.969172:0:14542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796623360 00000100:00100000:2.0:1746147740.969186:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1746147740.969186:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147740.969192:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3303:x1830967796623744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147740.969194:0:14542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1746147740.969199:0:14542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a634195-95c6-4e3b-860d-2cf2df4961a5+18:3304:x1830967796623360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147740.969199:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746147740.969204:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796624256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746147740.969220:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147740.969233:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3303:x1830967796623744:12345-0@lo:400:kworker.0 Request processed in 41us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147740.969234:0:14542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a634195-95c6-4e3b-860d-2cf2df4961a5+18:3304:x1830967796623360:12345-0@lo:400:kworker.0 Request processed in 35us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147740.969238:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1746147740.969243:0:14542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1746147740.969245:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3a634195-95c6-4e3b-860d-2cf2df4961a5:3304:1830967796623360:0@lo:400:kworker.0 00000100:00100000:2.0:1746147740.969249:0:8470:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796623872 00000100:00100000:2.0:1746147740.969251:0:8470:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796623872 00000100:00100000:2.0:1746147740.969264:0:8470:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1746147740.969268:0:8470:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3304:x1830967796623872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147740.969270:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796623616 00000100:00100000:0.0:1746147740.969272:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796623616 00000100:00100000:2.0:1746147740.969290:0:8470:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3304:x1830967796623872:12345-0@lo:400:kworker.0 Request processed in 22us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147740.969294:0:8470:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1746147740.969318:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1830967796623744:0@lo:400:kworker.0 00000100:00100000:1.0:1746147740.969352:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1830967796623488:0@lo:400:kworker.0 00000100:00100000:1.0:1746147740.969376:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147740.969382:0:5744:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796623488 00000100:00100000:0.0:1746147740.969385:0:5744:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796623488 00000100:00100000:1.0:1746147740.969391:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1830967796624000:0@lo:400:kworker.0 00000100:00100000:2.0:1746147740.969395:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1746147740.969401:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1830967796623616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147740.969405:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147740.969406:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1746147740.969411:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1830967796623488:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1746147740.969426:0:7107:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147740.969428:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1830967796623616:12345-0@lo:400:kworker.0 Request processed in 28us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147740.969433:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1746147740.969436:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796624000 00000100:00100000:1.0:1746147740.969438:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796624000 00000100:00100000:0.0:1746147740.969444:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1830967796623488:12345-0@lo:400:kworker.0 Request processed in 34us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147740.969450:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1746147740.969460:0:5744:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1746147740.969464:0:5744:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a21a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1830967796624000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147740.969482:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1830967796623488:0@lo:400:kworker.0 00000100:00100000:0.0:1746147740.969485:0:5744:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a21a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1830967796624000:12345-0@lo:400:kworker.0 Request processed in 21us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147740.969490:0:5744:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1746147740.969492:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1830967796624000:0@lo:400:kworker.0 00000100:00100000:0.0:1746147740.969505:0:8471:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796624256 00000100:00100000:0.0:1746147740.969508:0:8471:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796624256 00000100:00100000:3.0:1746147740.969544:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1830967796623616:0@lo:400:kworker.0 00000100:00100000:3.0:1746147740.969549:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796624128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147740.969550:0:8471:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1746147740.969555:0:8471:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3304:x1830967796624256:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746147740.969565:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147740.969582:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967796624128 00000100:00100000:2.0:1746147740.969587:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967796624128 00002000:00000024:0.0:1746147740.969592:0:8471:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 496566272 pending 17039360 free 3849322496 avail 3847225344 00000100:00100000:2.0:1746147740.969608:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1746147740.969613:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3302:x1830967796624128:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147740.969618:0:8471:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3304:x1830967796624256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147740.969623:0:8471:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00002000:00000024:2.0:1746147740.969630:0:8472:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 440467456 pending 15335424 free 3850371072 avail 3848273920 00000100:00100000:0.0:1746147740.969648:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796624256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746147740.969655:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3302:x1830967796624128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147740.969661:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1746147740.969662:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1830967796623872:0@lo:400:kworker.0 00000100:00100000:3.0:1746147740.969727:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1830967796624128:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1746147740.990120:0:7378:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed Debug log: 69552 lines, 69552 kept, 0 dropped, 0 bad.